Skip to main content

SCAIL 2 - Turn Table Test

Updated 1 min readMarkdown
Part of seriesSpriteDX
SCAIL 2 - Turn Table Test

In previous post, we had 8 directional renders using SCAIL 2 inside 3x3 tiles.

This time, we are doing something similar with single tile.

Workflow:

Driving Video:

Reference Character:

Prompt:

sprite, pixelated, grey_background,

Result:

Discussions:

  • Quality is not as good as 3x3 tile approach for some reason.
  • It is much faster inference than previous approach.

Next Steps:

  • Find a middle ground between previous approach and this approach.
  • We can do a hybrid with a template.
    • We put 2 characters side by side in reference image and driving video.
    • The left one is an example inference, and the SCAIL 2 model is asked to only inference the right half.
    • The left one has the quality and rendering style we want.
    • The SCAIL 2 masks are only pointing to right character.

‒ Sprited Dev 🐛

No comments yet. Be the first to comment.

SpriteDX

Part 1 of 50

Tracks development of sprite generator AI tool. https://spritedx.com