SCAIL 2 - Turn Table Test

In previous post, we had 8 directional renders using SCAIL 2 inside 3x3 tiles.

This time, we are doing something similar with single tile.

Workflow:

Driving Video:

Reference Character:

Prompt:

sprite, pixelated, grey_background,

Result:

Discussions:

• Quality is not as good as 3x3 tile approach for some reason.

• It is much faster inference than previous approach.

Next Steps:

• Find a middle ground between previous approach and this approach.

• We can do a hybrid with a template.

  • We put 2 characters side by side in reference image and driving video.

  • The left one is an example inference, and the SCAIL 2 model is asked to only inference the right half.

  • The left one has the quality and rendering style we want.

  • The SCAIL 2 masks are only pointing to right character.

‒ Sprited Dev 🐛