
In previous post, we had 8 directional renders using SCAIL 2 inside 3x3 tiles.
This time, we are doing something similar with single tile.
Workflow:
Driving Video:
Reference Character:
Prompt:
sprite, pixelated, grey_background,
Result:
Discussions:
- Quality is not as good as 3x3 tile approach for some reason.
- It is much faster inference than previous approach.
Next Steps:
- Find a middle ground between previous approach and this approach.
- We can do a hybrid with a template.
- We put 2 characters side by side in reference image and driving video.
- The left one is an example inference, and the SCAIL 2 model is asked to only inference the right half.
- The left one has the quality and rendering style we want.
- The SCAIL 2 masks are only pointing to right character.
‒ Sprited Dev 🐛
Comments
Join the discussionNo comments yet. Be the first to comment.



