SCAIL 2 - 8 Directional Chibi to Monet

Configuration:

• Model: wan2.1_14B_SCAIL_2_fp8_scaled.safetensors

• LoRA: lightx2v_I2V_14B_480p_cfg_step_distill_rank128_bf16.safetensors

• LoRA Strength: 1.0

• Prompts: "" / ""

• Steps / CFG / Shift: 8 / 1.0 / 1.0

• Sampler / Scheduler: uni_pc / simple

• Denoise:1.0

• Seed: 42

• Resolution / Frame / FPS: 768×768 / 65 / 24

• Pose strength / Start / End: 1.0 / 0.0 / 1.0

• Camera Angle: 15 degrees

• Mask: Reference (Blue character over white), Driving (Blue character over white).

Driving Video:

Reference Image:

Result:

It came out pretty nicely.

• Generation time was around 2minutes.

• Also tried with two other seed numbers and result were very similar.

• SCAIL2 is able to do motion transfers pretty well in the domain of chibi sprites like the ones you see in SpriteDX.

Demo:

https://codepen.io/jin-hyuk-cho/pen/pveNGYV

Next Steps:

• Motion: The generated animation has this surreal 3d animation feel. We can experiment with more sprite animation like motion priors. We may need to study the difference between sprite animations seedance 1 produces with the 3d based methods. We will first try using seedance to generate the motion on 8 directions then try to use them.

• Face: Currently, facial expression is not there. It would be good to see if there are any models we can use to replace facial expressions with a deterministic renderer.

• Render: Current character is fuzzy. We can try the approach on anime style line arts.

— Sprited Dev 🐛