SpriteDX

Today, we will revisit how multi-shot frame generation happens. We’ve been hitting quality issues in the animation generation and we need to stablize it.

Reference Image:

Gen 1 - Base Prompt

Prompt 1: [Scene Description] Character is a game sprite character for game called “Machi.” Her name is “Eliana.” The video has no camera movements.

[SHOT 1] npc-sprite-greet-loop.gif: Camera static full body shot and pixel art character says “hi.” [CUT]

[SHOT 2] npc-sprite-idle-loop.gif: Character stands still facing slightly right (+x) and shows sprite animation loop for “idle” state, breathing in and breathing out, on a pure white background. [CUT]

[SHOT 3] npc-sprite-run-loop.gif (in-place, +x): Camera LOCKED on the pixel art character running in positive x direction, and character starts showing sprite animation loop for “run” state on a pure white background. [CUT]

[Tags] #character-animation #角色动画 #game-sprite #游戏精灵 #platformer #平台跳跃 #machi #Machi #cute #可爱 #pixel-art #像素艺术 #1girl #少女 #subject-only #主体突出 #character-only #纯人物 #side-scroller #横版卷轴 #platformer #平台游戏 #idle-loop #待机循环 #run-cycle #跑步循环 #pure-white-background #纯白背景

Gen 1.1 - Success

Gen 1.2- Success

Gen 1.3 - Failure - Character moves across

Gen 1.4 - Failure - Character Swap

Gen 1.5 - Success

Result: 3/5 → 60% Success

Issues: Character swap, Character moves across

Gen 2 - Using “player” instead of “npc“

Tried slightly different prompt

Prompt 2: [Scene Description] Character is a game sprite character for game called “Machi.” Her name is “Eliana.” The video has no camera movements.

[SHOT 1] player-sprite-greet-loop.gif: Camera static full body shot and pixel art character says “hi.” [CUT]

[SHOT 2] player-sprite-idle-loop.gif: Character stands still facing slightly right (+x) and shows sprite animation loop for “idle” state, breathing in and breathing out, on a pure white background. [CUT]

[SHOT 3] player-sprite-run-loop.gif (in-place, +x): Camera LOCKED on the pixel art character running in positive x direction, and character starts showing sprite animation loop for “run” state on a pure white background. [CUT]

[Tags] #character-animation #角色动画 #game-sprite #游戏精灵 #platformer #平台跳跃 #machi #Machi #cute #可爱 #pixel-art #像素艺术 #1girl #少女 #subject-only #主体突出 #character-only #纯人物 #side-scroller #横版卷轴 #platformer #平台游戏 #idle-loop #待机循环 #run-cycle #跑步循环 #pure-white-background #纯白背景

Gen 2.1 - Success

Gen 2.2 - Failure - No Stable Run Loop

Gen 2.3 - Success

Gen 2.4 - Failure - No idle loop

Gen 2.5 - Failure - No clear idle loop

Result: 2/5 → 40% Success

Issues: Not too much different.

Gen 3 - 3 Second Duration

Tried doing 3s duration instead:

Prompt 3: [Scene Description] Character is a game sprite character for game called “Machi.” Her name is “Eliana.” The video has no camera movements.

[SHOT 1] player-sprite-greet-loop.gif: Camera static full body shot and pixel art character says “hi.” [CUT!]

[SHOT 2] player-sprite-idle-loop.gif: Character stands still facing slightly right (+x) and shows sprite animation loop for “idle” state, breathing in and breathing out, on a pure white background. [CUT!]

[SHOT 3] player-sprite-run-loop.gif (in-place, +x): Camera LOCKED on the pixel art character running in positive x direction, and character starts showing sprite animation loop for “run” state on a pure white background. [CUT!]

[Tags] #character-animation #角色动画 #game-sprite #游戏精灵 #platformer #平台跳跃 #machi #Machi #cute #可爱 #pixel-art #像素艺术 #1girl #少女 #subject-only #主体突出 #character-only #纯人物 #side-scroller #横版卷轴 #platformer #平台游戏 #idle-loop #待机循环 #run-cycle #跑步循环 #pure-white-background #纯白背景

Gen 3.1 - Failure - no idle loop

Gen 3.2 - Failure - no idle loop

Gen 3.3 - Failure - character direction

Gen 3.4 - Failure - idle loop too short

Gen 3.5 - Failure - Multiple issues

Result: 0/5 → 0% Success

Issues: Not enough frames to cover 3 shots.

Gen 4 - 7s Duration

Same prompt 3s → 7s

Gen 4.1 - Success

Gen 4.2 - Success

Gen 4.3 - Failure - Portrait Shot

Gen 4.4 - Success

Gen 4.5 - Failure - Multiple Issues

Result: 3/5 → 60% Success

It was more or less similar to 5s. We will fix duration to 5s from now on.

Gen 5 - Character anchor

Going back to 5s and using character name in the file names:

Prompt 5: [Scene Description] Character is a game sprite character for game called “Machi.” Her name is “Eliana.” The video has no camera movements.

[SHOT 1] eliana-sprite-greet-loop.gif: Camera static full body shot and pixel art character says “hi.” [CUT!]

[SHOT 2] eliana-sprite-idle-loop.gif: Character stands still facing slightly right (+x) and shows sprite animation loop for “idle” state, breathing in and breathing out, on a pure white background. [CUT!]

[SHOT 3] eliana-sprite-run-loop.gif (in-place, +x): Camera LOCKED on the pixel art character running in positive x direction, and character starts showing sprite animation loop for “run” state on a pure white background. [CUT!]

[Tags] #character-animation #角色动画 #game-sprite #游戏精灵 #platformer #平台跳跃 #machi #Machi #cute #可爱 #pixel-art #像素艺术 #1girl #少女 #subject-only #主体突出 #character-only #纯人物 #side-scroller #横版卷轴 #platformer #平台游戏 #idle-loop #待机循环 #run-cycle #跑步循环 #pure-white-background #纯白背景

Gen 5.1 - Success

Gen 5.2 - Success

Gen 5.3 - Success

Gen 5.4 - Failure - Slide in

Gen 5.5 - Success

Result: 4/5 → 80% Success

Issues: Sliding characters

Gen 6 - ChatGPT Suggestion 1

5s.

Prompt 6: [Scene Description] Pixel art game sprite character for the game “Machi.” Her name is Eliana. She has light brown hair in twin braids, a red scarf, and a blue dress. This identity must remain exactly consistent in all shots.

The video has no camera movements. Camera is static, full-body side view, landscape orientation, centered on the character. Background is pure white.

[SHOT 1] player-sprite-greet-loop.gif: Camera static full body shot, pixel art character says “hi.” [CUT]

[SHOT 2] player-sprite-idle-loop.gif: Same character as previous shot. Character stands still facing slightly right (+x). Shows at least two breathing idle loop cycles over the entire duration (7 seconds). In-place. No translation. [CUT]

[SHOT 3] player-sprite-run-loop.gif (in-place, +x): Same character. Camera locked on character running in-place, staying fixed in frame, positive x direction. Pure white background. Smooth looping run animation over 7 seconds. [CUT]

[Tags] #character-animation #pixel-art #1girl #platformer #idle-loop #run-cycle #pure-white-background #side-scroller #subject-only #landscape

Gen 6.1 - Failure - Running towards cam

Gen 6.2 - Success - slight fade at the end though

Gen 6.3 - Success

Gen 6.4 - Success

Gen 6.6 - Success - Weird but has 3 shots

Result: 4/5 → 80% Success

Issues: Run direction, fading, backwards runnig

Gen 7 - ChatGPT Suggestion 2

Prompt 7: [Scene Description] Pixel art game sprite character for the game “Machi.” Her name is Eliana. She has light brown twin braids, a red scarf, and a blue dress. Her appearance must remain exactly the same in all shots — same outfit, proportions, and style. The background is pure white. The camera is static, full-body, side view. No camera movement.

[SHOT 1] eliana-sprite-greet-loop.gif: Pixel art animation of Eliana saying “hi.” Full-body shot. Loop smoothly. [CUT!]

[SHOT 2] eliana-sprite-idle-loop.gif: Same character. Standing still facing the +x direction. Performing a smooth idle animation with at least two breathing cycles. The character stays fixed in place. Loop seamlessly. [CUT!]

[SHOT 3] eliana-sprite-run-loop.gif (in-place, +x): Same character. Runs in-place facing the +x direction. Feet move, body stays fixed in frame. No background movement, no camera motion. The run cycle loops smoothly. [CUT!]

[Tags] #character-animation #像素艺术 #pixel-art #game-sprite #平台跳跃 #platformer #1girl #subject-only #character-only #side-scroller #pure-white-background #idle-loop #run-cycle #in-place-run #static-camera

Gen 7.1 - Success

Gen 7.2 - Failure - Character swap

Gen 7.3 - Success

Gen 7.4 - Failure - Character Swap, Run direction wrong

Gen 7.5 - Failure - Character swap, run dir

Result: 2/5 → 40% Success

Issues: Lots of character swaps.

Gen 8 - ChatGPT Suggestion 3

Prompt 8: [Scene Description] Pixel art game sprite character for the game “Machi.” Her name is Eliana — the same character shown in the reference image. She has brown hair in a side ponytail, a blue jumper dress over a white shirt, red shoes, and a red hair tie. Her appearance must stay exactly the same across all shots. Style: pixel art, chibi proportions, pure white background, static full-body side view.

[SHOT 1] eliana-sprite-greet-loop.gif: Eliana (from the reference image) waves or says “hi.” Camera static, full-body view. Smooth looping motion. [CUT!]

[SHOT 2] eliana-sprite-idle-loop.gif: Eliana stands still facing right (+x). Shows an idle animation with gentle breathing — at least two full cycles. Character stays fixed in place, no translation or camera movement. Loop seamlessly. [CUT!]

[SHOT 3] eliana-sprite-run-loop.gif (in-place, +x): Eliana runs in-place facing right (+x). Feet move while her body stays fixed in the frame. No scrolling, zooming, or panning. Loop smoothly. [CUT!]

[Tags] #character-animation #pixel-art #game-sprite #1girl #platformer #idle-loop #run-cycle #in-place-run #side-scroller #pure-white-background #static-camera #same-character

Gen 8.1 - Success

Gen 8.2 - Failure - Comstume Swap

Gen 8.3 - Success

Gen 8.4 - Failure Character costume swap

Gen 8.5 - Success

Result: 3/5 → 60% Success

Issues: Costume swap!

Gen 9 - Using SPECIFIC Token

Prompt 9: [Scene Description] Pixel art game sprite character for the game “Machi.” Her name is ELIANI_REF. She has brown hair with a ponytail, a blue dress over a white shirt, red shoes, and a red hair tie. Her appearance must stay exactly the same across all shots. Style: pixel art, chibi proportions, pure white background, static full-body side view.

[SHOT 1] ELIANI_REF-sprite-greet-loop.gif: Eliana (from the reference image) waves or says “hi.” Camera static, full-body view. Smooth looping motion. [CUT!]

[SHOT 2] ELIANI_REF-sprite-idle-loop.gif: Eliana stands still facing right (+x). Shows an idle animation with gentle breathing — at least two full cycles. Character stays fixed in place, no translation or camera movement. Loop seamlessly. [CUT!]

[SHOT 3] ELIANI_REF-sprite-run-loop.gif (in-place, +x): Eliana runs in-place facing right (+x). Feet move while her body stays fixed in the frame. No scrolling, zooming, or panning. Loop smoothly. [CUT!]

[Tags] #character-animation #pixel-art #game-sprite #1girl #platformer #idle-loop #run-cycle #in-place-run #side-scroller #pure-white-background #static-camera #same-character #角色帧动画

Gen 9.1 - Failure - Run Direction

Gen 9.2 - Failure - Character hair swap

Gen 9.3 - Failure - Run dir

Gen 9.4 - Success

Gen 9.5 - Success

Result: 3/5 → 60% Success

Issues: Run Direction and hair swap

Gen 10 - Addressing some of the previously mentioned issues

Prompt 10: [System] You are an agent animating a 2D pixel art character for a game.

[Scene Description] Pixel art game sprite character for the game “Machi.” Her name is Eliana. She has brown hair with a ponytail, a blue dress, red shoes, and a red hair tie. Her appearance must stay exactly the same across all shots. Style: pixel art, chibi proportions, pure white background, static full-body side view.

[SHOT 1] eliana-sprite-greet-loop.gif: Eliana (from the reference image) waves or says “hi.” Camera static, full-body view. Smooth looping motion. [CUT!]

[SHOT 2] eliana-sprite-idle-loop.gif: Eliana stands still facing right (+x). Shows an idle animation with gentle breathing — at least two full cycles. Character stays fixed in place, no translation or camera movement. Loop seamlessly. [CUT!]

[SHOT 3] eliana-sprite-run-loop.gif (in-place, +x): Eliana runs in-place facing (right:1.6) (+x). Feet move while her body stays fixed in the frame. No scrolling, zooming, or panning. Loop smoothly. [CUT!]

[Tags] #character-animation #pixel-art #game-sprite #1girl #platformer #idle-loop #run-cycle #in-place-run #side-scroller #pure-white-background #static-camera #same-character #角色帧动画

Gen 10.1 - Success

Gen 10.2 - Success

Gen 10.3 - Failure - Character Swap

Gent 10.4 - Success

Gen 10.5 - Success

Gen 10.6 - Success

Gen 10.7 - Failure - Winged character swap.

Gen 10.8 0 Failure - White shirt character comes out?

Gen 10.9 - Success

Gen 10.10 - Success

Result: 7/10 → 70% Success

Issues: Character swap…

Gen 11 - Reduce character swap

Prompt 11: [System] You are an agent animating a 2D pixel art character for a game.

[Scene Description] Pixel art game sprite character for the game “Machi.” Her name is Eliana. She has brown hair with a ponytail, a blue dress, red shoes, and a red hair tie. Her appearance must stay exactly the same across all shots. Style: pixel art, chibi proportions, pure white background, static full-body side view.

[SHOT 1] eliana-sprite-greet-loop.gif: Eliana (from the reference image) waves or says “hi.” Camera static, full-body view. Smooth looping motion. [CUT!]

[SHOT 2] eliana-sprite-idle-loop.gif: Eliana stands still facing right (+x). Shows an idle animation with gentle breathing — at least two full cycles. Character stays fixed in place, no translation or camera movement. Loop seamlessly. [CUT!]

[SHOT 3] eliana-sprite-run-loop.gif (in-place, +x): Eliana (runs:1.6) in-place facing (right:1.6) (+x). Feet move while her body stays fixed in the frame. No scrolling, zooming, or panning. Loop smoothly. [CUT!]

[Tags] #character-animation #pixel-art #game-sprite #1girl #platformer #idle-loop #run-cycle #in-place-run #side-scroller #pure-white-background #static-camera #same-character #角色帧动画