# Plan of Record — Dancing Stick Figures

![](https://cdn.hashnode.com/uploads/covers/682665f051e3d254b7cd5062/611e8c6f-7f6c-49ed-8bbf-c0e2e8cd15b5.png align="center")

**Figure 1 - Chibi Designs (Sprite DX, q-version, 3D wireframe, game, ragnarok online, prototype rendering)**

After *Dancing Stick Figures*, we are experimenting with the idea of building a flat shaded chibi figure with articulated face.

The basic idea is that:

1.  Create a very basic flat shaded chibi figure rig.
    
2.  Live animate the body using Nvidia ARDY or Nvidia MotionBricks.
    
3.  Use Nvidia Audio2Face to animate the facial movements.
    
4.  Use Qwen3-TTS(sohee) for character voice acting.
    
5.  Create a demo website which shows a prototype of this.
    
6.  Make it into a dataset, and train a streaming model out of it.
    

## The basic idea

```plaintext
           procedurally 
       generated character 
                + 
          real-time generated 
    voice, expressions, movements
                ↓
             DATASET 
                &
             Pipeline
                ↓
      Trained Streamer model
        (long term vision)
```

## An alternative

Alternative to this idea is to use SOTA video generation models to generate bunch of live action videos of characters, then use those to learn streamer model directly bypassing all procedural generation efforts.

## Constraints

*   128x128 Output Space
    
*   Start with limited motions.
    

## What are we going to do

We are actually performing both experiments in parallel.

```plaintext
Track A (Cladia): Procedural Char + ARDY + Audio2Face

Track B (Pixel): Train a model that replicates SpriteDX character animations
```

Track A is a good middle ground because there exists lots of prior art in VRoid VRChat community. The facial action also directly ties with the ARKit approach in Audio2Face.

Track B is more of a test of what kinda of model would be trainable within the kind of compute and dataset budget we have. Also this is to uncover any issues in training such model in back burner.

\-- Sprited Dev