Digital Being - Type 2 - Harness UI Mockup

Today, I iterated on the demo page mockup.

The idea is to instantiate digital being in a flat island.

At High Level:

• Body: is divided in to 5 nodes. Brain, Heart, Lung, Stomach and Muscle.

  • Each node contains Oxygen and Nutrients.

  • They get consumed and get replenished by heart beat.

• Heart: It beats. Delivers oxygen and nutrients.

• Muscle: Locomotion consumes its resources.

• Brain: Needs constant inflow of oxygen. LLM inference uses its resources. If this dies, body dies.

• Lung: Stores oxygen for short duration. Main provider for oxygen.

• Stomach: Consumes food and stores excess food.

• State Machine: Deterministic machine that updates entity’s states. It prompts LLM with tool_calls as seem fit.

• V1 Scope: Food spawns at random location and disappears.

• State machine (SM1) notices that entity is hungry.

  • SM1 prompts LLM (TM1) for action.

  • Entity approaches the food and consumes it. Light chat (interrupt) possible.

User Interface:

• User is able to span the whole map.

• The character is selected by default.

• Server owns the simulation. Client merely reflects.

• There is population limit of 10.

Update: After some thought, we decided to make this a uninhibited island. This better fits the survival story.

Few benefits here.

• We can make it so that an elliptical coconuts drop from the tree. It's orientation is random. Thus, it hits the ground and rolls in random direction.

• Falling coconut is a hazard. Agent needs to avoid being hit by it.

• The island is surrounded by the body of water making it more realistic that it is bounded space.

Q: Why are we making this with full visual instead of just kit bashing things? We could do that, but we already have bunch of assets from SpriteDX. It is faster to use those assets than to kit-bash.

What's Next? I will work on building this harness. Basically it is full screen canvas with bunch of HUDs. At the top we have the header with some controls. Left HUD displays actions. Right HUD displays physiology of the character and some graphs.

Bottom HUD will provide prompt entry. This entry field will allow us to interface with the digital being using textual prompts.

I think the key here is to just to make something that looks like the mock up above. Then, have the character simulate to death over time. The prompt box won't do anything in the beginning.

Let's build this out.

-- Sprited Dev 🐛