Skip to main content

Command Palette

Search for a command to run...

SCAIL 2 - BF16 vs. FP8

Updated
โ€ข1 min readโ€ขView as Markdown
SCAIL 2 - BF16 vs. FP8

Currently in Sprute, SCAIL 2 is the heaviest VRAM user mainly due to 768x768 canvas and the need for diffusing 81-5 frames.

Comparison:

BF16 FP8
Peak PyTorch Memory 44.85GiB 35.07GiB
Duration (s) 308s 330s

Results:

Discussions:

  • There was no reduction in time.

  • But there was around 10 GiB (22%) saving on VRAM.

  • Still not good enough to fit into RTX 5090.

โ€’ Sprited Dev ๐Ÿ›

SpriteDX

Part 1 of 50

Tracks development of sprite generator AI tool. https://spritedx.com