The 8 GB Lab Book · Chapter 30

The budget I would defend in a room

Board
Jetson Orin Nano Super
Mode
15W
Summary
Day 25's residents took 5,178 of 7,620 usable MiB and left 2,442. Day 27's stacked run showed that wedge is not room for a VLA: SmolVLA beside the brain stopped at 326 MiB available, and at 422 and 363 in two reruns on 2026-10-04. Three holes stay unmeasured: the real inner loop, a real camera, and the power mode.

What I expected

On Chapter 1 I wrote 8,000 MB as the budget. I had not yet measured the 1,498 MB floor. I expected the brain to be the large slice and all other slices to be small. I expected the last page to show a pie with a comfortable wedge left.

Thirty days ago, I also expected that the hard part would be to make models fast. The hard part was to make the numbers mine: measured, with the power mode recorded and the source written next to each number.

The theory

The budget as arithmetic, and the one line of physics under all of it

The pie in percent (arithmetic on Day 25, MiB)

floor  1,498 / 7,620 = 19.7%
SLM    2,639 / 7,620 = 34.6%
STT + eyes  1,032 / 7,620 = 13.5%
left   2,442 / 7,620 = 32.0%
= 8,192 - 7,620 = 572 MiB reserved before Linux counts it

The physics, one line (fp32 spec arithmetic, checked against Day 4)

ridge = 1.25 TFLOP/s (fp32 spec) / 68 GB/s = 18 flop/byte
Q4 decode: 2 flop per 0.56 byte = 3.6
under the ridge: a token is a bandwidth read
1.2 B params x 0.56 byte = 0.67 GB
0.67 GB / 28 GB/s = 24 ms = 42 tok/s
= Day 4 measured 34.36: the gap, my guess, is launches

Unit check on the KV term: 144 KB per token (Chapter 3) x 4,096 tokens = 576 , which is 604 MB. This term is a part of the 2,639 MiB slice. The rest of that slice is weights and a CUDA context. Unit check on the pie: prints MB but counts MiB, and the 8 GB chip is 8,192 MiB, so 572 MiB is reserved before Linux counts it. Each tegrastats and MemAvailable figure in Days 21 to 30 is MiB and is labeled MiB from this correction on. Chapter 1's first note said 380 MB, which was 8,000 - 7,620 across two units.

The budget, three numbers (measured, 15W, MiB)

usable
7,620 MiB
resident
5,178 MiB
left
2,442 MiB
2,442: the wedge the camera pool, the gait process and the margin have to share. 32% of the board, and the only slice on the page that no measured resident has paid for yet. Chapter 27 tried to put SmolVLA in it, and the board stopped at 326 MiB available.

The setup

Rebuild the pie from the series (build_day30.py, beside the tools/ folder of the day scripts)
python3 build_day30.py
# reads every dayNN/measured.json; the pie is Day 25's residents

The measurement

WhatExpectedMeasuredNote
OS + desktop (floor)-1,498 MiBDay 25
house SLM, Q4, 4k-2,639 MiBDay 25
STT server-456 MiBDay 25
vision engine-576 MiBDay 25
left for camera + gait + margin-2,442 MiB7,620 - all resident; Day 27: SmolVLA did not fit in it, nor in two reruns on 2026-10-04
usable8,0007,620 MiBDay 1
Measured on the board unless the row says estimate or predicted. RAM is tegrastats, MiB.
The budget: what is resident on the board with the house model, STT and eyes up, and what is left (Day 25, 15W)
Fig 30.1The budget: what is resident on the board with the house model, STT and eyes up, and what is left (Day 25, 15W).

Five bars, every one a tegrastats delta

floor
1,498 MiB, desktop inside it
SLM
2,639 MiB
STT
456 MiB
eyes
576 MiB
left
2,442 MiB, unpaid; SmolVLA did not fit in it (Day 27)
Chapter 25, 15W, desktop up. No bar on this page comes from a spec sheet, a paper or a Chapter 1 guess. tegrastats counts MiB.
slice or holeMiBfromwhat would measure it
OS + desktop floor1,498Day 25a headless boot: the desktop's share
house SLM, Q4, 4k2,639Day 25512 vs 4k context: the KV term alone
STT server + eyes456 + 576Day 25-
left2,442arith.camera pool, then gait: a delta each
SmolVLA beside the brainstopped at 326 available; 422 and 363 in two reruns, 2026-10-04Day 27the headless boot, then the same four again
usable7,620Day 1prior was 8,000
hole 1: real inner loopnot measured yetsim onlythe loop on real motors, p99 of its period
hole 2: real cameranot measured yetsyntheticthe C920 on the bus: memory type, p99
hole 3: power modenot measured yet15W, recorded, not pinnedMAXN + locked clocks: re-run Day 4's 612 MHz cap
Measured slices and the holes, with the instrument that would fill each. Three holes, three instruments, none of them a model.

The page has one pie of measured slices. It has three holes, and each hole names its instrument. It has one rule.

Where it broke

The wedge is not comfortable, and Chapter 27 showed it is not room for a . SmolVLA is 1,602 to 1,744 MiB as a process. Beside the brain, the load took MemAvailable to 326 MiB and the guard stopped it. The budget does not close with all four resident and the desktop up. It closes as a choice: the SLM with a VLA, 6,853 of 7,620 MiB with 767 left, or the SLM with ears and eyes, 5,191 with 2,429 left in the stacked run (Chapter 25's own read of the same three was 5,178 and 2,442). In both cases Chapter 25's voice wants STT and TTS to take turns. Two reruns on 2026-10-04 stopped at 422 and 363.

The three holes are not small either. The loop that owns torque exists only in sim. Each camera number came from a synthetic source. The power mode, the clocks and the headless boot are each one command away. The walk-day date depends on two of the three. More inference work does not move them.

The first wrong number was 8,000. I wrote it before I measured anything. After that, I measured each slice before I put it in the budget.

Thirty days of runs measured inference and no walking. This pie is the brain half of the robot. The other half has no page yet.

Summary

  • Three holes stay unmeasured after thirty days, each with its instrument named:
  • the high-rate on real hardware: it runs at 1 kHz in sim (Chapter 29), not yet on real motors.
  • the camera: each camera number in this series comes from a synthetic source (Days 6, 16, 20). The C920 changes the memory type and the p99
  • the power mode: the harness recorded 15W and did not set it. No logged day shows MAXN or jetson_clocks. The headless boot, the systemd install and Nsight counters are each one command from a measurement.

Sources

These sources are not mine. Measured numbers came off my own board; specs, estimates and paper figures are labeled as such.

  • The previous 29 pages
  • Orin Nano 8GB Super datasheet
  • Orin Nano 2 announcement as future hardware, not today's
  • day27/rerun-2026-10-04/summary.json: the Day 25/27 stacked pile twice more on 2026-10-04