PyTorch eager
BF16
99%198/200
- Backend
- PyTorch eager
- Precision
- BF16
- Tasks
- 10
- Episodes
- 200
- Flow steps
- 4
VLA · Verne Robotics · measured on AGX Thor
Benchmark results for the model from vernerobotics/v0.5-libero.
Compare with other models on AGX Thor →
PyTorch eager → ZETIC optimized · AGX Thor
AGX Thor · per policy call
| Metric | ReferencePyTorch eager · BF16 · 4 flow steps | ZETIC optimizedMixed precision · 2 flow steps |
|---|---|---|
| Policy latency · p50 | 259.39 ms | 53.92 ms |
| Energy per inference | 22.14 J | 5.9 J |
| Peak memory | 44.02 GB | 32.04 GB |
Different inference configurations.
View optimized build results →
Peak board memory above idle (MemTotal − MemAvailable), over the full command including model loading; not process RSS.
p50. v0.5-libero · libero · AGX Thor
Speedup is reference latency divided by path latency on this board. Lowest recorded latency excludes marked model or inference-schedule variants. Check the configurations below before treating paths as a matched comparison.
PyTorch eager · Model authors · BF16
PyTorch eager · BF16 · 4 flow steps · batch 1
Peak board memory above idle (MemTotal − MemAvailable), over the full command including model loading; not process RSS.
ZETIC · ZETIC · Mixed precision
ZETIC · Mixed precision · 2 flow steps · batch 1 · Different configuration
Additional validation pending. Peak board memory above idle (MemTotal − MemAvailable), over the full command including model loading; not process RSS.
PyTorch eager: End-to-end latency, p50 (median of round medians), 4 rounds · 232 samples per round.
ZETIC: End-to-end latency, p50 (median of round medians), 4 rounds · 1,076 samples per round.
Source: reviewed benchmark measurements. Public measurement: record-572e80f79750962162d0c6af18974e62396c80819087d46bc4bfb2ef1912ac38.
Measurement methodology ↗v0.5-libero · LIBERO Goal
AGX Thor · Same episodes for both paths
PyTorch eager
BF16
99%198/200
ZETIC optimized
MIXED PRECISION
99%198/200
Observed difference: 0 pp
| Path / seed | Task / task | Result | Failed episodes |
|---|---|---|---|
| PyTorch eagerSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 5 · Task 5 | 19/20OOOOOOOOOOOOOOOOOOOx | 19 |
| PyTorch eagerSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 9 · Task 9 | 19/20OOOOxOOOOOOOOOOOOOOO | 4 |
| ZETIC optimizedSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 5 · Task 5 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 9 · Task 9 | 18/20OOOOxOOOOOOOOOOOxOOO | 4, 16 |
O = success · x = failure.
v0.5-libero · LIBERO Spatial
AGX Thor · Same episodes for both paths
PyTorch eager
BF16
98.5%197/200
ZETIC optimized
MIXED PRECISION
98.5%197/200
Observed difference: 0 pp
| Path / seed | Task / task | Result | Failed episodes |
|---|---|---|---|
| PyTorch eagerSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 1 · Task 1 | 18/20OOOOxOOOOOOOOOxOOOOO | 4, 14 |
| PyTorch eagerSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 4 · Task 4 | 19/20OOOOOOOOOOOOOOOOOOxO | 18 |
| PyTorch eagerSeed 7 | 5 · Task 5 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 9 · Task 9 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 1 · Task 1 | 18/20OOOOxOOOOOOOOOxOOOOO | 4, 14 |
| ZETIC optimizedSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 4 · Task 4 | 19/20OOOOOxOOOOOOOOOOOOOO | 5 |
| ZETIC optimizedSeed 7 | 5 · Task 5 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 9 · Task 9 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
O = success · x = failure.
v0.5-libero · LIBERO Object
AGX Thor · Same episodes for both paths
PyTorch eager
BF16
99.5%199/200
ZETIC optimized
MIXED PRECISION
99.5%199/200
Observed difference: 0 pp
| Path / seed | Task / task | Result | Failed episodes |
|---|---|---|---|
| PyTorch eagerSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 5 · Task 5 | 19/20OxOOOOOOOOOOOOOOOOOO | 1 |
| PyTorch eagerSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 9 · Task 9 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 3 · Task 3 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 5 · Task 5 | 19/20OOOOOOxOOOOOOOOOOOOO | 6 |
| ZETIC optimizedSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 9 · Task 9 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
O = success · x = failure.
v0.5-libero · LIBERO 10
AGX Thor · Same episodes for both paths
PyTorch eager
BF16
98.5%197/200
ZETIC optimized
MIXED PRECISION
99%198/200
Observed difference: +0.5 pp
| Path / seed | Task / task | Result | Failed episodes |
|---|---|---|---|
| PyTorch eagerSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 3 · Task 3 | 19/20OOOxOOOOOOOOOOOOOOOO | 3 |
| PyTorch eagerSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 5 · Task 5 | 19/20OOOOOOOOOOOOOOxOOOOO | 14 |
| PyTorch eagerSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| PyTorch eagerSeed 7 | 9 · Task 9 | 19/20OOOOOOOOOOOOOOOOOOOx | 19 |
| ZETIC optimizedSeed 7 | 0 · Task 0 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 1 · Task 1 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 2 · Task 2 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 3 · Task 3 | 18/20OOOOOOOOOOOOOxOOOOOx | 13, 19 |
| ZETIC optimizedSeed 7 | 4 · Task 4 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 5 · Task 5 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 6 · Task 6 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 7 · Task 7 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 8 · Task 8 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
| ZETIC optimizedSeed 7 | 9 · Task 9 | 20/20OOOOOOOOOOOOOOOOOOOO | None |
O = success · x = failure.
Build with ZETIC
Share your v0.5-libero checkpoint for AGX Thor, with goals for lower latency, energy per inference and memory use.