- benchmark: raise SystemExit if 0 frames were measured, so a run that produces no
batches (swallowed decode error, all batches dropped) fails loudly instead of being
reported green with NaN/zero numbers (the misleading "COMPLETED" CUDA jobs).
- add benchmarks/streaming/diagnose_decode.py: isolates the streaming decode path
(resolve path -> fsspec.open -> torchcodec VideoDecoder -> get one frame) and prints
package versions + the first bytes of the handle. Pinpoints decode failures: bad/
placeholder bytes vs ffmpeg/torchcodec build issue. RoboCasa videos are AV1; the
failure message calls out AV1 decoder + NVDEC-on-Ada requirements explicitly.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Pepijn