pepijn 3ec60da82b feat(streaming): add cluster dataloading benchmark example ...

Single-file SLURM-oriented benchmark comparing the map-style and native
streaming loaders on single-image samples: a self-submitting serial chain
that measures peak RSS, samples/s (and decoded frames/s), fetch-vs-decode
split, shuffle randomness, and p50/p95/p99 sample latency over a fixed
wall-clock window, including a 2-node split_dataset_by_node leg.

Co-authored-by: Cursor <cursoragent@cursor.com>

2026-06-12 14:23:15 +00:00

..

benchmark_dataloading.py

feat(streaming): add cluster dataloading benchmark example

2026-06-12 14:23:15 +00:00