Pepijn f8f7fa0279 feat(streaming): expose video_fetch_workers in the dataloading benchmark ...

One-flag A/B for the fetch-concurrency fix on the cluster benchmark.

Component-level A/B against the Hub (old EpisodeByteCache @7b6f4f2b1 vs
new, decoder stubbed, 16 episodes x 3 cameras x 6 MB slices of a 518 MB
file, both run orders to bound CDN warmth):

  OLD (4 workers, sequential cams):  22.2 / 24.3 MiB/s
  NEW (16 workers, parallel cams):   47.3 / 45.1 MiB/s   (~2.0x)

on a residential link; the cluster needed 1.44x (465 -> 670 MiB/s
aggregate) to hit its 1000 samples/s target.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-07-03 08:59:30 +02:00

..

benchmark_dataloading.py

feat(streaming): expose video_fetch_workers in the dataloading benchmark

2026-07-03 08:59:30 +02:00