From 2d1c17d9712930c32f0c7a94736b9cba64615970 Mon Sep 17 00:00:00 2001 From: Pepijn Date: Tue, 9 Jun 2026 17:10:18 +0200 Subject: [PATCH] docs(streaming): note AV1 is LeRobot's default codec (vcodec=libsvtav1) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit So the A100/H100 no-AV1-NVDEC limitation applies to most LeRobot v3 datasets, not just RoboCasa — GPU decode needs an Ada GPU, an hevc/h264-encoded dataset, or a re-encode. Co-Authored-By: Claude Opus 4.8 (1M context) --- benchmarks/streaming/README.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/benchmarks/streaming/README.md b/benchmarks/streaming/README.md index 82d6dd4c1..18677fcda 100644 --- a/benchmarks/streaming/README.md +++ b/benchmarks/streaming/README.md @@ -55,8 +55,9 @@ limited number of concurrent decode sessions per GPU; if you hit session/IPC lim or compare against `--num_workers 0` (single-process NVDEC, which often saturates the decode engine on its own). Result files include the decode device in their name (`..._w6_cuda.json`). -> **Codec ⇄ NVDEC compatibility (important).** NVDEC can only decode codecs its hardware supports. LeRobot -> v3 datasets are often **AV1**-encoded, and the **A100 and H100 compute GPUs have no AV1 NVDEC decoder** +> **Codec ⇄ NVDEC compatibility (important).** NVDEC can only decode codecs its hardware supports. LeRobot's +> **default video codec is AV1** (`VideoEncoderConfig.vcodec = "libsvtav1"`), so most v3 datasets are +> AV1-encoded — and the **A100 and H100 compute GPUs have no AV1 NVDEC decoder** > (per NVIDIA's [decode support matrix](https://developer.nvidia.com/video-encode-and-decode-gpu-support-matrix-new)); > only Ada (L4/L40/RTX40) and a few Ampere cards (A10/A40/A16) do. On A100/H100, AV1 must be decoded on > **CPU**, or the dataset re-encoded to H.265/H.264 (which those GPUs' NVDEC do support). Run