Pepijn Kooijmans 9dfc9084e1 review: decode keyframes via video_utils.decode_video_frames ...

Addresses three of CarolinePascal's frames.py comments (the fourth, the
subprocess re-encode, waits on #3611):

- replace the bespoke _decode_pyav_direct PyAV decoder with
  lerobot.datasets.video_utils.decode_video_frames (torchcodec backend,
  PyAV fallback) — torchvision's VideoReader removal no longer applies
- frames flow through the provider as torch.Tensor (C, H, W uint8); PIL
  is materialised only at the VLM-message boundary in to_image_blocks /
  to_video_block, where the chat backends need it
- _decode now returns exactly one frame per timestamp (or [] on failure),
  so frames_at pairs them with strict=True

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-18 14:00:38 +02:00

..

annotations

review: decode keyframes via video_utils.decode_video_frames

2026-05-18 14:00:38 +02:00

artifacts

feat(policy): use pretrained vision encoder weights by default for diffusion and vqbet (#3202)

2026-05-07 12:10:38 +02:00

async_inference

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

cameras

test(cameras): skip flaky async_read test (#3106)

2026-03-08 14:02:33 +01:00

configs

review: emitted_at uses 0.1s tolerance; MessageTurn requires stream at construction

2026-05-06 19:55:08 +02:00

datasets

review: emitted_at uses 0.1s tolerance; MessageTurn requires stream at construction

2026-05-06 19:55:08 +02:00

envs

feat(envs): add RoboTwin 2.0 benchmark (#3315)

2026-04-20 17:46:39 +02:00

fixtures

review: address CarolinePascal feedback

2026-05-18 12:03:25 +02:00

mocks

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

motors

fix(feetech): motor position readings overflow (#3373)

2026-04-13 22:39:58 +02:00

optim

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

policies

feat(policies): add EO-1 model (#3403)

2026-05-06 18:01:16 +02:00

processor

fix(language): keep base install green — drop processor re-export, gate dataset-extra tests

2026-05-06 14:12:54 +02:00

rewards

fix(train): migrate legacy RA-BC fields in train config loading (#3480)

2026-04-29 16:17:00 +02:00

rl

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

robots

feat(robots): Unitree G1 WBC implementation (#2876)

2026-03-08 11:33:24 +01:00

scripts

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

teleoperators

refactor(imports): enforce guard pattern (#3382)

2026-04-14 22:54:05 +02:00

training

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

transport

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

utils

fix(language): address review — tools accessor, motion docs, conditional collate

2026-05-06 14:51:06 +02:00

__init__.py

chore(doc): add license header to all files (#818)

2025-03-05 17:56:51 +01:00

conftest.py

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

test_available.py

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

test_cli_peft.py

feat(rollout): decouple policy deployment from data recording with new lerobot-rollout CLI (#3413)

2026-04-28 00:57:35 +02:00

test_control_robot.py

feat(rollout): decouple policy deployment from data recording with new lerobot-rollout CLI (#3413)

2026-04-28 00:57:35 +02:00

test_robomme_env.py

feat(envs): add RoboMME benchmark (#3311)

2026-04-20 20:21:27 +02:00

test_rollout.py

feat(rollout): decouple policy deployment from data recording with new lerobot-rollout CLI (#3413)

2026-04-28 00:57:35 +02:00

utils.py

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00