Commit Graph

1599 Commits

Author SHA1 Message Date
Caroline Pascal b42332f43d Merge branch 'main' into feat/depth-integration 2026-06-24 22:48:46 +02:00
CarolinePascal 95f2923b56 test(fix): fixing failing tests 2026-06-24 22:47:20 +02:00
CarolinePascal 24c0bf6199 fix(lossless): tuning depth encoding parameters for lossless depth storage 2026-06-24 22:41:00 +02:00
CarolinePascal 96e04e5d05 docs(cheat sheet): adding depth and video encoding to the cheat sheet 2026-06-24 22:03:13 +02:00
CarolinePascal 96c1416bc9 fix(remove ffv1): removing ffv1 as it does not support MP4 2026-06-24 22:02:51 +02:00
CarolinePascal 5a7968b835 chore(fail): removing misplaced file 2026-06-24 21:36:20 +02:00
CarolinePascal 82b8e56011 chore(fail): removing misplaced file 2026-06-24 21:35:39 +02:00
CarolinePascal 71f5fc0bf8 feat(LeSadKiwi): excluding LeKiwi from depth support (for now) 2026-06-24 21:32:24 +02:00
CarolinePascal 9032e1d893 feat(robots): adding depth support in compatible follower robots 2026-06-24 21:31:37 +02:00
CarolinePascal 5efeef3c2c chore(annotation): excluding depth from the annotation pipeline 2026-06-24 21:23:13 +02:00
CarolinePascal 2f30584799 docs(renaming): reflecting renamings in a clearer way in the docs 2026-06-24 21:14:18 +02:00
CarolinePascal 1d67a9fa7e chore(renaming): fixing missed RGBEncoderConfig renamings 2026-06-24 20:58:03 +02:00
CarolinePascal 92b973de7a refactor(read depth): factorizing depth reading methods for realsense camera and adding support for depth-only usage 2026-06-24 19:38:01 +02:00
CarolinePascal ea424a7c71 fix(streaming): adding support for dequantization in streaming_dataset.py 2026-06-24 19:11:30 +02:00
CarolinePascal 368830fe8e chore(format): format code 2026-06-24 17:57:15 +02:00
CarolinePascal 5868ca6492 fix(signle channel squeeze): fixing single channel squeezing 2026-06-24 17:54:29 +02:00
CarolinePascal 31aa0766a2 fix(compress): removing rerun compression for DepthImages 2026-06-24 17:46:43 +02:00
CarolinePascal 73d15e160b feat(lerobot-dataset-viz): adding support for depth in lerobot-dataset-viz 2026-06-24 17:45:54 +02:00
CarolinePascal 1ba225c4ca fix(PyAV container seek): fixing initial PyAV container seek to be robust againsy codec choice 2026-06-24 17:42:27 +02:00
CarolinePascal a98a38160c fix(ImageNet): excluding dpeth frames from ImageNet stats 2026-06-24 17:34:08 +02:00
CarolinePascal 5c187a06f5 fix(copy&reindex): fixing metadat reshaping for single channel frames 2026-06-24 17:33:07 +02:00
CarolinePascal d4cff6b0cc feat(leagcy metadata): adding automatic metadata update for legacy 'video.is_depth_map' feature 2026-06-24 17:32:12 +02:00
CarolinePascal 168476d866 fix(spam): replacing spamming warning but a debug log 2026-06-24 17:30:48 +02:00
Alexandre Edmond 536b9621b2 Fix pi0fast model id in docs (#3855) 2026-06-24 11:44:03 +02:00
Jiwen Cai 79d4976ae2 fix(deps): pin cmeel-urdfdom <5 and cmeel-tinyxml2 <11 in placo-dep (#3873)
placo pulls in pin (Pinocchio), whose binary wheels dlopen specific cmeel
sonames (liburdfdom_sensor.so.4.0, libtinyxml2.so.10) but declare only `>=`
floors on their cmeel packages. The 2026-05-21 major bumps (cmeel-urdfdom
6.0.0 -> .so.6, cmeel-tinyxml2 11.0.0 -> .so.11) ship newer sonames, so left
unpinned the resolver grabs them and `import placo` fails at load with
"liburdfdom_sensor.so.4.0: cannot open shared object file".

#3647 capped placo and hardened the kinematics import, but the guard only
defers the failure: constructing RobotKinematics still raises. Pin the cmeel
packages to the 4.x / 10.x ABI the placo/pin wheels are built against (there
is no cmeel-urdfdom 5.x; <5 selects 4.x). Regenerated uv.lock with uv 0.8.0
to match CI; the only resolution change is the two cmeel versions (plus a
deterministic decord platform-marker cascade from 4.0.1's wider wheel set).

Fixes #3755
2026-06-24 11:23:25 +02:00
CarolinePascal eec82264ef feat(units): adding constants for depth frames units (m and mm) 2026-06-23 18:39:44 +02:00
CarolinePascal 235356730e doc(write_u16_plane): improving docstrings for write_u16_plane 2026-06-23 18:36:30 +02:00
CarolinePascal 2b2c186ff0 chore(TODO): removing deprecated TODO 2026-06-23 18:03:14 +02:00
Khalil Meftah 6f0ba4be38 Record eval rollouts as LeRobot datasets (#3825)
* feat(eval): record eval rollouts as raw LeRobot datasets

- Record raw env observations inline during rollout(), before
preprocess_observation() transforms them. Uses LeRobotDataset.create()
with add_frame()/save_episode().

- Supports vectorized envs: each env in the batch records independently,
with save_episode() called per env on termination. Each task gets its
own dataset under output_dir/recordings/{task_group}_{task_id}/.

Enabled via --eval.recording=true; disabled by default.

* fix(eval): use FeatureType enum comparison instead of string value

* refactor(eval): per-env datasets recording, no double reset

- Extract _infer_shape_from_obs() to reduce nesting in feature conversion
- Move dataset creation into rollout() using its own env.reset() observation,
  eliminating the extra reset in run_one()
- Replace deepcopy with _shallow_copy_obs() for raw observation stashing
- Support batch_size > 1: each parallel env records to its own dataset
  (single env skips the env_0/ nesting for simplicity)
- One-time warning for env_features keys missing from observations
- Pass recording_dir + env_features through the call chain instead of
  a pre-built recording_dataset object

* refactor(eval): remove shape inference and shallow copy helpers

* feat(eval): optionally push recorded eval datasets to the Hub

* fix(eval): address review comments

- Wrap rollout loop in try/finally so finalize() runs on crash/interrupt
- Guard push_to_hub with num_episodes > 0 to avoid pushing empty datasets
- Hoist loop-invariant multi_env and base_repo_id out of creation loop
2026-06-23 14:03:57 +02:00
CarolinePascal 2167731b2c fix(RGB <-> camera): renaming camera_encoder to rgb_encoder for clarity 2026-06-23 11:28:13 +02:00
CarolinePascal 8f939767ca feat(mm as default): adding a global DEFAULT_DEPTH_UNIT variable setting mm as default depth unit 2026-06-23 11:27:22 +02:00
CarolinePascal a08c3ec4a6 feat(docstrings): adding explicit docstring for encoding parameters. Docstrigns will now show up as description in the CLI --help. 2026-06-22 23:15:43 +02:00
CarolinePascal 7675506227 test(visualization): fixing visualization tests 2026-06-22 17:17:47 +02:00
CarolinePascal 52653382fd chore(rebase): fixing rebase merge conflicts 2026-06-22 17:17:47 +02:00
CarolinePascal 95c01a6b12 fix(update video info): ditching the differentiated approahces for video info update - video info are always updated unless for preserved keys. 2026-06-22 17:17:47 +02:00
CarolinePascal 2c96703505 chore(format): format code 2026-06-22 17:17:47 +02:00
CarolinePascal 24267f99fd fix(review): add Claude review 2026-06-22 17:17:47 +02:00
CarolinePascal 66028b0d10 test(reencode): fixing reencoding monkeypatch 2026-06-22 17:17:47 +02:00
CarolinePascal 3cb3d2e0c7 fix(update video info): fixing update video info logic to match the recording and editing use cases 2026-06-22 17:17:47 +02:00
CarolinePascal 40d1ad8c30 fix(save images): fixing image saving in dataset tools 2026-06-22 17:17:47 +02:00
CarolinePascal fb4c0b6639 docs(dataset tools): updating docs 2026-06-22 17:17:47 +02:00
CarolinePascal de156dff20 docs(docstring): updating docstrings 2026-06-22 17:17:47 +02:00
CarolinePascal 303743f4fc feat(dataset tools): adding missing docstrings and features for depth fill support in dataset edition tools 2026-06-22 17:17:47 +02:00
CarolinePascal a41211bbd9 fix(rebase): rebase follow up corrections 2026-06-22 17:17:47 +02:00
CarolinePascal d21682c1a7 docs(mermaid): fixing mermaid diagram 2026-06-22 17:17:46 +02:00
CarolinePascal cb94a25e1c fix(pyav check): fixing PyAV option validation for integer codec options by normalizing
numeric values before calling `is_integer()`

Co-authored-by: Wensi (Vince) Ai <59036629+wensi-ai@users.noreply.github.com>
2026-06-22 17:17:46 +02:00
CarolinePascal b64f827537 chore(format): formatting code 2026-06-22 17:17:46 +02:00
CarolinePascal 8ef772820f test(dataset tools): adding missing tests for new dataset edition tools features 2026-06-22 17:17:46 +02:00
CarolinePascal 5506d32d38 test(fix): fixing depth tests 2026-06-22 17:17:46 +02:00
CarolinePascal 15e930e6a3 docs(depth): improving depth maps docs 2026-06-22 17:17:46 +02:00