527ae8e557
Add variable-size test datasets ( #1610 )
...
* fix: dummy datasets can be written to multiple files in multiple folders based on arbitrary data size
* fix: writing atomic episodes to multiple files (maybe)
* fix: moving unused write dataset function to test code
2025-07-30 11:26:28 +02:00
890b1e473d
Merge branch 'main' into user/michel-aractingi/2025_06_30_dataset_v3
2025-07-30 00:43:53 +02:00
664e069c3f
docs/style: updating docs and deprecated links ( #1584 )
2025-07-28 12:55:47 +02:00
989f3d05ba
[Async Inference] Merge Protos & refactoring ( #1480 )
...
* Merge together proto files and refactor Async inference
* Fixup for Async inference
* Drop not reuqired changes
* Fix tests
* Drop old async files
* Drop chunk_size param
* Fix versions
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix wrong fix
Co-authored-by: Ben Zhang <ben.zhang@uwaterloo.ca >
* Fixup
---------
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
Co-authored-by: Ben Zhang <ben.zhang@uwaterloo.ca >
Co-authored-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
2025-07-23 11:30:01 +02:00
218ebed3ef
feat(convert_dataset_v21_to_v3) added the use of more efficient Dataset.from_parquet and concatenate_datasets
2025-07-22 17:27:41 +02:00
f5d6b5b3a7
test(cameras): skip depth test in rs camera for latest version ( #1574 )
...
* test(cameras): increase timeout in depth read for testing
* test(cameras): skip test_depth in realsense
---------
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
2025-07-22 15:14:01 +02:00
5ec70f704e
removed check_timestamps_sync that is no longer used in the code,
...
removed tests in datasets related to check_timestamps_sync
added the use of `clear_episode_buffer` that was not used in `save_episode`
added the creation of the codebase_version tag that was missing in `slurm_upload`
2025-07-18 16:33:20 +02:00
e05d22cb7b
Merge branch 'main' into user/michel-aractingi/2025_06_30_dataset_v3
...
Signed-off-by: Michel Aractingi <michel.aractingi@huggingface.co >
2025-07-18 16:33:18 +02:00
7e9f955b40
fix(hil-serl): drain queue on get_last_item_from_queue ( #1524 )
...
* fix(hil-serl): drain queue on get_last_item_from_queue
* parametrize queue tests
* revert changes for Darwin
* revert parametrize queue tests
* add test_get_last_item_multiple_items_with_torch_queue
* update test_get_last_item_multiple_items_with_torch_queue
* update test_get_last_item_multiple_items_with_torch_queue
2025-07-17 17:01:48 +02:00
378e1f0338
Update pre-commit-config.yaml + pyproject.toml + ceil rerun & transformer dependencies version ( #1520 )
...
* chore: update .gitignore
* chore: update pre-commit
* chore(deps): update pyproject
* fix(ci): multiple fixes
* chore: pre-commit apply
* chore: address review comments
* Update pyproject.toml
Co-authored-by: Ben Zhang <5977478+ben-z@users.noreply.github.com >
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
* chore(deps): add todo
---------
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Ben Zhang <5977478+ben-z@users.noreply.github.com >
2025-07-17 14:30:20 +02:00
dfb1571bcf
Added missing licenses ( #1517 )
...
* Added missing liscenses
2025-07-16 11:31:25 +02:00
724874e063
Fix tests ( #1510 )
2025-07-15 11:27:01 +02:00
30c161006d
Add Async Inference ( #1196 )
...
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
2025-07-10 10:39:11 +02:00
4e01f87a6e
add: tests forcing new file creation
2025-07-08 13:38:01 +02:00
9287c36f37
- Added missing license in the new scripts
...
- Added back legacy functions in conversion script of v2 to v21
- Updated README description for dataset_v3
2025-07-06 22:29:05 +02:00
bee74c3eab
Fix(tests) fix task index error in test_policies
2025-07-06 10:03:19 +02:00
83bf24cc9a
fix(tests) add features argument to load_nested_dataset
2025-07-05 10:16:29 +02:00
3dbc3e60fb
Added docstrings to aggregate, fix test_policies.py
2025-07-04 11:27:00 +02:00
69b1f7b118
nit precommit
2025-07-02 18:20:01 +02:00
66454a0fbf
Remove more references to lerobot.common
2025-07-02 18:18:19 +02:00
1c17419224
Reverted back files that were changed during the rebase
2025-07-02 17:26:34 +02:00
9dde8829e6
style nit
2025-07-02 17:10:56 +02:00
0f66bbe2f9
Migrate PR to new folder structure introduce on 1417
2025-07-02 17:10:26 +02:00
6de5670912
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-07-02 11:52:34 +02:00
5e39b4ce94
fix(tests)
...
- Updated `lerobot_dataset.py:add_frame` to take task as key in frame
- Updated `lerobot_dataset.py` to remove robot argument from `create` function of lerobotdataset and lerobotdatasetmetadata and directly take the features
- Update `test_datasets.py` to features from Mock robot
- Update all the usage of `add_frame` in the library
- Update `dataset_factories.py`; had issues with new argument order
- Raise ValueError when no task is provided (in `datasets/utils.py` validate func)
2025-07-02 11:51:56 +02:00
6b482a93d6
fix(rebase) deleting media related to tutorials
2025-07-02 11:47:09 +02:00
d9b9cc80da
fix(rebase) reverting files to main
2025-07-02 11:47:07 +02:00
01d0b7b102
fix: modularize tests to improve readability
2025-07-02 11:45:29 +02:00
848a494ff6
add: tests for aggregation code
2025-07-02 11:45:29 +02:00
d4fbf6ef39
add: support for videos generation in datasets
2025-07-02 11:45:11 +02:00
58795d72c8
In tests: Add use_videos=False by default, Create mp4 file if True, then fix test_datasets and test_aggregate (all passing)
2025-07-02 11:44:21 +02:00
ad1ad11eac
fix hf_dataset.set_transform(hf_transform_to_torch)
2025-07-02 11:43:33 +02:00
01bc89b6f4
Merge remote-tracking branch 'origin/user/rcadene/2025_04_11_dataset_v3' into user/rcadene/2025_04_11_dataset_v3
2025-07-02 11:43:24 +02:00
8c43b3d05e
Faster self.meta.episodes[...]
...
switch back to set_transform instead of set_format
Add video_files_size_in_mb
pre-commit run --all-files
2025-07-02 11:43:22 +02:00
d4af22418b
Fix unit tests
2025-07-02 11:42:52 +02:00
0a390de361
Merge remote-tracking branch 'origin/main' into user/rcadene/2025_04_11_dataset_v3
2025-07-02 11:41:53 +02:00
d4ee470b00
Package folder structure ( #1417 )
...
* Move files
* Replace imports & paths
* Update relative paths
* Update doc symlinks
* Update instructions paths
* Fix imports
* Update grpc files
* Update more instructions
* Downgrade grpc-tools
* Update manifest
* Update more paths
* Update config paths
* Update CI paths
* Update bandit exclusions
* Remove walkthrough section
2025-07-01 16:34:46 +02:00
0b2285d1ec
Feat: Improve hub integration ( #1382 )
...
* feat(policies): Initial setup to push policies to hub with tags and model card
* feat: add dataset that is used to train
* Add model template summary
* fix: Update link model_card template
* fix: remove print
* fix: change import name
* fix: add model summary in template
* fix: minor text
* fix: comments Lucain
* fix: feedback steven
* fix: restructure push to hub
* fix: remove unneeded changes
* fix: import
* fix: import 2
* Add MANIFEST.in
* fix: feedback pr
* Fix tests
* tests: Add smolvla end-to-end test
* Fix: smolvla test
* fix test name
* fix policy tests
* Add push to hub false policy tests
* Do push to hub cleaner
* fix(ci): add push_to_hub false in tests
---------
Co-authored-by: Steven Palma <steven.palma@huggingface.co >
2025-06-26 14:36:16 +02:00
d8079587a2
Port HIL SERL ( #644 )
...
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
Co-authored-by: Eugene Mironov <helper2424@gmail.com >
Co-authored-by: s1lent4gnt <kmeftah.khalil@gmail.com >
Co-authored-by: Ke Wang <superwk1017@gmail.com >
Co-authored-by: Yoel Chornton <yoel.chornton@gmail.com >
Co-authored-by: imstevenpmwork <steven.palma@huggingface.co >
Co-authored-by: Simon Alibert <simon.alibert@huggingface.co >
2025-06-13 13:15:47 +02:00
9e6f49f507
Fix test_teleoperate ( #1216 )
2025-06-06 09:38:37 +02:00
e23b41e79a
Hardware API redesign ( #777 )
...
Co-authored-by: Pepijn <138571049+pkooij@users.noreply.github.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Steven Palma <steven.palma@huggingface.co >
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
Co-authored-by: Pepijn <pepijn@huggingface.co >
2025-06-05 17:48:43 +02:00
bfd26eef5a
Add SmolVLA ( #1175 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: fracapuano <francesco.capuano@huggingface.co >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Dana Aubakirova <118912928+danaaubakirova@users.noreply.github.com >
Co-authored-by: Remi <remi.cadene@huggingface.co >
2025-06-03 17:11:50 +02:00
0cf864870c
[Fix] Unpin torch beyond 2.6.0 & torchcodec beyond 0.2.1 ( #1127 )
2025-05-28 16:54:20 +02:00
4acf99f622
pre-commit run --all-files
2025-04-21 09:34:19 +02:00
5a6ea09248
Rename tests/test_aggregate_datasets.py -> tests/datasets/test_aggregate.py
2025-04-19 19:30:28 +05:30
b0cca75e5e
Progress on aggregate_datasets
2025-04-19 19:11:53 +05:30
eab5543750
Merge (No verify)
2025-04-17 04:46:09 +02:00
6b6a990f4c
most unit tests passing (TODO: convert datasets)
2025-04-16 21:30:58 +02:00
c2a05a1fde
Fix (Now loading all frames is possible)
2025-04-14 14:47:18 +00:00
34c5d4ce07
Most unit tests are passing
2025-04-11 14:04:22 +02:00
Francesco Capuano