e4a1b27fd3
Merge branch 'main' into feature/add-multitask-dit
2025-12-14 09:10:48 -08:00
1d07a4aefd
add auto in docs ( #2645 )
...
Signed-off-by: Jade Choghari <chogharijade@gmail.com >
2025-12-13 17:11:19 +01:00
71f359ca6e
refactor code to perform task tokenization in the processor instead of in the modeling code for multitask dit
2025-12-11 12:09:54 -08:00
51dfee43f4
rename config param for multiple vision encoders
2025-12-11 09:58:57 -08:00
1f74982469
note origins of each training objective
2025-12-11 09:55:41 -08:00
8e3a1e8945
add more descriptions and depth to multitask dit tutorial
2025-12-11 09:45:53 -08:00
43c335d0d7
reformat and clean up tutorial for multitask dit policy
2025-12-11 09:33:30 -08:00
dd4ef1383f
fix nit formatting in generate actions fcn
2025-12-11 09:21:26 -08:00
f3823e8bcd
remove the base classes since we don't need to be able to extend
2025-12-11 09:20:25 -08:00
c398a146b3
use constants for indexing into batches and remove env state references
2025-12-11 09:13:38 -08:00
9b47c5fac9
move policy to top of file
2025-12-11 09:04:38 -08:00
56dbeed89f
add processor tests to multitask dit tests
2025-12-11 09:04:23 -08:00
67b1a9eeb1
update typo in test instruction comment
2025-12-11 08:28:35 -08:00
86e0ee787d
remove environment state conditioning
2025-12-11 08:26:21 -08:00
ba968e84f1
fix bugs when testing on hardware
2025-12-10 16:26:57 -08:00
d49d3390f6
Merge branch 'main' into feature/add-multitask-dit
2025-12-10 14:44:04 -08:00
f1ac454800
add tutorial to training with multi_task_dit
2025-12-10 14:43:27 -08:00
10cfc17705
remove redundant asserts
2025-12-10 14:43:27 -08:00
5524a0d7a7
split up select action return statement
2025-12-10 14:43:27 -08:00
3a16a002f8
add torch.no_grad decorators
2025-12-10 14:43:27 -08:00
3b2a4f548c
merge all modules files into the main modeling file
2025-12-10 14:43:27 -08:00
b92dc82ddd
add references to the modeling file comments
2025-12-10 14:43:27 -08:00
103230c64c
simplify config for multitask dit by merging and flattening everything, then adding comments to denote where some parameters are only used for specific objectives
2025-12-10 14:43:27 -08:00
cdacc090cd
update docstring for multitask dit policy processor file
2025-12-10 14:43:27 -08:00
6f856016c5
adjust factory comment
2025-12-10 14:43:27 -08:00
adabb37af6
remove dino vision encoder and simplify text and vision encoders by removing inheritance structure
2025-12-10 14:43:27 -08:00
55e19ff9a7
update readme and citations for multitask dit policy
2025-12-10 14:43:27 -08:00
ce348a3460
enable variable image sizes to pi0/pi0.5 ( #2609 )
...
* enable variable image sizes to pi0/pi0.5
* add square image assertion
2025-12-10 19:41:11 +01:00
22714af08d
Merge branch 'main' into feature/add-multitask-dit
2025-12-09 20:45:59 -08:00
cb920235c4
docs: update X-VLA training strategies/commands ( #2611 )
2025-12-09 19:08:09 +01:00
46ebcc2f7d
add RoPE attention module as this is shown to help training dynamics and generation quality for DiTs
2025-12-09 08:42:56 -08:00
a0d5a088e3
Merge branch 'main' into feature/add-multitask-dit
2025-12-09 07:44:05 -08:00
7f40b3bf82
feat(dataset): add tool to convert images to video datasets ( #2560 )
...
* add video encoding tool
* style
* make it work
* more fixes
2025-12-08 18:50:21 +01:00
2e9c9fd832
Replay while loop in sample actions with for loops ( #2600 )
2025-12-08 14:47:54 +01:00
f9cb5e659c
chore(ci): skip workflows if not lerobot repository ( #2601 )
...
Co-authored-by: Alex Tyshka <atyshka15@gmail.com >
2025-12-08 12:44:36 +01:00
0217e1e3ad
Fix dataset aggreagation for multi video datasets' ( #2550 )
2025-12-05 16:09:25 +01:00
d79dd6d31f
Add a documentation page with a brief intro to hw backends ( #2385 )
2025-12-05 13:32:58 +01:00
56b43cc888
fix(scripts): missing so101 import ( #2577 )
...
* fix(scripts): missing so101 import
Co-authored-by: Skyler <skylerwiernik@gmail.com >
* fix(scripts): move urdf to cli args
* refactor(scripts): improve find_joints_limits
---------
Co-authored-by: Skyler <skylerwiernik@gmail.com >
2025-12-03 18:20:26 +01:00
77fe5a09ed
fix(docs): argument typo ( #2361 )
...
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-03 17:57:18 +01:00
89ae7813a7
Reorganize assembly instructions setup before assembly ( #2333 )
...
Motors should be set up before the arm is assembled.
Moving the entire motor setup section before the part cleaning and assembly section.
Signed-off-by: Austin King <shout@ozten.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-03 17:56:58 +01:00
e003108cf8
Fix link to lerobot-train script in documentation ( #2466 )
...
* Fix link to lerobot-train script in documentation
Signed-off-by: ./c² <cagataycali@icloud.com >
* Update link to lerobot record script
Signed-off-by: ./c² <cagataycali@icloud.com >
---------
Signed-off-by: ./c² <cagataycali@icloud.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-03 15:46:26 +01:00
5766eea377
fix(docs): remove duplicated package in install instructions ( #2573 )
2025-12-03 15:45:56 +01:00
f8a4cf225b
feat(robots): add earth rover robot support ( #2575 )
...
Co-authored-by: somthecoder <sbaner64@gmail.com >
Co-authored-by: randomSmarts <Aarshsmittal@gmail.com >
Co-authored-by: Hassoonu <halsae2@illinois.edu >
Co-authored-by: Saketh06 <saketh.kantipudi@gmail.com >
Co-authored-by: sairajshetye <sairajshetye2@gmail.com >
Co-authored-by: Khalil Meftah <kmeftah.khalil@gmail.com >
2025-12-03 15:36:22 +01:00
43b0f17eb9
feat(policies): Add X-VLA ( #2405 )
...
* first commit
* more fixes
* add franka action
* update testing script
* add changes
* update files
* logits matching
* add imagenet as a norm type
* logits matching atol1e-2
* more eval fixes
* more changes
* xvla works on libero
* remove seed
* more refactoring
* more fixes
* more changes
* more changes
* more fixes
* migrate policy revert
* major pre-commit cleanup
* renaming
* revert to self.transformer
* refactor
* new changes
* clean
* update libero
* more changes
* make it work
* more changes:
* remove imagenet dependency
* style
* more
* more refactor
* remove proprio
* add loss
* more
* more
* add freeze/unfreeze options
* add testing
* upgrade transformers version
* update testing
* add installation
* remove .sh file
* fix testing
* silent linter in xvlatest
* fix failing test
* upgrade test, fix failing
* fix testing
* more fixes to testing
* require cuda in tests
* temp check
* add xvla docs
* fix styling
* update libero doc
* remove timm dep
* add different dtype support
* remove timm skip
* remove white lines
* Enhance X-VLA finetuning documentation with optimizer details (#2537 )
Added detailed instructions for implementing a custom optimizer and modifying parameter retrieval for X-VLA finetuning.
Signed-off-by: Jinliang Zheng <54488861+2toinf@users.noreply.github.com >
* fix style
* iterate on review
* iterate on cpilot
* revert xvla dep
* free up ci
* test(xvla): remove main test (#2565 )
* Add xvla custom optim and dtype (#2567 )
* add custom optim
* add custom optim
* add auto mode
* more changes
* add identity to all
* add auto
* release
* add docs
* make image smaller docs
* smaller image in doc
* evan smaller image doc
* finalize doc
---------
Signed-off-by: Jinliang Zheng <54488861+2toinf@users.noreply.github.com >
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Jinliang Zheng <54488861+2toinf@users.noreply.github.com >
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-03 15:29:14 +01:00
b0b755471b
Revert "Earth Rover Mini Plus integration ( #2544 )" ( #2574 )
...
This reverts commit 35c5a27352
2025-12-03 14:43:07 +01:00
35c5a27352
Earth Rover Mini Plus integration ( #2544 )
...
* feat: Add EarthRover Mini Plus robot integration with Frodobots SDK
* refactor: Clean up
* refactor: Remove VirtualCamera implementation for EarthRover Mini Plus integration
* fix: Reduce timeout for camera requests
* fix: Add empty cameras dict for compatibility with recording script
* refactor: Remove record.py script for EarthRover Mini Plus use lerobot_record instead
* refactor: Update documentation for EarthRover Mini Plus integration
* refactor keyboard teleoperation
* refactor: Remove angular velocity
* docs: Add documentation for EarthRover Mini Plus integration
* Add earthrover_mini_plus robot to replay and teleoperate scripts
* refactor: Update stop key from Space to X
* refactor: Implement caching for camera frames and robot telemetry data
* refactor
* refactor: Replace string literals with constants for action and observation keys
* Add Earth Rover Mini to robots section in documentation
Co-authored-by: somthecoder sbaner64@gmail.com
Co-authored-by: randomSmarts Aarshsmittal@gmail.com
Co-authored-by: Hassoonu halsae2@illinois.edu
Co-authored-by: Saketh06 saketh.kantipudi@gmail.com
Co-authored-by: sairajshetye sairajshetye2@gmail.com
2025-12-03 14:24:57 +01:00
afb90e17e7
doc: fix wrong package name in installation doc ( #2513 )
2025-12-03 13:36:59 +01:00
9ec9ee781a
feat(policies): Allow users to register 3rd party policies - pip install lerobot_policy_mypolicy ( #2308 )
...
* feat: Register external policies
* ruff fix
* move policy util functions to policy factory
* refactor register_third_party_devices -> register_third_party_plugins
* feat: Update docs with bring your own policies
* Improve docs for new policies
* fix: Inconsistent quotation marks
* fix: Remove print statement
* fix: wrong base class name in documentation
* fix: Handle better how the models are parsed
* fix: precommit passing
* Update docs/source/bring_your_own_policies.mdx
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
Signed-off-by: Daniel San José Pro <42489409+danielsanjosepro@users.noreply.github.com >
---------
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Signed-off-by: Daniel San José Pro <42489409+danielsanjosepro@users.noreply.github.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-03 12:09:24 +01:00
0b497fc37d
Make transport module Mypy Compliant [issue#1731] ( #2433 )
...
* latest
* Delete =3.0.0
Signed-off-by: Md. Muhaimin Rahman <sezan92@gmail.com >
* Update src/lerobot/transport/utils.py
Signed-off-by: Md. Muhaimin Rahman <sezan92@gmail.com >
---------
Signed-off-by: Md. Muhaimin Rahman <sezan92@gmail.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-12-02 22:12:15 +01:00
797cd2725a
fix pi05 forward compile ( #2551 )
2025-12-02 11:01:43 +01:00
Bryson Jones