add support for libero2lerobot (#42)

* add libero2lerobot readme

* use datatrove for libero2lerobot

* update libero2lerobot readme

* update README.md

* Update libero2lerobot/README.md

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* Update libero2lerobot/README.md

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

* fix

* set upload_large_folder to false

* use vectorized operations for faster transform

---------

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
Qizhi Chen
2025-06-27 11:36:25 +08:00
committed by GitHub
parent e7ee6a0052
commit 4dc21b9b70
8 changed files with 932 additions and 1 deletions
+10
View File
@@ -0,0 +1,10 @@
export SVT_LOG=1
export HF_DATASETS_DISABLE_PROGRESS_BARS=TRUE
export HDF5_USE_FILE_LOCKING=FALSE
python libero_h5.py \
--src-paths /path/to/libero/ \
--output-path /path/to/local \
--executor local \
--tasks-per-job 3 \
--workers 10