Steven Palma
db8547e35d
test(cameras): skip flaky async_read test ( #3106 )
2026-03-08 14:02:33 +01:00
Steven Palma
c17d949531
chore(readme): update citation with ICLR26 paper ( #3107 )
...
* peer reviewed citation 🎉
Signed-off-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
* add iclr year
Signed-off-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
* fix quentin's spelling name
Signed-off-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
* docs(readme): update citation
---------
Signed-off-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
Co-authored-by: Francesco Capuano <74058581+fracapuano@users.noreply.github.com >
2026-03-08 14:01:43 +01:00
Steven Palma
1e131f93f8
chore(docs): add uv installation instructions ( #3105 )
...
* chore(docs): add uv installation instructions
* fix(docs): format tabs
* chore(docs): small details
* chore(docs): last details uv installation instructions
* chore(docs): last detail
---
Co-authored-by: sahilmaniyar888 <156301258+sahilmaniyar888@users.noreply.github.com >
2026-03-08 13:00:06 +01:00
Ignat Georgiev
2fb5c7add0
feat(train): add cudnn_deterministic option for reproducible training ( #3102 )
...
Add a `cudnn_deterministic` flag to `TrainPipelineConfig` (default: False)
that sets `torch.backends.cudnn.deterministic = True` and disables benchmark
mode, eliminating CUDA floating-point non-determinism at the cost of ~10-20%
training speed. When False (default) the existing benchmark=True behaviour
is preserved.
2026-03-08 12:29:33 +01:00
Martino Russi
4f2ef024d8
feat(robots): Unitree G1 WBC implementation ( #2876 )
...
* move locomotion from examples to robot, move controller to teleoperator class
* modify teleoperate to send back actions to robot
* whole body controller
* add holosoma to locomotros
* various updates
* update joint zeroing etc
* ensure safefail with locomotion
* add unitree locomotion
* launch camera from g1 server
* publish at varying framerates
* fix async read in camera
* attempting to fix camera lag
* test camera speedup
* training
* inference works
* remove logging from pi0
* remove logging
* push local changes
* testing
* final changes
* revert control_utils
* revert utils
* revert
* revert g1
* revert again:
* revert utils
* push recents
* remove examples
* remove junk
* remove mjlog
* revergt edit_dataset
* Update lerobot_edit_dataset.py
Signed-off-by: Martino Russi <77496684+nepyope@users.noreply.github.com >
* undo teleop changes
* revert logging
* remove loggings
* remove loogs
* revert dataset tools
* Update dataset_tools.py
Signed-off-by: Martino Russi <77496684+nepyope@users.noreply.github.com >
* move gravity to utils
* revert changes
* remove matplotlib viewer (rerun works fine)
* factory revert
* send policy action directly
* recent changes
* implement flexible action space
* send empty command if arms are missing
* rename locomotion to controller
* add init
* implement feedback
* add feedback for teleoperator
* fix ruff
* fix ruff
* use read_latest
* fix zmq camera
* revert exo_serial
* simplify PR
* revert exo_changes
* revert camera_zmq
* Update camera_zmq.py
Signed-off-by: Martino Russi <77496684+nepyope@users.noreply.github.com >
* remove frame duplication from zmq server
* revert channerfactoryinitialize
* keep channelfactoryinitialize
* remove zeroing out logic
* fix typo
* refactor teleop class
* simplify teleop further
* import armindex at the top
* fix visualizer again
* revert ik helper
* push stuff
* simplify image_server
* update image_server
* asd
* add threading logic
* simplify ik helper stuff
* simplify holosoma
* fix names
* fix docs
* revert leg override
* clean connect
* fix controller
* fix ruff
* clean teleoperator
* set_from_wireless
* avoid double initializations
* refactor robot class
* fix pre-commit
* update docs
* update docs format
* add teleop instructions
* unitree_g1 specific exception in record/teleoperate
* add thumbnail to docs
* add thumbnail to doc
* refactor(unitree): multiple improvements (#3103 )
* refactor(unitree): multiple improvements
* test(unitree): added tests + improved installation instructions
* refactor(robots): minor changes unitree robot kinematic
* chore(robots): rename g1 kinematics file
---------
Signed-off-by: Martino Russi <77496684+nepyope@users.noreply.github.com >
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Steven Palma <steven.palma@huggingface.co >
2026-03-08 11:33:24 +01:00
Shun.Sasaki
6139b133ca
fix(async_inference): restore robot module imports in robot_client.py ( #3081 )
2026-03-06 17:14:14 +01:00
Steven Palma
85de893fa7
fix(ci): skip HF log in (and tests) in forks and community PRs ( #3097 )
...
* fix(ci): skip HF log in (and tests) in forks and community PRs
* chore(test): remove comment about test meant to be only run locally
* fix(tests): no hf log in decorator for xvla
* fix(test): no decorator in yield
2026-03-06 16:33:43 +01:00
Steven Palma
a4c66e530b
chore(docs): remove pi installation note ( #3095 )
2026-03-06 15:52:54 +01:00
Steven Palma
a225127527
chore(dependencies): sync intelrealsense + added notes ( #3094 )
2026-03-06 10:50:46 +01:00
Steven Palma
e489ba24fc
feat(dependencies): require Python 3.12+ as minimum version ( #3023 )
...
* feat(dependecies): upgrade to python3.12
* fix(test): processor regex message
* fix(test): processor regex message
* fix(dependecies): resolve all tags in python 3.12
* fix(dependecies): add more hints to faster resolve
* chore(dependecies): remove cli tag huggingface-hub dep
* refactor(policy): update eagle for python3.12
* chore(docs): update policy creation for python 3.12
* chore(test): skip failing tests in macos
2026-03-06 10:15:13 +01:00
Steven Palma
d324ffe810
fix(ci): test only multi-gpu tests in multi-gpu runner ( #3092 )
2026-03-05 19:53:40 +01:00
Pepijn
1a24f770d3
Feat/slurm compute rabc script ( #3041 )
...
* Add SLURM SARM progress annotation script.
Provide a standalone two-stage compute/aggregate pipeline for RA-BC progress generation so large datasets can be processed in parallel and optionally uploaded to the Hub.
Made-with: Cursor
* fix pr comments
* remove comments
2026-03-05 18:27:58 +01:00
Caroline Pascal
92fba37225
fix(num_frames): fixing redundant frames count in conversion script ( #3091 )
2026-03-05 15:49:50 +01:00
Steven Palma
3e45120272
fix(ci): log in HF for gated repo in nightly workflows ( #3089 )
...
* fix(ci): log in HF for gated repo in nightly workflows
* fix(ci): add env var
* fix(ci): remove 10 min limit for multi-gpu nightly
2026-03-05 13:22:37 +01:00
Steven Palma
f0d2b37beb
chore(dependencies): bump transformers v5 ( #2964 )
...
* chore(dependencies): upgrade transformers + hggingface-hub + peft + scipy
* chore(dependencies): bump pi0 family to transformers v5
* chore(dependencies): bump wall x to transformers v5
* chore(dependencies): bump gr00t to transformers v5
* chore(style): fix pre-commit
* fix(policy): xvla forced_bos_token missing
* test(rl): skip ci tests for resnet10
* Fix: full pi models support for transformer v5 (#2967 )
* fix(pi): remove loss truncation
* fix(pi): remove state padding before tokenization
* fix(pi): fix image padding value
* fix from_pretrain
* add transformer v5 changes
* remove reference
* more fixes
* make it work
* add support for rest of pi family
* add pifast work
* more changes
* more changes
* more cleanup
* fix torch params
* dtype fix
* torch compile
* embed mismatch fix
* revert groot
* more nit fixes
* remove unused classes
* more fixes
* revert
* nit
* torch dtype warning fix
* but back dynamic renaming
* add tie embedding
---------
Co-authored-by: Yufei Sun <skieyfly@gmail.com >
* chore: fix XVLA in transformers v5 (#3006 )
* test(policies): enable wall x CI testing
* style(test): pre-commit check
* style(test): pre-commit
* fix wall x for transformer v5 (#3008 )
* tv5 fix
* various wall x fixes
* Delete tests/policies/pi0_pi05/print_pi05_output_logits.py
Signed-off-by: Jade Choghari <chogharijade@gmail.com >
* sync modeling_florence2.py with chore/bump_transformers_v5
* more
* more fixes
* more
* remove comment
* more
---------
Signed-off-by: Jade Choghari <chogharijade@gmail.com >
* chore(dependencies): adjust dependencies versioning after transformers v5 (#3034 )
* chore(dependecies): adjust dependecies versioning after transformers v5
* fix(policies): remove deprecated input_embeds
* fix(policies): dict _tied_weights_keys
* chore(depedencies): common qwen-vl-utils
* chore(dependencies): bump transformers to 5.2
* Fix policy testing for tv5 (#3032 )
* fix ci logger
* other fix
* fix mypy
* change logits to torch2.10
* skip wallx|
* remove logging
---------
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
* feat(ci): log into HF to unblock some CI tests (#3007 )
* feat(ci): log into HF to unblock some CI tests
* chore(ci): change hf call + secret name
* fix(ci): temp fix for pi0 rtc test
* test(policies): require_cuda for unblocked tests
* test(policies): require_cuda wall_x
* fic(tests): require_cuda outter most for pi0
* fix(test): return instead of yield
---------
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
* style(test): fix pre-commit
* chore(deps): upgrade transformers (#3050 )
* chore(test): use lerobot model
* fix(policies): change default action tokenizer for wall x
* sample on cpu
* Revert "Merge branch 'chore/bump_transformers_v5' of https://github.com/huggingface/lerobot into chore/bump_transformers_v5"
This reverts commit d9b76755f7 , reversing
changes made to 89359cb0b6 .
* Reapply "Merge branch 'chore/bump_transformers_v5' of https://github.com/huggingface/lerobot into chore/bump_transformers_v5"
This reverts commit c9914db78b .
---------
Signed-off-by: Jade Choghari <chogharijade@gmail.com >
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Jade Choghari <chogharijade@gmail.com >
Co-authored-by: Yufei Sun <skieyfly@gmail.com >
Co-authored-by: Pepijn <pepijn@huggingface.co >
2026-03-05 09:25:26 +01:00
Caroline Pascal
cbc8bfb2e6
chore(docstrings): updating v2.1-v3.0 conversion script docstrings to match the new task label ( #3077 )
...
* chore(docstrings): updating v2.1-v3.0 conversion script docstrings to match the new task label
* chore(task): renamming the default index label in the tasks DataFrame to task
* Revert "chore(docstrings): updating v2.1-v3.0 conversion script docstrings to match the new task label"
This reverts commit f55de3255278f23f18b5d955565f6768d094951d.
* chore(docstrings): updating docstrings to match dataset v3.0 architecture
* chore(format): formatting code
2026-03-04 17:59:03 +01:00
Paul Crook
0d1be72dc8
Fixing metadata indexing when writing new Parquet file ( #2941 )
...
* Fixing metadata indexing when writing new Parquet file
Summary:
- addressing this issue: https://github.com/huggingface/lerobot/issues/2401
- vibe-coded bugfix by Claude Sonnet 4.5
* Backing out changes to convert_videos_of_camera
* Addressing Ruff pre-commit complaint
Summary:
- addressing "SIM113 Use `enumerate()` for index variable `ep_idx` in `for` loop"
---------
Co-authored-by: Paul <238953601+pac-robotics@users.noreply.github.com >
2026-03-04 16:53:34 +01:00
Maxime Ellerbach
96b7c212c4
chore(docs): updating deprecated huggingface-cli to hf ( #3071 )
...
* chore(docs): updating deprecated huggingface-cli to hf
* small typo in my-org
2026-03-04 15:08:49 +01:00
Caroline Pascal
4303b3c930
chore(root): fixing root semantics in convert_dataset script ( #3073 )
...
* fix(root): fixing root semantincs in convert_dataset script
* fix(\): fixing command syntax in dataset conversion script
Signed-off-by: Caroline Pascal <caroline8.pascal@gmail.com >
---------
Signed-off-by: Caroline Pascal <caroline8.pascal@gmail.com >
2026-03-04 11:11:21 +01:00
Caroline Pascal
63dca86df8
fix(dataset edit tools): clarifying root argument usage + adding related features ( #3049 )
...
* fix(root): adding proper support for the root and new_root arguments
* feat(roots): adding a roots agrument for the merge operation
* chore(clean): cleaning up code
* chore(doctrings): updating doctrings with new features
* fix(repo_id): setting repo_id to None when not needed
* fix(roots/repo_ids): making mypy happy by using repo_ids and roots for merge operation
* fix(path): fixing path related issues
* fix(repo_id): fixing issues related to repo_id
* chore(doctrings): updating docstrings + fix typo
* chore(clean): cleaning code
* fix(split new_repo_id): reverting new_repo_id addition for split operation
* docs(dosctrings): completing docstrings
* fix(repo_ids/roots): improving checks for repo_ids/roots lengths
* fix(repo_ids): making repo_ids optional in MergeConfig but raise if not given
* fix(docstrings): fixing docstrings for split operation
* fix(hints): updating get_output_path hints to accept paths as strings too
* fix(y/N prompts): removing y/N prompts in lerobot_edit_dataset
* fix(merge repo_id): fixing merge operation to use new_repo_id instead of repo_id
* fix(typo): fixing typo in doctrings
2026-03-03 15:40:46 +01:00
Caroline Pascal
8a0cc3d664
fix(frame_index): making rerun's "frame_index" timeline compatible with behaviour1k datasets ( #3068 )
...
* fix(frame_index): making rerun's "frame_index" timeline compatible with behaviour1k datasets
* fix(segfault risk): removing segfault risk by calling batch["index"] in the dataloader loop
2026-03-03 11:55:09 +01:00
Bernie Telles
8bb8ed4803
Improve policy_device documentation for async.mdx ( #3060 )
2026-03-02 15:35:15 +01:00
Steven Palma
095856b06a
chore: add AI policy ( #3055 )
2026-02-28 14:41:28 +01:00
Steven Palma
563f42bdb1
chore(dependencies): Bump lerobot to 0.4.5 ( #3051 )
2026-02-27 19:29:35 +01:00
Caroline Pascal
8fff0fde7c
chore(docstrings): fixing deprecated root argument description in LeRobotDataset class ( #3035 )
...
* chore(docstrings): fixing deprecated `root` argument docstrings in LeRobotDataset class
* chore(draccus): updating draccus CLI help
* chore(revert): reverting changes in lerobot_dataset_viz.py
---------
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
v0.4.4
2026-02-27 18:22:44 +01:00
Pepijn
04de496547
fix(logging): avoid double-counting samples across processes ( #3045 )
2026-02-27 17:45:19 +01:00
Khalil Meftah
baf9b50365
Fix(diffusion): enforce no-crop behavior when crop_ratio=1.0 ( #3046 )
...
* refactor(diffusion): replace crop_shape with resize_shape and crop_ratio
* fix(diffusion): address review feedback on resize/crop backward compat
* test: regenerate diffusion artifacts for updated default config
* fix: disable crop when resize path uses crop_ratio=1.0
---------
Co-authored-by: starlitxiling <1754165401@qq.com >
2026-02-27 17:44:53 +01:00
Jade Choghari
a0fdbf037a
feat(policies): add Smolvla torch compile support ( #3043 )
...
* Change LIBERO init_state_id when reset.
Signed-off-by: Aoqun Jin <aojiaojiao@foxmail.com >
* Change LIBERO init_state_id when reset.
Signed-off-by: Aoqun Jin <aojiaojiao@foxmail.com >
* pre-commit run
* Add torch.compile for smolvla
Signed-off-by: Aoqun Jin <aojiaojiao@foxmail.com >
* Add torch.compile for smolvla
Add model compilation option for improved performance.
Signed-off-by: Aoqun Jin <aojiaojiao@foxmail.com >
* first
---------
Signed-off-by: Aoqun Jin <aojiaojiao@foxmail.com >
Co-authored-by: Aoqun Jin <aojiaojiao@foxmail.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-27 18:58:36 +03:00
Khalil Meftah
c085531b17
fix: add missing openarm_mini import to CLI scripts ( #3028 )
2026-02-27 15:46:31 +01:00
Steven Palma
c7c6205332
chore(scripts): no spam log when no action ( #3042 )
2026-02-27 15:26:56 +01:00
Michio Sun
4e54be1334
fix(datasets): skip warning when MultiLeRobotDataset features are identical ( #3019 )
...
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-26 17:42:22 +01:00
Damien LaRocque
fde9d08281
feat(async_inference) Enable plugins with async inference ( #2425 )
...
* feat(async-inference) Try using async inference server with plugins
* Fix import
* Fix import error in Robot Client
---------
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-26 14:41:32 +01:00
Khalil Meftah
46044fed75
Fix: remove device_map from SmolVLA model loading ( #3029 )
...
* Fix SmolVLA meta tensor error by removing device_map
- Remove device_map parameter from VLM model loading
- Change torch_dtype from string to torch.bfloat16
- Add explicit .to(device) calls after initialization
This resolves NotImplementedError when training SmolVLA policy.
Fixes meta tensor copy issue in factory.py:418.
* fix: remove manual device movement logic and fix dtype handling
---------
Co-authored-by: Highsky7 <albert31115@gmail.com >
2026-02-26 13:28:46 +01:00
Khalil Meftah
975dcad918
Feat(teleoperators): add OpenArm Mini teleoperator ( #3022 )
...
* add OpenArm Mini config and module init
* add OpenArm Mini teleoperator implementation
* add OpenArm Mini into factory and setup motors
---------
Co-authored-by: Pepijn <138571049+pkooij@users.noreply.github.com >
2026-02-25 18:46:55 +01:00
Cotton Hu
d0b58190da
fix(policies): support dp train when n_obs_steps=1 ( #2430 )
...
Co-authored-by: hukongtao <hukongtao@agibot.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-25 17:36:31 +01:00
Mishig
9a5ab8ffab
feat: add visualization badge to card template and update dataset card creation with repo_id ( #3005 )
...
* feat: add visualization badge to card template and update dataset card creation with repo_id
* Update src/lerobot/datasets/card_template.md
* Update src/lerobot/datasets/card_template.md
---------
Signed-off-by: Mishig <dmishig@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2026-02-25 16:02:40 +01:00
Khalil Meftah
7541d72130
Fix SARM dense_only mode: always load episodes_df for target computation ( #3021 )
...
* fix annotation mode check
* fix: SARM dense_only mode always load episodes_df for target computation
---------
Co-authored-by: John Newsom <jackmnewsom@gmail.com >
Co-authored-by: Pepijn <138571049+pkooij@users.noreply.github.com >
2026-02-25 13:28:01 +01:00
Jash Shah
0317a15bf1
fix(video): replace assertions with proper exceptions in video frame decoding ( #3016 )
...
Replaced assert statements with FrameTimestampError exceptions in
decode_video_frames_torchvision and decode_video_frames_torchcodec.
Assertions are unsuitable for runtime validation because they can be
silently disabled with python -O, and they produce unhelpful
AssertionError tracebacks. The codebase already defines
FrameTimestampError for this exact purpose but it was only used
in one of the three validation sites.
Also removed AssertionError from the except clause in
LeRobotDataset.__init__, which was masking video timestamp errors
by silently triggering a dataset re-download instead of surfacing
the actual problem.
2026-02-25 12:29:22 +01:00
Jash Shah
f138e5948a
Fix metaworld_config.json not bundled in pip installs and AttributeError crash ( #3017 )
...
1. Include metaworld_config.json in package distributions by adding it to
both MANIFEST.in (for sdist) and pyproject.toml package-data (for wheels).
Without this, pip-installed lerobot raises FileNotFoundError when
importing the metaworld environment.
2. Fix crash in sanity_check_dataset_name where the error message accesses
policy_cfg.type when policy_cfg is None, raising AttributeError instead
of the intended ValueError.
Fixes #2958
2026-02-25 12:29:10 +01:00
Martin Kiefel
8fef4ddab8
fix(dataset): Fix reindexing bug for videos on splits ( #2548 )
...
* fix(dataset): Reindex videos based on frame and not on time
Sometimes during split operations the frame timestamp floating
precision leads to frame ending up in the wrong split.
This changes fixes the issues by directly working with frame indices
instead.
* Fix formatting
2026-02-25 11:57:07 +01:00
Steven Palma
18d9cb5ac4
feat(scripts): Integrate tqdm for training progress visualization ( #3010 )
2026-02-24 19:10:43 +01:00
Steven Palma
5095ab0845
fix(ci): permissions triton ( #3011 )
2026-02-24 19:09:34 +01:00
Jash Shah
dac1efd13d
feat: Enable torch.compile for DiffusionPolicy inference ( #2486 )
...
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-24 17:29:08 +01:00
Dominik Paľo
7fd71c83a3
docs: add WSL evdev installation note ( #2855 )
...
Add a note in the installation guide explaining that users on WSL need to install evdev to avoid build issues.
See: https://github.com/huggingface/lerobot/issues/2528
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-23 20:41:20 +01:00
Yuan Haokuan
0f44adbeec
docs: fix HF_USER export command to correctly parse username ( #2932 )
...
* Fix HF_USER extraction command in documentation
Updated command to extract the username from hf auth output.
Signed-off-by: Yuan Haokuan <138340416+WilbertYuan@users.noreply.github.com >
* Correct HF_USER variable assignment in documentation
Fix the variable extraction from hf auth output.
Signed-off-by: Yuan Haokuan <138340416+WilbertYuan@users.noreply.github.com >
* Update docs/source/il_robots.mdx
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Signed-off-by: Yuan Haokuan <138340416+WilbertYuan@users.noreply.github.com >
---------
Signed-off-by: Yuan Haokuan <138340416+WilbertYuan@users.noreply.github.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-23 17:51:13 +01:00
Guilherme Miotto
7dbbaa3727
Small comment fix ( #2990 )
...
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-23 17:11:55 +01:00
Yuta Nakagawa
fcabfd32a5
chore(docs): update the document for Phone teleop to clarify how to use the examples ( #2991 )
...
* update the document for Phone teleope to clarify how to use the examples
* Update docs/source/phone_teleop.mdx
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Signed-off-by: Yuta Nakagawa <ytnkgw@gmail.com >
---------
Signed-off-by: Yuta Nakagawa <ytnkgw@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-23 17:11:46 +01:00
Steven Palma
544cbc5f38
feat(motors): add RobStride CAN implementation ( #2821 )
...
* feat(motors): add initial implementation of robstride
Co-authored-by: Virgile <virgilebatto@gmail.com >
* chore(motors): solve some linter
* remove kp/kd attribute
* code uniformisation between damiao and robstride
* remove normalization warning
* remove non valid baudrates and small docstring update
* remove all useless files. Only keeping robstride.py and table.py
* typing for mypy
* reduce NameOrId usage
* align signature with damiao
* put the same helper than in the damiao implementation
* bug correction : expect a response after each bus.send
---------
Co-authored-by: Virgile <virgilebatto@gmail.com >
2026-02-23 16:39:04 +01:00
Yueci Deng
a0c5d19391
add metadata_buffer_size to dataset creation ( #2998 )
...
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2026-02-23 16:32:59 +01:00
Steven Palma
e96339a3b4
feat(dataset): add streaming video encoding + HW encoder support ( #2974 )
...
* feat(dataset): init stream encoding
* feat(dataset): use threads to fix frame pickle latency
* refactor(dataset): remove HW encoded related changes
* add lp (#2977 )
* feat(dataset): add Hw encoding + log drop frames (#2978 )
* chore(docs): add streaming video encoding guide
* fix(dataset): style docs + testing
* chore(docs): simplify sttreaming video encoding guide
* chore(dataset): add commands + streaming encoding default false + print note if false + queue default is now 30
* chore(docs): add verification note advice
* chore(dataset): adjusting defaults & docs for streaming encoding
* docs(scripts): improve docstrings
* test(dataset): polish streaming encoding tests
* chore(dataset): move FYI log related to streaming
* chore(dataset): add arg vcodec to suggestions
* refactor(dataset): better handling for auto and available vcodec
* chore(dataset): change log level
* docs(dataset): add note related to training performance vcodec
* docs(dataset): add more notes to streaming encoding
---------
Co-authored-by: Caroline Pascal <caroline8.pascal@gmail.com >
Co-authored-by: Pepijn <pepijn@huggingface.co >
2026-02-23 13:57:43 +01:00