Predrag Cvetkovic 35339d31e5 fix(datasets): bound memory of augment_dataset_quantile_stats by sampling frames (#3749) ...

* fix(datasets): bound memory of augment_dataset_quantile_stats by sampling frames

Per-episode stats previously materialized every frame (and decoded up to 16
episodes in parallel), so peak memory scaled with episode length and OOM'd on
large datasets (#2889). Numeric features are now read in full from the table
(exact), while only image/video frames are sub-sampled per episode using the
existing sample_indices heuristic. Worker count is configurable via
LEROBOT_STATS_MAX_WORKERS; --no-sampling restores exact behavior.

* Update tests/datasets/test_augment_quantile_stats.py

Co-authored-by: Haoming Song <1847575517@qq.com>
Signed-off-by: Pepijn <138571049+pkooij@users.noreply.github.com>

---------

Signed-off-by: Pepijn <138571049+pkooij@users.noreply.github.com>
Co-authored-by: Pepijn <138571049+pkooij@users.noreply.github.com>
Co-authored-by: Haoming Song <1847575517@qq.com>

2026-07-29 12:32:03 +02:00

..

annotations

feat(annotate): improve VLM subtask annotation (legible contact sheets, seeded relabeling, self-hosted vLLM recipe) (#3896)

2026-07-15 11:38:49 +02:00

artifacts

feat(encoding parameters): adding support for user provided video encoding parameters (#3455)

2026-05-14 23:46:42 +02:00

async_inference

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

cameras

feat(camera): add manual exposure, gain, and white balance options for RealSense cameras (#4130)

2026-07-28 13:41:09 +02:00

configs

feat(train): run training remotely on HF Jobs via --job.target (#3856)

2026-06-29 17:59:33 +02:00

datasets

fix(datasets): bound memory of augment_dataset_quantile_stats by sampling frames (#3749)

2026-07-29 12:32:03 +02:00

envs

fix(envs): set LiberoEnvConfig.fps default to 20 to match robosuite (#4124)

2026-07-23 19:49:19 +02:00

fixtures

fix(depth unit): adding input depth unit storage in the dataset metadata (#3899)

2026-07-02 11:53:13 +02:00

jobs

feat(annotate): run lerobot-annotate on HF Jobs via --job.target (#4095)

2026-07-23 10:30:33 +02:00

mocks

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

motors

fix(robots): add retries while recording motor ranges (#4126)

2026-07-23 18:41:48 +02:00

optim

feat(train): FSDP checkpoint saving (#3810)

2026-06-22 13:51:21 +02:00

policies

fix peft factory test mocking (#4201)

2026-07-28 17:54:58 +02:00

processor

fix(processor): keep missing local state resolution local (#3715)

2026-07-27 15:53:31 +02:00

rewards

feat(rewards): add ROBOMETER reward model (#3627)

2026-05-29 21:45:39 +02:00

rl

RL stack refactoring (#3075)

2026-05-12 15:49:54 +02:00

robots

feat(robot): Make SO follower P coefficient configurable (#4142)

2026-07-24 16:03:04 +02:00

scripts

fix(scripts): register third-party plugins in lerobot_setup_motors (#4123)

2026-07-23 18:06:44 +02:00

teleoperators

refactor(robots): homogenize bi-manual setups implementations (#3772)

2026-06-15 16:28:54 +02:00

training

Add inline offline validation with train/eval split (#3824)

2026-06-25 15:31:24 +02:00

transport

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

utils

Aggregate policy sub-losses through MetricsTracker (#4024)

2026-07-16 12:12:37 +02:00

__init__.py

chore(doc): add license header to all files (#818)

2025-03-05 17:56:51 +01:00

conftest.py

perf(tests): cache draccus docstring extraction (#3903)

2026-07-01 17:05:43 +02:00

test_available.py

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00

test_cli_peft.py

feat(rollout): decouple policy deployment from data recording with new lerobot-rollout CLI (#3413)

2026-04-28 00:57:35 +02:00

test_control_robot.py

feat(rollout): decouple policy deployment from data recording with new lerobot-rollout CLI (#3413)

2026-04-28 00:57:35 +02:00

test_robomme_env.py

feat(envs): add RoboMME benchmark (#3311)

2026-04-20 20:21:27 +02:00

test_rollout.py

fix(dependencies): protect peft import (#4188)

2026-07-28 14:57:50 +02:00

test_yaml_policy_path.py

Fix policy.path in YAML configs (PR #3145 followup) (#3597)

2026-05-26 14:01:19 +02:00

utils.py

feat(dependencies): minimal default tag install (#3362)

2026-04-12 20:03:04 +02:00