lerobot

mirror of https://github.com/huggingface/lerobot.git synced 2026-07-26 19:26:16 +00:00

Files

T

Pepijn e9e7cbbbda ci(robocasa): smoke-eval 10 atomic tasks instead of 1

Broader coverage in the benchmark CI job: evaluate SmolVLA on ten
fixture-centric atomic RoboCasa tasks (one episode each) instead of
just CloseFridge. The tasks are all drawn from TARGET_TASKS.atomic_seen
and selected to avoid object-manipulation categories that would require
the objaverse/aigen asset packs (we only ship objs_lw in the Docker
image, paired with obj_registries=["lightwheel"] on the runtime side).

Tasks: CloseFridge, OpenCabinet, OpenDrawer, TurnOnMicrowave,
TurnOffStove, CloseToasterOvenDoor, SlideDishwasherRack,
TurnOnSinkFaucet, NavigateKitchen, TurnOnElectricKettle.

`scripts/ci/parse_eval_metrics.py` already handles multi-task output
via the `overall` key, so no parser changes needed. Bumped the metrics
artifact's task label to `atomic_smoke_10` to reflect the grouping.

Made-with: Cursor

2026-04-17 13:34:01 +01:00

benchmark_tests.yml

ci(robocasa): smoke-eval 10 atomic tasks instead of 1

2026-04-17 13:34:01 +01:00

claude.yml

chore(ci): proper claude args workflow (#3338 )

2026-04-09 16:20:01 +02:00

docker_publish.yml

feat(ci): add uv.lock (#3292 )

2026-04-06 12:23:37 +02:00

documentation-upload-pr.yml

chore: bump doc-builder SHA for PR upload workflow (#3386 )