lerobot

mirror of https://github.com/huggingface/lerobot.git synced 2026-05-19 10:40:04 +00:00

Files

T

Pepijn 26cb38a7d0 feat(smolvla2): startup task picker, /vlm mode toggle, interactive VQA overlay

Three additions to the SmolVLA2 interactive runtime:

1. Startup task picker — when no --task is given, the runtime lists the
   dataset's task strings as a numbered menu (plus a custom-task option)
   instead of silently waiting for the first stdin line.

2. Mode toggle — /action and /vlm slash commands flip a persistent run
   mode. /vlm pauses the whole action loop (HighLevelSubtaskFwd,
   LowLevelForward and DispatchAction gate on state["mode"]) and clears
   the action queue so the robot holds position; /action resumes it.
   The mode is shown in the state panel.

3. Interactive VQA — in /vlm mode a typed line is a VQA question. The
   new inference/vqa.py module asks which camera to ground on, runs the
   VLM on that single camera, and when the answer is a bbox/keypoint it
   draws the overlay, saves a PNG to ./vqa_overlays/ and auto-opens it.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-18 11:20:57 +02:00

groot

feat(dependencies): minimal default tag install (#3362 )

2026-04-12 20:03:04 +02:00

hilserl

feat(dependencies): minimal default tag install (#3362 )

2026-04-12 20:03:04 +02:00

multi_task_dit

fix(test): add missing device placement in multi-task DiT tests (#3349 )

2026-04-14 12:25:29 +02:00

pi0_fast

chore(dependecies): untangle dependecies across internal modules (#3149 )