Pepijn e67ceb213d feat(robotwin): eval 5 diverse tasks per CI run with NL descriptions ...

Widen the smoke eval from a single task (beat_block_hammer) to five:
click_bell, handover_block, open_laptop, stack_blocks_two on top of the
original. Each gets its own rollout video in videos/<task>_0/ so the
dashboard can surface visually distinct behaviours.

extract_task_descriptions.py now has a RoboTwin branch that reads
`description/task_instruction/<task>.json` (already shipped in the clone
at /opt/robotwin) and pulls the `full_description` field. CI cds into
the clone before invoking the script so the relative path resolves.

parse_eval_metrics.py is invoked with the same 5-task list so the
metrics.json embeds one entry per task.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-14 21:03:15 +02:00

..

extract_task_descriptions.py

feat(robotwin): eval 5 diverse tasks per CI run with NL descriptions

2026-04-14 21:03:15 +02:00

parse_eval_metrics.py

feat(ci): benchmark smoke tests with isolated Docker images (LIBERO + MetaWorld) (#3319)

2026-04-13 21:24:01 +02:00