Files
lerobot/spaces/health-dashboard
Pepijn 452d9abaa4 feat(ci): add health dashboard Space + benchmark metrics artifacts
- spaces/health-dashboard/app.py: Gradio Space that queries the GitHub
  Actions API directly (no extra datastore). Shows benchmark status
  badges, success-rate and duration trend charts, and embeds the latest
  rollout video per benchmark. Results cached 5 min in-memory; video
  files cached on disk by artifact ID so downloads only happen once.
- spaces/health-dashboard/requirements.txt + README.md: Space card with
  setup instructions for the GITHUB_RO_TOKEN secret (actions:read,
  metadata:read only).
- scripts/ci/parse_eval_metrics.py: runs on the CI host after each eval,
  reads eval_info.json written by lerobot-eval, extracts pc_success and
  n_episodes, and writes metrics.json to the artifacts dir.
- .github/workflows/benchmark_tests.yml: add "Parse … metrics" and
  "Upload … metrics" steps (if: always()) after each eval so the
  dashboard has data even when the eval fails.

The Space should be deployed as a private Space under the huggingface
org. Required secret: GITHUB_RO_TOKEN (fine-grained, read-only).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-08 17:46:44 +02:00
..

title, emoji, colorFrom, colorTo, sdk, sdk_version, app_file, pinned, license, short_description
title emoji colorFrom colorTo sdk sdk_version app_file pinned license short_description
LeRobot Health Dashboard 🤖 yellow orange gradio 5.29.0 app.py true apache-2.0 Live CI health for the LeRobot main branch

LeRobot Health Dashboard

Internal dashboard for monitoring the health of the main branch — benchmark smoke-test success rates, CI job durations, and latest rollout videos, all pulled live from the GitHub Actions API.

Required secret

Add GITHUB_RO_TOKEN in the Space settings with a fine-grained GitHub token scoped to:

  • Repository: huggingface/lerobot
  • Permissions: Actions → Read-only, Metadata → Read-only

The token is never exposed in the UI or logs.