Commit Graph

1164 Commits

Author SHA1 Message Date
Eugene Mironov 9a38c5f4d2 fixup! Fix PI0.5 RTC tests to use quantile stats (q01, q99) for normalization 2025-11-18 21:30:02 +07:00
Eugene Mironov 5ff66e498f Fix PI0.5 RTC tests to use quantile stats (q01, q99) for normalization
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov dfa1e76082 Fix SmolVLA init_rtc_processor to use getattr instead of direct model access
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov 5fd1d8bce9 Fix PI0.5 init_rtc_processor to use getattr instead of direct model access
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov 4bacf70782 Add RTC initialization tests without config for PI0.5 and SmolVLA
Add test_pi05_rtc_initialization_without_rtc_config and
test_smolvla_rtc_initialization_without_rtc_config to verify that
policies can initialize without RTC config and that _rtc_enabled()
returns False in this case.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov 8858e0cbf1 fixup! fixup! Fix test to use _rtc_enabled() instead of is_rtc_enabled() 2025-11-18 21:30:02 +07:00
Eugene Mironov 43e631122c fixup! Fix test to use _rtc_enabled() instead of is_rtc_enabled() 2025-11-18 21:30:02 +07:00
Eugene Mironov 77fb71a903 Fix test to use _rtc_enabled() instead of is_rtc_enabled()
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov b4f67373e9 fixup! Add one more test 2025-11-18 21:30:02 +07:00
Eugene Mironov 7e820bc1e3 Add one more test 2025-11-18 21:30:02 +07:00
Eugene Mironov 691503d099 fixup! fixup! Add tests for flow matching models with RTC 2025-11-18 21:30:02 +07:00
Eugene Mironov a14e8a65cd fixup! Add tests for flow matching models with RTC 2025-11-18 21:30:02 +07:00
Eugene Mironov a59ebab66b Add tests for flow matching models with RTC 2025-11-18 21:30:02 +07:00
Eugene Mironov 60e1a0de0f Add tests for modeling_rtc 2025-11-18 21:30:02 +07:00
Eugene Mironov da92b0169e Fix tests 2025-11-18 21:30:02 +07:00
Eugene Mironov 36dc58d05e Silent validation 2025-11-18 21:30:02 +07:00
Eugene Mironov dd39d7a037 Update README 2025-11-18 21:30:02 +07:00
Eugene Mironov 70d5ca387e Add validatio at the end 2025-11-18 21:30:02 +07:00
Eugene Mironov 043432254e Add more tests 2025-11-18 21:30:02 +07:00
Eugene Mironov 7185a5350e Small fixes 2025-11-18 21:30:02 +07:00
Eugene Mironov e5c2a0a892 Add workable flow 2025-11-18 21:30:02 +07:00
Eugene Mironov a230e7424d fixup! fixup! fixup! fixup! fixup! Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov 3c484a77f6 fixup! fixup! fixup! fixup! Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov dd0bf8a86e fixup! fixup! fixup! Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov 0da9976c5f fixup! fixup! Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov 755ba419f6 fixup! Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov 2dd7c2a7ea Turn off compilation for pi0/pi05 2025-11-18 21:30:02 +07:00
Eugene Mironov 07550ff0ef fixup! Pi0 eval dataset 2025-11-18 21:30:02 +07:00
Eugene Mironov 577ab57bab Pi0 eval dataset 2025-11-18 21:30:02 +07:00
Eugene Mironov 6684c68612 Pi0 2025-11-18 21:30:02 +07:00
Eugene Mironov 687484a864 Add RTC to PI0 2025-11-18 21:30:02 +07:00
Eugene Mironov 4739ef9da3 Fix compilation 2025-11-18 21:30:02 +07:00
Eugene Mironov d9e72662c1 Debug 2025-11-18 21:30:02 +07:00
Eugene Mironov 9354d7ef10 Experiemnt with late detach 2025-11-18 21:30:02 +07:00
Eugene Mironov 16127642d4 fixup! Add matplotliv to dev 2025-11-18 21:30:02 +07:00
Eugene Mironov 495176f252 Add matplotliv to dev 2025-11-18 21:30:02 +07:00
Eugene Mironov 6aa940346d delete policies 2025-11-18 21:30:02 +07:00
Eugene Mironov 6fdee95923 Add torch compilation for eval_dataset 2025-11-18 21:30:02 +07:00
Eugene Mironov c5b246f57c Drop not required methods 2025-11-18 21:30:02 +07:00
Eugene Mironov 3d3cfcf751 Fix tests 2025-11-18 21:30:02 +07:00
Eugene Mironov a29e8a6737 Add tests for tracker 2025-11-18 21:30:02 +07:00
Eugene Mironov e758703f9a Right kwargs for the policy 2025-11-18 21:30:02 +07:00
Eugene Mironov 64c6b89c40 Fix traacking 2025-11-18 21:30:02 +07:00
Eugene Mironov ab5cae6547 fixup! fixup! fixup! Improve visualization: separate correction plot and fix axis scaling 2025-11-18 21:30:02 +07:00
Eugene Mironov b5ff2b38df fixup! fixup! Improve visualization: separate correction plot and fix axis scaling 2025-11-18 21:30:02 +07:00
Eugene Mironov 7dae02cec1 fixup! Improve visualization: separate correction plot and fix axis scaling 2025-11-18 21:30:02 +07:00
Eugene Mironov b54042a98f Improve visualization: separate correction plot and fix axis scaling
Changes:
- Create separate figure for correction data instead of overlaying on v_t
- Add _rescale_axes helper method to properly scale all axes
- Add 10% margin to y-axis for better visualization
- Fix v_t chart vertical compression issue

Benefits:
- Clearer v_t plot without correction overlay
- Better axis scaling with proper margins
- Separate correction figure for focused analysis
- Improved readability of all denoising visualizations

Output files:
- denoising_xt_comparison.png (x_t trajectories)
- denoising_vt_comparison.png (v_t velocity - now cleaner)
- denoising_correction_comparison.png (NEW - separate corrections)
- denoising_x1t_comparison.png (x1_t state with error)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Alexander Soare <alexander.soare159@gmail.com>
2025-11-18 21:30:02 +07:00
Eugene Mironov 0385ccdd05 fixup! Refactor plotting loging 2025-11-18 21:30:02 +07:00
Eugene Mironov bd85ea905f Refactor plotting loging 2025-11-18 21:30:02 +07:00
Eugene Mironov a3d32cf123 Move plotting logic from modeling_smolvla to eval_dataset script
Refactor to improve separation of concerns:

modeling_smolvla.py changes:
- Remove all plotting logic from sample_actions method
- Remove viz_xt_axs, viz_vt_axs, viz_x1t_axs parameters
- Remove matplotlib and RTCDebugVisualizer imports
- Remove viz_fig, viz_axs, denoise_step_counter instance variables
- Simplify denoising loop to only track data in rtc_processor

eval_dataset.py changes:
- Add _plot_denoising_steps_from_tracker helper method
- Retrieve debug steps from tracker after inference
- Plot x_t, v_t, x1_t, correction, and error from tracker data
- Enable debug tracking (cfg.rtc.debug = True) for visualization
- Remove viz axes parameters from predict_action_chunk calls

modeling_rtc.py changes:
- Remove v_t from track() call (handled by user change)

Benefits:
- Cleaner modeling code focused on inference
- Evaluation script owns all visualization logic
- Better separation of concerns
- Tracker is single source of truth for debug data

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Alexander Soare <alexander.soare159@gmail.com>
2025-11-18 21:30:02 +07:00