Skip to content

fix(dashboard): compare gripper action and PE state in mm - #2

Open
Peter-cuhk wants to merge 1 commit into
AgibotTech:mainfrom
Peter-cuhk:fix/dashboard-gripper-units-and-video-h264
Open

fix(dashboard): compare gripper action and PE state in mm#2
Peter-cuhk wants to merge 1 commit into
AgibotTech:mainfrom
Peter-cuhk:fix/dashboard-gripper-units-and-video-h264

Conversation

@Peter-cuhk

Copy link
Copy Markdown

Summary

  • Fix the world-model dashboard comparing WM action gripper channels (normalised [0, 1]) directly against Pose Expert state grippers (OmniPicker aperture in mm), which produced misleading deltas (e.g. +118 for a ~1 mm right-gripper error during replay).
  • Convert action gripper dims (7, 15) with the same 35 + norm * 85 mapping used in conditioning/band.py before rendering the comparison table.
  • Add wm_action_gripper_to_mm() helpers in gesim.types and unit tests.
  • Fall back to imageio-ffmpeg when ffmpeg is not on PATH, so save_video() prefers H.264 instead of OpenCV mp4v when possible.

Test plan

  • pytest tests/test_gripper_units.py tests/test_env_server_smoke.py
  • ruff check on touched files
  • Replay demo_000 and confirm dashboard gripper Δ is ~mm-scale (R grip ~1 mm, not ~118)

WM action grippers are normalised [0, 1] while Pose Expert state uses
OmniPicker aperture in mm. The dashboard was subtracting raw values,
producing misleading deltas (e.g. +118 for a ~1 mm right-gripper error).

Also fall back to imageio-ffmpeg when ffmpeg is not on PATH so rollout
videos use H.264 instead of OpenCV mp4v when possible.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant