Skip to content

Expand LIBERO-CF-Mini initial-state coverage #10

Description

@myheart521

Why

LIBERO-CF-Mini v0.1 covers four task families but only init state 0 in each family. This is enough for a pilot, not paper-level variation.

Scope

Add a bounded second initial state for each existing task family without changing the current v0.1 evidence.

Acceptance criteria

  • Propose a versioned manifest change and explain compatibility.
  • Pin every BDDL and init-state source hash.
  • Preserve exact snapshot restore, repeated no-op, and forward/reverse branch-order checks.
  • Generate or convert artifacts with resume-safe content addressing.
  • Update the benchmark card with coverage, runtime, licenses, and limitations.
  • Add tests for invalid hashes, restore mismatch, and branch-order dependence.
  • Run one smallest-task smoke before a full GPU run.

Non-goals

This is not a LIBERO policy leaderboard and does not claim task success. Generated RGB/state bundles and upstream assets stay outside Git.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:benchmarkBenchmark data or protocolhelp wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions