Skip to content

Fill in RESULTS.md placeholder tables as experiments complete #67

Description

@sebasmos

What this is

RESULTS.md at the repo root is the single source of truth for all experiment results. Every table currently has -- placeholders and NOT RUN status. This issue tracks updating those placeholders as runs complete.

How to update

When a run finishes, edit RESULTS.md and:

  1. Replace the NOT RUN status cell with the run date (YYYY-MM-DD).
  2. Fill in result cells with actual numbers (mean ± std where applicable).
  3. Add a bootstrap 95% CI where the table has a CI column.
  4. Reference the eval JSON path in a comment on this issue so results are traceable.

Tables to fill (in priority order)

Rule

Do not report a number in RESULTS.md without also referencing the eval JSON that produced it (e.g. eval/lora_no_wrapper.json @ commit abc1234). This keeps the table auditable.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions