Skip to content

BioHopR #34

@warner-benjamin

Description

@warner-benjamin

Implement verifiers env for BioHopR

Implement a verifiers environment for the BioHopR biomedical reasoning dataset. Use the authors’ question, system, and LLM-as-judge prompts if provided. Only create a training dataset if a training split exists.

Paper: https://arxiv.org/abs/2505.22240
Dataset / Project: https://huggingface.co/datasets/knowlab-research/BioHopR

Format & Env

  • Open-ended multi-hop biomedical reasoning: vf.JudgeRubric()
  • Optionally include exact-match scoring for short answers

Metadata

Metadata

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions