Skip to content

update evaluations - #2

Draft
ouhenio wants to merge 12 commits into
mainfrom
add-evaluations
Draft

update evaluations#2
ouhenio wants to merge 12 commits into
mainfrom
add-evaluations

Conversation

@ouhenio

@ouhenio ouhenio commented Jul 30, 2024

Copy link
Copy Markdown

This PR:

  • Updates the README with usage instruction, so our collaborator have an easier time using this tool.
  • Adds a Makefile for an friendlier interface.
    • Models included: Phi-2, Phi-3
    • Tasks included: MMLU_ES, Hellaswag_es

Todos:

  • : Add funcitonal vllm option.
  • : Improve output formatting.
  • : Add PSUs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant