This repository was archived by the owner on Jul 23, 2024. It is now read-only.

[Task Submission] Bias-amplified Splits (`bias_amplified_splits`)#23

Open

yuvalreif wants to merge 20 commits into

GenBench:mainfrom

yuvalreif:bias_amplified_splits

Commits on Aug 2, 2023

Add Bias-amplified Splits
Yuval Reif
committed
add git_commit_sha for evaluation metrics
Yuval Reif
committed
wanli: change labels from str to int
Yuval Reif
committed
wanli: fix hf_id
Yuval Reif
committed
update data to a smaller size (100 samples for train/dev/test)
Yuval Reif
committed
wanli: update dataset to contain a 'validation' split
Yuval Reif
committed
wanli: fix adding the 'validation' split to the dataset
Yuval Reif
committed
update documentation: 'usage'
Yuval Reif
committed
mnli: fix split names to 'validation', 'test' (instead of 'X_mismatched')
Yuval Reif
committed
wanli: fix adding 'validation' set to data
Yuval Reif
committed
qqp: remove f1 because of bug, for now
Yuval Reif
committed
fix quality issues
Yuval Reif
committed
mnli: update documentation -- usage
Yuval Reif
committed
update task documentation
Yuval Reif
committed
update task documentation
Yuval Reif
committed

Commits on Aug 3, 2023

Merge branch 'main' into bias_amplified_splits
yuvalreif
authored

Commits on Sep 1, 2023

update data splits back to full size
Yuval Reif
committed
Merge branch 'bias_amplified_splits' of github.com:yreif/genbench_cbt into bias_amplified_splits
Yuval Reif
committed
add prompt-based versions of mnli and wanli
Yuval Reif
committed

Commits on Nov 21, 2023

add minimal usage examples for fine-tuning tasks

Yuval Reif
authored and
Yuval Reif
committed