Skip to content

Extracting precise training data contents for HF published and other models #21

Description

@kingb12

Hi all! I was interested in getting the exact training dataset contents for the models available on huggingface (DIAL-FLANT5-XL, etc). I see in the README it says it would be all datasets contained in the repo as of June 2022, but wasn't sure how to extract these or group them by tasks. Is there a config file which specifies these exactly, including which split(s) from each dataset? I'm interested in using these models but need to be careful to avoid data contamination.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions