Skip to content

Sharing the complete dataset & Fix for tokenizer #1

Description

@bablf

Hello,

firstly, amazing paper and great work! Thank you!

I was wondering if there is a dataset version that includes all annotations? It seems like the dataset is split into several files and there seems to be some overlap between examples. I am not sure what kind of file format BRAT returns for its annotations but a complete json file would be great!

The dataset for the 5 different malware reports would also be great to have!

The fix for the tokenizer problem in the jupyter notebook is to use python3.8 as far as I can tell.
Also the requirements.txt should use scikit-learn not sklearn. I also suggest using the latest version of sentence_transformers instead of 2.2 like in the notebook.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions