How to generate my own wordpiece.json #7

Open

opened

on Apr 25, 2023

Hello, I have found that there are many semantic unrelated tokens in mimic_wordpiece.json. So I want to generate my own wordpiece file. How could I achieve it?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests