Skip to content

Fix tokenization bugs and typos - #2

Open
kingusiu wants to merge 3 commits into
uhh-pd-ml:mainfrom
kingusiu:fix/tokenization
Open

Fix tokenization bugs and typos#2
kingusiu wants to merge 3 commits into
uhh-pd-ml:mainfrom
kingusiu:fix/tokenization

Conversation

@kingusiu

Copy link
Copy Markdown

Summary

Fixes a handful of bugs encountered while running the VQ-VAE tokenization pipeline.

Changes

  • Fix typo in feature dict override: feature_dict_kin_massles_without_cuts.yamlfeature_dict_kin_massless_without_cuts.yaml
  • Remove alpha and k optimizer params from the tokenization transformer experiment config — these aren't accepted by RangerLite
  • Remove the stray binning_cfg argument passed to tokenize_jetclass_file(...) in create_tokenized_jetclass_files.py, which doesn't accept that parameter and caused a TypeError

Testing

Ran scripts/create_tokenized_jetclass_files.py end-to-end against a trained VQ-VAE checkpoint to confirm tokenization completes without error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant