Executing run.py fails with ignore_verification illegal

[nielstron]

Running run.py on python 3.9 (after fixing #21 )

(repobench) ➜  repobench git:(main) ✗ python run.py --model_name "deepseek-ai/deepseek-coder-1.3b-base" \
               --dataset_name "tianyang/repobench_python_v1.1" \
               --start_date "2023-12-01" \
               --end_date "2023-12-31" \
               --language "python" \
               --max_token_nums 15800 \
               --levels "2k" "4k" "8k" "12k" "16k" \
               --temperature 0.2 \
               --top_p 0.95 \
               --max_new_tokens 128 \
               --batch_size 1
README.md: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 10.0k/10.0k [00:00<00:00, 6.06MB/s]
Traceback (most recent call last):
  File "/Users/niels/git/repobench/run.py", line 183, in <module>
    fire.Fire(main)
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/fire/core.py", line 135, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/fire/core.py", line 468, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "/Users/niels/git/repobench/run.py", line 147, in main
    dataset = load_dataset(dataset_name, ignore_verifications=True)
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/datasets/load.py", line 2132, in load_dataset
    builder_instance = load_dataset_builder(
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/datasets/load.py", line 1890, in load_dataset_builder
    builder_instance: DatasetBuilder = builder_cls(
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/datasets/builder.py", line 342, in __init__
    self.config, self.config_id = self._create_builder_config(
  File "/Users/niels/miniconda3/envs/repobench/lib/python3.9/site-packages/datasets/builder.py", line 590, in _create_builder_config
    raise ValueError(f"BuilderConfig {builder_config} doesn't have a '{key}' key.")
ValueError: BuilderConfig ParquetConfig(name='default', version=0.0.0, data_dir=None, data_files={'cross_file_first': ['data/cross_file_first-*'], 'cross_file_random': ['data/cross_file_random-*'], 'in_file': ['data/in_file-*']}, description=None, batch_size=None, columns=None, features=None) doesn't have a 'ignore_verifications' key.

removing ignore_verifications=True fixes this issue