chore(deps): bump datasets from 3.6.0 to 4.3.0

[dependabot]

Bumps datasets from 3.6.0 to 4.3.0.

Release notes

Sourced from datasets's releases.

4.3.0

Dataset Features

Enable large scale distributed dataset streaming:

• Keep hffs cache in workers when streaming by @​lhoestq in huggingface/datasets#7820
• Retry open hf file by @​lhoestq in huggingface/datasets#7822

These improvements require huggingface_hub>=0.36.0 to take full effect

What's Changed

• fix conda deps by @​lhoestq in huggingface/datasets#7810
• Add pyarrow's binary view to features by @​delta003 in huggingface/datasets#7795
• Fix polars cast column image by @​CloseChoice in huggingface/datasets#7800
• Allow streaming hdf5 files by @​lhoestq in huggingface/datasets#7814
• Fix batch_size default description in to_polars docstrings by @​albertvillanova in huggingface/datasets#7824
• docs: document_dataset PDFs & OCR by @​ethanknights in huggingface/datasets#7812
• Add custom fingerprint support to from_generator by @​simonreise in huggingface/datasets#7533
• picklable batch_fn by @​lhoestq in huggingface/datasets#7826

New Contributors

• @​delta003 made their first contribution in huggingface/datasets#7795
• @​CloseChoice made their first contribution in huggingface/datasets#7800
• @​ethanknights made their first contribution in huggingface/datasets#7812
• @​simonreise made their first contribution in huggingface/datasets#7533

Full Changelog: huggingface/datasets@4.2.0...4.3.0

4.2.0

Dataset Features

• Sample without replacement option when interleaving datasets by @​radulescupetru in huggingface/datasets#7786

  ds = interleave_datasets(datasets, stopping_strategy="all_exhausted_without_replacement")

• Parquet: add on_bad_files argument to error/warn/skip bad files by @​lhoestq in huggingface/datasets#7806

  ds = load_dataset(parquet_dataset_id, on_bad_files="warn")

• Add parquet scan options and docs by @​lhoestq in huggingface/datasets#7801

  • docs to select columns and filter data efficiently

  ds = load_dataset(parquet_dataset_id, columns=["col_0", "col_1"])
  ds = load_dataset(parquet_dataset_id, filters=[("col_0", "==", 0)])

... (truncated)

Commits

• 41c0529 release: 4.3.0 (#7827)
• 9332649 picklable batch_fn (#7826)
• d10e846 Add custom fingerprint support to from_generator (#7533)
• fb445ff docs: document_dataset PDFs & OCR (#7812)
• 74c7154 Fix batch_size default description in to_polars docstrings (#7824)
• 0b2a4c2 Keep hffs cache in workers when streaming (#7820)
• 12f5aca Retry open hf file (#7822)
• 3e13d30 Allow streaming hdf5 files (#7814)
• aa7f2a9 Fix polars cast column image (#7800)
• 63c933a Add pyarrow's binary view to features (#7795)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[coderabbitai]

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[dependabot]

Superseded by #99.