chore: bump deps

[dependabot]

⚠️ Dependabot is rebasing this PR ⚠️

Rebasing might not happen immediately, so don't worry if this takes some time.

Note: if you make any changes to this PR yourself, they will take precedence over the rebase.

---

Updates the requirements on datasets and ipykernel to permit the latest version.
Updates datasets to 5.0.0

Release notes

Sourced from datasets's releases.

5.0.0

Datasets Features

Agent traces

• Parse Agent traces messages for SFT using teich by @​lhoestq in huggingface/datasets#8232

  • Agent traces from claude_code/pi/codex and others can now be loaded with load_dataset
  • Using the teich library (new optional dependency), traces are parsed to messages to enable training on traces using e.g. trl
  • Load the data:

  >>> from datasets import load_dataset
  >>> ds = load_dataset("lhoestq/agent-traces-example", split="train")
  >>> ds[0]["messages"]
  [{'role': 'user', 'content': 'Download a random dataset from Hugging Face, use DuckDB to inspect it, and come back with a short report about it. Be concise and include: dataset name, what files/format you found, row count or rough size if you can determine it,...'
   ...]

  • Train on agent traces:

  trl sft --dataset-name lhoestq/agent-traces-example ...

  • find all the Agent traces datasets on HF here: https://huggingface.co/datasets?format=format:agent-traces&sort=trending

Next-level shuffling in streaming mode

• Use multiple input shards for shuffle buffer by @​lhoestq in huggingface/datasets#8194

  ds = load_dataset(..., streaming=True)
  ds = ds.shuffle(seed=42)
  # or configure local buffer shuffling manually, default is:
  ds = ds.shuffle(seed=42, buffer_size=1000, max_buffer_input_shards=10)

  before👎:

  after✨:

  toy example comparison

  from datasets import IterableDataset
  ds = IterableDataset.from_dict({"i": range(123_456_789)}, num_shards=1024)
  ds = ds.shuffle(seed=42)
  print("Cold start ids:")

... (truncated)

Commits

• 68ac1a9 Release: 5.0.0 (#8239)
• cfe4492 Support composed splits in streaming datasets (#8220)
• fd67320 Keep None as a real null in Json() columns instead of the string "null" (#8231)
• 10cdc81 Fix iterable skip over full Arrow blocks (#8236)
• b7c064d Parse agent traces messages for SFT using teich (#8232)
• 31e92f1 fix: embed_external_files=True for mesh support (#8224)
• d168d5f feat: add TsFile (Apache IoTDB) packaged builder with per-device wide format ...
• 992f3cf fix(map): fix progress bar exceeding total when load_from_cache_file=False (#...
• 8474a91 Fix single lance file form pylance 7.0 (#8225)
• d4284e9 feat: add 3D mesh support and MeshFolder builder (#8055)
• Additional commits viewable in compare view

Updates ipykernel to 7.3.0

Release notes

Sourced from ipykernel's releases.

v7.3.0

7.3.0

(Full Changelog)

New features added

• feat(displayhook): add register_hook/unregister_hook to ZMQShellDisplayHook #1522 (@​rgbkrk, @​minrk)
• Support ZMQ Curve for transport encryption #1515 (@​krassowski, @​Carreau, @​minrk)

Enhancements made

• Support new iPython system_raise_on_error flag in ZMQInteractiveShell #1496 (@​adityawasudeo, @​ianthomas23)
• pass cell_meta from do_execute to run_cell #1475 (@​erawn, @​P4X-ng, @​ianthomas23)

Bugs fixed

• Fix broken IPython Reference URL in help_links #1526 (@​goelakash, @​Carreau, @​JohanMabille, @​krassowski)
• Mark cell execution as failing when formatter errors out #1521 (@​krassowski, @​Carreau)
• Fix ENOTSOCK traceback when iopub socket closes during shutdown #1518 (@​Carreau, @​minrk)
• Bugfix: Ensure that we take a copy of the sys.modules before iterating over it #1514 (@​pelson, @​Carreau)

Maintenance and upkeep improvements

• build docs on latest python #1525 (@​Carreau)
• Fix recent debugpy failures #1524 (@​Carreau)
• Unpin Spinx now that typehints issue ought to be resolved #1517 (@​krassowski, @​Carreau)
• Fix downstream test: do not use editable install for ipyparallel #1516 (@​krassowski, @​Carreau)
• Linting fixes #1509 (@​ianthomas23)
• chore: update pre-commit hooks #1508 (@​Carreau)
• chore: update pre-commit hooks #1502 (@​ianthomas23)
• Removed pinning of virtualenv #1501 (@​JohanMabille)
• Fixed a flaky windows test #1500 (@​adityawasudeo, @​JohanMabille, @​ianthomas23)
• Switch from using nest-asyncio to nest-asyncio2 #1499 (@​ianthomas23)
• Temporary pin virtualenv < 21 #1498 (@​ianthomas23)
• Reintroduce changing base method to async #1497 (@​ianthomas23)
• chore: update pre-commit hooks #1495 (@​ianthomas23)

Other merged PRs

• Bump the actions group across 1 directory with 2 updates #1513 (@​Carreau, @​minrk)

Contributors to this release

The following people contributed discussions, new ideas, code and documentation contributions, and review. See our definition of contributors.

(GitHub contributors page for this release)

... (truncated)

Changelog

Sourced from ipykernel's changelog.

7.3.0

(Full Changelog)

New features added

• feat(displayhook): add register_hook/unregister_hook to ZMQShellDisplayHook #1522 (@​rgbkrk, @​minrk)
• Support ZMQ Curve for transport encryption #1515 (@​krassowski, @​Carreau, @​minrk)

Enhancements made

• Support new iPython system_raise_on_error flag in ZMQInteractiveShell #1496 (@​adityawasudeo, @​ianthomas23)
• pass cell_meta from do_execute to run_cell #1475 (@​erawn, @​P4X-ng, @​ianthomas23)

Bugs fixed

• Fix broken IPython Reference URL in help_links #1526 (@​goelakash, @​Carreau, @​JohanMabille, @​krassowski)
• Mark cell execution as failing when formatter errors out #1521 (@​krassowski, @​Carreau)
• Fix ENOTSOCK traceback when iopub socket closes during shutdown #1518 (@​Carreau, @​minrk)
• Bugfix: Ensure that we take a copy of the sys.modules before iterating over it #1514 (@​pelson, @​Carreau)

Maintenance and upkeep improvements

• build docs on latest python #1525 (@​Carreau)
• Fix recent debugpy failures #1524 (@​Carreau)
• Unpin Spinx now that typehints issue ought to be resolved #1517 (@​krassowski, @​Carreau)
• Fix downstream test: do not use editable install for ipyparallel #1516 (@​krassowski, @​Carreau)
• Linting fixes #1509 (@​ianthomas23)
• chore: update pre-commit hooks #1508 (@​Carreau)
• chore: update pre-commit hooks #1502 (@​ianthomas23)
• Removed pinning of virtualenv #1501 (@​JohanMabille)
• Fixed a flaky windows test #1500 (@​adityawasudeo, @​JohanMabille, @​ianthomas23)
• Switch from using nest-asyncio to nest-asyncio2 #1499 (@​ianthomas23)
• Temporary pin virtualenv < 21 #1498 (@​ianthomas23)
• Reintroduce changing base method to async #1497 (@​ianthomas23)
• chore: update pre-commit hooks #1495 (@​ianthomas23)

Other merged PRs

• Bump the actions group across 1 directory with 2 updates #1513 (@​Carreau, @​minrk)

Contributors to this release

The following people contributed discussions, new ideas, code and documentation contributions, and review. See our definition of contributors.

(GitHub contributors page for this release)

@​adityawasudeo (activity) | @​Carreau (activity) | @​erawn (activity) | @​goelakash (activity) | @​ianthomas23 (activity) | @​JohanMabille (activity) | @​krassowski (activity) | @​minrk (activity) | @​P4X-ng (activity) | @​pelson (activity) | @​rgbkrk (activity)

... (truncated)

Commits

• 5dbd5ce Publish 7.3.0
• 28e9cf8 chore: update pre-commit hooks (#1508)
• 4e4f82c Support ZMQ Curve for transport encryption (#1515)
• b64f597 Merge branch 'main' into curve-encryption
• 6fc8b58 Fix broken IPython Reference URL in help_links (#1526)
• cd6f460 Fix typing due to new jupyter_client version
• b0678ba Update pyproject.toml to depend on jupyter_client 8.9.0 rather than branch
• 2157ae7 Update tests to reflact rename to "auto"
• 336971e build docs on latest python (#1525)
• 7ecb521 Fix tests
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore <dependency name> major version will close this group update PR and stop Dependabot creating any more for the specific dependency's major version (unless you unignore this specific dependency's major version or upgrade to it yourself)
• @dependabot ignore <dependency name> minor version will close this group update PR and stop Dependabot creating any more for the specific dependency's minor version (unless you unignore this specific dependency's minor version or upgrade to it yourself)
• @dependabot ignore <dependency name> will close this group update PR and stop Dependabot creating any more for the specific dependency (unless you unignore this specific dependency or upgrade to it yourself)
• @dependabot unignore <dependency name> will remove all of the ignore conditions of the specified dependency
• @dependabot unignore <dependency name> <ignore condition> will remove the ignore condition of the specified dependency and ignore conditions

[lipikaramaswamy]

@dependabot recreate