chore(deps): bump mlflow from 3.10.0 to 3.14.0 by dependabot[bot] · Pull Request #435 · twsl/lit-mlflow

dependabot · 2026-04-13T17:13:57Z

Bumps mlflow from 3.10.0 to 3.14.0.

Release notes

v3.14.0

MLflow 3.14.0 includes several major features and improvements

Major New Features

🚀 One-command agent onboarding with mlflow agent setup: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command.

⚡ Durable, low-latency tracing for Claude Code: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash.

📝 Review Queues for traces: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation.

🗂️ Revamped evaluation dataset UI: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace.

🧪 Pytest integration for regression testing: Write GenAI regression tests as plain pytest functions with the @mlflow.test marker, gate them in CI, and review test history and per-assertion judge results in the UI.

🎛️ LLM Playground: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables.

Breaking Changes

[Models] Change mlflow.sklearn serialization_format default from cloudpickle to skops (#23987, @copilot-swe-agent)

[Models] Change serialization_format default to "pt2" for mlflow.pytorch.log_model and mlflow.pytorch.save_model (#23988, @copilot-swe-agent)

[Models] Change serialization_format default to "skops" in mlflow.lightgbm log_model/save_model (#23986, @copilot-swe-agent)

Other Assorted Features & Improvements:

[Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62)

[Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62)

[Prompts] Prompt Playground (#23273, @TomeHirata)

[Evaluation] [2/3] Add EvaluationResult.passed/.reason for @mlflow.test assertions (#23869, @B-Step62)

[UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db)

[UI] Add shareable review queue URLs with a startReview deep link (#23941, @harupy)

[UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db)

[Tracing] Add x-mlflow-run-id support to OTLP trace ingestion (#23664, @sanatb187)

[Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62)

[UI] Improve review queue empty states with onboarding content (#23903, @B-Step62)

[UI] Add mlflow skills view/list CLI (#23907, @joshuawong-db)

[UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62)

[Tracing] Add MLFLOW_WORKSPACE support to OSS auth provider (#23927, @Nehanth)

[Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata)

[Evaluation] Add MLFLOW_GENAI_JUDGE_DEFAULT_MODEL environment variable (#23860, @B-Step62)

[Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db)

[Evaluation] Add rule-based built-in scorers: RegexMatch, PIIDetection, ResponseLength (#22571, @debu-sinha)

[Tracing] Support Databricks backend in mlflow agent setup (#23783, @harupy)

[Evaluation] Add POST /mlflow/genai/evaluate/invoke handler & job for UI-triggered eval runs (#23779, @aaronteo-db)

[Tracing] [Claude Code] Support UC trace location via MLFLOW_TRACE_LOCATION (#23770, @B-Step62)

[Tracing] [Codex] Support UC trace location via MLFLOW_TRACE_LOCATION (#23771, @B-Step62)

[Evaluation / Tracking] [3/N] Label schemas: handlers + SDK + REST client (#23603, @kriscon-db)

[Tracing / Tracking] Add run_id support for trace APIs (#23629, @sanatb187)

[Evaluation / UI] Dataset v2 port (#23560, @B-Step62)

[Evaluation / Tracking] Add OSS-native label schema entity, validation, and SQL store (#23597, @kriscon-db)

[Tracing] Support mapping gen_ai.conversation.id to MLflow trace session (#23584, @SahilKumar75)

[Tracing / UI] Added polling logic to live check and auto-refresh traces tab empty state with trace first ingestion (#23184, @vivian-xie-db)

[Tracing] Add MlflowWalSpanExporter to hand traces off to the WAL daemon (#23641, @aaronteo-db)

[Tracing] Support native UC trace ingestion from TypeScript SDK (#23562, @B-Step62)

[Evaluation] Add Google ADK LLM judge scorers (Hallucination, Safety, ResponseEvaluation) (#22496, @debu-sinha)

... (truncated)

Changelog

Sourced from mlflow's changelog.

3.14.0 (2026-06-17)

MLflow 3.14.0 includes several major features and improvements

Major New Features

🚀 One-command agent onboarding with mlflow agent setup: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command.

⚡ Durable, low-latency tracing for Claude Code: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash.

📝 Review Queues for traces: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation.

🗂️ Revamped evaluation dataset UI: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace.

🧪 Pytest integration for regression testing: Write GenAI regression tests as plain pytest functions with the @mlflow.test marker, gate them in CI, and review test history and per-assertion judge results in the UI.

🎛️ LLM Playground: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables.

Breaking Changes

[Models] Change mlflow.sklearn serialization_format default from cloudpickle to skops (#23987, @copilot-swe-agent)

[Models] Change serialization_format default to "pt2" for mlflow.pytorch.log_model and mlflow.pytorch.save_model (#23988, @copilot-swe-agent)

[Models] Change serialization_format default to "skops" in mlflow.lightgbm log_model/save_model (#23986, @copilot-swe-agent)

Other Assorted Features & Improvements:

[Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62)

[Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62)

[Prompts] Prompt Playground (#23273, @TomeHirata)

[Evaluation] [2/3] Add EvaluationResult.passed/.reason for @mlflow.test assertions (#23869, @B-Step62)

[UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db)

[UI] Add shareable review queue URLs with a startReview deep link (#23941, @harupy)

[UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db)

[Tracing] Add x-mlflow-run-id support to OTLP trace ingestion (#23664, @sanatb187)

[Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62)

[UI] Improve review queue empty states with onboarding content (#23903, @B-Step62)

[UI] Add mlflow skills view/list CLI (#23907, @joshuawong-db)

[UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62)

[Tracing] Add MLFLOW_WORKSPACE support to OSS auth provider (#23927, @Nehanth)

[Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata)

[Evaluation] Add MLFLOW_GENAI_JUDGE_DEFAULT_MODEL environment variable (#23860, @B-Step62)

[Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db)

[Evaluation] Add rule-based built-in scorers: RegexMatch, PIIDetection, ResponseLength (#22571, @debu-sinha)

[Tracing] Support Databricks backend in mlflow agent setup (#23783, @harupy)

[Evaluation] Add POST /mlflow/genai/evaluate/invoke handler & job for UI-triggered eval runs (#23779, @aaronteo-db)

[Tracing] [Claude Code] Support UC trace location via MLFLOW_TRACE_LOCATION (#23770, @B-Step62)

[Tracing] [Codex] Support UC trace location via MLFLOW_TRACE_LOCATION (#23771, @B-Step62)

[Evaluation / Tracking] [3/N] Label schemas: handlers + SDK + REST client (#23603, @kriscon-db)

[Tracing / Tracking] Add run_id support for trace APIs (#23629, @sanatb187)

[Evaluation / UI] Dataset v2 port (#23560, @B-Step62)

[Evaluation / Tracking] Add OSS-native label schema entity, validation, and SQL store (#23597, @kriscon-db)

[Tracing] Support mapping gen_ai.conversation.id to MLflow trace session (#23584, @SahilKumar75)

[Tracing / UI] Added polling logic to live check and auto-refresh traces tab empty state with trace first ingestion (#23184, @vivian-xie-db)

[Tracing] Add MlflowWalSpanExporter to hand traces off to the WAL daemon (#23641, @aaronteo-db)

[Tracing] Support native UC trace ingestion from TypeScript SDK (#23562, @B-Step62)

... (truncated)

Commits

86cd7f5 Bump version to 3.14.0 (#24052)
2db0fed Add docs page for @mlflow.test pytest regression testing (#24011)
6786bef [3/3] Show regression-test results in the existing eval-run UI (#23985)
fb1a4ed Skip tracking backend prompt in mlflow agent setup when `MLFLOW_TRACKING_UR...
4d7a1b3 Fix ChrfScore RAGAS scorer instantiation due to class name mismatch (#24047)
a64ca84 [Fix] Restore scrolling in the Playground conversation area (#24042)
03dd3d2 Fix make_judge doc: self-referential deprecation note and link typo (#24046)
1b64388 [Fix] Map OpenAI Agents SDK guardrail spans to SpanType.GUARDRAIL (#24044)
4b60b87 Add "Save prompt to registry" action to the Prompt Playground (#24021)
437d9f6 Surface review-question modal failures as toasts (#24035)
Additional commits viewable in compare view

github-actions · 2026-04-13T17:15:34Z

Code Coverage Linux 3.11

Package	Line Rate	Branch Rate	Health
.	36%	0%	❌
utils	18%	0%	❌
Summary	34% (114 / 335)	0% (0 / 134)	❌

Results for commit 60d245a.

github-actions · 2026-04-13T17:15:37Z

Code Coverage Linux 3.12

Package	Line Rate	Branch Rate	Health
.	36%	0%	❌
utils	18%	0%	❌
Summary	34% (114 / 335)	0% (0 / 134)	❌

Results for commit 60d245a.

github-actions · 2026-04-13T17:15:42Z

Test Results Linux 3.11

1 tests 1 ✅ 18s ⏱️
1 suites 0 💤
1 files 0 ❌

Results for commit 6e5a298.

♻️ This comment has been updated with latest results.

github-actions · 2026-04-13T17:15:44Z

Test Results Linux 3.12

1 tests 1 ✅ 25s ⏱️
1 suites 0 💤
1 files 0 ❌

Results for commit 6e5a298.

♻️ This comment has been updated with latest results.

twsl · 2026-07-28T12:39:03Z

@dependabot rebase

Bumps [mlflow](https://github.com/mlflow/mlflow) from 3.10.0 to 3.14.0. - [Release notes](https://github.com/mlflow/mlflow/releases) - [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md) - [Commits](mlflow/mlflow@v3.10.0...v3.14.0) --- updated-dependencies: - dependency-name: mlflow dependency-version: 3.11.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>

dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Apr 13, 2026

dependabot Bot requested a review from twsl as a code owner April 13, 2026 17:13

dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Apr 13, 2026

dependabot Bot mentioned this pull request Apr 13, 2026

chore(deps): bump mlflow from 3.10.0 to 3.10.1 #420

Closed

dependabot Bot changed the title ~~chore(deps): bump mlflow from 3.10.0 to 3.11.1~~ chore(deps): bump mlflow from 3.10.0 to 3.14.0 Jul 28, 2026

dependabot Bot force-pushed the dependabot/uv/mlflow-3.11.1 branch from dbe249e to 6e5a298 Compare July 28, 2026 12:40

twsl approved these changes Jul 29, 2026

View reviewed changes

twsl merged commit 0b91005 into main Jul 29, 2026
10 checks passed

dependabot Bot deleted the dependabot/uv/mlflow-3.11.1 branch July 29, 2026 07:05

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore(deps): bump mlflow from 3.10.0 to 3.14.0 - #435

chore(deps): bump mlflow from 3.10.0 to 3.14.0#435
twsl merged 1 commit into
mainfrom
dependabot/uv/mlflow-3.11.1

dependabot Bot commented on behalf of github Apr 13, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 13, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 13, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 13, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Apr 13, 2026 •

edited

Loading

Uh oh!

twsl commented Jul 28, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dependabot Bot commented on behalf of github Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

v3.14.0

Major New Features

Breaking Changes

Other Assorted Features & Improvements:

3.14.0 (2026-06-17)

Major New Features

Breaking Changes

Other Assorted Features & Improvements:

Uh oh!

github-actions Bot commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Code Coverage Linux 3.11

Uh oh!

github-actions Bot commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Code Coverage Linux 3.12

Uh oh!

github-actions Bot commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Results Linux 3.11

Uh oh!

github-actions Bot commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Test Results Linux 3.12

Uh oh!

twsl commented Jul 28, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

dependabot Bot commented on behalf of github Apr 13, 2026 •

edited

Loading

github-actions Bot commented Apr 13, 2026 •

edited

Loading

github-actions Bot commented Apr 13, 2026 •

edited

Loading

github-actions Bot commented Apr 13, 2026 •

edited

Loading

github-actions Bot commented Apr 13, 2026 •

edited

Loading