Skip to content

feat(config): add context compression policy - #11556

Open
localai-org-maint-bot wants to merge 2 commits into
masterfrom
cron/issue-9534-context-compression-20260816
Open

feat(config): add context compression policy#11556
localai-org-maint-bot wants to merge 2 commits into
masterfrom
cron/issue-9534-context-compression-20260816

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

  • add the opt-in per-model compression configuration contract
  • cover YAML decoding for every proposed policy field
  • document the configuration and its current runtime status

This is the configuration foundation for #9534. It does not close the issue: the chat request transformation and summarizer invocation remain follow-up work.

Verification

  • git diff --check HEAD^ HEAD
  • go test ./core/config could not run because this fresh worktree lacks generated pkg/grpc/proto sources
  • make protogen could not restore them because the environment denied the protobuf compiler download with HTTP 403

Notes for Reviewers

The schema stays disabled by default. The documentation warns that enabling it does not transform requests until the middleware lands.

Signed commits

  • Yes, I signed my commits.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Define the opt-in model configuration contract before the chat middleware consumes it. Document each policy field so later request handling does not invent a second schema.\n\nRefs #9534\n\nAssisted-by: Codex:gpt-5
The model editor metadata gate rejects new config fields without descriptions and suitable controls. Register the compression policy so operators can edit its six fields safely.

Assisted-by: Codex:gpt-5 [monitoring-prs]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant