Skip to content

[Feature]: Support model allow and deny listing in LLM Provider #2495

Description

@thivindu

Please select the area the issue is related to

Platform API, Gateway, AI Workspace

Please select the aspect the issue is related to

Aspect/API (API backends, definitions, contracts, interfaces, OpenAPI), Aspect/UI (Frontend layouts, components, styling), Aspect/AI (AI/LLM integration, MCP, AI readiness)

Suggested Feature

Currently the model provider and models that we define for a LLM provider in the AI Workspace is not enforced in the Gateway. And the model provider and model that is displayed on the AI Workspace is hardcoded.

Improve this UI/UX to display a allow/deny list for models to that the user can explicitly decide what models can be accessed in the gateway. Furthermore, enforce this in the gateway so that invocations for models that are not allowed are blocked in the gateway.

Related Issues

No response

Steps to Verify

  • Design Document — A detailed design document has been created and reviewed, covering architecture, data flow, and edge cases.
  • Design Mail — A design summary email has been sent to relevant stakeholders for awareness and feedback.
  • Code Review — All code changes have been peer-reviewed and approved according to the project's review standards.
  • Testing — Adequate unit, integration, and/or end-to-end tests have been written and are passing.
  • Documentation — User-facing and/or developer documentation has been updated to reflect the new feature.
  • Feature Complete — The feature is fully implemented, all checklist items above are done, and it is ready for release.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Area/AIGatewayAI Gateway runtime/control plane related issuesArea/AIPoliciesIssues related to policies,guardrails in AI GatewayArea/AIWorkspaceIssues related to AI WorkspaceArea/Platform-APIArea/PolicyEngineAspect/AIAI/LLM integration, MCP, AI readinessAspect/APIAPI definitions, contracts, OpenAPI, interfacesAspect/UIFrontend, visual layouts, components, stylingAspect/UXUser experience, flows, usability, clarity

    Fields

    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions