Skip to content

Support runtime configuration聽#8272

Description

@GregoryComer

馃殌 The feature, motivation and pitch

We need a method for the user to pass in runtime configuration options, especially to specific delegates, but potentially to the core runtime as well. Motivating use cases include enabling/disabling workspace sharing or weight caching in the XNNPACK delegate. Ideally we would be able to expose both global and per-model configurations. @dbort has an older proposal for runtime configuration APIs that we can likely iterate on and implement.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

cc @JacobSzwejbka @dbort

Activity

  1. added
    triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
    on Feb 6, 2025
  2. locked and limited conversation to collaborators on Feb 6, 2025
  3. converted this issue into a discussion #8279 on Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: runtimeIssues related to the core runtime and code under runtime/triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions