Skip to content

Adjust the operators so they handle batched requests #5

Description

@karlhigley

Operators:

  • Feast
  • Tensorflow
  • Faiss
  • ...

Open Questions:

  • How to use async in TritonPythonModel and OperatorRunner (execute becomes async, does transform?)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions