ci: Add support for max_inflight_requests parameter to prevent unbounded memory growth in ensemble models - #8458

ci: Add support for max_inflight_requests parameter to prevent unbounded memory growth in ensemble models#8458

pskiran1 merged 36 commits into

maintriton-inference-server/server:mainfrom

spolisetty/tri-26-triton-dali-ensemble-model-memory-issuetriton-inference-server/server:spolisetty/tri-26-triton-dali-ensemble-model-memory-issueCopy head branch name to clipboard