Cancel the requests in streaming case by default when closing the connection - #781

Cancel the requests in streaming case by default when closing the connection#781

Tabrizian wants to merge 4 commits into

maintriton-inference-server/client:mainfrom

imant-cancel-closetriton-inference-server/client:imant-cancel-closeCopy head branch name to clipboard