Hi,
Is there a way to reduce disk space usage when building the trtllm_backend given it uses bazel build system to compile c++ code and given it pull lots of libs etc? Disable arm build?
git clone https://github.com/triton-inference-server/tensorrtllm_backend.git
cd tensorrtllm_backend
git checkout --recurse-submodules 49aba4a
docker build -t triton_tensorrtllm -f dockerfile/Dockerfile.triton.trt_llm_backend .
cc @dmitry-tokarev-nv @mc-nv @achartier @chzblych
Hi,
Is there a way to reduce disk space usage when building the trtllm_backend given it uses bazel build system to compile c++ code and given it pull lots of libs etc? Disable arm build?
git clone https://github.com/triton-inference-server/tensorrtllm_backend.git
cd tensorrtllm_backend
git checkout --recurse-submodules 49aba4a
docker build -t triton_tensorrtllm -f dockerfile/Dockerfile.triton.trt_llm_backend .
cc @dmitry-tokarev-nv @mc-nv @achartier @chzblych