perf: reduce Xavier GPU transfer padding with persistent small slabs - #5621

perf: reduce Xavier GPU transfer padding with persistent small slabs#5621

qinxuye merged 3 commits into

xorbitsai:mainxorbitsai/inference:mainfrom

qinxuye:perf/xavier-sized-gpu-slabsqinxuye/inference:perf/xavier-sized-gpu-slabsCopy head branch name to clipboard