PERF: reduce Xavier GPU snapshot eviction overhead - #5624

PERF: reduce Xavier GPU snapshot eviction overhead#5624

qinxuye merged 4 commits into

xorbitsai:mainxorbitsai/inference:mainfrom

qinxuye:perf/xavier-packed-snapshot-demotionqinxuye/inference:perf/xavier-packed-snapshot-demotionCopy head branch name to clipboard