fix: count global layers in hybrid KV-cache estimates - #18

fix: count global layers in hybrid KV-cache estimates#18

layer8labs8 merged 1 commit into

layer8labs8:mainlayer8labs8/quantpreflight:mainfrom

Erfouni:fix/hybrid-kv-cache-7Erfouni/quantpreflight:fix/hybrid-kv-cache-7Copy head branch name to clipboard