Hybrid cache (SSM/conv) + unified hybrid support gate
Cache and admit-path foundations for lfm2 / nemotron_h / qwen3_5_moe linear-attn layers.
Spec: doc/plans/engine-inference-core.md § E3
Part of: #106 (E3) · Epic: #56
Tasks - cache
Tasks - support gate unification
Carried from PR #99 second review (finding 6), deferred until hybrid is first-class:
Today pure-dense qwen3_5 rejects hybrid via three overlapping checks:
linear_num_key_heads > 0 || linear_num_value_heads > 0
has_hybrid_layers (via shared reject_dense_common)
- Loop over
layer_is_global when has_explicit_layer_types
Refs
Hybrid cache (SSM/conv) + unified hybrid support gate
Cache and admit-path foundations for lfm2 / nemotron_h / qwen3_5_moe linear-attn layers.
Spec:
doc/plans/engine-inference-core.md§ E3Part of: #106 (E3) · Epic: #56
Tasks - cache
SSMCacheEntrysemantics)nextChunkEnd)Tasks - support gate unification
Carried from PR #99 second review (finding 6), deferred until hybrid is first-class:
Today pure-dense qwen3_5 rejects hybrid via three overlapping checks:
linear_num_key_heads > 0 || linear_num_value_heads > 0has_hybrid_layers(via sharedreject_dense_common)layer_is_globalwhenhas_explicit_layer_typesRefs