You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Define storage & serialization for quantization types MinMax. #992
Define storage & serialization for quantization types (Blanket Issue)
Description
As we expand multi-vector support beyond standard floating-point types, we need a robust storage and serialization strategy for quantized data. Different quantization schemes (e.g., MinMax, Scalar Quantization) require specific metadata—such as scaling factors, zero-points, or offsets—to be stored alongside the compressed vector representations and routed to the Reduce abstraction.
Tasks
Define a standardized interface for serializing and deserializing quantized multi-vector data and its associated metadata.
Implement the storage layout and serialization logic specifically for MinMax quantization (handling scales and offsets).
Ensure the deserialized metadata feeds efficiently into the newly abstracted Reduce pipeline.
Blanket Task: Create sub-issues for other required quantization types as needed (e.g., specific SQ variants).
Activity
[-]Define storage & serialization for quantization types (MinMax, etc.)[/-][+]Define storage & serialization for quantization types MinMax.[/+]