Skip to content

Define storage & serialization for quantization types MinMax. #992

Open

Description

Define storage & serialization for quantization types (Blanket Issue)

Description

As we expand multi-vector support beyond standard floating-point types, we need a robust storage and serialization strategy for quantized data. Different quantization schemes (e.g., MinMax, Scalar Quantization) require specific metadata—such as scaling factors, zero-points, or offsets—to be stored alongside the compressed vector representations and routed to the Reduce abstraction.

Tasks

  • Define a standardized interface for serializing and deserializing quantized multi-vector data and its associated metadata.
  • Implement the storage layout and serialization logic specifically for MinMax quantization (handling scales and offsets).
  • Ensure the deserialized metadata feeds efficiently into the newly abstracted Reduce pipeline.
  • Blanket Task: Create sub-issues for other required quantization types as needed (e.g., specific SQ variants).

Activity

  1. changed the title [-]Define storage & serialization for quantization types (MinMax, etc.)[/-] [+]Define storage & serialization for quantization types MinMax.[/+] on Jul 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions