Sequential A/B Testing Framework in Python
-
Updated
Apr 19, 2026 - Python
Sequential A/B Testing Framework in Python
Always-valid sequential A/B testing engine: mSPRT confidence sequences make peeking safe by construction, CUPED cuts variance up to 49%, SRM gates bad data. Built-in adversarial peeking harness proves the claim: naive daily peeking hit 27.5% false positives in 2,000 simulations; this engine held 1.7%. All numbers reproducible from committed seeds.
Add a description, image, and links to the always-valid-inference topic page so that developers can more easily learn about it.
To associate your repository with the always-valid-inference topic, visit your repo's landing page and select "manage topics."