https://pyvideo.org/2026-03-21T00:00:00+00:002026-03-21T00:00:00+00:002026-03-21T00:00:00+00:00Stephen Pettinatotag:pyvideo.org,2026-03-21:/pycascades-2026/anti-patterns-in-ab-testing-or-how-does-ab-testing-scale.html

<h3>Description</h3><p>AB testing is a tried and true standard across technology companies used extensively for 20+ years, Still it's hard to get right. With vendors and libraries, with better statistics and more experience, companies still struggle to scale AB Testing beyond one artisanal test at time.</p> <p>Learn the language and …</p>

<h3>Description</h3><p>AB testing is a tried and true standard across technology companies used extensively for 20+ years, Still it's hard to get right. With vendors and libraries, with better statistics and more experience, companies still struggle to scale AB Testing beyond one artisanal test at time.</p> <p>Learn the language and systems required to scale AB Testing. Tips and tricks for talking to your manager and stakeholders about the importance of AB Testing as a system and the benefits that happen when it runs like a song.</p> <p>A basic understanding of AB Testing and Python will make this talk fully understandable, but attendees that lack both of these things will still get the general idea of how AB Testing can be hard to scale</p>