Practitioner’s Guide to Statistical Tests
The two most essential things in A/B tests are the design of the experiments and accurate analysis of the experiments’ results.
In this article, authors will stick to the most common design and compare various statistical analysis procedures, from the very standard t-test and Mann-Whitney test to state-of-the-art approaches like the reweighted bootstrap.
After reading this article, you will learn how to choose the right statistical test from the many available and run it on your own data.
Links:
• Post
• The code to reproduce everything
• The “sandbox” notebook you can use to play with the tests
Navigational hashtags: #armknowledgesharing #armarticles
General hashtags: #ab #abtesting #statistics
@data_science_weekly
6May 3, 2026 468 10
