top | item 39548840

Show HN: I built a tool to visualize and understand A/B tests results

4 points| nick-keller | 2 years ago |tggl.io

I am a visual learner and I like interacting with things to build an intuitive understanding.

I decided to build a tool that lets you input and play with your A/B test data. It should help you understand how the number of users or the conversion rates visually impact the statistical significance.

I actually understood many things while playing with it in a new way, I could even find an interesting way to graphically show the p-value and really SEE what it meant.

Any feedback is appreciated.

2 comments

order

injb|2 years ago

That's cool! I think it would be nice to show the actual % chance that the change seen is random when the slider is moved below the significant threshold. Is that possible?

nick-keller|2 years ago

Interesting, yes that would be nice actually. I just have to display the p-value. Thanks for the feedback!