Why A/B Testing Sucks
Most teams don’t have a problem with running experiments; they have a problem with how they interpret them. This talk shows how our industry’s obsession with p-values, “95% significance,” and single-number uplifts quietly leads to bad product decisions, misunderstood results, and wasted opportunities. Instead of yet another stats lecture, we’ll unpack how A/B tests and p-values can easily get misread in practice and why classical significance testing is so hard to explain to stakeholders.
Then, we’ll explore a more intuitive way to talk about experiments: in terms of the probability of uplift, minimum expected impact, and business value, not arbitrary thresholds. You’ll walk away with practical guidance and report patterns you can use tomorrow. So that your A/B tests stop “sucking” and start supporting clearer, more honest decisions in your product team.
Speaker
Dr.-Ing. Maximilian Speicher is Director of Product Design at BESTSECRET. His (research) interests lie primarily with novel ways to do UX research and design, responsible and sustainable design, and beyond-screen and physical–digital interaction. He is also a freelance UX and product consultant, plays ringtennis, and blogs at maxspeicher.com/newsletter.
Hosts
This event is hosted by UX Hub BCN in partnership with Hatch Conference
Location: Wallapop HQ
To join us, just:
✅ RSVP here on Meetup
✅ RSVP here on Hatch conference - mixers.hatchconference.com/e/barcelona-uxhub
✅ Answer this form
Details:
🗓️ Date: Wednesday, September 16, 2026
⏰ Time: 18:30 CET
📍 Location: Wallapop HQ
Why You’ll Love It:
Learn how to stop misinterpreting A/B tests and start making clearer, more confident product decisions with frameworks and reporting patterns you can use tomorrow.
Agenda:
18:30\-19:00 \| Doors open
19:00–19:15 \| Introduction
19:15–18:55 \| Talk
18:55–19:15 \| Live Q&A
Educational partners:
Interaction Design Foundation
Uxce