Conservation of Intent: The hidden reason why A/B tests aren't as effective as they look at andrewchen

When a +10% isn’t really a +10% OK, this is an infuriating startup experience: You ship an experiment that’s +10% in your conversion funnel. Then your revenue/installs/whatever goes up by +10% right? Wrong :( Turns out usually it goes up a little bit, or maybe not at all. Why is that? Let’s call thi