3-Bullet Thursday – 23/12/2021
A wonderful way to display the learnings from AB tests, why metrics-driven development is hard (and what to do about it), and an overview of Product Operations from SVPG.
Hi friends 👋
I hope you find these as interesting as I did!
A Free Trial Paywall Challenge
I’ve put this in for 2 reasons:
I thought it was a very different way to display the results of an AB test and one I’d like to see more of.
I found the psychology particularly interesting. For example, here’s a great example of the Goal Gradient Effect; something I’m sure could be used to improve myriad forms and onboarding journeys:
Metrics-Driven Product Development is Hard
Daniel’s short post packs an outsized punch, digging in to:
The challenges of balancing long and short-term success.
How to ensure your short-term successes combine for greater long-term success.
Why lagging indicators (eg. revenue, retention) should be paired with leading indicators (eg. the % of users who perform a specific action).
Product Ops Overview
I’ve been going down a Product Operations rabbit-hole recently so it was well timed by SVPG to publish this post on the subject. Marty covers 6 models, the first 5 of which he suggests are usually quite problematic:
The Reincarnated PMO Model
The Two-in-a-Box PM Model
The Delegated Product Leader Model
Production Operations Rebranding Model
The Product Marketing Manager Rebranding Model
The Force Multiplier Model
Number 6, the Force Multiplier Model, breaks down in to smaller sections, namely “quantitative insights”, “qualitative insights”, and “tools and best practices evangelism”. This is the model he hopes companies will consider adopting.
John Cutler, Head of Education at Amplitude, gave me similar advice on a call earlier this week. To paraphrase: “Product Ops will help you do what you’re already doing better and faster.”