Ex Google & Meta PM, Mark Rose, does a mock interview on ChatGPT-5 metrics. The question: "How would you measure the success of ChatGPT-5?" 🎥 Timestamps: 00:00 Introduction 00:30 The Question 00:40 Clarifying Questions 01:15 The Framework 02:07 The mission 04:50 Lesson 1 05:06 GPT-5 model 08:21 Monetization Metrics 11:53 Lesson 2 12:04 How to Measure Metrics 14:09 Counter Metrics 16:42 Lesson 3 16:49 North Star 18:56 Lesson 4 19:48 Aakash Feedback 20:50 Where to Find Mark Full deep dive: 🤵🏻 Featured Expert: Mark Rose—Product Management Coach • Former PM at Google & Facebook • Helped hundreds land FAANG roles • Specializes in analytics, strategy & leadership interviews • Get coaching: His Linkedin: 👤 Where to find Aakash: Twitter: LinkedIn: Instagram: 🔑 Key Takeaways: 1. Mark started with stakeholders and goals before jumping into specific metrics. He mapped out consumers, companies, governments, and OpenAI to understand what each group actually cares about. This foundation helped him build relevant measurements instead of random KPIs. 2, Traditional engagement metrics fail for AI products because users want problems solved quickly, not extended sessions. Mark defined "jobs completed" as when someone accomplishes their intent efficiently - whether that takes one query or three queries. 3. With massive infrastructure costs, every query needs to generate more revenue than it costs to process. Mark broke this down to per-query economics, emphasizing that scaling to millions of users only works if the unit economics are sustainable from day one. 4. Mark insisted on tracking "jobs not done" alongside success metrics. He also mentioned API error rates, latency issues, and hallucination rates as essential guardrails to prevent optimizing for the wrong behaviors. 5. When I challenged him on operationalizing "jobs completed," Mark acknowledged the concern, explained the data science collaboration needed, then smoothly returned to his framework. He didn't get defensive or derailed by the pushback. About Product Growth: The world's largest newsletter and podcast focused solely on product + growth, with over 176K listeners. Hosted by Aakash Gupta, who spent 16 years in PM rising to VP of product. 📚 Want More Mock Interviews? This is part of our Mock Interview Masterclass series featuring top PMs from Google, Meta, Stripe, and more tackling real interview questions with zero prep time. 🔔 Subscribe and hit the bell for more real interview practice! --- #productmanagement #mockinterview











