Watch the Full Interview
Navigating Uncertainty: How This Product Manager Decided When to Reopen Retail Stores During COVID
Are Right A LotExpert Roundtable
4 experts discuss this interview
Marcus Johnson
Director of Product
Sarah Chen
VP of Engineering
Jordan Taylor
Senior Client Success Manager
Priya Sharma
Head of Growth
Discussing:
Panel review of Are Right A Lot response
The candidate's instinct to go with the feature that 'felt right' for users shows some customer empathy, but they didn't start with the actual customer problem or any data from interviews to validate it. There's no mention of trade-offs or a prioritization framework, like weighing outcomes against other hypotheses. I wonder if this gut approach scales when influencing stakeholders across functions.
I see ownership in their decision-making instincts, but they skipped any systems-level thinking about alternatives, like technical feasibility or scalability impacts. No reflection on how engineering input might have changed the path or quantified the business impact. That's a pushback for me at this level - senior PMs need to show they own the full stack of trade-offs.
Their proactive instinct on what drives adoption is a green flag, but they didn't tie it to customer relationships or risks identified through conversations. No mention of multi-threading with clients to validate the decision or have tough talks about alternatives. From the customer's side, I'd want to see more evidence they build trust before betting on gut feel.
Good instincts on funnel impact, but zero discussion of experiments, hypotheses, or data to weigh options - like A/B tests or CAC implications of alternatives. They just landed on the 'right' path without explaining attribution or conversion metrics. I'd want to test if this scales by running a quick experiment on their decision process.
Sarah, I agree we need more ownership of trade-offs like technical feasibility, and Jordan, tying instincts to customer relationships is crucial but missing here. Building on Priya's call for experiments, the candidate's 'felt right' feature choice skips any customer interviews or data to weigh hypotheses against alternatives. I wonder if we're assuming their gut scales without seeing stakeholder influence in action.
Marcus, you're spot on about stakeholder influence, but I want to push back - without systems thinking on scalability, even customer-validated instincts fail at our scale. Priya, I'd extend your experiment idea to include eng input on feasibility before betting on that funnel impact. Jordan's relationship point is valid, yet no reflection on how tech constraints affect client adoption shows a gap in full-stack ownership.
Sarah, I see your point on tech constraints hitting adoption, and Marcus, customer interviews are key to building that trust before gut decisions. But from the customer's side, Priya, their lack of proactive risk talks or multi-threading means no evidence the 'felt right' path avoided churn. Exactly, and we'd need tough conversations to validate outcomes, not just instincts.
Jordan, building on your trust foundation, we'd test the 'felt right' choice with A/B experiments on conversion rates to prove funnel lift. Sarah and Marcus, I agree - adding attribution for CAC and eng feasibility turns instincts into scalable hypotheses. But without quantifying alternatives' impact, like revenue trade-offs, this doesn't show growth readiness.
We've all agreed the candidate's instincts on the 'felt right' feature show customer empathy, but Sarah and I both see gaps in trade-offs and stakeholder influence without data from interviews. Jordan and Priya nailed it - without tying to relationships or experiments, it doesn't demonstrate scalable prioritization. In the end, their gut approach lacks the hypothesis-testing we need to confidently make right calls at this level.
Marcus, spot on about hypothesis-testing, and Priya, extending experiments to eng feasibility aligns perfectly with our shared push for full-stack ownership. Jordan's point on tech constraints affecting adoption reinforces why skipping systems thinking on alternatives is a miss. Overall, the candidate owns instincts but not the quantified impacts or scalability that define senior PMs.
Sarah, your scalability concern directly hits adoption risks, and Marcus, customer interviews are essential for that trust-building we all want. Priya, testing via A/B on conversion would validate multi-threading relationships beyond gut feel. Wrapping up, proactive instincts are promising, but without tough conversations or risk identification, it falls short on outcome-focused relationships.
Jordan, exactly - trust via experiments proves funnel lift without churn risks, and Sarah, adding CAC attribution to eng trade-offs ties it all together. Marcus, our consensus on data over gut scales to revenue hypotheses everyone raised. Ultimately, strong instincts need structured validation like A/B tests on alternatives to show growth potential here.
Panel Consensus
The panel unanimously agrees that the candidate demonstrates promising instincts, such as customer empathy, ownership, proactive adoption thinking, and funnel awareness, which are green flags across their lenses. They consistently highlight shared concerns about the lack of structured validation through data, trade-offs, experiments, systems thinking, and customer relationships, emphasizing that gut decisions do not scale for a senior PM role. While there are no major disagreements, they build on each other - e.g., extending experiments to engineering feasibility and tying relationships to technical constraints - to reinforce the need for full-stack, hypothesis-driven ownership.
Hiring Signals from the Loop
Marcus Johnson
Director of Product
Reason to Hire
Candidate's instinct to choose the feature that 'felt right' for users demonstrates some customer empathy.
Concern
Lacks starting with customer problems or data from interviews, no trade-offs or prioritization framework, and gut approach may not scale for stakeholder influence.
Sarah Chen
VP of Engineering
Reason to Hire
Shows ownership in decision-making instincts.
Concern
Skips systems-level thinking on alternatives like technical feasibility, scalability impacts, or quantified business impact, missing full-stack trade-offs for senior PMs.
Jordan Taylor
Senior Client Success Manager
Reason to Hire
Proactive instinct on what drives adoption is a green flag.
Concern
Fails to tie decisions to customer relationships, proactive risk identification, multi-threading, or tough conversations to validate beyond gut feel.
Priya Sharma
Head of Growth
Reason to Hire
Good instincts on funnel impact.
Concern
No discussion of experiments, hypotheses, data, attribution, or CAC implications to weigh alternatives, lacking structured validation for scalability.