Behind the Craft

Peter Yang

Expert interviews and guides to help you level up as a product leader and creator fast.

  1. 6 DAYS AGO

    AI Evaluations Crash Course in 50 Minutes (2025) | Hamel Husain

    Today, I want to share a new episode with Hamel Husain. Hamel has trained 2,000+ PMs and engineers from companies like OpenAI, Anthropic, and Google on how to run AI evals. In my new episode, he shares a free master class on how to build evals for a real AI agent in just 50 minutes using a simple spreadsheet. I learned a lot from Hamel and I think you will too. Hamel and I talked about: (00:00) What the most valuable part of evals is (01:25) Live walkthrough: Analyzing 100 real production traces (09:50) Creating the eval criteria using a simple spreadsheet (24:44) Why binary pass/fail ratings beat 1-5 scores every time (28:52) The agreement metric trap that fools most PMs (30:08) True positive and negative rates explained (36:00) How to set up continuous evals in production Get the takeaways: https://creatoreconomy.so/p/ai-evaluations-crash-course-in-50-minutes-hamel-husain Where to find Hamel: X: https://x.com/HamelHusain Website: https://hamel.dev/ 📌 Subscribe to this channel – more interviews coming soon!

    52 min

  2. 21 SEPT

    Full Tutorial: From Design to Code with Claude Code in 40 Minutes | Meaghan Choi

    Today, I want to share a new episode with Meaghan Choi.As the design lead for Claude Code, Meaghan not only designs new features but also ships code on a regular basis. She showed me her exact design to code workflow along with her top 3 use cases for Claude Code. This interview is a must-watch if you’re a designer or PM who dreams of shipping to production. Meaghan and I talked about: (00:00) Why shipping to prod as a designer feels "terrifying and magical" (02:36) Top 3 design workflows with Claude Code (07:20) How designers can get engineers to let them ship code (11:06) Live demo: From Figma design to working code in minutes (19:10) Custom Claude.md files to make AI work for designers (22:47) How Anthropic ships features in days, not months (28:22) Meaghan's favorite Claude Code shortcuts and pro tips (33:58) The future of design roles in an AI-native worldBrought to you by: Linear — The operating system for AI agents. Get 6 months free of Linear Business here: https://linear.app/behind-the-craftWhere to find Meaghan: X: https://x.com/meag_han_c Website: http://clau.de/peteryang📌 Subscribe to this channel – more interviews coming soon!

    39 min

  3. 14 SEPT

    Inside Claude Code: How an AI Native Team Actually Works | Cat Wu

    Today, I want to share a new episode with Cat Wu.Cat is the product lead for Claude Code and I got her to share how one of the most AI-native teams in tech actually works. Highlights include getting user feedback every 10 minutes, going straight to prototypes instead of docs, and designers checking in code directly. Cat also shared her 3 best Claude Code tips and what’s next for the product.Cat and I talked about: (00:00) The process behind the best Claude Code features (05:00) How engineers can own features from idea to launch (10:04) Getting feedback every 10 minutes from 1000+ users (14:00) How designers and PMs can ship production code (19:58) How the Claude Code team does AI evaluations (29:04) 3 tips from Cat to get the most out of Claude Code (30:12) Why your Claude.md file is so important (33:32) What's next for Claude Code Thanks to our sponsor: Lorikeet: The AI concierge that gets it done lorikeetcx.ai/peter My top 10 takeaways: https://creatoreconomy.so/p/inside-claude-code-how-an-ai-native-actually-works-cat-wuWhere to find Cat: X: https://x.com/_catwu Website: https://www.anthropic.com/claude-code 📌 Subscribe to this channel – more interviews coming soon!

    41 min

  4. 7 SEPT

    Full Tutorial: Build an AI Co-Pilot for Your Life with Claude Code | Alex Finn

    Today, I want to share a new episode with Alex Finn.Alex is a founder who has built a complete “Claude Life” operating system to automate research, curate AI news, analyze brain dumps, and more. I asked him to walk through exactly how to set up this system using Claude Code slash commands and sub-agents in just 25 minutes. Alex and I talked about: (00:00) How Alex uses Claude Code to automate his life (04:18) Inside "Claude Life" — Alex’s life operating system (05:29) The newsletter research agent that saves hours weekly (09:09) How to use custom slash commands and sub-agents (14:41) The most important skill that everyone needs in 2025 (18:01) Brain dump analysis to find new content pillars (21:14) Daily brief agent that aggregates AI news Get the takeaways: https://creatoreconomy.so/p/full-tutorial-build-an-ai-life-copilot-with-claude-code-alex-finn Where to find Alex: X: https://x.com/AlexFinnX Website: https://www.creatorbuddy.io/ 📌 Subscribe to this channel – more interviews coming soon!

    26 min

  5. 31 AUG

    Ranking 15 PM Skills: What Survives vs. Gets Disrupted by AI | Nan Yu (Linear)

    Today, I want to share a new episode with Nan Yu (Linear’s Head of Product).Despite only having 2 PMs, Linear has scaled to over 15,000 companies including OpenAI and Ramp. In our chat, Nan and I did a fun exercise to rank what PM skills still matter in the AI era and he also demoed Linear’s new AI agents that can write code, triage tickets, and analyze customer feedback.Nan and I talked about: (00:00) Why Linear is a billion dollar company with just 2 PMs (03:22) Ranking PM skills: What survives vs gets disrupted by AI (11:10) Why strategy is actually being disrupted by AI (21:51) The new skills PMs must build: context and agent management (26:57) Craft vs speed: Linear's 10% rule for shipping fast (38:09) Live demo: Using MCP to analyze customer feedback instantly (53:04) Delegating entire backlogs to AI agents with one command (57:12) Linear's future as an operating system for human-AI collaborationGet the takeaways: https://creatoreconomy.so/p/ranking-every-pm-skill-what-still-matters-gets-disrupted-by-ai-nan-yu-linearWhere to find Nan: X: https://x.com/thenanyu Website: https://linear.app/📌 Subscribe to this channel – more interviews coming soon!

    59 min

  6. 24 AUG

    Complete Beginner's Course on AI Evaluations: Step by Step (2025) | Aman Khan

    Today, I want to share a new episode with Aman Khan.The best way to learn about AI evaluations is to watch 2 PMs build them live from scratch. In our new episode, Aman and I walk through creating evals for an AI customer support agent — from labeling a golden dataset to aligning LLM judges. This is the complete beginners AI eval course you've been waiting for.Aman and I talked about: (00:00) What are AI evals and how to get good at them (02:52) The 4 types of AI evaluations everyone should know (06:08) Live demo: Building evals for a customer support agent (10:29) Using Anthropic's console to generate great prompts (15:13) Creating the evaluation criteria (17:40) Adding human labels to the golden dataset (31:05) Scaling evals with LLM-judge prompts (38:21) How to align LLM judges with human judgmentGet the takeaways: https://creatoreconomy.so/p/complete-beginner-course-on-ai-evaluations-aman-khanWhere to find Aman: X: https://www.linkedin.com/in/amanberkeley/ Website: https://arize.com/📌 Subscribe to this channel – more interviews coming soon!

    52 min

  7. 17 AUG

    Cursor Tutorial for Beginners from Cursor's Head of AI Education (2025) | Lee Robinson

    Today, I want to share a new episode with Lee Robinson.Lee is the VP of Developer Experience at Cursor and a legend in his field. While most people are still vibe coding, Lee showed me how to build apps properly using planning, test-driven development, AI agent workflows, and more. This is a must-watch tutorial for beginners who want to learn how to build with AI the right way.Lee and I talked about: (00:00) How the way we build software is fundamentally changing (03:49) Live demo: Building a music tracking app with Cursor (5:17) The critical setup phase most people skip (tests, git, linting) (16:03) Foreground vs background agents and when to use each (27:34) How to create cursor rules that compound your workflows (37:31) Why experienced engineers shouldn't fear AI tools (42:19) Essential advice for PMs who want to learn technical skills (44:48) How Cursor builds products without any PM (47:18) The future of generalist engineers in an AI world Get the takeaways: https://creatoreconomy.so/p/cursor-tutorial-for-beginners-from-cursor-head-of-ai-education-lee-robinson Where to find Lee: X: https://x.com/leerob Website: https://leerob.com/ 📌 Subscribe to this channel – more tutorials coming soon!

    50 min

  8. 10 AUG

    How to Build an AI Co-Pilot to Help You Ace PM Interviews | Ben Erez (ex-Meta)

    Today, I want to share a new episode with Ben Erez.Ben is a former Meta PM who has helped 100s of people ace their PM interviews and land their dream jobs in tech. I got him to show me exactly how to ace product sense interviews and build an AI-copilot that his students say feels like having a "calibrated interviewer that's available 24/7."Ben and I talked about:(00:00) The current state of the PM job market (02:07) The exact structure of the product sense interview (08:58) How to build your AI interview co-pilot step-by-step (12:36) Live demo: AI co-pilot walking through a Meta interview question (13:33) Why Ben designed the AI to be the candidate, not the interviewer (25:23) How to prioritize the right user segments and problems to solve (32:13) The biggest mistakes candidates make when challenged by interviewersThis episode covers how to build a simple AI co-pilot from scratch, but you should also check out Ben’s advanced interview AI co-pilot: https://www.benerez.com/copilotGet the takeaways: https://creatoreconomy.so/p/how-to-build-an-ai-co-pilot-to-ace-your-pm-interviews-ben-erezWhere to find Ben: LinkedIn: https://www.linkedin.com/in/benerez/ Website: www.benarez.com📌 Subscribe to this channel – more interviews coming soon!

    37 min
See All (76)

About

Expert interviews and guides to help you level up as a product leader and creator fast.

Information

  • Creator
    Peter Yang
  • Years Active
    2024 - 2025
  • Episodes
    76
  • Rating
    Clean
  • Copyright
    © Peter Yang
  • Show Website
    Behind the Craft

You Might Also Like