Forward Deployed

Basil Chatha

Discover how leading enterprises and professionals turn AI into real products. Hear candid conversations with executives and builders who deploy AI at scale and learn what works (and what doesn't).

एपिसोड

  1. He Built a $200M AI Agent 10 Years Before ChatGPT

    28 जन॰

    He Built a $200M AI Agent 10 Years Before ChatGPT

    Summary:In this conversation, I talked to Ashish Shubham (VP of Engineering), who's been at ThoughtSpot for 10 years, about AI agents in enterprise analytics. ThoughtSpot started as a search-based analytics company trying to make data accessible to regular business users. In 2019, they tried building natural language interfaces using BERT, but only hit about 50% accuracy. For a product where enterprise customers make billion-dollar decisions, that wasn't good enough. They shelved the project.When ChatGPT came out, ThoughtSpot was ready. Ashish walked me through how they pivoted: they built a 25-30 person team, decided to use prompting instead of fine-tuning, and leveraged their existing semantic data modeling layer to get accuracy into the high 90s. We got into the technical evolution from monolithic systems to agent architectures with tools, how they went from manual human judges to using LLMs to evaluate their outputs, and how enterprise security requirements shaped what they built.We also talked about how software engineering is changing. Ashish said 50-60% of his code is AI-generated now, and he thinks system design is becoming the critical skill, even for junior engineers. He had an interesting take on the "95% of AI deployments fail" stat too. Chapters: 0:00 Intro and Ashish's journey to ThoughtSpot from GoDaddy 0:13 ThoughtSpot's mission to democratize data analytics for business users 1:26 Early search-based analytics before natural language processing 2:36 ThoughtSpot vs Tableau and the promise of self-service analytics 4:40 The analyst bottleneck problem and how ThoughtSpot aimed to solve it 5:49 Early technical challenges with in-memory databases and data migration 8:11 Semantic data models, joins, and creating abstraction layers for users 11:39 Who builds the data models and the role of analysts 12:22 Pre-LLM natural language processing using BERT and word2vec in 2018-2019 14:43 The accuracy problem and ambiguity in translating user queries 16:58 Trust challenges and why the early NLP product never became core 19:59 Competition with Tableau, Looker, and Power BI 22:44 How analyst roles changed with self-service analytics tools 25:30 The ChatGPT moment and pivoting to LLM-powered natural language 27:48 Early prompt engineering days and generating SQL with LLMs 31:09 Training vs prompting debate and why fine-tuning was eventually abandoned 34:28 Organizational changes and building the NLS team 37:16 Coaching systems for company-specific terminology vs training models 39:02 Evolution of evaluation methods from human judges to LLM-as-judge 43:23 Moving to LangFuse and GCP for agent infrastructure 46:29 How LLM context windows and capabilities evolved their product 50:07 From 30-column limits to agentic systems with 90%+ accuracy 52:52 RAG, column selection, and using proprietary data indexes 54:59 Multi-model support and enterprise data security concerns 59:14 How AI has changed Ashish's personal engineering workflow 1:02:42 Impact of AI on the broader engineering organization 1:04:15 Measuring AI productivity and the challenge of metrics 1:07:26 50-60% AI-generated code and the changing nature of coding 1:09:18 System design skills becoming more important than coding 1:13:00 Junior engineers doing senior-level work and interview changes 1:14:37 Customer conversations about Gen AI adoption across industries 1:17:26 The MIT report on 95% agent failures and why it misses the point 1:22:12 Agent architecture with LangGraph vs Google ADK and building internal agent platform 1:24:26 Where value lies in the next two years: tools, skills, and optimization 1:28:05 Startup opportunities in making AI accessible to non-technical users 1:29:26 Closing remarks

    1 घं॰ 31 मि॰
  2. He Led AI Transformation for Angry Birds. Then He Quit.

    7 जन॰

    He Led AI Transformation for Angry Birds. Then He Quit.

    In this conversation, Tatu discusses the transformative impact of AI on game development, drawing from his extensive experience in the gaming industry. He highlights the shift from traditional game development processes to a more agile, AI-driven approach that allows for rapid prototyping and iteration. Tatu emphasizes the importance of organizational change and the need for leaders to embrace AI as a core part of their strategy. He also explores the evolving role of product managers, the challenges of user acquisition, and the future of marketing in a saturated gaming market. The discussion culminates in Tatu's vision for his new AI-native game studio, aiming to disrupt the industry by leveraging cutting-edge technology to create high-quality games at unprecedented speed. Takeaways: AI is condensing the time and resources needed for game development.Organizational inertia can hinder the adoption of AI in large companies.The future of game development will require T-shaped professionals with diverse skills.AI will fundamentally change the economics of the gaming industry.Smaller companies can leverage AI to outmaneuver larger competitors.The role of product managers will evolve as AI takes over prioritization tasks.Marketing strategies will need to adapt to a more saturated market.User acquisition costs are expected to rise due to increased competition.Novelty may not be as valuable as familiarity in a saturated market.The future of entertainment will see a rise in fast, iterative game development. Chapters: 00:00 The Evolution of Game Development with AI 03:07 From Web Design to Gaming: A Career Journey 05:50 The Impact of AI on Knowledge Work 09:07 The Changing Landscape of Game Development 11:53 Organizational Inertia and the Future of Gaming Companies 14:55 The Role of AI in Transforming Game Development 17:57 Navigating the Challenges of AI Adoption 21:08 The Future of Game Development Methodologies 23:46 The Role of Product Managers in an AI-Driven World 26:47 Marketing Strategies in the Gaming Industry 29:59 The Role of Publishers in Game Development 33:05 The Future of User Acquisition in Gaming 36:02 The Changing Economics of Game Development 38:56 The Future of Software Development 42:13 The Role of Novelty in Game Development 45:04 The Importance of Familiarity in a Saturated Market 48:12 The Future of Fast Entertainment 50:59 Leveraging Licensing for Success 54:02 The Journey from Rovio to AI Native Gaming 57:02 Building Tools for Rapid Game Development 59:57 The Vision for Future Games 01:03:04 AI Adoption in Organizations: A Leader's Perspective

    1 घं॰ 16 मि॰

परिचय

Discover how leading enterprises and professionals turn AI into real products. Hear candid conversations with executives and builders who deploy AI at scale and learn what works (and what doesn't).