Eye On A.I.

Craig S. Smith

Eye on A.I. is a biweekly podcast, hosted by longtime New York Times correspondent Craig S. Smith. In each episode, Craig will talk to people making a difference in artificial intelligence. The podcast aims to put incremental advances into a broader context and consider the global implications of the developing technology. AI is about to change your world, so pay attention.

  1. 1D AGO

    #298 Ryan Kolln: How Appen Trains the World's Most Powerful AI Models

    This episode is sponsored by AGNTCY. Unlock agents at scale with an open Internet of Agents.  Visit https://agntcy.org/ and add your support. How do the world's most powerful AI models get trained and trusted at scale, and what does that really take from data to deployment? In this episode, Appen CEO Ryan Kolln joins Eye on AI to unpack how rigorous human evaluation, culturally aware data, and model-based judges come together to raise real-world performance. In this episode of Eye on AI, host Craig Smith speaks with Ryan Kolln, CEO of Appen, about building evaluation systems that go beyond static benchmarks to measure usefulness, safety, and reliability in production. They explore how human raters and AI evaluators work in tandem, why localization matters across regions and domains, and how quality controls keep feedback signals trustworthy for training and post-training. Ryan explains how evaluation feeds reinforcement strategies, where rubric-driven human judgments inform reward models, and how enterprises can stand up secure workflows for sensitive use cases. He also discusses emerging needs around sovereign models, domain-specific testing, and the shift from general chat to agentic workflows that operate inside real business systems. Learn how leading teams design human-in-the-loop evaluation, when to route judgments from models back to expert reviewers, how to capture cultural nuance without losing universal guardrails, and how to build an evaluation stack that scales from early prototypes to production AI. Stay Updated: Craig Smith on X: https://x.com/craigss  Eye on A.I. on X: https://x.com/EyeOn_AI

    51 min
  2. OCT 16

    #294 Bhaskar Roy: How Workato Is Building the Rise of the Agentic Enterprise

    Try OCI for free at http://oracle.com/eyeonai This episode is sponsored by Oracle. OCI is the next-generation cloud designed for every workload – where you can run any application, including any AI projects, faster and more securely for less. On average, OCI costs 50% less for compute, 70% less for storage, and 80% less for networking.  Join Modal, Skydance Animation, and today's innovative AI tech companies who upgraded to OCI…and saved.   How are enterprises moving from AI experiments to a true agentic enterprise with measurable ROI? In this episode of Eye on AI, host Craig Smith speaks with Bhaskar Roy from Workato about how organizations can design, orchestrate, and govern AI agents at scale without sacrificing security or control. Together they unpack Workato's approach to building a single workspace for employees while agents and apps work behind the scenes to automate real business processes. They explain why the future of enterprise AI depends on orchestration, permissions, and human in the loop design. You will hear how Workato One and Workato Go bring connectivity, action, and governance into one stack, how teams assign KPIs to agents and track outcomes, and how to reduce agent sprawl while optimizing SaaS spend. Learn how leading companies are defining the agentic enterprise, what pitfalls to avoid when moving from pilots to production, and how to measure impact across sales, IT, support, HR, and finance so AI drives durable business value. Stay Updated: Craig Smith on X: https://x.com/craigss Eye on A.I. on X: https://x.com/EyeOn_AI

    57 min
4.7
out of 5
55 Ratings

About

Eye on A.I. is a biweekly podcast, hosted by longtime New York Times correspondent Craig S. Smith. In each episode, Craig will talk to people making a difference in artificial intelligence. The podcast aims to put incremental advances into a broader context and consider the global implications of the developing technology. AI is about to change your world, so pay attention.

You Might Also Like