ServiceNow Podcasts

ServiceNow Community Podcasts

ServiceNow Podcast Program is a collection of podcast shows hosted by various ServiceNow experts and professionals covering different focus areas and a broad variety of topics. Come listen to our experts talk about what's going on at ServiceNow. Join the conversation! Visit the Now Community forums

  1. Day One Ready: What New Engineers Need to Know About AI — Engineering Now Unlocked

    6D AGO

    Day One Ready: What New Engineers Need to Know About AI — Engineering Now Unlocked

    Day One Ready: What New Engineers Actually Need to Know About AI | Engineering Now Unlocked Starting your first engineering role — or coming back for a return offer — and wondering what AI actually changes about the job? This episode gives you the real answer, from two engineers living it every day. Jordan Shelton and Cynthia Mathenge sit down with Ian Thurlow (Senior Manager, Data Platform Software Engineering) and Andrew Yan (Software Engineer, Data Foundations) to talk about what day one looks like now, what AI tools actually do for early-career engineers, and what fundamentals still separate good engineers from great ones. If you’re about to start an internship, just got your return offer, or you’re a manager thinking about how to set new engineers up for success — this is the conversation you need before day one. What you’ll learn✔ What AI actually changes about day-to-day engineering work (and what it doesn’t) ✔ Why the fundamentals matter more than ever — not less ✔ How to build a network at a company like ServiceNow, even if you start remotely ✔ How to use AI as a sounding board, not a crutch Chapters 00:00 Introduction — Engineering Now Unlocked 02:08 Meet Ian Thurlow and Andrew Yan 03:03 How AI is changing day-to-day engineering work 04:47 AI as an accelerator, not a replacement 09:04 AI as a sounding board 12:38 Leadership mindset in an AI-first team 13:46 Raising the bar for early-in-career talent 15:41 What your first 30 days should look like 17:43 This or That 19:16 Code reviews: the fastest way to learn that nobody talks about 20:57 Building your network — even fully remote 24:24 Ian and Andrew’s Work Advice 27:43 Outro Guests Ian Thurlow Senior Manager, Data Platform Software Engineering — ServiceNow Andrew Yan Software Engineer, Data Foundations — ServiceNow Hosts Jorden Shelton Technical Program Manager, AI Engineering & Delivery — ServiceNow Cynthia Mathenge Business Operations Manager, AI Engineering & Delivery — ServiceNow Bobby Brill ServiceNow Insights Links & Resources Learn more about ServiceNow Engineering → https://www.servicenow.com/company/careers/engineering.html ServiceNow Docs → https://docs.servicenow.com New to the channel? Subscribe so you never miss an episode of ServiceNow Insights. See omnystudio.com/listener for privacy information.

    30 min
  2. EVA - A Framework for Evaluating Voice Agents by ServiceNow

    APR 29

    EVA - A Framework for Evaluating Voice Agents by ServiceNow

    Voice AI agent evaluation — why it's fundamentally harder than text, how cascade failures derail conversations invisibly, and ServiceNow's open-source framework to establish industry evaluation standards. Featuring real audio examples showing authentication failures, leaked reasoning, and latency problems. WHAT WE COVER  TARA BOGAVELLI — Research Engineer, ServiceNow Leading the open-source voice agent evaluation framework. Explains why existing benchmarks don't measure what matters and what ServiceNow is releasing to establish industry standards. KATRINA STANKIEWICZ — Staff Machine Learning Engineer, ServiceNow Cascade model architecture expert. Breaks down STT → LLM → TTS failure modes, named entity transcription challenges, and real audio example analysis. GABRIELLE GAUTHIER MELANÇON — Staff Applied Research Scientist, ServiceNow Multi-language evaluation specialist. Reveals why Large Audio Language Models lag behind, the native speaker requirement, and bot-to-bot simulation methodology.  CHAPTERS0:00 Introduction — The evaluation gap 1:11 ServiceNow's Open-Source Framework Announcement — Tara Bogavelli 2:43 Meet the Researchers 3:43 Voice-Specific Challenges — Tara Bogavelli 5:03 Cascade Architecture: STT → LLM → TTS — Katrina Stankiewicz 7:57 The Named Entity Problem — Katrina Stankiewicz 10:06 Evaluation Metrics: Accuracy vs Experience — Gabrielle Gauthier Melançon 11:23 Bot-to-Bot Testing at Scale — Gabrielle Gauthier Melançon 14:30 The LALM Gap: Why Audio AI Judges Struggle — Tara Bogavelli16:57 Real Audio Example: Flight Rebooking Gone Wrong 21:58 Breaking Down the Failures — Katrina Stankiewicz 28:30 Wrap-Up & Resources KEY INSIGHTS The Cascade Failure Problem: STT → LLM → TTS errors propagate invisibly Named Entity Transcription: The #1 enterprise blocker—names, confirmation codes, emails break authentication Accuracy vs Experience: Perfect task completion means nothing if users hang up due to poor experience LALM Gap: Large Audio Language Models lag behind text LLMs—human evaluators remain essential Latency Kills Conversations: Five-second pauses make users think the call dropped, breaking the experience even when tasks complete Open-Source Framework: ServiceNow releasing evaluation tools, metrics, and bot-to-bot simulation methodology for the industry. LEARN MORE Website: https://servicenow.github.io/eva/ GitHub: https://github.com/servicenow/eva Blog Post: https://huggingface.co/blog/ServiceNow-AI/eva Dataset: https://huggingface.co/datasets/ServiceNow-AI/eva ABOUT Hosted by Bobby Brill. ServiceNow Insights podcast explores AI research, real-world applications, and the people building the future of work. #VoiceAI #AIEvaluation #ServiceNow #MachineLearning #OpenSource #ConversationalAI #STT #TTS #LLM #VoiceAgents #AIResearch #Podcast See omnystudio.com/listener for privacy information.

    30 min

Trailers

Ratings & Reviews

4.4
out of 5
11 Ratings

About

ServiceNow Podcast Program is a collection of podcast shows hosted by various ServiceNow experts and professionals covering different focus areas and a broad variety of topics. Come listen to our experts talk about what's going on at ServiceNow. Join the conversation! Visit the Now Community forums

You Might Also Like