AI Confidential

Opaque Systems

AI Confidential is a podcast about AI and how to benefit from it responsibly. We speak with leaders from Microsoft, Accenture, NVIDIA, Google Cloud — and more — about how confidential AI is reshaping business.

  1. 23 SEPT

    Are LLMs Dead?

    OpenAI’s ChatGPT-4, released in March 2023, was noticeably more intelligent than ChatGPT-3. It reasoned better, answered questions more accurately, and could handle more complex tasks. But LLM advancements have since slowed down. And critics have called OpenAI’s latest release — ChatGPT-5  — “overhyped and underwhelming.” In this episode, hosts Aaron Fulkerson and Mark Hinkle discuss: Whether LLMs are dead Why 95% of AI projects are failing How enterprises can harness AI without sacrificing data security If you want to learn more about AI and how to use it responsibly, visit opaque.co

    45 min

  2. 9 SEPT

    Days to Seconds: Harnessing Confidential AI Agents with Kellie Romack

    In the age of agentic AI, Kellie Romack knows deploying secure agents needs to be a baseline for enterprises, not an aspiration. In this episode, host Aaron Fulkerson unpacks how confidential AI agents work and talks to Kellie Romack, CDIO at ServiceNow, about how her company is implementing confidential AI agents across its platform. Since partnering with OPAQUE, Microsoft Azure, and NVIDIA to deploy confidential AI agents, ServiceNow has seen average response times from its sales commission help desk speed up from four days to just eight seconds. Kellie and Aaron also discuss: How ServiceNow, a defining enterprise software company, is approaching AI governance Advice for enterprise leaders building out agentic workflows Predictions on how companies can gain the most value from AI If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co Special thanks to Now Productions for filming this interview at ServiceNow's headquarters in Santa Clara.

    51 min

  3. 12 AUG

    Agents Are the New API Client with Marco Palladino

    Marco Palladino knows that the internet is changing quickly. As the Co-founder and CTO at Kong, an API management platform, he’s on the forefront of integrating APIs with AI — and is wrestling with the questions around security and governance that this shift presents. In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Palladino about: LLM gateways and why we need them How AI is impacting API development Why AI governance is — and will continue to be — a challenge How enterprises can prepare for the agentic web If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    1h 8m

  4. 29 JUL

    Confidential Computing Summit 2025: Day 2 Recap & Interviews

    Last month at Opaque’s annual Confidential Computing Summit™, hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers and sponsors about the agentic web, data security, and AI. This episode dives into a few of those conversations. First, Jason Clinton — CISO at Anthropic — talks about the future of agents, MCP, and Anthropic’s latest safety upgrade, ASL-3, which is designed to prevent bad actors from misusing its models. Next, Daniel Rohrer — NVIVIA's VP of Software Product Security, Architecture & Research —shares how NVIDIA is handling AI security and scaling compute power and trust. Finally, Daniel J. Beutel — Co-Founder and CEO of Flower Labs — explains how his company is using federated learning to keep data secure in AI workloads. If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    1h 33m

  5. 15 JUL

    Confidential Computing Summit 2025: Day 1 Recap & Interviews

    Last month at Opaque’s annual Confidential Computing Summit™, hosts Aaron Fulkerson and Mark Hinkle interviewed several of our incredible speakers about the future of confidential AI, genAI, and agents. This episode dives into a few of those conversations. First, Mark Russinovich — CTO, Deputy CISO, and Technical Fellow at Microsoft Azure — talks to us about recent developments in confidential AI from his research team, including a new framework for thinking about the various security levels available for data using confidential computing.  Next, James Kaplan — CTO at McKinsey Technology and Partner at McKinsey — shares takeaways from his research into how large enterprises are using AI and explains how genAI is allowing enterprises to mine troves of unstructured data.  Finally, Vinay Pillai — Chief Architect and VP of Engineering, Digital Technology, and Technology Platform at ServiceNow — explains how ServiceNow is using confidential agents powered by Opaque, Microsoft Azure, and NVIDIA to improve their sales commission desk response times from four days to eight seconds. If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    1h 35m

  6. 1 JUL

    Understanding the Internet of Agents with Vijoy Pandey

    Vijoy Pandey, Head of Outshift by Cisco, understands that an internet populated by agents requires an open, interoperable framework for agent-to-agent communication and a seismic shift in governance. That’s why Outshift by Cisco, in partnership with LangChain and Galileo, created AGNTCY — an open source collective for inter-agent collaboration. And we’re excited to announce that Opaque is a member! In this episode, Pandey talks to hosts Aaron Fulkerson and Mark Hinkle about:  His aims for AGNTCY How we create an open-source, collaborative, interoperable, and secure internet of agents If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    1h 19m

  7. 17 JUN

    Understanding Data Complexity in Enterprise AI Systems with John Willis

    What would Founder, Systems Architect, and Deeptech Strategist, John Willis, like you to understand? The history of AI and the risks associated with data exhaust. Willis recently published Rebels of Reason, an AI history told through the stories of lesser-known technologists who built the foundation for modern-day AI. And one of the biggest threats he’s flagging for enterprise AI users is data exhaust, byproduct info that's generated while using digital systems. From manufacturing process details to AI model configurations, this data trail is growing fast and can be collected and exploited.  Also in this episode, you’ll hear about: Why legacy systems and tech debt still haunt AI adoption How the NORMAL stack embeds AI governance into every layer of the enterprise Why RAG isn’t dead If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    1h 28m

  8. 3 JUN

    Navigating AI Evaluation and Observability with Atin Sanyal

    As GenAI tools have become more intelligent and robust, the reliability of their output has decreased. Enter Galileo: an AI reliability platform designed for GenAI applications. Atin Sanyal — the Co-founder and CTO of Galileo — has a background building machine learning tech at Uber and Apple. One innovative technique that sets Galileo apart is ChainPoll — their hallucination detection methodology that uses consensus scoring and prompts the LLM to outline its step-by-step reasoning process.  In this episode, hosts Aaron Fulkerson and Mark Hinkle talk to Atin about: What evaluation agents are, and why they get smarter over time How Galileo helps enterprises evolve their own AI quality metrics Why data quality and confidential computing will become increasingly important to enterprises building AI systems If you want to learn more about AI and how to benefit from it responsibly, visit opaque.co

    53 min
See All (18)

About

AI Confidential is a podcast about AI and how to benefit from it responsibly. We speak with leaders from Microsoft, Accenture, NVIDIA, Google Cloud — and more — about how confidential AI is reshaping business.

Information

  • Creator
    Opaque Systems
  • Years Active
    2024 - 2025
  • Episodes
    18
  • Rating
    Explicit
  • Copyright
    © 2024
  • Show Website
    AI Confidential

You Might Also Like