Authorized Intelligence

Rubrik

Authorized Intelligence is for the security and technology leaders caught between unlocking the value of AI and confronting the new risks organizations are contending with both from outside and within. Host ⁠Cal Al-Dhubaib⁠, AI risk management expert at ⁠Rubrik⁠, brings you into the room with the world’s leading frontier model red teamers, CISOs, AI policymakers, and beyond to unpack the new rules of resilience in an AI powered world.

Episodes

  1. 1h ago

    Evaluating the safety and reliability of frontier models

    This week on Authorized Intelligence, Cal Al-Dhubaib speaks with Peter Gostev, AI Capability Lead at Arena, about how frontier AI models are evaluated, where current benchmarks fall short, and what their growing capabilities mean for enterprise security. They discuss measuring real-world performance, the cost of completing tasks, and why organizations should be using AI more actively to strengthen their defenses. What You’ll Learn Why model evaluations need to keep evolving: As the ways people use AI become more complex, benchmarks must move beyond static tests and reflect real-world tasks. What makes a model useful: Performance is only part of the equation. Cost, efficiency, speed, and user satisfaction all factor into evaluating a model. Why benchmark scores need context: Strong results in controlled environments don't necessarily translate to flawless performance in the real world. How organizations should approach AI security: Rather than focusing only on restricting internal AI tools, security teams should use AI to proactively test their systems and prepare for increasingly autonomous attacks. Key Moments 00:00 What does BullshitEval reveal about frontier models? 04:00 How can real-world usage improve model evaluations? 07:30 Why should organizations measure the cost of completing a task? 10:45 What do cybersecurity benchmarks tell us about AI capabilities? 13:00 How should enterprises rethink AI and security? 18:00 What AI developments could reshape entire industries? About Peter Gostev Peter Gostev is the AI Capability Lead at Arena, where he works on evaluating the performance and capabilities of frontier AI models. He has explored new approaches to model evaluation, including BullshitEval, a benchmark designed to test whether models recognize flawed or nonsensical premises rather than confidently accepting them. Listen & Subscribe If you enjoyed this episode of Authorized Intelligence, subscribe wherever you listen to podcasts and leave us a rating or review. Have a question or a topic you'd like Cal to explore? Get in touch with us through authorizedintelligence.fm.

  2. 1h ago

    Solving AI board paralysis

    This week on Authorized Intelligence, Cal Al-Dhubaib speaks with Dominique Shelton, CEO of Global Data Innovation, about how AI is changing the role of corporate boards in risk management, governance, and cyber resilience. They discuss why boards are moving from AI awareness to actively seeking solutions, how organizations can turn AI incident data into stronger governance practices, and why meaningful board engagement is essential to managing emerging risks. What You’ll Learn Boards are moving from AI awareness to action. Shelton describes how boardroom conversations have shifted from being problem unaware to actively seeking solutions and exercising oversight. AI governance requires more than finding solutions. Organizations must ensure safeguards are actually implemented across their technology stack and business operations, rather than stopping at the planning stage. The TRUST framework offers a structure for responsible AI oversight. It emphasizes triage, right data, uninterrupted testing and monitoring, supervising humans, and tech documentation. Boards need to be active participants in AI oversight. Regular technology briefings and meaningful dialogue with security leaders help boards understand risks, evaluate priorities, and meet their fiduciary responsibilities. Key Moments 00:00 How are AI conversations changing in the boardroom? 02:00 Why do boards struggle to move from awareness to action? 04:00 How is AI changing cyber resilience requirements? 08:00 What does the TRUST framework look like? 13:00 How can boards improve AI oversight? 17:00 What is the biggest challenge facing boards? About Dominique Shelton Dominique Shelton is the CEO of Global Data Innovation, where she works with organizations on AI governance, data innovation, and risk management. A former Big Law partner, she brings extensive legal and governance experience to helping companies proactively address AI risks and build responsible technology practices. She developed the TRUST framework to help organizations translate lessons from thousands of AI incidents into practical governance strategies. Listen & Subscribe If you enjoyed this episode of Authorized Intelligence, subscribe wherever you listen to podcasts and leave us a rating or review. Have a question or a topic you'd like Cal to explore? Get in touch with us through authorizedintelligence.fm.

  3. 1h ago

    Red teaming with frontier models

    This week on Authorized Intelligence, Cal Al-Dhubaib speaks with Nidhi Aggarwal, Chief Product Officer at HackerOne⁠, about how frontier AI is transforming cybersecurity red teaming and vulnerability discovery. They discuss how AI is increasing the scale and sophistication of security testing, why validation and remediation are becoming critical bottlenecks, and why organizations need continuous security practices that combine AI capabilities with human judgment. What You’ll Learn AI is expanding vulnerability discovery. Frontier models allow researchers to examine larger attack surfaces and entire code bases, uncovering vulnerabilities that previously exceeded human capacity. Validation determines real exposure. A vulnerability must be tested against production environments and existing security controls. Aggarwal explains that thousands of discoveries may represent only a handful of truly exploitable risks. Continuous security is essential to cyber resilience. Organizations need an always-on cycle of discovery, validation, prioritization, remediation, and retesting rather than relying on annual penetration tests or one-time assessments. AI increases the need for human judgment. Security teams will increasingly review and govern AI-driven work, requiring stronger cross-functional collaboration and an understanding of business objectives. Key Moments 00:00 How is AI changing red teaming? 03:00 Why does vulnerability validation matter? 04:00 What makes an organization cyber resilient? 08:00 How fast is AI changing security? 10:00 Where are organizations falling behind? 17:00 What should organizations prioritize now? About Nidhi Aggarwal Nidhi Aggarwal is the Chief Product Officer at HackerOne, where she leads the company's product strategy and platform vision. With a background in technology, product leadership, and entrepreneurship, she brings a perspective on how AI can scale security capabilities while ensuring human expertise, validation, and governance remain central to effective cybersecurity. Listen & Subscribe If you enjoyed this episode of Authorized Intelligence, subscribe wherever you listen to podcasts and leave us a rating or review. Have a question or a topic you'd like Cal to explore? Get in touch with us through  authorizedintelligence.fm.

About

Authorized Intelligence is for the security and technology leaders caught between unlocking the value of AI and confronting the new risks organizations are contending with both from outside and within. Host ⁠Cal Al-Dhubaib⁠, AI risk management expert at ⁠Rubrik⁠, brings you into the room with the world’s leading frontier model red teamers, CISOs, AI policymakers, and beyond to unpack the new rules of resilience in an AI powered world.

You Might Also Like