Agile Software Engineering

Alessandro

This podcast explores how craftsmanship, architecture, engineering rigor, and organizational practices come together in modern R&D environments. Each edition refines and deepens my earlier reflections, building a coherent and evolving body of knowledge around Agile Software Engineering 

  1. Sep 22

    AI RISKS Q&A. Putting recent AI risk debates into perspective.

    Send us Fan Mail In this episode of The Agile Software Engineering Deep Dive, Alessandro Guida returns to the subject of AI risk with a Q&A exploring some of the questions raised by recent developments in agentic AI and recursive self-improvement. The discussion begins with the Hugging Face incident and what it tells us about agents that pursue goals in unexpected ways, circumvent restrictions, discover new uses for their environment and interact with systems their designers never intended them to reach. From there, the episode examines whether surprising agent behaviour should be interpreted as evidence of independent will, and explains why capable language models combined with tools, memory, permissions and repeated attempts can already produce behaviour that is difficult to predict. The episode then turns to recursive self-improvement. What does it actually mean for AI to help improve AI? Can synthetic training data contribute to better future models? What are the limits imposed by model collapse, evaluation, compute, infrastructure and reliable feedback? And how plausible is the idea that this process could eventually accelerate dramatically? Finally, the discussion looks at the risks that already deserve serious attention: badly engineered agents, excessive permissions, weak containment, cyber misuse, inadequate independent oversight and the competitive race to build increasingly capable AI systems. The central question is therefore becoming less about whether AI will suddenly acquire evil intentions and more about whether we can engineer, secure and govern increasingly autonomous systems well enough to keep their behaviour within acceptable boundaries Support the show This Podcast is an audio version of the written Agile Software Engineering newsletter.  If you want to go deeper, don't forget to subscribe the newsletter too.

    AI RISKS Q&A. Putting recent AI risk debates into perspective.
  2. Sep 17

    WHEN A PROMPT IN A LOOP BECOMES AN AGENT. What the Hugging Face incident really tells us about AI risk

    Send us Fan Mail In this episode of The Agile Software Engineering Deep Dive, Alessandro Guida explores what the recent Hugging Face incident really tells us about AI agents and AI risk. The episode starts with a simple question: how can something that is essentially an LLM running inside a loop begin to behave in ways its designers never explicitly programmed? Using the Hugging Face case as a concrete example, the episode explains how agents can adapt to an evolving environment, discover unexpected uses for shared infrastructure, communicate with other agents, divide work, and pursue increasingly indirect ways of achieving their original objective. The discussion also looks at one of the most important distinctions in AI safety: the difference between telling a model what it should not do and engineering a system that makes dangerous actions genuinely difficult or impossible. From there, the episode turns to a broader question of responsibility. If autonomous AI systems become more capable and more difficult to inspect, can the companies building them also be the only ones deciding when their safeguards are sufficient? The conclusion is less about science-fiction scenarios and more about familiar engineering principles: defence in depth, least privilege, containment, independent verification, and designing systems with the assumption that components can fail. Support the show This Podcast is an audio version of the written Agile Software Engineering newsletter.  If you want to go deeper, don't forget to subscribe the newsletter too.

    WHEN A PROMPT IN A LOOP BECOMES AN AGENT. What the Hugging Face incident really tells us about AI risk

About

This podcast explores how craftsmanship, architecture, engineering rigor, and organizational practices come together in modern R&D environments. Each edition refines and deepens my earlier reflections, building a coherent and evolving body of knowledge around Agile Software Engineering