Software Architecture Insights

Lee Atchison
  • 5.0 (1)
  • Technology

Your system worked fine at a thousand users. Then it didn't. Software Architecture Insights is Lee Atchison's podcast about building software that holds up. Scaling, availability, cloud cost, and what AI is doing to how we build. Most episodes run about 15 minutes. Lee takes an idea from his weekly newsletter and goes further than the article could. Sometimes he revisits an old call to see how it aged. Sometimes he talks with someone doing the work. Lee is the author of Architecting for Scale. He writes for architects, engineers, and the leaders who depend on them. Get the newsletter at softwarearchitectureinsights.com.

  1. Apr 28

    The Role of AI in Modern Software Development with Burke Holland

    Today, we discuss the significant impact of AI on software development, particularly the use of AI assistants like GitHub Copilot. Our guest, Burke Holland, a principal developer advocate at Microsoft, shares insights on how developers are increasingly integrating AI into their workflows. We explore the current spectrum of AI usage, from code completion to AI agents that can write code autonomously. Burke emphasizes the need for developers to adapt to these changes while maintaining a critical perspective on AI-generated code. This conversation sheds light on the evolving role of software developers in an AI-enhanced landscape. In this insightful episode, Burke Holland, a principal developer advocate at Microsoft for the Visual Studio Code team, discusses the transformative role of artificial intelligence (AI) in software development. The conversation starts with the observation that developers have shifted from skepticism about AI's capabilities in coding to a more supportive stance, with many now using AI tools like GitHub Copilot to assist in their work. Burke explains how these AI tools can provide significant assistance through 'completions'—intelligent suggestions that understand the context of what the developer is working on, effectively acting as a cognitive partner in the coding process. The discussion further explores the concept of AI 'agents,' which represent a cutting-edge approach to automating aspects of coding. Burke acknowledges the potential of these agents to undertake more complex tasks but also expresses concern about the implications for developers' roles. He emphasizes the importance of human oversight, suggesting that while AI can enhance efficiency, developers must remain engaged with the code they produce to ensure quality and comprehensibility. The episode highlights the balance between leveraging AI's strengths and maintaining the critical thinking skills that are essential in programming. As the episode wraps up, Burke encourages developers to adopt an exploratory mindset toward AI tools. He notes that the landscape of software development is rapidly evolving, and by integrating AI thoughtfully, developers can enhance their productivity while still preserving their essential skills and understanding of coding. The conversation underscores a future where AI and human collaboration can lead to better software outcomes, emphasizing the need for a nuanced approach to AI integration. Takeaways: In the podcast, we discussed how AI is changing the software development landscape significantly.Burke Holland highlighted that the use of AI in coding has seen a dramatic increase recently.We talked about the importance of understanding the code produced by AI to maintain quality.Completions in AI tools like GitHub Copilot can enhance a developer's workflow remarkably.Burke shared insights on the difference between completions and agents in AI coding practices.We concluded that while AI can write code, developers still play a crucial role in ensuring its accuracy. Links referenced in this episode: softwarearchitectureinsights.com Companies mentioned in this episode: MicrosoftVS CodeGitHub CopilotJetBrainsSpeckit

  2. Apr 7

    Understanding AI Security Risks with Preston Wood

    Today's discussion centers on the vulnerabilities associated with AI systems and the increasing threats they face. Our guest, Preston Wood, the Chief Security and Strategy Officer at Databox, highlights the lack of transparency in AI technologies as a significant factor that makes them more susceptible to attacks. We explore how this obfuscation creates challenges in understanding and defending against potential threats. As AI continues to advance, we also consider the evolving nature of phishing attacks and the importance of robust data management strategies to mitigate risks. This episode aims to provide insights for software architects and leaders on navigating the complexities of AI integration while ensuring security and reliability. The podcast episode features an insightful discussion about the growing vulnerabilities associated with AI systems. The guest, Preston Wood, the Chief Security and Strategy Officer at Databox, addresses the surge in AI-related attacks, emphasizing the need for greater transparency and understanding of AI operations. He explains that the ambiguous nature of AI systems makes them appealing targets for attackers, who can exploit the lack of visibility into how these systems function. Throughout the conversation, Preston highlights the importance of ensuring that AI-generated data is clean and comprehensible to mitigate risks. He compares today's AI landscape to early phishing attacks, which have evolved into sophisticated threats due to advancements in AI technology. This episode serves as a crucial resource for software architects and technology leaders, offering them guidance on how to navigate the complexities of securing AI systems and understanding the implications of AI on data management and security practices. Takeaways: The podcast discusses the growing vulnerabilities associated with AI-based systems due to their lack of transparency.Preston Wood emphasizes the importance of clean and understandable data for AI performance and security.Organizations are advised to improve their data architecture to ensure AI projects are successful and not hindered by poor data quality.The conversation highlights the evolving nature of phishing attacks, which are now more sophisticated due to AI advancements.Effective security requires a layered approach that combines model training and guardrails for AI systems.Listeners are encouraged to consider how well their organizations are integrating AI into their existing technology frameworks.

  3. Mar 17

    AI Hype vs Application Reality: How Architects Can Keep Their Products on Track in 2025

    AI is no longer a novelty; it is now a significant part of our lives. In this podcast, we discuss the importance of using AI thoughtfully in software architecture. As architects, our role is not to chase the latest AI trends but to determine how AI can genuinely enhance our applications. We emphasize that AI should be viewed as a tool, not just a product strategy. We also provide guidance on evaluating AI requests, ensuring that the focus remains on achieving meaningful business outcomes while managing the complexities that come with AI implementation. Software Architecture Insights provides a comprehensive overview of the evolving role of AI in software architecture as we enter 2025. The discussion begins with the acknowledgement that AI is no longer a novel concept, but a standard aspect of modern technology. Generative AI models and multimodal systems are now common, seamlessly integrating text, images, and speech. Despite the substantial growth in AI capabilities, the hype surrounding AI continues to escalate, with companies feeling pressure to incorporate AI into their products. This episode emphasizes that software architects must not succumb to this hype. Instead, their focus should be on ensuring that AI is used appropriately and effectively within their applications. The speaker stresses that AI should be viewed as a tool to enhance products rather than a mere trend to follow. This means that architects need to translate management’s desire for AI into actionable, realistic strategies that align with business goals and product visions. The conversation delves into the responsibilities of a software architect, who must evaluate whether AI solutions genuinely address identified problems. This includes assessing the available data, understanding the types of AI needed, and determining the long-term operational costs associated with implementing AI features. The speaker underscores that not every problem requires an AI solution; sometimes, a simpler approach may suffice. For instance, traditional algorithms might be more efficient and effective than complex AI systems for certain tasks. As architects navigate these challenges, they are advised to engage in thoughtful discussions with leadership to align expectations and ensure that AI implementations are sustainable. In conclusion, the episode provides practical guidelines for evaluating AI requests in a software architecture context. Architects are encouraged to clarify business goals, assess data readiness, explore simpler alternatives, and plan for compliance and sustainability. By doing so, they can ensure that AI is integrated into products in a meaningful way, ultimately bridging the gap between innovation and practicality. The key takeaway is that AI should enhance the product and align with business objectives rather than merely serving as a checkbox to satisfy market demands. Takeaways: In 2025, AI is a significant part of everyday software development and design.Software architects must not only embrace AI but also understand its real implications and costs.AI should enhance products and services, not be an unthoughtful addition driven by hype.The role of the architect includes translating management's AI requests into meaningful technical strategies. Links referenced in this episode: softwarearchitectureinsights.com Companies mentioned in this episode: OpenAI Mentioned in this episode: How do you operate a modern organization at scale? Read more in my O'Reilly Media book "Architecting for Scale", now in its second edition. http://architectingforscale.com Architecting for Scale

  4. Feb 24

    Navigating Modern Data Challenges with Optical Storage: Greg Kittilson, VP Engineering of Folio Photonics

    Today, we discuss the advancements in optical storage technology and its implications for data archival. Our guest, Greg Kittilson, VP of Engineering at Folio Photonics, shares insights on how their innovative approach to optical storage offers multiple layers of data storage, significantly enhancing capacity. Unlike traditional methods, this technology can provide long-lasting and environmentally friendly solutions for data archiving. We explore the importance of understanding data accessibility and the cost implications of different storage solutions. Join us as we delve into the intersection of technology, sustainability, and software architecture. Software Architecture Insights presents a compelling dialogue with Greg Kittleson, the VP of Engineering at Folio Photonics. We delve into the evolution of data archiving and the pivotal role of optical storage technology in modern software architecture. Unlike traditional methods, Folio Photonics is advancing optical storage to offer sustainable and durable solutions for data archiving. Greg explains how their innovative approach overcomes the limitations of conventional optical storage, such as Blu-ray technology, by enabling significantly more data layers on a single disk through advanced polymer co-extrusion techniques. This advancement allows for larger storage capacities while maintaining lower costs, making it a viable option for enterprise-scale archival systems. As the conversation unfolds, we explore the implications of data storage in the context of environmental sustainability. Greg emphasizes the importance of reducing energy consumption in data centers and how optical storage can alleviate some of the environmental impacts associated with traditional storage solutions. We discuss the staggering amount of data generated annually, estimated at around 200 zettabytes, and how much of this data remains archived rather than actively used. This leads us to examine the different classes of data—active, near-archive, and cold archive—and how software architects can make informed decisions about data storage strategies based on access speed and cost considerations. The episode further highlights the potential for optical storage to contribute to a greener future. With minimal power requirements and fewer environmental controls needed compared to hard drives and tapes, optical storage emerges as a strong contender in the quest for sustainable data solutions. We conclude with insights into how software architects can leverage these advancements in optical storage technology, ensuring that they not only meet current data demands but also anticipate future needs in an increasingly data-driven world. Takeaways: The podcast discusses the importance of data archiving and how optical storage can improve sustainability in data management.Greg explains how Folio Photonics technology allows for multiple layers of data storage, enhancing capacity significantly.Accessibility of data is crucial for software architects, as different types of data require different storage solutions and access speeds.The conversation highlights the environmental impact of data centers and how optical storage reduces power consumption compared to hard drives.Folio's optical storage technology offers a cost-effective and reliable solution for active and cold data storage needs.The podcast emphasizes the need for software architects to understand data lifecycle and compliance requirements in their design choices. Links referenced in this episode: softwarearchitectureinsights.comfoliophotonics.com Companies mentioned in this episode: Folio PhotonicsSonyPickle Mentioned in this episode: How do you operate a modern organization at scale? Read more in my O'Reilly Media book "Architecting for Scale", now in its second edition. http://architectingforscale.com Architecting for Scale What do 160,000 of your peers have in common? They've all boosted their skills and career prospects by taking one of my courses. Go to atchisonacademy.com. Atchison Academy

  5. Feb 3

    Why should I care about AI?

    AI is now essential for software architects. While it may seem that AI has recently become important, it has been around since the 1950s. In this episode, we discuss how AI affects modern software architecture and why understanding AI is crucial for our careers. We explore the new challenges and opportunities AI brings, such as the need for structured data and the importance of ethical considerations. As we navigate this complex landscape, it is clear that knowledge of AI will shape the future of software design and architecture. Takeaways: AI has been an integral part of software since the 1950s, not just a recent trend.As software architects, we need to understand AI's applications and implications in our work.AI creates new architectural challenges and opportunities that we must navigate effectively.Data management is critical for AI systems, requiring careful structuring and ethical sourcing.AI introduces unpredictability in software behavior, requiring us to plan for uncertainty.Ethics in AI is now a significant concern for architects, affecting our design decisions. Links referenced in this episode: softwarearchitectureinsights.com

  6. Jan 13

    Navigating Cloud Infrastructure using AI with Marcin Wyszynski, Spacelift

    Cloud infrastructure provisioning can be a challenging task, often requiring a delicate balance between speed and accuracy. In our discussion today, we explore how AI can streamline this process. Our guest, Marcin Vizensky, co-founder of SpaceLift, introduces us to their innovative solution called Spacelift Intent, which simplifies infrastructure management by removing the complexities of traditional tools like Terraform. Marcin explains how this platform allows users to express their needs directly, enabling quicker provisioning while maintaining necessary controls and policies. Join us as we delve into the intricacies of AI-driven cloud provisioning and its potential to make infrastructure management more accessible for developers and data scientists alike. The discussion centers around the challenges of cloud infrastructure provisioning and how AI can provide solutions. Marcin Vizensky, co-founder of SpaceLift, outlines two extremes in the current landscape: the rapid but unrepeatable manual provisioning of cloud resources through console clicks, and the slow, complex processes involving tools like Terraform that require extensive knowledge and setup. He emphasizes that many users, such as developers and data scientists, do not need to become cloud experts; they simply want to provision resources effectively. Marcin introduces Spacelift Intent, a tool designed to simplify this process by allowing users to express their needs in natural language, which AI translates into API calls. This approach shortens the lengthy deployment cycle typically associated with traditional tools, making it easier for users to manage infrastructure without deep technical expertise. Takeaways: Cloud infrastructure provisioning is challenging due to the extreme approaches we have adopted.AI can facilitate the process of managing cloud infrastructure by streamlining resource provisioning.SpaceLift Intent provides a middle ground between fast but chaotic and slow but formal cloud setups.Using AI in infrastructure management can allow for quick prototyping without extensive learning curves.The approach of SpaceLift Intent helps users transition from initial setups to formal infrastructure management.Historical data from previous configurations is preserved, allowing for easy migration and state management. Links referenced in this episode: spacelift.comopentofu.orgsoftwarearchitectureinsights.com Companies mentioned in this episode: SpaceLiftOpen TOFUterraformpulumiCloud formationAWSGCPMicrosoft Mentioned in this episode: What do 160,000 of your peers have in common? They've all boosted their skills and career prospects by taking one of my courses. Go to atchisonacademy.com. Atchison Academy

  7. 12/09/2025

    Navigating AI Development with InWorld's Kylan Gibbs

    Today, we explore the evolving landscape of conversational AI with Kylan Gibbs, the CEO and founder of InWorld AI. We focus on how InWorld develops AI products that enhance the creation of scalable applications, particularly in consumer contexts where user interaction is increasingly conversational. Kylan shares insights into the importance of real-time performance and how expectations differ between consumer and business applications. He emphasizes that while businesses often prioritize automation and factuality, consumer applications demand speed and engagement, requiring a nuanced approach to AI design. Join us as we delve into the technical challenges and innovations that are shaping the future of AI interactions. The podcast features a deep dive into the evolving landscape of software architecture, focusing on the role of AI in modern applications. Our guest, Kylan Gibbs, the CEO of InWorld AI, discusses how his company builds AI products that facilitate real-time conversational experiences for users. Kylan emphasizes that the majority of consumer interactions with AI now occur through conversational interfaces, such as chatbots and voice assistants. He explains that InWorld specializes in creating scalable applications that not only meet user demands but also adapt to varying contexts, such as customer support, gaming, and educational applications. This adaptability is crucial because user expectations differ significantly across different scenarios. The conversation further explores the intricate balance between performance and user experience, highlighting how different user expectations influence the design and functionality of AI-driven applications. Kylan shares insights into the engineering challenges that come with real-time AI interactions, emphasizing the need for robust performance engineering to deliver smooth conversational flows. He believes that as AI technology progresses, the focus should shift towards enhancing user engagement while maintaining high performance standards. Overall, this episode offers valuable insights into how software architects can navigate the complexities of integrating AI into consumer-facing applications while ensuring that the user experience remains at the forefront. Takeaways: InWorld AI focuses on creating conversational interfaces that improve user engagement in applications. The performance of real-time conversational AI is crucial, requiring fast and precise responses. Consumer AI applications need to adapt to various contexts, changing user expectations significantly. Optimizing AI performance often requires using low-level programming languages like C for better control. AI spending is increasingly shifting towards consumer applications, presenting new opportunities for developers. Understanding the nuances of AI architecture is essential for creating effective conversational agents. Links referenced in this episode: softwarearchitectureinsights.cominworld.ai Companies mentioned in this episode: InWorld AI OpenAI Google Mentioned in this episode: How do you operate a modern organization at scale? Read more in my O'Reilly Media book "Architecting for Scale", now in its second edition. http://architectingforscale.com Architecting for Scale What do 160,000 of your peers have in common? They've all boosted their skills and career prospects by taking one of my courses. Go to atchisonacademy.com. Atchison Academy

  8. 11/18/2025

    Get Rid of Your Users - The Role of Transactional vs Experiential Applications

    Not all applications are created equal. Some applications process transactions and maintain state, while others aim to deliver content, data, or experiences to users. For software architects and engineering leaders, recognizing these core application types is essential for making informed decisions regarding scalability, infrastructure, security, and data management. Understanding whether an application is experiential or transactional influences its design and architecture. This distinction is vital for ensuring that applications meet user expectations effectively and efficiently. Understanding the distinction between experiential and transactional applications is crucial for software architects and engineering leaders. Each type of application serves a different purpose and is designed to meet specific user expectations. Experiential applications aim to keep users engaged for extended periods, providing value through interaction and content delivery. Examples include social media platforms, where the longer users stay, the more advertising revenue the platform generates. The architecture of such applications needs to prioritize low latency, high availability, and the ability to deliver personalized content efficiently. This requires strong data management practices and the use of advanced technologies like machine learning to enhance user experience. On the other hand, transactional applications focus on speed and efficiency. They are designed for users to complete tasks quickly, such as checking an order status or making a purchase. The underlying architecture must ensure reliability and data integrity, as even minor delays can frustrate users. Key architectural considerations for transactional applications include low latency APIs, robust database management for consistency, and the ability to handle asynchronous processes effectively. Understanding these differences is essential for architects to design systems that align with user expectations and business goals. The implications of choosing the right application type extend beyond product management; they are foundational to the overall architecture and infrastructure strategy. A misalignment can lead to performance issues and user dissatisfaction, making it vital for software leaders to understand not just how to build functional software but how to build software that meets the specific needs of its users. As we explore these themes, we recognize that the architectural decisions made today will shape the user experiences of tomorrow, influencing everything from scalability to data management. Takeaways: Not all applications are created equal; they serve different purposes and user needs. Experiential applications aim to engage users for longer periods, enhancing value over time. Transactional applications prioritize speed and efficiency, allowing users to complete tasks quickly. Understanding the type of application informs architectural decisions about scalability and data management. Application design impacts user experience; architects must align their strategies with user expectations. Misaligning application type with architectural choices can lead to performance and satisfaction issues. Links referenced in this episode: softwarearchitectureinsights.com Companies mentioned in this episode: Amazon.com Mentioned in this episode: How do you operate a modern organization at scale? Read more in my O'Reilly Media book "Architecting for Scale", now in its second edition. http://architectingforscale.com Architecting for Scale

See All (13)

Trailer

About

Your system worked fine at a thousand users. Then it didn't. Software Architecture Insights is Lee Atchison's podcast about building software that holds up. Scaling, availability, cloud cost, and what AI is doing to how we build. Most episodes run about 15 minutes. Lee takes an idea from his weekly newsletter and goes further than the article could. Sometimes he revisits an old call to see how it aged. Sometimes he talks with someone doing the work. Lee is the author of Architecting for Scale. He writes for architects, engineers, and the leaders who depend on them. Get the newsletter at softwarearchitectureinsights.com.

Information