Tech Threads: Weaving the Intelligent Future

Baya Systems
  • 5.0 (1)
  • TECH NEWS
  • UPDATED MONTHLY

This podcast hosted by Baya Systems explores the cutting edge of technology, from AI acceleration to data movement and chiplet innovation. Each episode dives into groundbreaking advancements shaping the future of computing, featuring insights from industry experts on the trends and challenges defining the tech landscape. Tune in to stay ahead in the rapidly evolving world of technology.

Episodes

  1. Inside the AI Bottleneck: Data Movement, Chiplets, and System Scaling

    MAR 27

    Inside the AI Bottleneck: Data Movement, Chiplets, and System Scaling

    For the last decade AI has been driven by one thing, more compute: bigger models, more accelerators, higher throughput. But as NVIDIA’s Jensen Huang recently highlighted at GTC, the industry is hitting a different kind of wall, one that hasn’t received nearly as much attention. The real constraint is no longer just compute. It’s data movement. To its credit, Nvidia has pushed this frontier with innovations like NVLink Fusion, and continued investment in connectivity AI dataflow architectures. But the challenge is bigger than any one company. As AI systems scale to hundreds - and even thousands - of processors, performance is increasingly defined by the ability to efficiently move, synchronize, and manage data across increasingly distributed architectures that can orchestrate data across chiplets, nodes, and entire racks. In this episode of Tech Threads, we bring together a panel of deeply experienced technologists, architects and leaders from companies like Intel, Arm, Altera, Texas Instruments, and Arteris - individuals who have helped shape modern compute, interconnect standards, and system architecture. Together they explore what is really changing beneath the surface: why traditional scaling approaches are breaking down, how coherent interconnects and network-on-chip architectures are evolving, and why system-level thinking is becoming essential. They also dive into the growing complexity introduced by chiplet-based designs, heterogeneous compute, and distributed memory systems and what it takes to maintain performance, efficiency, and programmability at scale. This is not just a technology shift, it’s an architectural reset. If you’re building or thinking about next-generation AI systems, this conversation gets to the heart of what matters next.

    54 min
  2. From Arduino to AI Infrastructure: Scaling the Next Wave of Computingl

    JAN 21

    From Arduino to AI Infrastructure: Scaling the Next Wave of Computingl

    What do Arduino, IoT, edge AI, and Nvidia-era data centers have in common? They all depend on ecosystems: people, platforms, and momentum. In this episode, Sander Arts joins Baya’s Chief Commercial Officer and Tech Threads host Nandan Nayampally for a wide-ranging, candid conversation on how breakthrough technology actually scales. Sander brings a rare operator’s perspective shaped by 25+ years scaling global technology companies across semiconductors, enterprise software, and AI. As the founder of Orange Tulip Consultancy, he serves as a Fractional CMO and growth advisor, helping leadership teams turn deep technology into real-world adoption. Together, Nandan and Sander explore how communities, developer access, and platform ecosystems turn deep technology into real-world adoption, and why timing and openness can be just as critical as technical performance. The discussion moves from the maker-era lessons of Arduino and IoT to today’s AI infrastructure boom, unpacking why scaling “long-tail” customers is both an opportunity and an operational challenge, and how edge AI and data center markets are evolving in parallel. They also debate the art of “opening the kimono,” how standardization and middleware shape adoption, and why capital intensity and speed often determine whether innovation stays local or becomes global. They close by looking ahead at emerging trends like robotics, neo-cloud architectures, quantum with real customers, and the networking backbone powering AI’s future, and how these shifts intersect with Baya’s view of increasingly complex, software-driven systems.

    43 min
  3. The Architecture of "Open" Intelligence

    10/14/2025

    The Architecture of "Open" Intelligence

    In this episode of TechThreads: Weaving the Intelligent Future, legendary chip architect Jim Keller joins Nandan Nayampally, Baya Systems’ Chief Commercial Officer, to explore how openness, modularity, and simplicity are redefining the architecture of intelligence. From his early work on Apple’s A4 through A7 processors to today’s AI-driven computing revolution, Jim shares how every leap in performance has come from breaking complexity down into composable, modular layers. Referencing The Systems Bible, he explains why “you can’t fix broken complicated systems”, and why the only path forward is to design simpler components that can scale and evolve together. The conversation spans: - The AI paradigm shift. Why traditional compute models no longer scale. - How data movement, not just compute, has become the new frontier. - The rise of chiplets and software-driven fabrics for scalable design. - The power of open ecosystems like RISC-V and OCA to democratize AI innovation. - Building a path toward sovereign and collaborative compute platforms worldwide. Listen as Jim Keller unpacks the engineering philosophy behind building open, intelligent systems and what it means for the future of AI and computing at scale.

    44 min
  4. AI from Edge to Cloud: Hype vs Reality

    08/14/2025

    AI from Edge to Cloud: Hype vs Reality

    In this episode of Tech Threads, Nandan Nayampally sits down with Sally Ward-Foxton (EE Times) and Dr. Ian Cutress (More Than Moore) for an unfiltered look at the state of AI, from the far edge to hyperscale data centers. Ahead of the recording, we asked our LinkedIn followers to weigh in on some of the biggest questions in AI today, from bottlenecks in system design to the future of GPUs. Those poll results are revealed and discussed in the episode, bringing your insights directly into the conversation. The discussion covers where the real bottlenecks lie in AI system design, whether “AI at the edge” is living up to the hype, and if GPUs will continue to dominate or give way to new architectures. With insights on hardware-software co-design, open vs proprietary ecosystems, and the realities of scaling AI infrastructure, this episode blends deep technical perspective with candid industry observations. If you care about AI performance, power efficiency, and what’s next in compute architecture, this is a discussion you won’t want to miss.

    48 min
  5. Edge AI Revolution: Scaling Intelligence from the Network Edge to the Data Center

    07/15/2025

    Edge AI Revolution: Scaling Intelligence from the Network Edge to the Data Center

    In this episode of Tech Threads: Weaving the Intelligent Future, Baya Systems' CCO Nandan Nayampally welcomes Fabrizio Del Maffeo, founder and CEO of Axelera AI, one of Europe’s most promising AI semiconductor startups. The conversation opens with a sharp look at the growing shift from cloud to edge AI, exploring the power, cost, latency constraints, and more importantly, the regional and use-case considerations that are reshaping how and where intelligence is deployed. The discussion covers strategies for deploying AI at the network edge, adapting to rapidly evolving workloads, and leveraging digital in-memory computing to enable low-power, high-throughput inference acceleration. It also delves into the future of chiplet-based design, the role of open and programmable hardware, and broader efforts to democratize compute. With shared perspectives on “scale within” and scalable system architectures, this episode offers a compelling view into the future of distributed AI.

    40 min
  6. Beyond the Bottlenecks: A Vision for Intelligent Systems

    06/13/2025

    Beyond the Bottlenecks: A Vision for Intelligent Systems

    In this episode of Tech Threads: Weaving the Intelligent Future, host Nandan Nayampally welcomes Rochan Sankar, AI infrastructure pioneer and founder of Enfabrica, for a deep dive into the next frontier of intelligent computing. Together, they explore one of the most critical and often overlooked challenges in AI: data movement, and its impact at every level from cloud to end device.  The discussion explores new system architecture, key’s to scalability, optical interconnects, chiplet innovation and impacts, and a whole lot more. From startup lessons to bold predictions, this conversation delivers candid insights and forward-looking perspectives on what it will take to build truly scalable AI systems. Whether you're an engineer, architect, or simply curious about the technologies shaping tomorrow’s computing landscape, this episode delivers both substance and inspiration. Listen in to discover what’s redefining performance at the infrastructure layer—and what’s coming next.

    44 min
  7. Scaling AI: Simplicity Meets Compute

    05/14/2025

    Scaling AI: Simplicity Meets Compute

    In this riveting episode of Baya Systems' Tech Threads podcast, tech luminaries Raja Koduri, founder and CEO of Mihiri AI and Dr. Sailesh Kumar, founder and CEO of Baya Systems unpack the explosive growth of the intelligent compute era where AI demands unprecedented scalability. From Koduri’s trailblazing accelerated computing work at Apple, Intel, and AMD to Kumar’s innovations in software-defined networking, they reveal how today’s supply-constrained systems are evolving through chiplet technology and simplified architectures to meet the tripling annual needs of AI models. Koduri stresses simplicity in design, advocating for software abstractions and hardware that hide complexity to enable seamless scaling. Kumar details the need for configurable, software-defined fabrics to support heterogeneous compute workloads. From the elegance of “simple” scaling solutions to the critical role of software-hardware co-design, this episode is a masterclass in understanding the tech that powers our world—and what’s coming next. This episode is a must-listen for tech enthusiasts and professionals alike, offering a thrilling glimpse into the trillion-agent AI future and the scalable, boundary-pushing innovations shaping tomorrow’s world. Learn more about Baya Systems' software-defined fabrics solutions for scalable AI at bayasystems.com

    47 min
  8. AI, Open Platforms, and the Next Frontier of Innovation

    04/16/2025

    AI, Open Platforms, and the Next Frontier of Innovation

    In the second episode of the Tech Threads podcast, Nandan Nayampally, Chief Commercial Officer at Baya Systems, interviews Keith Witek, Chief Operating Officer at Tenstorrent. The discussion focuses on the new frontiers of AI and the technological challenges they present. Witek, a seasoned technology executive with a rich background at companies like Google, SiFive, Tesla, and AMD, shares insights into Tenstorrent’s recent $693 million fundraising and their mission to bring high-performance RISC-V cores to data centers and mobile phones. He emphasizes the importance of open platforms, drawing parallels to how Linux competes with Windows, and highlights Tenstorrent’s partnerships, such as with Baya Systems, to enhance system design efficiency and speed up market delivery. The conversation also delves into broader industry trends, including the consolidation of control points in the supply chain, the impact of trade wars, and the need for sovereign technology development to reduce dependency on monopolies. Witek and Nayampally discuss the transformative potential of AI, predicting disruptions in sectors like autonomous driving, healthcare, and entertainment, where AI could redefine business models and societal structures. They explore the role of chiplet technology in making hardware more agile and cost-effective, advocating for standardization to foster innovation. The episode concludes with a call to join the open platform movement to accelerate progress, overcome barriers like slowing Moore’s Law, and create a larger market pie for all stakeholders.

    41 min

  9. 02/19/2025

    AI, Chiplets, and the Future of Semiconductors

    In this inaugural episode of Tech Threads, hosted by Stan Reiss, we welcome Baya Systems’ new board members, Siva Yerramilli (Synopsys) and Manish Muthal (Maverick Silicon), for a deep dive into the rapid evolution of the semiconductor industry. As AI accelerates innovation, chiplet-based architectures are redefining how chips are designed and built, all while Moore’s Law slows down. Join us as we explore what’s driving this shift, the challenges ahead, and how the industry is adapting to meet the demands of next-generation computing.

    33 min
  • 9 Episodes

About

This podcast hosted by Baya Systems explores the cutting edge of technology, from AI acceleration to data movement and chiplet innovation. Each episode dives into groundbreaking advancements shaping the future of computing, featuring insights from industry experts on the trends and challenges defining the tech landscape. Tune in to stay ahead in the rapidly evolving world of technology.

Information