The Deep Edge Podcast

Ray Mota

The Deep Edge Podcast discusses technologies powering a cloud-native, fully connected world: Virtual and physical compute; virtual and physical networking; orchestration; mobile/wireless, wired; Internet of things; NFV; SDN; routing and switching; optical; cable; and hyper-scalers. We deliver the skills, insights, and materials to help our subscribers master their own transformations.

  1. 1d ago

    AI’s Network Bottleneck: Cisco’s Bill Gartner & ACG Research’s Ray Mota | Ep: 78

    Powerful GPUs are only part of the AI equation. The networks connecting them play a critical role in performance, efficiency, and scale. Join Ray Mota of ACG Research and Bill Gartner of Cisco for a discussion on how optical networking and interconnect infrastructure are evolving to support increasingly demanding AI workloads. In this conversation: - Connecting AI infrastructure across distributed data centers - How packet loss and latency affect GPU utilization - Advances in coherent optics and fiber capacity - Power efficiency and the economics of AI infrastructure - Network visibility, security, and agentic AI - Why networking belongs at the center of AI investment decisions Featuring Ray Mota — ACG Research Bill Gartner — Cisco Subscribe for more conversations on networking, cloud, and AI infrastructure. #AI infrastructure #AI networking #ScaleAcross #CiscoOpticalNetworking #CiscoRoutedOpticalNetworking #Multi-raillinesystems #CoherentPluggableOptics #DCI

    AI’s Network Bottleneck: Cisco’s Bill Gartner & ACG Research’s Ray Mota | Ep: 78

  2. Oct 10

    AI Infrastructure & Self-Driving Networks: How HPE Juniper Is Powering the AI Era | Ep: 77

    In this episode of the Deep Edge Podcast, host Ray Mota sits down with AE from HPE Juniper to break down the massive shift happening in networking and AI infrastructure. From multi-data center connectivity to edge computing and self-driving networks, they dive deep into how modern networks are evolving to support the heavy demands of AI workloads. In this episode, we cover: Scale-Up, Scale-Out & Scale-Across: Why AI is inherently a distributed application and how backend networks (DCI, GPU fabrics) are adapting. AI On-Ramps & Edge Computing: Connecting enterprise users to AI clusters for high-performance inference and real-time consumption. Silicon Strategy: How HPE Juniper leverages custom silicon (PTX and Trio chips) to optimize power efficiency, space, latency, and GPU duty cycles. Non-Traditional Fabrics: Navigating satellite/LEO connectivity and data center expansion in space. Self-Driving Networks: Moving from telemetry and AIOps concept to real-world deployments that reduce support tickets and automate operations. Enterprise Networking Advice: Why traditional oversubscription model architectures are failing in the age of agentic AI and symmetric traffic flows. #AINetworking #HPEJuniper #DeepEdgePodcast #AIInfrastructure #SelfDrivingNetworks #EdgeComputing #DataCenter #NetworkingStrategy

    AI Infrastructure & Self-Driving Networks: How HPE Juniper Is Powering the AI Era | Ep: 77

  3. Sep 8

    The Hidden Cost of AI Inference: Token Pricing, Egress & Edge Architecture | Ep: 76

    In this episode of The Deep Edge Podcast, host Ray Mota sits down with Ari Weil, Vice President of Cloud Computing and Delivery Product Marketing at Akamai, to examine the real economics of AI inference. Token pricing may be the most visible line item, but it does not tell the whole story. Ray and Ari discuss how network egress, cross-region data transfers, latency, model placement, and increasingly complex agentic and RAG workflows can reshape the total cost of running AI in production. They also explore when centralized inference makes sense, when distributed and edge architectures offer an advantage, and the essential questions enterprises should ask before committing to an AI infrastructure provider. Read Ari Weil’s article, “Your AI Cost Model Stops at the Token Price. The Bill Doesn’t”: https://www.akamai.com/blog/ai/ai-cost-model-stops-token-price-bill-doesnt Topics covered: • Why token pricing provides an incomplete view of AI costs • The hidden impact of egress and data movement • How agentic AI and RAG increase infrastructure interactions • Latency, locality, privacy, and data sovereignty • Centralized versus distributed AI inference • Choosing the right model for each workload • Questions enterprises should ask AI infrastructure vendors Chapters: 00:00 Introduction 01:25 Welcome — Ray Mota and Ari Weil 02:04 Why token pricing misses the real cost 03:53 Agentic AI, RAG, and infrastructure interactions 06:18 Why egress, data movement, and latency matter 08:36 Centralized versus distributed inference 10:26 Questions enterprises should ask vendors 12:01 Closing thoughts Subscribe to The Deep Edge Podcast for conversations about AI infrastructure, cloud computing, networking, edge architecture, and the technologies shaping our connected world. #AI #AIInfrastructure #CloudComputing #EdgeComputing #Akamai #AgenticAI #TheDeepEdgePodcast

    The Hidden Cost of AI Inference: Token Pricing, Egress & Edge Architecture | Ep: 76

  4. Jul 12

    Quantum Networking: The Internet That Cannot Be Copied I Ep: 75

    What if a message could be protected by the laws of physics—not just by encryption? In this video, we explore the real promise of quantum networking and the science behind the no-cloning theorem, quantum entanglement, trusted nodes, quantum repeaters, and the race to build a true end-to-end quantum internet. We also look at what is working today, including China’s large-scale quantum communication network, and what is still holding the industry back. The biggest challenges are not the theory, they are the engineering bottlenecks involving distance, quantum memory, hardware interoperability, switching, and network emulation. You will learn: • Why quantum data cannot be copied • How eavesdropping leaves a detectable fingerprint • Why trusted relay stations remain a security risk • How entanglement swapping and quantum repeaters work • Why quantum memory is one of the biggest technical obstacles • How digital twins and virtual emulators are helping engineers test quantum networks • The three-stage roadmap toward a global quantum internet • Why “harvest now, decrypt later” is accelerating investment in quantum security Quantum networking is not simply a faster version of today’s internet. It represents an entirely new approach to communication, security, and distributed computing. For the last century, we built the internet around the ability to perfectly copy information. The engineering race of the next century may be defined by the ability not to. #QuantumNetworking #QuantumInternet #QuantumComputing #QuantumSecurity #Cybersecurity #QuantumCommunication #PostQuantumCryptography #Technology #FutureOfNetworking #ACGResearch

    Quantum Networking: The Internet That Cannot Be Copied I Ep: 75

  5. Jun 25

    Optical Is the Foundation of AI: Why Light Is the Real AI Infrastructure Bottleneck I Ep: 74

    For the last two years, the AI infrastructure conversation has been dominated by GPUs. But as AI clusters scale to tens of thousands — and eventually hundreds of thousands — of GPUs, the real bottleneck is shifting. The next AI infrastructure challenge is not just compute. It is interconnect. In this episode of The Deep Edge Podcast, Ray Mota breaks down why optical networking is becoming the foundation of AI data centers. From 800G and 1.6T optics to Linear Pluggable Optics, Co-Packaged Optics, Optical Circuit Switching, and silicon photonics, the future of AI depends on how fast, efficiently, and reliably GPUs can communicate. A GPU waiting on data is stranded capital.  And optical is what keeps the AI factory moving. Topics covered: Why copper is reaching its physical limitsWhy AI clusters need massive east-west bandwidthThe role of 800G and 1.6T opticsLinear Pluggable Optics and Co-Packaged OpticsOptical Circuit Switching and flatter AI networksWhy optical efficiency directly impacts AI economicsWhy light, not just compute, will define the next AI buildoutKey takeaway: Compute gets the headlines, but optical holds the AI factory together.

    Optical Is the Foundation of AI: Why Light Is the Real AI Infrastructure Bottleneck I Ep: 74

  6. Jun 3

    AI Is Not a GPU Problem — It’s a Network Economics Problem I Ep: 73

    Everyone is talking about the GPU shortage. GPUs are expensive, scarce, power-hungry, and central to AI infrastructure. But the real issue is much deeper. In this episode of The Deep Edge Podcast, Ray Mota breaks down why AI infrastructure is not fundamentally a GPU problem — it is a network economics problem. As AI workloads scale, the hidden bottleneck is not just compute capacity, but the ability of the network to move data efficiently, keep GPUs utilized, reduce latency, control power consumption, and avoid massive infrastructure waste Ray explains why enterprises, service providers, and hyperscalers must rethink AI infrastructure through the lens of network design, utilization economics, east-west traffic, data movement, automation, and total cost of ownership. The key message: buying more GPUs will not solve the problem if the network cannot support the economics of AI at scale.

    AI Is Not a GPU Problem — It’s a Network Economics Problem I Ep: 73

  7. May 30

    Starbucks has recently pulled the plug on their AI inventory tool, after just 9 months in 11,000+ shops. I Ep: 72

    Starbucks has recently pulled the plug on their AI inventory tool, after just 9 months in 11,000+ shops. The bigger lesson for me is simple: AI cannot solve an operations problem it does not understand. The technology was designed to utilize computer vision and spatial intelligence to count inventories faster and more precisely. On paper it sounds powerful. But in the real world, it apparently confused products, failed to find items on shelves, and made stockout concerns worse, not better. This is not a Starbucks problem. It’s a larger lesson for enterprise AI. Many firms are trying to expand AI without even understanding the operational challenge, the workflow, the human behavior and execution environment. AI doesn’t instantly produce process discipline. It magnifies the quality, or the fragility, of the underlying operational model. Some major take-aways: Speed is not preparation. Scaling AI to thousands of locations fast might seem daring, but success in the pilot does not always translate to success in production. AI requires operational context. If the fundamental cause is supply chain consistency, replenishment timeliness, store level execution, or process variation, then counting faster is not the issue. Frontline feedback is important. The failure sites are commonly seen by employees closest to the work. That signal is ignored, delaying adjustment and increasing risk. The design of the integration is as crucial as the AI model. Enterprise AI success isn’t about claims of accuracy. It’s about workflow fit, process reform, data quality, governance, training and adoption. Enterprise AI’s biggest danger isn’t the adoption. Scaling prematurely without properly diagnosing the business and operational problem. AI is powerful, but we need to relate it to the realities of how work really gets done.” What’s your take: are corporations rushing too fast to implement AI before they properly grasp the operational difficulties they are seeking to solve? #AI #EnterpriseAI #DigitalTransformation #RetailTech #SupplyChain #Operations #TechLeadership

  8. Apr 14

    The Economics of AI Infrastructure: From Network Cost to Capital Return I Ep: 71

    In this episode of The Deep Edge Podcast, Ray Mota breaks down one of the most important questions facing network architects, CTOs, and business leaders building next-generation AI data centers: how to make the right infrastructure investment decisions with real confidence. Ray explains why the economics of AI data centers are fundamentally different from traditional enterprise networks. In the AI era, the biggest investment is often the GPU cluster, and the network’s role is no longer just to provide connectivity. Its job is to keep high-value GPU resources fully utilized. When the network underperforms, the result is not just lower performance. It can mean lost revenue, delayed service delivery, and direct destruction of capital efficiency. The episode explores why financial modeling tools such as economic digital twins are becoming essential for planning AI infrastructure. Ray also outlines the critical questions every organization should quantify before committing capital, including the cost of GPU idle time, the CapEx-to-OpEx tradeoffs of different architectures, and the break-even point for transport decisions under varying growth scenarios. This is a practical and executive-level discussion on why AI infrastructure decisions must now be guided by modeled economics, not vendor slides.

See All (78)

5
out of 5
8 Ratings

About

The Deep Edge Podcast discusses technologies powering a cloud-native, fully connected world: Virtual and physical compute; virtual and physical networking; orchestration; mobile/wireless, wired; Internet of things; NFV; SDN; routing and switching; optical; cable; and hyper-scalers. We deliver the skills, insights, and materials to help our subscribers master their own transformations.

Information

  • Creator
    Ray Mota
  • Years Active
    2020 - 2026
  • Episodes
    78
  • Rating
    Clean
  • Copyright
    © 2026 The Deep Edge Podcast
  • Show Website
    The Deep Edge Podcast