EDGE AI POD

EDGE AI FOUNDATION

Discover the cutting-edge world of energy-efficient machine learning, edge AI, hardware accelerators, software algorithms, and real-world use cases with this podcast feed from all things in the world's largest EDGE AI community.  These are shows like EDGE AI Talks, EDGE AI Blueprints as well as EDGE AI FOUNDATION event talks on a range of research, product and business topics. Join us to stay informed and inspired!

  1. 1 day ago

    Edge AI That Cuts Chemical Waste

    What if a lab test that takes 12 to 24 hours could be replaced by a live estimate that guides dosing in real time? We walk through a high-stakes water story where boron control in desalination demanded more than a clever model—it needed a secure, local-first AI system that works across wildly different plants. Our journey with Acciona started with a simple idea: a virtual sensor to predict boron and avoid overusing caustic soda or risking fines. The reality was messy. Membranes, sensors, and SCADA setups varied from site to site. Cybersecurity kept data locked on-prem, and lab workflows produced sparse, noisy labels. A single global model wasn’t resilient enough. So we flipped the playbook and orchestrated many models at the edge—one per rack when needed—packaged in Docker, deployed with a click, and monitored locally with InfluxDB and Grafana. We break down the full stack: MQTT brokers to standardize data, connectors for heterogeneous OT systems, TensorFlow for inference, and JupyterLab plus MLflow for on-device training and versioning. This architecture kept raw data inside the plant while a cloud console managed applications securely. The payoff was immediate: accurate boron estimates tightened dosing, cut chemical spend, reduced penalties, and built operator trust by showing predictions alongside lab results. One site saved over $200,000 in a year; scaled across the fleet, the impact reaches well into the millions, with healthier water as a bonus. Beyond boron, the same edge AI approach unlocks energy optimization for high-pressure pumps, membrane fouling detection, and even computer vision tasks—without compromising critical infrastructure security. If you care about industrial AI that actually ships, this is a practical blueprint: local models, secure orchestration, and a path from pilot to fleet. Enjoy the episode, share it with a teammate who wrestles with on-prem constraints, and leave a review. Want to see it live? Ask us for the free trial and we’ll set up a demo. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  2. 30 Jul

    The Skinny Transformer: Squeezing Gen AI into Tiny Devices

    The future of artificial intelligence isn't just in massive cloud data centers—it's happening right now on the devices all around us. This insightful panel discussion brings together leading experts from major semiconductor companies and academia to explore how Generative AI is transforming edge computing. What makes this conversation particularly valuable is the panelists' emphasis on practical reality versus future potential. While many assume GenAI requires enormous computing resources, the experts reveal that today's edge hardware—from smartphones to IoT devices—already supports numerous generative applications. The key isn't waiting for more powerful chips but rethinking how we approach model design, quantization, and specialization. Danilo Pau from STMicroelectronics shares a fascinating vision of natural language interaction with everyday objects like thermostats, while Qualcomm's Evgeny Kuznetsov highlights how real-time translation and synthetic data generation deliver immediate productivity benefits. ARM's John Mark Yodis emphasizes that education and framework selection are more significant barriers than hardware limitations. The technical discussion delves into cutting-edge compression techniques, with quantization advancing from Int8 to Int4, Int2, and even Int1 representations. Professor Huanrui Yang explains how foundation models can be specialized and pruned to maintain performance only in domains relevant to specific edge applications. This targeted approach enables capabilities previously thought impossible on resource-constrained devices. Perhaps most exciting is the panel's exploration of unique edge advantages—proximity to data, sensor integration, and specialized hardware—that enable entirely new GenAI applications impossible in the cloud. Through orchestration across heterogeneous computing resources and domain-specific adaptation, the next wave of intelligent systems will distribute AI processing across the compute spectrum. Whether you're a developer looking to deploy GenAI on current hardware, a researcher exploring new compression techniques, or a product manager planning your AI roadmap, this discussion provides crucial insights into what's possible today and where the technology is heading tomorrow. Don't wait for the future—generative AI at the edge is already here. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  3. 23 Jul

    How Microsecond AI Control Transforms Power Systems And Cuts Errors

    What if the control loop could think ahead and correct itself before errors take hold? We dive into a practical leap for motors, inverters, and energy storage: ultra-low-latency edge AI that predicts error trajectories at startup and intervenes inside the loop in about 100 microseconds. Instead of piling on sensors and pushing raw signals to the cloud, we work directly from existing operational data, chart the most efficient path, and act locally—then pass only meaningful transients upstream for fleet analytics and predictive maintenance. We start by grounding the challenge: linear systems tolerate classic PID, but nonlinear dynamics create overshoot, oscillation, and costly performance tradeoffs. Throwing bigger processors at the problem hits limits on cost, memory, and thermals. The solution mirrors a lesson from the smartphone era—where dynamic voltage and frequency scaling transformed performance-per-watt—by bringing adaptive optimization to the plant itself. Our Ultra-Edge technology extends PID behavior into nonlinear territory, shrinking speed error during torque steps and tightening control, even on modest 32 MHz platforms, with further gains as faster silicon comes online. From factory floors to the power grid, the implications are big. In motor drives, torque transitions smooth out with fewer current spikes. In utilities and data centers, grid-forming converters coordinate with renewables and battery energy storage to deliver synthetic inertia, riding through disturbances and supporting stability rather than tripping offline. By acting in microseconds, converters offer a stabilizing boost, enabling higher renewable penetration and a more credible path to net zero. Meanwhile, microcontroller-level filtering trims a million samples per second down to high-value events so teams get signal without noise. If you care about real-time control, nonlinear systems, and scaling stability with clean energy, this conversation brings clear examples, measured results, and a roadmap for adoption—from pilots and soft IP to demo platforms and a growing model library. Subscribe, share with a teammate who owns drives or converters, and leave a review with your biggest control pain point so we can tackle it next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  4. 16 Jul

    Edge of Tomorrow: How NXP is Revolutionizing On-Device AI

    The AI landscape is transforming rapidly, and NXP Semiconductors is at the forefront of bringing these capabilities where they matter most—directly to edge devices. Alberto Alvarez delivers a compelling overview of how NXP is enabling sophisticated generative AI to run locally on microprocessors, without relying on cloud connectivity. Unlike companies focused on massive cloud-based AI training, NXP targets the critical deployment phase, where privacy, security, and efficiency are paramount. Their approach empowers developers to create AI-enhanced solutions for industrial automation, healthcare, automotive systems, and smart environments that keep sensitive data completely local. The presentation unveils the EAQ GenAI flow—a comprehensive software pipeline that allows developers to fine-tune and optimize large language models for specific applications without exposing proprietary data to third-party servers. This pipeline includes automatic speech recognition (ASR) based on the Whisper architecture, LLM reasoning with LLAMA3, retrieval-augmented generation (RAG) for domain-specific knowledge, and natural text-to-speech synthesis—all running efficiently on NXP's hardware. Most impressively, through a partnership with Kinara, NXP demonstrates a fully edge-based multimodal AI implementation running on their iMX810 Plus platform. This system combines an 8-billion parameter language model with computer vision capabilities, allowing it to analyze images, reason about visual content, and respond to questions—all without sending any data to the cloud. The implementation achieves remarkable performance metrics, generating 6.5 tokens per second with response latency as low as 1.5 seconds for follow-up questions about images. From robots with enhanced reasoning capabilities to medical assistants that can analyze diagnostic imagery, the possibilities for this technology are vast and expanding daily. As NXP continues pushing the boundaries of what's possible at the edge, they're laying the groundwork for the next frontier: agentic AI systems that can perceive, reason, and act autonomously across multiple modalities. Ready to build secure, private AI applications that don't compromise on capability? Explore NXP's resources and start creating tomorrow's intelligent edge solutions today. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  5. 9 Jul

    Hardware-Aware AI, Not Just Bigger Models

    What if the obstacle to fast, reliable AI isn’t your dataset or your optimizer—but the silicon under your model? We dig into why performance collapses when architecture and hardware don’t align, and we lay out a clear path to ship models that actually fly on the devices your users own. Starting with the Ferrari-and-hummingbird metaphor, we show how theoretical efficiency—FLOPs, parameters, even TOPS—often fails to predict real-world latency, power, and user experience. We walk through a surprising benchmark: MobileNet V2, small and “efficient,” runs slower than an older ResNet18 on GPUs because depthwise, sequential kernels underutilize parallel hardware. Then we zoom out to hardware selection itself, where NPUs can outperform GPUs despite lower TOPS due to operator support, kernel fusion, and memory behavior. The takeaway is simple: architecture matters only in context, and context means the execution engine, compiler stack, and memory hierarchy that will carry your model in production. From there, we share a four-step framework to become hardware aware: profile on real devices from day one, verify operator compatibility early, automate bottleneck discovery and model selection in CI, and optimize with context using hardware-aware pruning and mixed precision. To show how this works in practice, we unpack our Llama 3.2-1B project on Snapdragon Gen 3, where targeted pruning and precision tuning delivered 31% faster token generation, 25% faster prompt processing, and a 126% faster initialization—all with under 1% accuracy loss. If you build models for the edge, mobile, GPUs, or NPUs, this conversation will help you avoid dead-ends and design for the hardware you actually ship on. Subscribe for more deep dives, share this episode with your team, and leave a review to tell us which hardware you’re targeting next. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  6. 2 Jul

    What If A Pair Of Glasses Could Read Intent?

    Imagine steering a game with nothing but a blink and a glance. That’s the spark behind our latest build: a noninvasive brain-computer interface that runs entirely on a tiny edge microcontroller, translating eye movements into reliable, real-time commands without a laptop or cloud. We start with the human why. Millions live with neurological conditions that constrain movement but preserve eye control—a narrow channel with huge potential. We compare the promises and trade-offs of invasive BCIs like Neuralink, BrainGate, and Synchron against accessible wearables from Emotiv, Muse, and OpenBCI. The big gap is obvious: people need precise, low-latency control without surgery, high cost, or a desktop tether. Our approach uses electrostatic charge sensing with a glasses-ready electrode layout at the nose bridge and a reference behind the ear, capturing strong ocular signals that are practical for daily wear. From there, we break down the full on-device pipeline. A high-pass filter removes drift, a 50 Hz notch kills power-line noise, and a low-pass smooths the signal so a smaller model can focus on meaningful features. A lightweight Z-score event detector stays always-on and wakes the classifier only when something happens, buffering a 300-sample window at 240 Hz across two channels. The classifier is a tiny 1D CNN—convolution, ReLU, pooling, softmax—clocking about 0.76 ms inference with roughly 18 KB flash and 6 KB RAM. With K-fold cross-validation on nine participants, we see around 90% accuracy for four classes: discard involuntary blinks, map voluntary blinks to “click,” and detect left and right glances. We showcase it with a playful demo: blink to jump over obstacles, glance right to change lanes and collect coins. Beyond the fun, the implications are serious—restoring agency with affordable hardware that works off-grid in real time. We close by outlining what’s next: integrating the sensors into everyday glasses, testing across more users and environments, and adding quick calibration for personalization. If accessible control matters to you—whether for assistive tech, gaming, or new hands-free interfaces—this is a glimpse of what near-future wearables can do. Enjoy the episode? Follow the show, share it with a friend, and leave a quick review to help more listeners discover these conversations. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  7. 25 Jun

    Got Fake Chips? Our AI Doesn't Fall For That

    Semiconductor counterfeiting has grown into a $200 billion annual problem threatening the integrity of global electronics supply chains. As both chip shortages and sophisticated counterfeiting techniques persist, traditional detection methods fall short—requiring complex setups, hardware modifications, or extensive data labeling. Two machine learning engineers from Analog Devices' advanced R&D team unveil their elegant solution: an unsupervised learning approach that captures the unique "fingerprints" of authentic chips by analyzing power signatures during memory operations. What makes their method revolutionary is its lightweight footprint (under 60KB) and ability to run directly on standard Cortex-M4 microcontrollers at the edge, requiring no cloud connectivity or specialized equipment. The team shares their methodology for creating a robust dataset of 1,000 secure authenticator chips and developing a convolutional autoencoder architecture that achieved 100% accuracy in distinguishing authentic components from close counterparts. Their model learns the normal reconstruction patterns of legitimate chips, then flags anomalies when encountering counterfeits with distinctly different power signatures. Beyond secure authenticators, this approach proves universally applicable to any semiconductor from which analog fingerprints can be collected. Rather than replacing traditional cryptographic methods, it serves as an additional security layer that remains effective even when encryption keys might be compromised through side-channel attacks. Ready to strengthen your supply chain against increasingly sophisticated counterfeits? Discover how this scalable, software-based solution could be integrated with your existing security infrastructure to provide an additional layer of protection for critical semiconductor components. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

  8. 18 Jun

    Smarter AI, Faster Hardware

    Your phone, watch, and even your fridge want real-time intelligence—but power and latency won’t tolerate bloated models or generic compute. We walk through a practical path from Python to custom hardware using high-level synthesis, then invite you to prove it in our Efficient Inferencing Hackathon. With a ready-to-run RISC‑V Rocket Core baseline for MNIST, a full Siemens EDA toolchain, and on-demand training, you’ll learn how to cut latency and power while protecting accuracy through precision mapping, parallelism, and smarter dataflow. We start by mapping the compute landscape—CPUs for flexibility, GPUs for throughput, TPUs/NPUs for tensors, and custom FPGA/ASIC designs for peak power-performance-area. From there, we get tactical: use quantization to right-size bit-widths; apply loop pipelining and unrolling to unlock throughput; partition memories and stream between layers to eliminate round-trips; and iterate quickly with HLS directives instead of rewriting RTL. You’ll see how a baseline inference in the millisecond range can be driven far lower with disciplined co-design, and how Catapult HLS, Questa, and PowerPro provide the feedback loop—latency, area, and power—to make confident trade-offs. Participants receive a virtual machine, C kernels for convolution and dense layers, and a step-by-step path from Keras to synthesizable RTL. The goal is simple and demanding: deliver the fastest MNIST implementation that meets accuracy, area, and energy targets. Along the way, the HLS Academy community offers guidance from experts and peers, and winners will be announced at the Edge AI Foundation event in Taipei, with prizes including a 3D printer, an FPGA board, and Bose earbuds. Ready to turn models into efficient silicon? Join the workshop series, claim your VM via the QR code at hls.academy, and use the promo code with two underscores to unlock full access. If this resonates, subscribe, share with a teammate who ships edge AI, and leave a review to help others find the show. Send us Fan Mail Support the show Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

See All (107)

About

Discover the cutting-edge world of energy-efficient machine learning, edge AI, hardware accelerators, software algorithms, and real-world use cases with this podcast feed from all things in the world's largest EDGE AI community.  These are shows like EDGE AI Talks, EDGE AI Blueprints as well as EDGE AI FOUNDATION event talks on a range of research, product and business topics. Join us to stay informed and inspired!

Information

  • Creator
    EDGE AI FOUNDATION
  • Years Active
    2024 - 2026
  • Episodes
    107
  • Rating
    Clean
  • Copyright
    © 2026 EDGE AI FOUNDATION
  • Show Website
    EDGE AI POD

You Might Also Like