Keeping it Local: Generative AI at the Edge

Unlocking AI at the Edge with NXP's eIQ GenAI Flow | EdgeVerse Techcast

In this episode of the EdgeVerse Techcast, hosts Bridgette Stone and Kyle Dando delve into the transformative impact of NXP's eIQ GenAI Flow on edge computing. Joined by AI expert Davis Sawyer, the conversation covers the deployment of large language models at the edge, the integration of audio tasks, and the role of Retrieval Augmented Generation (RAG) in improving model accuracy. The discussion also highlights real-world applications in automotive, healthcare, and industrial automation, showcasing how eIQ GenAI Flow enables secure, efficient, and local AI processing.

Tune in to discover how this innovative tool is setting new standards for AI performance at the edge.

Additional resources to keep learning:

• eIQ on NXP.com: www.nxp.com/eIQ
• Read a Blog: www.nxp.com/company/about-nxp/smarter-world-blog/BL-GEN-AI-FOR-EMBEDDED-APPS
• Read a Paper: www.nxp.com/webapp/Download?colCode=GEN-AI-RAG-WHITEPAPER
• Watch Training: www.nxp.com/design/design-center/training/TS-MACHINE-LEARNING-AND-AI

00:00 Introduction and Hosts

00:53 Guest Introduction: Davis Sawyer

01:39 Understanding eIQ GenAI Flow

03:06 Exploring RAG (Retrieval Augmented Generation)

05:44 Quantization and NPU Acceleration

08:08 Real-World Applications of GenAI Flow

10:17 Future of Edge-Based GenAI

12:01 Conclusion and Wrap-Up