Edge Devices and LLMs: What's Ahead for AI

OnTrack: The PCB Design Podcast

In this episode of the Altium OnTrack podcast, host Tech Consultant Zach Peterson explores the fascinating world of Edge AI and how Large Language Models (LLMs) fit into the picture with Jan Jongboom, co-founder of Edge Impulse. The two discuss the evolution from GPT-2 to GPT-4, the importance of edge computing, and the hardware requirements for running AI on edge devices. Discover how reducing the size of LLMs enables efficient deployment on edge devices, gain insights into the practical applications of AI in various industries, and learn about EDGE IMPULSE.

More resources:

  • Getting started w/ Edge Impulse on Renesas platforms
  • Connect with Jan on LinkedIn
  • Learn more about Edge Impulse
  • Check out a recent video from Edge Impulse: Using GPT-4o to train a 2,000,000x smaller model (that runs directly on device)
  • Exclusive 15 Days Free Altium Designer Access

To listen to explicit episodes, sign in.

Stay up to date with this show

Sign in or sign up to follow shows, save episodes and get the latest updates.

Select a country or region

Africa, Middle East, and India

Asia Pacific

Europe

Latin America and the Caribbean

The United States and Canada