Chris Cole - Running LLMs on Microcontrollers

,

In this episode, we discuss aspects running AI on edge systems (both microcontrollers and embedded Linux). Chris has a lot of experience doing this and has used AI at the edge in multiple projects to solve real problems. This episode provides an overview of the technology and will help you understand the steps to implementing an AI model in your system.

Chris has published an open source project for implementing neural networks on embedded systems.

Discussing and learning from Chris’s experiences was one of the best.