Edge Devices and LLMs: What's Ahead for AI

James Sweetlove

| 已创建：June 12, 2024 | 已更新：July 1, 2024

Edge Devices and LLMs: What's Ahead for AI

In this episode of the Altium OnTrack podcast, host Tech Consultant Zach Peterson explores the fascinating world of Edge AI and how Large Language Models (LLMs) fit into the picture with Jan Jongboom, co-founder of Edge Impulse. The two discuss the evolution from GPT-2 to GPT-4, the importance of edge computing, and the hardware requirements for running AI on edge devices. Discover how reducing the size of LLMs enables efficient deployment on edge devices, gain insights into the practical applications of AI in various industries, and learn about EDGE IMPULSE.

Listen to the Episode

Watch the Episode

More resources:

Getting started w/ Edge Impulse on Renesas platforms
Connect with Jan on LinkedIn
Learn more about Edge Impulse
Check out a recent video from Edge Impulse: Using GPT-4o to train a 2,000,000x smaller model (that runs directly on device)
Exclusive 15 Days Free Altium Designer Access

Understanding the PCB Design Process

关于作者

关于作者

James Sweetlove is the Social Media Manager for Altium where he manages all social accounts and paid social advertising for Altium, as well as the Octopart and Nexar brands, as well as hosting the CTRL+Listen Podcast series. James comes from a background in government having worked as a commercial and legislative analyst in Australia before moving to the US and shifting into the digital marketing sector in 2020. He holds a bachelor’s degree in Anthropology and History from USQ (Australia) and a post-graduate degree in political science from the University of Otago (New Zealand). Outside of Altium James manages a successful website, podcast and non-profit record label and lives in San Diego California.

更多内容来自 James Sweetlove

相关资源

Why Your Supply Chain Needs AI Now Cofactr on Ctrl+Listen

Why Your Supply Chain Needs AI Now Understand why your supply chain needs AI now. See how AI transforms procurement, sourcing, and resilience as hardware teams face constant volatility and rising complexity. 阅读文章

The Current State of AI in PCB Design in 2023

The Current State of AI in PCB Design in 2023 Your favorite machine learning, optimization, and generative AI algorithms may soon be used in your favorite PCB design program. Now that ChatGPT has become a household name and competitor companies are developing their own GPT equivalents (Claude, LLaMa, etc.), EDA startups are looking at how to leverage these tools to help PCB designers and engineers be more productive. With so many industries touched by automation and AI, it was only a matter 阅读文章

Yocto vs ubuntu for embedded systems

Yocto vs. Ubuntu: Which OS is Best For Embedded AI? If you’re a programmer, then you know about Ubuntu. It’s one of the standard Linux distros for server environments, and it’s been used in a number of embedded applications. However, there are other, better choices to use for an OS for your next embedded system. Yocto has a steep learning curve, but it may be the best choice for your next embedded application. 阅读文章

Embedded AI

The Path Forward for Embedded AI In April 2021, I published an article in Printed Circuit Design & Fab, where I proclaimed the future of AI is embedded. In short, my view is that embedded systems will leverage greater usage of AI on the end device, meaning they will rely less on cloud platforms or data centers for inference. Without a doubt, I believe the future of AI is still embedded, but not with the chipset or system architecture I would have thought. At the time of writing 阅读文章

Gemini与ChatGPT对比

Gemini与ChatGPT：谁能写出更好的代码？在这篇文章中，Ari Mahpour 进行了一对一的编码比较，对比了ChatGPT的GPT4模型和Google最强大的模型Gemini Advanced。阅读文章

使用生成式AI为实验室仪器增添物联网功能

使用生成式AI为实验室仪器增添物联网功能在本文中，Ari Mahpour 向您展示如何利用生成式 AI 创建一个完整的网络服务，以控制您的实验室仪器阅读文章

使用ChatGPT分析您的测试数据

使用ChatGPT分析您的测试数据在这篇文章中，Ari Mahpour 讨论了如何最佳利用 ChatGPT 来分析您的测试数据。阅读文章

如何构建自定义GPT动作与您的硬件通信

如何构建自定义GPT动作与您的硬件对话在本文中，Ari Mahpour 向您展示如何创建自定义 GPT Actions，以便与您在家中或实验室里的硬件连接阅读文章

可以使用ChatGPT进行PCB设计吗？

您可以使用ChatGPT进行PCB设计吗？ ChatGPT正在颠覆一切，包括工程。LLM能否用于PCB设计？我们将探讨一些可以使用ChatGPT自动执行的任务。阅读文章

相关的技术文档

返回主页