Discover the cutting-edge world of energy-efficient machine learning, edge AI, hardware accelerators, software algorithms, and real-world use cases with this po...
Revolutionizing Edge Devices with Energy-Efficient Generative AI Techniques
Send us a textUnlock the secrets of energy-efficient AI as we explore the groundbreaking fusion of Edge AI and generative AI in our latest episode. With expert insights from Victor Jung, a trailblazer in the field, discover how foundational models can be deployed on tiny and embedded systems to revolutionize devices like AR glasses and nanodrones. Listen as we unravel the complexities of deploying neural networks on microcontrollers, with a focus on powerful techniques like quantization, graph lowering, and innovative memory management strategies.Victor guides us through the nuanced process of deploying neural networks, highlighting critical stages like graph lowering and memory allocation. Traverse the intricate front-end and mid-end stages where neural network graphs are optimized, ensuring peak performance on specific hardware platforms. We'll illustrate the importance of efficient memory usage through a fascinating example involving a tiny language model on the Syracuse platform, showcasing the role of quantization and memory management tailored for hardware constraints.Dive into the future of AI deployment on edge devices with a focus on quantization and hardware support. From exploring the potential of foundation models like DenoV2 to discussing the emerging micro scaling format, we uncover the technologies that are making AI more energy-efficient and versatile. Our conversation underscores the importance of viewing memory as a compute asset and the need for ongoing research to enhance system efficiency for generative AI at the edge. Join us for an enlightening episode that highlights the vital steps needed to optimize memory and computing resources for meaningful applications on small platforms.Support the showLearn more about the EDGE AI FOUNDATION - edgeaifoundation.org
-------- Â
50:19
Transforming Edge AI Education: Insights from Harvard's Dr. Vijay Janapa Reddi
Send us a textJoin us for an insightful conversation with Dr. Vijay Janapa Reddi from Harvard, who takes us on a journey through the evolving world of edge computing and machine learning education. Discover how his family's affinity for East Coast seasons inspired his academic path, and learn about his groundbreaking open-source book on machine learning systems. This episode celebrates the rebranding of the tinyML Foundation to the Edge AI Foundation, reflecting an expanded focus that transcends embedded devices. We tackle the complexities of machine learning education, where excitement often masks the real challenges of developing robust AI systems.Dr. Janapa Reddi’s vision for his work-in-progress book draws from his teaching experiences at Harvard, aiming to universalize machine learning system principles akin to core concepts in operating systems. We explore the challenge of crafting educational materials that cater to both beginners and seasoned professionals, providing a roadmap to guide diverse audiences. The discussion highlights the importance of hands-on learning, especially in data collection and lab work, with contributions from notable figures like Marcelo Rovai in the tinyML space, emphasizing practical applications for edge AI systems.In a fascinating discussion on data science versus data engineering, Dr. Janapa Reddi elucidates the foundational role of data engineering in successful machine learning projects. We also delve into microcontroller programmability and the integration of frameworks like TensorFlow and PyTorch into curriculums. As we explore the role of AI tools like ChatGPT in programming, the conversation shifts to the exciting potential of AI-powered educational assistants, transforming the future of learning through interactive and personalized experiences. Whether you're a student, educator, or industry professional, this episode offers a wealth of insights into the intersection of AI, education, and the future of edge technologies.Support the showLearn more about the EDGE AI FOUNDATION - edgeaifoundation.org
-------- Â
59:56
Recap of the "Beyond Chatbots - The Journey of Generative AI to the Edge"
Send us a textGet ready for the recap of the Beyond Chatbots - The Journey of Generative AI to the Edge - exploring the frontier of Generative AI and edge technology with Davis Sawyer, Danilo Pau and Pete Bernard as they discuss the dynamic innovations transforming these fields. We uncover the fascinating shift from cloud-based proof-of-concepts to the compelling reality of edge solutions. This conversation dives into the ever-evolving landscape of generative AI, particularly in edge environments where cost and power efficiency reign supreme. From automotive breakthroughs to advanced memory optimization techniques, discover how these innovations are redefining the role of AI in our world.Listen in as we dissect the gravitational pull towards edge solutions with insights from recent industry research and captivating discussions. Dave shares intriguing observations on AI as crucial infrastructure, likening it to essential utilities that promise lasting impacts across sectors. As we look ahead, the conversation turns to the future of AI in manufacturing and the exciting potential for AGI-capable equipment. With Foundation partners like STMicroelectronics and NXP at the helm, the potential for edge AI advancements is limitless. Join us for an engaging exploration of the trends shaping the future of AI and edge computing.Support the showLearn more about the EDGE AI FOUNDATION - edgeaifoundation.org
-------- Â
8:31
Crafting Artistic Images with Embedded AI with Alberto Ancilotto of FBK
Send us a textUnlock the secrets of neural style transfer on microcontrollers with our special guest, Alberto Ancilotto of FBK, as he explores a groundbreaking approach to image generation on low-power devices. Discover how this innovative technique allows us to combine the content of one image with the artistic style of another, transforming simple visuals into unique masterpieces—like turning a regular cat photo into a Van Gogh-inspired work of art. Alberto introduces Xinet, a cutting-edge convolutional neural network designed to perform these creative tasks efficiently on embedded platforms. Gain insight into the process of optimizing performance by evaluating CNN operators for energy efficiency and adapting networks for a variety of devices, from the smallest microcontrollers to advanced TPUs and accelerators.We dive deep into the collaboration between Clip and style transfer networks, enhancing the precision of semantic representation in generated images. Witness the impressive capabilities of this technology through real-world examples, such as generating images in just 60 milliseconds on the STM32N6 microcontroller. Experience the advanced applications in video anonymization, where style transfer provides a superior alternative to traditional blurring methods, altering appearances while maintaining action consistency. Alberto also addresses the broader implications of anonymization technology in public spaces, including privacy protection and GDPR compliance, while maintaining artistic integrity. Join us as we tackle audience questions about model parameters, deployment flexibility, and the exciting potential of this technology across various sectors.Support the showLearn more about the EDGE AI FOUNDATION - edgeaifoundation.org
-------- Â
31:30
Revolutionizing Software Development with GenAI-Powered Edge Solutions with Anirban Bhattacharjee of Wipro
Send us a textWhat if AI could transform the landscape of software development, making traditional methods seem like relics of the past? Join us as we sit down with a visionary guest from Wipro Engineering to uncover how GenAI-based custom code systems are revolutionizing the future of AI PCs. We promise a deep dive into how these intelligent tools are not just enhancing productivity but are redefining the very essence of software creation. Discover why the shift from cloud-based to edge-based solutions is imperative for enterprise developers dealing with proprietary codebases, and explore the power of open-source models like Code Llama, integrated through advanced frameworks such as LanChain and Lama Index. This episode promises to unravel the intricacies of an innovative web-based application designed to boost performance and user efficiency.Our conversation also shines a light on the tangible productivity gains brought by cutting-edge code assistance tools, effectively reducing weeks of work into days. We explore the vital role of hardware—like RAM and discrete GPUs—in maximizing these tools' potential. Discussions reveal varying levels of acceptance among developers, with younger professionals more readily embracing the shift. To bridge this gap, we recommend intensive training and boot camps as pathways to wider adoption. Furthermore, the potential of generative AI in deciphering and documenting legacy code is highlighted, offering a glimpse into how these advancements are reshaping the programming landscape. Engage with us to understand the profound impact of these innovations on the future of software development.Support the showLearn more about the EDGE AI FOUNDATION - edgeaifoundation.org
Discover the cutting-edge world of energy-efficient machine learning, edge AI, hardware accelerators, software algorithms, and real-world use cases with this podcast feed from all things in the world's largest EDGE AI community. These are shows like EDGE AI TALKS, EDGE AI BLUEPRINTS as well as EDGE AI FOUNDATION event talks on a range of research, product and business topics. Join us to stay informed and inspired!
South Africa