On-Device ML
On-Device ML is the practice of running machine learning models directly on edge devices like smartphones, IoT sensors, or embedded systems, instead of in the cloud. This enables real-time inference, preserves user privacy by keeping data local, and reduces dependency on network connectivity.
AI companies are prioritizing on-device ML to deliver faster, more private, and more reliable AI features to billions of users while reducing cloud infrastructure costs. Apple and Meta are heavily investing in this area to power features like real-time camera filters, offline translation, and personalized recommendations without compromising user data.
🎓 Courses
Introduction to TensorFlow Lite
by Laurence Moroney
This course provides a practical foundation for deploying machine learning models on mobile and embedded devices using TensorFlow Lite, covering model conversion, optimization, and integration.
Deploying Machine Learning Models on Mobile
by Mat Leonard, Juan Delgado
This nanodegree program focuses on the end-to-end pipeline for optimizing and deploying models to mobile devices, including practical techniques for performance and size constraints.
TensorFlow Lite: Deploying ML on Mobile and IoT
by Google (via edX)
This professional certificate program teaches how to build, optimize, and deploy ML models for on-device applications using TensorFlow Lite, with hands-on projects for real-world scenarios.
📖 Books
TinyML Cookbook: Combine artificial intelligence and ultra-low-power embedded devices to make the world smarter
Gian Marco Iodice · 2023
This practical cookbook, updated in 2023, provides hands-on recipes for implementing machine learning on ultra-low-power microcontrollers and embedded devices.
Practical Deep Learning for Cloud, Mobile, and Edge: Real-World AI & Computer-Vision Projects Using Python, Keras & TensorFlow
Anirudh Koul, Siddha Ganju, Meher Kasam · 2023
This book dedicates significant coverage to deploying optimized models for mobile and edge devices, with practical projects using TensorFlow Lite and Core ML.
On-Device AI: A Practical Guide to Building and Deploying Edge Machine Learning Models
Vikramank Singh · 2024
This 2024 book is a comprehensive, practical guide focused specifically on the end-to-end process of building, optimizing, and deploying AI models directly on edge devices.
🛠️ Tutorials & Guides
Getting started with TensorFlow Lite
The official TensorFlow Lite documentation provides step-by-step tutorials for converting, optimizing, and deploying models on Android, iOS, and embedded Linux.
Learning resources last updated: April 13, 2026