https://ferranpons.com/tags/llamatik/Recent content in Llamatik onHugoenTue, 28 Jan 2025 00:00:00 +0000https://ferranpons.com/blog/how-to-run-llms-offline-on-android-kotlin/Tue, 28 Jan 2025 00:00:00 +0000https://ferranpons.com/blog/how-to-run-llms-offline-on-android-kotlin/<p>Cloud-based language models introduce network dependency, latency, usage-based costs, and privacy concerns. So the question is: can we run LLMs fully offline on Android, using Kotlin?</p> <p>The answer is yes — and it&rsquo;s more practical than you might think.</p> <h3 id="why-run-llms-offline-on-android">Why Run LLMs Offline on Android?</h3> <p>Offline LLMs enable:</p> <ul> <li>Offline-first applications</li> <li>Privacy-preserving AI</li> <li>Predictable performance and cost</li> <li>Tight UI integration with no round-trip latency</li> </ul> <p>Modern Android devices offer ARM CPUs with NEON support, substantial RAM on mid/high-end devices, and fast local storage. The challenge lies in tooling, not hardware.</p>