How to Run LLMs Offline on Android Using Kotlin</h1> <article> <h1>How to Run LLMs Offline on Android Using Kotlin</h1> <p>Tue, 28 Jan 2025 00:00:00 +0000</p> <p>Cloud-based language models introduce network dependency, latency, usage-based costs, and privacy concerns. So the question is: can we run LLMs fully offline on Android, using Kotlin?</p> <p>The answer is yes — and it’s more practical than you might think.</p> <h3 id="why-run-llms-offline-on-android">Why Run LLMs Offline on Android?</h3> <p>Offline LLMs enable:</p> <ul> <li>Offline-first applications</li> <li>Privacy-preserving AI</li> <li>Predictable performance and cost</li> <li>Tight UI integration with no round-trip latency</li> </ul> <p>Modern Android devices offer ARM CPUs with NEON support, substantial RAM on mid/high-end devices, and fast local storage. The challenge lies in tooling, not hardware.</p> </article> <article> <h1>How to run your Monogame app on a Raspberry Pi (or any Linux)</h1> <p>Fri, 01 Oct 2021 14:38:33 +0200</p> <p>If you are here you probably have a <strong>Windows</strong> game developed using <strong>Monogame</strong> that you would like to port to a <strong>Raspberry Pi</strong> device with Raspberry Pi OS (Raspbian). Or even, to any Linux distribution. Well, you are in the right place. This mini-tutorial will cover all the steps to run your game on it.</p> <h5 id="requirements">Requirements</h5> <p>Before starting to get your hands on the task you must comply with these requirements to maximize compatibility and to be up-to-date.</p> </article> <article> <h1>Job #3</h1> <p>Sun, 01 Dec 2024 00:00:00 +0100</p> <h2 id="3rd-job-cio">3rd job: CIO</h2> <p>As Chief Information Officer at Internet Affairs Inc., I lead the strategic transformation of our digital infrastructure and cybersecurity initiatives. My team of 150+ IT professionals works tirelessly to protect and optimize our global network spanning 23 countries.</p> <p>During my tenure, I’ve spearheaded the implementation of a revolutionary blockchain-based verification system that reduced fraudulent transactions by 87% while improving processing speeds by 300%. This initiative saved the company $12M annually and earned us the prestigious “Digital Innovation Award 2024”.</p> </article> <article> <h1>Graziella Nutella</h1> <p>Mon, 25 Nov 2024 21:53:18 +0100</p> <p>The content of this section comes from the <code>content/testimonial</code> folder contents. This that you see is in <code>content/testimonial/graziella-nutella.md</code>.</p> <p>You can also use parameters for configuration:</p> <div class="highlight-wrapper"> <button class="copy-code-btn" type="button" aria-label="Copy code to clipboard"> <svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"> <rect x="9" y="9" width="13" height="13" rx="2" ry="2"></rect> <path d="M5 15H4a2 2 0 0 1-2-2V4a2 2 0 0 1 2-2h9a2 2 0 0 1 2 2v1"></path> </svg> <span class="copy-text">Copy</span> </button><div class="highlight"><pre tabindex="0" style="background-color:#f7f7f7;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-text" data-lang="text"><span style="display:flex;"><span>name: "Nutting Hill" # place/city/country for the experience. Fill-in. </span></span><span style="display:flex;"><span>position: "Nutcracker" # from-to, for example "2022-2024". Fill-in. </span></span><span style="display:flex;"><span> </span></span><span style="display:flex;"><span>params: </span></span><span style="display:flex;"><span> image: </span></span><span style="display:flex;"><span> src: "images/testimonials/testimonial1.png" # example: "images/clients/asgardia.png" </span></span><span style="display:flex;"><span> scale: 0.5</span></span></code></pre></div></div> </article> <article> <h1>Dana Oneal</h1> <p>Mon, 25 Nov 2024 21:50:45 +0100</p> <p>I had the pleasure of working with this freelancer on several projects, and their performance has been nothing short of outstanding. They bring a high level of expertise, creativity, and dedication to every task. Their ability to understand project requirements and deliver exceptional results on time is truly impressive. They are a reliable and proactive professional who consistently exceeds expectations. I highly recommend this freelancer to anyone seeking top-notch skills and a collaborative partner.</p> </article> <article> <h1>Ferdinand Shermand</h1> <p>Mon, 25 Nov 2024 21:30:46 +0100</p> <p>Working with this colleague has been an absolute pleasure. Their dedication, professionalism, and positive attitude make them an invaluable asset to our team. They consistently go above and beyond to ensure that projects are completed on time and to the highest standard. Their ability to collaborate effectively and support their colleagues is truly commendable. I am continually impressed by their innovative thinking and problem-solving skills. This colleague is not just a team member but a true inspiration and a driving force behind our team’s success.</p> </article> <article> <h1>Ztos</h1> <p>Sun, 25 Aug 2024 10:23:39 +0200</p> </article> <article> <h1>Zoo</h1> <p>Sun, 25 Aug 2024 10:23:08 +0200</p> </article> <article> <h1>Kanba</h1> <p>Sun, 25 Aug 2024 10:22:34 +0200</p> </article> <article> <h1>Goldline</h1> <p>Sun, 25 Aug 2024 10:21:48 +0200</p> </article> <article> <h1>Earth 2.0</h1> <p>Sun, 25 Aug 2024 10:17:12 +0200</p> </article> <article> <h1>Asgardia</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> </article> <article> <h1>High School of Hard Knocks</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> </article> <article> <h1>Radity Finance - UI Kit</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> <p>We have been receiving a lot of requests for a Finance Kit recently due to the popularity of Fintech.</p> </article> <article> <h1>Robo Advisor</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> <p>Robo Advisor is a Swiss Wealth Manager and wants to create the best digital experience for its UNHW clients across the world. We started with a whiteboard.</p> </article> <article> <h1>Swiss Fintech Website</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> <p>Here you can add additional context, description, links, etc. The content you see here comes from the contents of the <code>content/projects</code> folder.</p> <p>This project is in the file <code>projects/swiss-fintech.md</code>.</p> <p>In the markdown file frontmatter you can also define additional parameters, such as the link:</p> <div class="highlight-wrapper"> <button class="copy-code-btn" type="button" aria-label="Copy code to clipboard"> <svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"> <rect x="9" y="9" width="13" height="13" rx="2" ry="2"></rect> <path d="M5 15H4a2 2 0 0 1-2-2V4a2 2 0 0 1 2-2h9a2 2 0 0 1 2 2v1"></path> </svg> <span class="copy-text">Copy</span> </button><div class="highlight"><pre tabindex="0" style="background-color:#f7f7f7;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-text" data-lang="text"><span style="display:flex;"><span>link: "https://www.adrianmoreno.info" # optional URL to link the logo to </span></span><span style="display:flex;"><span> </span></span><span style="display:flex;"><span>params: </span></span><span style="display:flex;"><span> button: </span></span><span style="display:flex;"><span> icon: "icon-arrow-right" </span></span><span style="display:flex;"><span> btnText: "Case Study" </span></span><span style="display:flex;"><span> URL: "https://www.adrianmoreno.info" </span></span><span style="display:flex;"><span> image: </span></span><span style="display:flex;"><span> src: "images/works/swissfintech.jpg" </span></span><span style="display:flex;"><span> scale: 0.5 </span></span><span style="display:flex;"><span> </span></span></code></pre></div></div> </article> <article> <h1>University of Life</h1> <p>Sun, 25 Aug 2024 09:53:42 +0200</p> </article> <article> <h1>Trabajo #3</h1> <p>Mon, 01 Jan 2024 00:00:00 +0100</p> <h2 id="arreglando-el-mundo-un-byte-a-la-vez">Arreglando el mundo, un byte a la vez</h2> <p>¡Adquisición hostil - ¿quién es el jefe ahora?!</p> </article> <article> <h1>Job #2</h1> <p>Fri, 01 Dec 2023 00:00:00 +0100</p> <h2 id="2nd-job-chief-intern">2nd job: Chief Intern</h2> <p>As Chief Intern at Internet Affairs Inc., I led several key initiatives that helped streamline our internal processes and boost productivity. Working closely with cross-functional teams, I developed and implemented an automated documentation system that reduced report generation time by 65% and improved accuracy by 40%.</p> <p>During my internship, I spearheaded the company’s first-ever “Innovation Lab” program, where I mentored junior interns and coordinated weekly brainstorming sessions. This initiative resulted in three patent-pending solutions and garnered attention from senior management. The program has since been adopted as a permanent fixture in the company’s internship structure.</p> </article> <article> <h1>Job #1</h1> <p>Thu, 01 Dec 2022 00:00:00 +0100</p> <h2 id="1st-job-junior-intern">1st job: Junior Intern</h2> <p>The beginning of a great career. As a Junior Intern at Internet Affairs Inc., I had the opportunity to work on various projects that helped me develop my technical and professional skills. Working alongside experienced developers, I contributed to the company’s core web applications and learned industry best practices in software development.</p> <p>During my internship, I took the initiative to create an internal documentation wiki that improved knowledge sharing across teams. This project taught me valuable lessons in technical writing and collaboration. I also participated in code reviews and daily stand-ups, gaining firsthand experience in agile development methodologies.</p> </article> <article> <h1>Footer</h1> <p>Mon, 01 Jan 0001 00:00:00 +0000</p> <section class="section section--border-bottom rad-animation-group section--padding"> <div class="container"> <div class="row rad-fade-down"> <div class="col-12"> <h2 class="section__title">Let's connect</h2> <div class="text-section__content"> <div class="contact-links-section"> <p class="contact-links-intro">Interested in working together or just want to say hi? Find me on GitHub or LinkedIn.</p> <div class="contact-links-row"> <a href="https://github.com/ferranpons" class="contact-link-card" target="_blank" rel="noopener" aria-label="Ferran Pons on GitHub"> <i class="icon-square-github" aria-hidden="true"></i> <span class="contact-link-card__label">GitHub</span> <span class="contact-link-card__value">github.com/ferranpons</span> </a> <a href="https://www.linkedin.com/in/ferranpons/" class="contact-link-card" target="_blank" rel="noopener" aria-label="Ferran Pons on LinkedIn"> <i class="icon-linkedin" aria-hidden="true"></i> <span class="contact-link-card__label">LinkedIn</span> <span class="contact-link-card__value">linkedin.com/in/ferranpons</span> </a> </div> </div> </div> </div> </div> </div> </section> </article> <article> <h1>Home</h1> <p>Mon, 01 Jan 0001 00:00:00 +0000</p> <section id="hero" class="rad-showcase rad-showcase--index rad-animation-group rad-fade-down"> <div> <div class="showcase-section row flex-column-reverse flex-md-row rad-fade-down rad-waiting rad-animate"> <div class="col-12 col-sm-12 col-md-6 col-lg-6 col-xl-6"> <h1 class="display-1"> Kotlin Multiplatform, Native C++ & AI Engineer </h1> <h2 class="display-5"> <span></span> </h2> <div class="lead"> I help teams build production-grade mobile, multiplatform and AI-powered applications — from Kotlin Multiplatform apps and native C++ integrations to on-device LLM tooling. </div> </div> <div class="col-12 col-sm-12 col-md-6 col-lg-6 col-xl-6 profile-image"> </picture> </div> <div class="col-12 inner-content"> <div class="container" id="contact-links"> <div class="row platform-links shortcode"> <div class="col-12"> <a href="https://github.com/ferranpons" target="_blank" rel="noopener noreferrer" aria-label="square-github" ><i class="icon-square-github"></i> </a> <a href="https://www.linkedin.com/in/ferranpons/" target="_blank" rel="noopener noreferrer" aria-label="linkedin" ><i class="icon-linkedin"></i> </a> <a href="https://twitter.com/ponsaffair" target="_blank" rel="noopener noreferrer" aria-label="x-twitter" ><i class="icon-x-twitter"></i> </a> </div> </div> </div> <div class="hero-cta-group"> <a href="#portfolio" class="cta-secondary">View projects</a> </div> </div> </div> <div class="row platform-links"> <div class="col-12"></div> </div> </div> </section> <div class="stats-strip"> <div class="stats-strip__inner"> <div class="stat-item"> <span class="stat-value">20+</span> <span class="stat-label">Years Experience</span> </div> <div class="stat-divider" aria-hidden="true"></div> <div class="stat-item"> <span class="stat-value">Open-source</span> <span class="stat-label">Maintainer</span> </div> <div class="stat-divider" aria-hidden="true"></div> <div class="stat-item"> <span class="stat-value">Conference</span> <span class="stat-label">Speaker</span> </div> <div class="stat-divider" aria-hidden="true"></div> <div class="stat-item"> <span class="stat-value">Android · iOS · AI</span> <span class="stat-label">Core platforms</span> </div> </div> </div> <section id="about" class="section rad-animation-group pb-0"> <div class="rad-fade-down"> <div class="row d-flex flex-column-reverse flex-md-row"> <div class="about__profile-picture col-12 col-md-6"> </picture> </div> <div class="col-12 col-md-6 my-auto"> <h1>About</h1> <div class="about-me content lead"> I specialize in building high-performance mobile and multiplatform applications. Over the last decade, I've worked across Android, iOS, Kotlin Multiplatform and native C++ systems, helping teams solve difficult technical challenges involving performance, interoperability and scalability. More recently, I focus on AI-powered applications and on-device LLM integrations through open-source projects such as Llamatik. </div> </div> </div> </div> </section> <section class="section section--border-bottom rad-animation-group section--padding"> <div class="container"> <div class="row rad-fade-down"> <div class="col-12"> <h2 class="section__title">Capabilities</h2> <div class="text-section__content"> <div class="feature-list"> <div class="feature"> <strong>Mobile & Multiplatform</strong> <div class="meta-badges">Kotlin Multiplatform · Android · iOS · Jetpack Compose · SwiftUI</div> </div> <div class="feature"> <strong>Native & Performance</strong> <div class="meta-badges">C++ · CMake · Kotlin/Native · Static linking · Linker debugging</div> </div> <div class="feature"> <strong>AI & LLMs</strong> <div class="meta-badges">On-device LLMs · llama.cpp · Kotlin-first SDKs · Production AI integrations</div> </div> <div class="feature"> <strong>Architecture & Delivery</strong> <div class="meta-badges">SDK design · CI/CD · Framework distribution · Production debugging</div> </div> </div> </div> </div> </div> </div> </section> <section id="portfolio" class="section section--border-bottom rad-animation-group section--padding"> <div class="container"> <div class="row rad-fade-down"> <div class="col-12"> <h2 class="section__title">Featured Project</h2> <div class="text-section__content"> <div id="portfolio" class="featured-project"> <div class="featured-project-header"> <h3 class="featured-project-title">Llamatik — Kotlin LLM tooling</h3> <span class="featured-project-badge">Open Source</span> </div> <p class="featured-project-description">Open-source Kotlin-first SDK for building AI-powered applications across Android, iOS and Desktop using Kotlin Multiplatform and llama.cpp.</p> </article> <article> <h1>Printable CV</h1> <p>Mon, 01 Jan 0001 00:00:00 +0000</p> <p>ℹ This page is a demo of the printer-friendly output of the theme. You can find the source code in the demo repo (<a href="https://raw.githubusercontent.com/zetxek/adritian-demo/refs/heads/main/content/cv.md%29">https://raw.githubusercontent.com/zetxek/adritian-demo/refs/heads/main/content/cv.md)</a>. Try printing it directly from your browser!</p> <h3 id="about-me">About me</h3> <p>I am a passionate software engineer with over 10 years of experience building web applications and distributed systems. My expertise spans full-stack development, cloud architecture, and leading engineering teams to deliver impactful solutions. I thrive on solving complex technical challenges while mentoring others and fostering a collaborative engineering culture.</p> </article> <article> <h1>Search</h1> <p>Mon, 01 Jan 0001 00:00:00 +0000</p> search </article> </main></body></html>