Medium Local AI · 1 min read
Private LLM: models up to 7B directly on iPhone and Mac, fully offline
In one sentence Private LLM brings LLMs up to 7B parameters to iPhone 15 Pro and M-series Macs via CoreML and Apple Neural Engine, completely offline with no telemetry or cloud subscriptions.
Reading level
Private LLM is an app for iPhone and Mac that runs AI models directly on the device, without an internet connection. On an iPhone 15 Pro or a Mac with Apple Silicon, you can use models from 1 to 7 billion parameters — similar to those running on Ollama on a computer — without sending anything to any server. The app uses Apple's built-in AI chip (Neural Engine) to keep speed acceptable. No subscription, no account, no data collection.
Companies
Private LLM
Tools
Private LLM, CoreML
Tags
Private LLMiOSmacOSCoreMLANEOn-device AIPrivacyOffline
Sources