Apple On-Device OpenAI
OpenAI-compatible API server for Apple Intelligence on-device models
Free LLM Server Open Source
Overview
Apple On-Device OpenAI is an open-source SwiftUI app that turns your Mac into a local AI server by exposing Apple's on-device Foundation Models through an OpenAI-compatible API. Any tool or app that speaks the OpenAI API format can connect to it — no cloud, no API keys, fully private. Supports streaming chat completions, automatic Apple Intelligence availability detection, and runs as a GUI app to bypass Apple's CLI rate limits. Requires macOS 26 with Apple Intelligence enabled.
Minimum macOS: 26.0 (Tahoe)
Architecture: Apple Silicon
Key Features
- OpenAI-compatible chat completions API endpoint at localhost:11535
- Real-time streaming responses matching OpenAI's format
- Fully on-device processing using Apple Foundation Models — no cloud needed
- Automatic Apple Intelligence availability detection on startup
- GUI app design to bypass Apple's CLI rate limits
- Health check, status, and model listing endpoints
- Drop-in replacement for OpenAI API in existing tools and apps
