Medium Local AI · 1 min read
Jan.ai 0.5: plugin architecture and full GPU support for offline LLMs
In one sentence Jan.ai 0.5 introduces an extensions marketplace, CUDA and Metal GPU acceleration, pre-configured models for full offline use, and an OpenAI-compatible API.
Reading level
Jan.ai is an open-source app for running AI models completely offline on your computer. With version 0.5 it becomes much more flexible: you can install extensions from the marketplace to add features, it fully leverages your GPU on both Windows (NVIDIA) and Mac (Apple Silicon), and includes pre-configured models for users who want to start immediately without setup. It also exposes an OpenAI-compatible API for integration with other tools.
Companies
Janhq
Tools
Jan.ai
Tags
Jan.aiPluginCUDAMetalOpenAI CompatibleOfflineLocal AI
Sources