Skip to content
AImpact
IT EN
Medium Local AI · 1 min read

Jan.ai 0.5: plugin architecture and full GPU support for offline LLMs

In one sentence Jan.ai 0.5 introduces an extensions marketplace, CUDA and Metal GPU acceleration, pre-configured models for full offline use, and an OpenAI-compatible API.

Verified Official source
ShareLinkedInX
Reading level

Jan.ai is an open-source app for running AI models completely offline on your computer. With version 0.5 it becomes much more flexible: you can install extensions from the marketplace to add features, it fully leverages your GPU on both Windows (NVIDIA) and Mac (Apple Silicon), and includes pre-configured models for users who want to start immediately without setup. It also exposes an OpenAI-compatible API for integration with other tools.

Companies

Janhq

Tools

Jan.ai

Tags

Jan.aiPluginCUDAMetalOpenAI CompatibleOfflineLocal AI

Sources