February 8, 2024 High Local AI · 1 min read

Ollama Modelfile and REST API: local LLMs enter dev workflows

In one sentence Ollama introduces the Modelfile (like a Dockerfile for LLMs), an OpenAI-compatible REST API, and a public registry with 100+ ready-to-use models.

Verified Official source

ShareLinkedIn X

Reading level

Ollama launches two features that change how developers work with local models. The Modelfile lets you define a custom model with parameters, system prompt, and template in a text file — just like a Dockerfile. The REST API is compatible with the OpenAI format, so existing libraries and tools built for GPT-4 work without modification. The public registry grows to over 100 models downloadable with a single command.

Companies

Ollama

Tools

Ollama