GPT4All: a ChatGPT-style assistant that runs offline on a laptop CPU
In one sentence Nomic AI releases GPT4All: LLaMA 7B fine-tuned with LoRA on about 437,000 GPT-3.5-Turbo responses, shipped as a 4-bit quantized checkpoint that runs locally on CPU, together with data, training code and LoRA weights.
At the end of March 2023 Nomic AI publishes GPT4All, an assistant-style model you can download and use on your own computer without a connection and without a GPU. The repository includes an already-quantized checkpoint and ready-made programs for M1 Macs, Intel Macs, Linux and Windows: you download the model file, put it in the right folder and start the chat from a terminal.
It is not yet an application with an installer and graphical interface: that arrives a few weeks later with GPT4All-J. But it is one of the first cases of a conversational assistant running credibly on an ordinary laptop, without sending data to a server.
Nomic also publishes the training data and the code to reproduce the model, and the stated cost is low: about 100 dollars for the final training run.
Companies
Nomic AI
Tools
GPT4All
Tags
Sources