Pathways: Google sketches the post-Transformer architecture
In one sentence Jeff Dean outlines Pathways, Google's unified architecture for sparse, multitask, multimodal models — the infrastructure foundation that will power PaLM and Gemini.
Jeff Dean, head of Google AI, publishes a vision: Pathways. The idea is to build a single AI model that can do many things at once — text, images, audio, code — instead of training a specialist for every task.
The system should be sparse: like a human brain, only activating the parts needed for the specific question. More efficient, more reusable.
Pathways isn't a product but infrastructure: the training platform that will let Google build PaLM (2022), then PaLM 2, all the way to Gemini. It's the document that explains how Google plans to chase and beat OpenAI.
Companies
Tools
Pathways
Tags
Sources