Skip to content
AImpact
IT EN
Training Beginner Also known as: Affinamento · Adattamento

Fine-tuning

An extra training step where a ready-made model is trained on a smaller, more specific dataset to improve its performance on a certain task or domain.

ShareLinkedInX

In practice

You do it when the base model does not match the style, jargon, or formats you need. It requires good labeled data and GPUs. Often you start with a lightweight variant like LoRA before doing a full fine-tune.

Related terms

LoRA Foundation model RLHF

Seen in the wild

11 entries mentioning it
  1. bitsandbytes 0.43: QLoRA and NF4/FP4 quantization for 4-bit fine-tuning
    Medium
  2. Databricks Mosaic AI: unified fine-tuning and inference on the data lakehouse
    Medium
  3. S-LoRA and Punica: serving hundreds of LoRA fine-tunings from a single base model
    High
  4. Backdoors in fine-tuned LLMs: hidden behaviors activatable on command
    High
  5. WizardLM: GPT-4-evolved instructions for fine-tuning
    Medium
  6. Gorilla: fine-tuned LLaMA that calls APIs without errors
    Medium
  7. Vicuna-13B: the open chatbot that reaches 90% of ChatGPT quality
    High
  8. Textual Inversion: inject a custom concept into diffusion models
    Medium
  9. DreamBooth: generate your subject in any style with 3-5 photos
    High
  10. InstructGPT: the fine-tuning that teaches GPT to obey
    High
  11. FLAN: instruction tuning that teaches models to follow directions
    High
← All terms