Lesson 022 · Technical · ~6 min read

Fine-Tuning vs Prompting

Last updated: October 2026 6 min read Prerequisite: APIs for Your Own Projects

Written and reviewed by Manish Kulkarni · About the author

Ways to customise a model's behaviour

If you want an AI model to behave differently for your use case, you have three main options, ordered here from simplest to most involved: change what you ask (prompting), give it your own documents to look at (retrieval), or change the model itself (fine-tuning). They solve different problems.

Prompting: instructions at request time

Prompting means giving instructions, context or examples with each request. The model's weights never change. This covers basic prompts, detailed system instructions and example-based prompting (see Prompting Fundamentals).

Retrieval: giving it your documents

Often the real problem is that the model doesn't know your information, such as your product manual or policies. Retrieval (often called RAG, retrieval-augmented generation) solves this by finding the relevant passages and including them in the prompt for each question. The model's weights still don't change, and your information can be updated any time by changing the documents.

Fine-tuning: retraining on your data

Fine-tuning continues training an existing model on your own dataset, actually adjusting its weights (see Training vs Inference). It is best for making a model consistently follow a particular style, format or narrow task, without repeating long instructions every time.

Example: a company wanting replies in a very specific brand voice might fine-tune a model on hundreds of examples of that voice, instead of including a long style guide in every prompt.

A common mix-up: facts versus behaviour

Fine-tuning is better at changing how a model responds than at teaching it new facts reliably. If your goal is "answer questions using our latest documentation", retrieval is usually the better fit, because the documents can change without retraining anything.

Which to try first

  1. Improve the prompt. Clear instructions and a few examples solve more problems than people expect.
  2. Add retrieval if the model needs to know your own or fast-changing information.
  3. Consider fine-tuning only if the first two still don't give consistent results.

When fine-tuning may be worth it

When prompting is usually better

Frequently asked

Is fine-tuning expensive?

Generally more expensive and complex than prompting, requiring quality training data and technical setup — most projects should try thorough prompting first before considering fine-tuning.

Does fine-tuning make a model "smarter" overall?

No — it typically makes a model better at a specific narrow task or style, sometimes at the cost of general flexibility elsewhere.

Can I fine-tune any AI model?

Not all providers offer fine-tuning access, and availability varies by model and provider — check the specific provider's documentation for what's supported.

← Back   Next: Open-Source vs Closed Models →