Two Ways to Hit the Target
the two fundamentally different ways to get a language model to do what you want: adjusting your instructions, or retraining the model itself.
Choosing whether to retrain the model or just talk to it better.
the two fundamentally different ways to get a language model to do what you want: adjusting your instructions, or retraining the model itself.
a closer look at what prompting really changes about a model's behavior, and why it works without any retraining at all.
how systems were customized for new tasks before pretrained language models made either prompting or fine-tuning genuinely practical options.
how far a well-crafted prompt alone can actually go in steering a model's behavior, and why it's usually the right first lever to reach for.
the genuine signs that a problem has outgrown prompting, and needs the deeper, more permanent change fine-tuning provides.
what fine-tuning actually does to a model's weights, and why this change is deeper and more permanent than anything a prompt can achieve.
why the quality and relevance of a fine-tuning dataset matters more than almost anything else in determining whether the result actually improves the model.
the tradeoffs between fine-tuning dataset size and quality, and why more examples eventually stop helping.
the difference between fully retraining every part of a model and adjusting only a small, targeted set of parameters.
a direct comparison of what prompting and fine-tuning actually cost, in both upfront effort and ongoing operation.
why a fine-tuned model's advantage can decay over time as the underlying task or data drifts, and what that means for maintaining it.
the overfitting risk in fine-tuning, where a model learns the quirks of its training data instead of the underlying task it was meant to learn.
why prompting's flexibility is a genuine structural advantage over fine-tuning, not just a matter of lower upfront cost.
why fine-tuning and prompting aren't actually mutually exclusive, and how combining them often outperforms relying on either alone.
why evaluating a fine-tuned or prompted model requires the same rigor, on the same held-out data, before either goes into production.
catastrophic forgetting: the risk that fine-tuning for a new capability quietly degrades capabilities the model already had.
how instruction tuning and reinforcement learning from human feedback are themselves a form of fine-tuning, applied to make base models genuinely usable.
a practical decision framework that pulls together every factor this series has covered, for choosing between prompting and fine-tuning on a real project.
the organizational-level costs of maintaining fine-tuned models over time — infrastructure, retraining cycles, and specialized skill — beyond any single project's calculation.
reassembling every lever this series has covered into one complete picture of how to steer, retrain, and maintain a language model deliberately.