AI glossary

What is Overfitting?

When a model memorizes its training data and performs much worse on new data.

The tell-tale sign is a large gap between training and validation scores. The same idea applies to prompts tuned to a small eval set.

Related terms