Glossary Entry:

Overfitting (in AI)

Overfitting (in AI)

When a model (such as a machine learning or generative AI large language model) captures the 'noise' of or 'memorizes' training data (rather than detecting patterns and trends which can be generalized to new inputs). An overfit model is too complex for the problem it is intended to solve.

"We dumped all the emails from the entire company into the LLM, and it's overfit. Now random emoji and email signatures end up in the text it generates and it can't really respond 'creatively.'"