Catastrophic Forgetting

Catastrophic Forgetting

When a fine-tuned model loses important general knowledge it had before.

"After we fine-tuned the model too narrowly, it forgot how to handle basic grammar—classic catastrophic forgetting."

No items found.

Overview

How to Think About

Catastrophic Forgetting

Practical Applications of

Catastrophic Forgetting