AI glossary

What is LoRA?

A parameter-efficient fine-tuning method that trains small low-rank adapter matrices instead of all of a model's weights.

LoRA dramatically reduces the memory and compute needed for fine-tuning, and adapters can be swapped on top of the same base model.

Related terms