LoRA fine-tuning
Full fine-tuning
Vision-language
LoRA target modules
LoRA fine-tuning
Full fine-tuning
Vision-language models
For the list of models that support vision-language fine-tuning on image and text data, along with the dataset schema and thetrain_vision parameter, see vision fine-tuning.
LoRA target modules
See LoRA vs. full fine-tuning for the default target modules per model. Passlora_trainable_modules="all-linear" to train every linear layer.
Model limits from the CLI
To get more detailed fine-tuning constraints for a specific model, including learning-rate bounds, batch-size limits, and the LoRA rank and target modules, runtg fine-tuning model-limits <model>.