# Rank of the LoRA matrices (higher = more capacity but more parameters) # Typical values: 8, 16, 32, 64. Start with 32 for general fine-tuning. # - attn1.to_k, attn1 ...