It makes sense to use a lora rank that high for a 12 billion parameter model? to train just a perso

It makes sense to use a lora rank that high for a 12 billion parameter model? to train just a person? may be even rank 4 or 8 is mora than enough
Was this page helpful?