are you using my auto installer? looks like you are giving incorrect model path
are you using my auto installer? looks like you are giving incorrect model path
load_in_8bit_fp32_cpu_offload=True and pass a custom device_map to from_pretrained" means that i should use lowvram version (i have 6gb vram)?load_in_8bit_fp32_cpu_offload=Truedevice_mapfrom_pretrained