Software Engineering Courses (SECourses)•2y ago

Hi all, a total noob to training here and just have experience with Automatic1111 on RunPod. Any adv

Hi all, a total noob to training here and just have experience with Automatic1111 on RunPod. Any advice on the best training option for realistic people using RunPod? Dreambooth, Kohya, OneTrainer etc?

kraussian•7/26/24, 2:52 PM

@Furkan Gözükara SECourses after running OneTrainer for ~6 hours, I was finally excited to see the results of my DreamBooth training. But when I try to load the model in A1111 WebUI, I'm getting this error:

changing setting sd_model_checkpoint to elwq_v0_1.safetensors [a5db6c23b6]: NotImplementedError
Traceback (most recent call last):
  ...
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 810, in _apply
    module._apply(fn)
  [Previous line repeated 3 more times]
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 833, in _apply
    param_applied = fn(param)
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1158, in convert
    return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
NotImplementedError: Cannot copy out of meta tensor; no data!

changing setting sd_model_checkpoint to elwq_v0_1.safetensors [a5db6c23b6]: NotImplementedError
Traceback (most recent call last):
  ...
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 810, in _apply
    module._apply(fn)
  [Previous line repeated 3 more times]
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 833, in _apply
    param_applied = fn(param)
  File "C:\sd\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1158, in convert
    return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
NotImplementedError: Cannot copy out of meta tensor; no data!

I've trained using the slow preset, 100 epochs. Only change I've made (apart from folder locations) is to enable xformers. What am I doing wrong?

Ddevinthenull I've seen mixed advice, what's the latest thoughts on xformers for lora/fine tun...

Furkan Gözükara SECourses•7/26/24, 11:24 PM

try to avoid if possible

Furkan Gözükara SECourses•7/26/24, 11:24 PM

but recent versions are much better than previous

JJay Hi all, a total noob to training here and just have experience with Automatic111...

Furkan Gözükara SECourses•7/26/24, 11:24 PM

Kohya dreambooth on runpod

Furkan Gözükara SECourses•7/26/24, 11:25 PM

i think i replied your message on patreon?

Kkraussian <@205854764540362752> after running OneTrainer for ~6 hours, I was finally excit...

Furkan Gözükara SECourses•7/26/24, 11:25 PM

did you take any backups_?

Furkan Gözükara SECourses•7/26/24, 11:25 PM

checkpoints?

Furkan Gözükara SECourses•7/26/24, 11:25 PM

what is your file size?

Furkan Gözükara SECourses•7/26/24, 11:26 PM

i think it couldnt understand your model class like sdxl or sd 1.5 but not sure

FFurkan Gözükara SECourses did you take any backups_?

kraussian•7/27/24, 1:08 AM

Yes, I’ve taken backups every 10 epochs, so let me see if those work.
File sizes are 6.7GB for backups and the final file

Kkraussian Yes, I’ve taken backups every 10 epochs, so let me see if those work. File sizes...

Furkan Gözükara SECourses•7/27/24, 1:23 AM

looking good

Furkan Gözükara SECourses•7/27/24, 1:23 AM

ye try backup

FFurkan Gözükara SECourses i think i replied your message on patreon?

JayOP•7/27/24, 1:37 AM

yes thanks!

FFurkan Gözükara SECourses looking good

kraussian•7/27/24, 9:59 AM

Managed to find a working backup at 90 epochs, but the images generated look nothing like the training images. I've used 33 images which I feel are of relatively good quality, and the 5,400 regularization images from your Patreon.
Should I be increasing the learning rate?

gohar•7/27/24, 10:08 AM

sir, when will u work on RVC or any other better voice cloning tool

Kkraussian Managed to find a working backup at 90 epochs, but the images generated look not...

Furkan Gözükara SECourses•7/27/24, 10:54 AM

can you share screenshots of your concepts setups

Ggohar sir, when will u work on RVC or any other better voice cloning tool

Furkan Gözükara SECourses•7/27/24, 10:54 AM

it is on my list but these keep coming up new ai models giving no time