Software Engineering Courses (SECourses)•3y ago

@ashleyk I updated the dev branch and it even has a popup that says fixed class images. But I tried

@ashleyk I updated the dev branch and it even has a popup that says fixed class images. But I tried it again, same error @Dr. Furkan Gözükara any ideas?

2023-06-03T15:57:40.583215104Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/ui_functions.py", line 729, in start_training
2023-06-03T15:57:40.583220784Z     result = main(class_gen_method=class_gen_method)
2023-06-03T15:57:40.583224064Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 1546, in main
2023-06-03T15:57:40.583227194Z     return inner_loop()
2023-06-03T15:57:40.583229735Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/memory.py", line 119, in decorator
2023-06-03T15:57:40.583246165Z     return function(batch_size, grad_size, prof, *args, **kwargs)
2023-06-03T15:57:40.583249145Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 246, in inner_loop
2023-06-03T15:57:40.583252465Z     count, instance_prompts, class_prompts = generate_classifiers(
2023-06-03T15:57:40.583255115Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/utils/gen_utils.py", line 153, in generate_classifiers
2023-06-03T15:57:40.583257975Z     builder = ImageBuilder(
2023-06-03T15:57:40.583260385Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/helpers/image_builder.py", line 46, in __init__
2023-06-03T15:57:40.583263265Z     self.target = pbar.target
2023-06-03T15:57:40.583265755Z AttributeError: 'mytqdm' object has no attribute 'target'

2023-06-03T15:57:40.583215104Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/ui_functions.py", line 729, in start_training
2023-06-03T15:57:40.583220784Z     result = main(class_gen_method=class_gen_method)
2023-06-03T15:57:40.583224064Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 1546, in main
2023-06-03T15:57:40.583227194Z     return inner_loop()
2023-06-03T15:57:40.583229735Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/memory.py", line 119, in decorator
2023-06-03T15:57:40.583246165Z     return function(batch_size, grad_size, prof, *args, **kwargs)
2023-06-03T15:57:40.583249145Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 246, in inner_loop
2023-06-03T15:57:40.583252465Z     count, instance_prompts, class_prompts = generate_classifiers(
2023-06-03T15:57:40.583255115Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/utils/gen_utils.py", line 153, in generate_classifiers
2023-06-03T15:57:40.583257975Z     builder = ImageBuilder(
2023-06-03T15:57:40.583260385Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/helpers/image_builder.py", line 46, in __init__
2023-06-03T15:57:40.583263265Z     self.target = pbar.target
2023-06-03T15:57:40.583265755Z AttributeError: 'mytqdm' object has no attribute 'target'

2023-06-03T15:57:40.583215104Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/ui_functions.py", line 729, in start_training
2023-06-03T15:57:40.583220784Z     result = main(class_gen_method=class_gen_method)
2023-06-03T15:57:40.583224064Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 1546, in main
2023-06-03T15:57:40.583227194Z     return inner_loop()
2023-06-03T15:57:40.583229735Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/memory.py", line 119, in decorator
2023-06-03T15:57:40.583246165Z     return function(batch_size, grad_size, prof, *args, **kwargs)
2023-06-03T15:57:40.583249145Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 246, in inner_loop
2023-06-03T15:57:40.583252465Z     count, instance_prompts, class_prompts = generate_classifiers(
2023-06-03T15:57:40.583255115Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/utils/gen_utils.py", line 153, in generate_classifiers
2023-06-03T15:57:40.583257975Z     builder = ImageBuilder(
2023-06-03T15:57:40.583260385Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/helpers/image_builder.py", line 46, in __init__
2023-06-03T15:57:40.583263265Z     self.target = pbar.target
2023-06-03T15:57:40.583265755Z AttributeError: 'mytqdm' object has no attribute 'target'

2023-06-03T15:57:40.583215104Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/ui_functions.py", line 729, in start_training
2023-06-03T15:57:40.583220784Z     result = main(class_gen_method=class_gen_method)
2023-06-03T15:57:40.583224064Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 1546, in main
2023-06-03T15:57:40.583227194Z     return inner_loop()
2023-06-03T15:57:40.583229735Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/memory.py", line 119, in decorator
2023-06-03T15:57:40.583246165Z     return function(batch_size, grad_size, prof, *args, **kwargs)
2023-06-03T15:57:40.583249145Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/train_dreambooth.py", line 246, in inner_loop
2023-06-03T15:57:40.583252465Z     count, instance_prompts, class_prompts = generate_classifiers(
2023-06-03T15:57:40.583255115Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/dreambooth/utils/gen_utils.py", line 153, in generate_classifiers
2023-06-03T15:57:40.583257975Z     builder = ImageBuilder(
2023-06-03T15:57:40.583260385Z   File "/workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension/helpers/image_builder.py", line 46, in __init__
2023-06-03T15:57:40.583263265Z     self.target = pbar.target
2023-06-03T15:57:40.583265755Z AttributeError: 'mytqdm' object has no attribute 'target'

NNom @ashleyk I updated the dev branch and it even has a popup that says fixed class ...

Furkan Gözükara SECourses•6/3/23, 4:19 PM

will let you know once i do a training

Furkan Gözükara SECourses•6/3/23, 4:19 PM

preparing class images

Lucas•6/3/23, 4:19 PM

(venv) C:\deepface\roop>python run.py --gpu
Traceback (most recent call last):
File "C:\deepface\roop\run.py", line 3, in <module>
from roop import core
File "C:\deepface\roop\roop\core.py", line 15, in <module>
from opennsfw2 import predict_video_frames, predict_image
ModuleNotFoundError: No module named 'opennsfw2' I am getting this error :/ someone know ?

NNom @ashleyk I updated the dev branch and it even has a popup that says fixed class ...

ashley•6/3/23, 4:20 PM

Hmmm looks like its still broken, I will test it in a bit

LLucas (venv) C:\deepface\roop>python run.py --gpu Traceback (most recent call last): ...

Furkan Gözükara SECourses•6/3/23, 4:24 PM

c++ tools missing

FFurkan Gözükara SECourses c++ tools missing

Lucas•6/3/23, 4:25 PM

I'm a newbie sorry, but I already installed it? I think I forgot a step

Lucas•6/3/23, 4:27 PM

oh fine, i got it thx

LLucas I'm a newbie sorry, but I already installed it? I think I forgot a step

Furkan Gözükara SECourses•6/3/23, 4:40 PM

let me know results

FFurkan Gözükara SECourses let me know results

Lucas•6/3/23, 4:54 PM

(venv) C:\deepface\roop>python run.py --keep-frames --keep-fps --gpu
Traceback (most recent call last):
File "C:\deepface\roop\run.py", line 3, in <module>
from roop import core
File "C:\deepface\roop\roop\core.py", line 23, in <module>
import roop.globals
File "C:\deepface\roop\roop\globals.py", line 1, in <module>
import onnxruntime
ModuleNotFoundError: No module named 'onnxruntime'

Hussein•6/3/23, 6:11 PM

How to continue training from a checkpoint in shivamshrirao repo with Colab?

ashley•6/3/23, 6:42 PM

@Dr. Furkan Gözükara have you used Tensorboard to monitor learning rate, loss etc?

FFurkan Gözükara SECourses make a new venv

Nepper•6/3/23, 7:01 PM

It worked! Thx)

Furkan Gözükara SECourses•6/3/23, 7:26 PM

amazing auto cropping the pictures

Furkan Gözükara SECourses•6/3/23, 7:26 PM

Furkan Gözükara SECourses•6/3/23, 7:26 PM

Furkan Gözükara SECourses•6/3/23, 7:27 PM

preparing the best every fine tuning / classification dataset

LLucas (venv) C:\deepface\roop>python run.py --keep-frames --keep-fps --gpu Traceback (...

Furkan Gözükara SECourses•6/3/23, 7:28 PM

this is easy

Furkan Gözükara SECourses•6/3/23, 7:28 PM

you are skipping steps

Furkan Gözükara SECourses•6/3/23, 7:28 PM

https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Tutorials/1-Click-DeepFake-Tutorial.md

GitHub

Stable-Diffusion/1-Click-DeepFake-Tutorial.md at main · FurkanGozuk...

Best Stable Diffusion and AI Tutorials, Guides, News, Tips and Tricks - Stable-Diffusion/1-Click-DeepFake-Tutorial.md at main · FurkanGozukara/Stable-Diffusion

HHussein How to continue training from a checkpoint in shivamshrirao repo with Colab?

Furkan Gözükara SECourses•6/3/23, 7:30 PM

shown in this video : https://youtu.be/kIyqAdd_i10

YouTubeSECourses

Stable Diffusion Google Colab, Continue, Directory, Transfer, Clone...

Our Discord : https://discord.gg/HbqgGaZVmr. This is the video where you will learn how to use Google Colab for Stable Diffusion. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

Playlist of Stable Diffusion Tutorials, #Automatic1111...

NNepper It worked! Thx)

Furkan Gözükara SECourses•6/3/23, 7:30 PM

great

Aashley @Dr. Furkan Gözükara have you used Tensorboard to monitor learning rate, loss et...

Furkan Gözükara SECourses•6/3/23, 7:30 PM

i think they are not very useful for stable diffusion

ashley•6/3/23, 7:38 PM

How do I fix this issue:

################################################################
Launching launch.py...
################################################################
Using TCMalloc: libtcmalloc.so.4
Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0]
Version: v1.3.1
Commit hash: b6af0a3809ea869fb180633f9affcae4b199ffcf
Traceback (most recent call last):
  File "/workspace/stable-diffusion-webui/launch.py", line 38, in <module>
    main()
  File "/workspace/stable-diffusion-webui/launch.py", line 29, in main
    prepare_environment()
  File "/workspace/stable-diffusion-webui/modules/launch_utils.py", line 257, in prepare_environment
    raise RuntimeError(
RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check

################################################################
Launching launch.py...
################################################################
Using TCMalloc: libtcmalloc.so.4
Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0]
Version: v1.3.1
Commit hash: b6af0a3809ea869fb180633f9affcae4b199ffcf
Traceback (most recent call last):
  File "/workspace/stable-diffusion-webui/launch.py", line 38, in <module>
    main()
  File "/workspace/stable-diffusion-webui/launch.py", line 29, in main
    prepare_environment()
  File "/workspace/stable-diffusion-webui/modules/launch_utils.py", line 257, in prepare_environment
    raise RuntimeError(
RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check

ashley•6/3/23, 7:39 PM

The pod has a GPU so I don't understand why its doing this.

ashley•6/3/23, 7:39 PM

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 510.108.03   Driver Version: 510.108.03   CUDA Version: 11.8     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:45:00.0 Off |                  N/A |
|  0%   27C    P8    32W / 350W |      1MiB / 24576MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 510.108.03   Driver Version: 510.108.03   CUDA Version: 11.8     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:45:00.0 Off |                  N/A |
|  0%   27C    P8    32W / 350W |      1MiB / 24576MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

ashley•6/3/23, 7:41 PM

Will it still function correctly if I add

--skip-torch-cuda-test

--skip-torch-cuda-test

ashley•6/3/23, 8:01 PM

It doesn't like the

NVIDIA GeForce RTX 3090

NVIDIA GeForce RTX 3090

GPU type on RunPod.
Works fine on

NVIDIA RTX A5000

NVIDIA RTX A5000

Eggo•6/3/23, 8:28 PM

hey quick question. im not familiar with fp16 vs bf16. I am setting up Kohya right now. what difference between fp16 vs bf16? (i have rtx 3070 GPU)

Aashley It doesn't like the `NVIDIA GeForce RTX 3090` GPU type on RunPod. Works fine on ...

Furkan Gözükara SECourses•6/3/23, 8:31 PM

very weird

EEggo hey quick question. im not familiar with fp16 vs bf16. I am setting up Kohya rig...

Furkan Gözükara SECourses•6/3/23, 8:31 PM

your gpu supports both

Furkan Gözükara SECourses•6/3/23, 8:31 PM

you can pick either

FFurkan Gözükara SECourses your gpu supports both

Eggo•6/3/23, 8:32 PM

okay thanks! one of these options would increase training speed?

EEggo okay thanks! one of these options would increase training speed?

Furkan Gözükara SECourses•6/3/23, 8:34 PM

i would chose bf16

Furkan Gözükara SECourses•6/3/23, 8:35 PM

man been working whole day

Furkan Gözükara SECourses•6/3/23, 8:37 PM

full real pictures classification dataset

Furkan Gözükara SECourses•6/3/23, 8:37 PM

coming to the patreon

FFurkan Gözükara SECourses very weird

ashley•6/3/23, 8:37 PM

Yeah, I don't understand it either, because I am pretty sure you said you were using that GPU type in RunPod

FFurkan Gözükara SECourses full real pictures classification dataset

ashley•6/3/23, 8:38 PM

This is awesome, will it working better than the usual classification images?

Furkan Gözükara SECourses•6/3/23, 8:38 PM

Aashley This is awesome, will it working better than the usual classification images?

Furkan Gözükara SECourses•6/3/23, 8:39 PM

i am hoping so

Furkan Gözükara SECourses•6/3/23, 8:39 PM

from very high resolution

Furkan Gözükara SECourses•6/3/23, 8:39 PM

i will post different aspect ratios

Furkan Gözükara SECourses•6/3/23, 8:39 PM

512x512 , 768x1024 , 1024x768 , 640x960, 960x640

Furkan Gözükara SECourses•6/3/23, 8:39 PM

512x768, 768x512

Furkan Gözükara SECourses•6/3/23, 8:39 PM

this can be used to fine tune as well

Sequa•6/3/23, 8:41 PM

saw a reddit post somewhere by someone that swears by using real images for classification images, instead of SD generated images

Sequa•6/3/23, 8:41 PM

I wonder how much of a difference it makes

Sequa•6/3/23, 8:41 PM

I think they mentioned using unsplash images as well

Sequa•6/3/23, 8:44 PM

@Dr. Furkan Gözükara there is also this https://github.com/NVlabs/ffhq-dataset

GitHub

GitHub - NVlabs/ffhq-dataset: Flickr-Faces-HQ Dataset (FFHQ)

Flickr-Faces-HQ Dataset (FFHQ). Contribute to NVlabs/ffhq-dataset development by creating an account on GitHub.

Furkan Gözükara SECourses•6/3/23, 8:44 PM

i also collected from unspash

################################################################ Launching launch.py... ################################################################ Using TCMalloc: libtcmalloc.so.4 Python 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Version: v1.3.1 Commit hash: b6af0a3809ea869fb180633f9affcae4b199ffcf Traceback (most recent call last): File "/workspace/stable-diffusion-webui/launch.py", line 38, in <module> main() File "/workspace/stable-diffusion-webui/launch.py", line 29, in main prepare_environment() File "/workspace/stable-diffusion-webui/modules/launch_utils.py", line 257, in prepare_environment raise RuntimeError( RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check

@ashleyk I updated the dev branch and it even has a popup that says fixed class images. But I tried

Similar Threads

Similar Threads

Similar Threads