Software Engineering Courses (SECourses)•3y ago

Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17, dedicated GPU pods

Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17, dedicated GPU pods can run for a little more than 2 days non stop for that price.

AlaBeat•5/28/23, 10:21 AM

works

Aashley Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17...

Furkan Gözükara SECourses•5/28/23, 10:23 AM

wow 17$ huge

Furkan Gözükara SECourses•5/28/23, 10:23 AM

you could get like 50+ hours

FFurkan Gözükara SECourses you could get like 50+ hours

ashleyOP•5/28/23, 10:27 AM

yes exactly

AlaBeat•5/28/23, 10:31 AM

so i tried to train, it didn't work, i think it was something either with torch or xformers, did a pip uninstall/install xformers, now i try to start kohya and get this root@b12c8b7fa1ad:/workspace/kohya_ss# bash gui.sh --share
Validating that requirements are satisfied.
Error: The following packages have the wrong version:
- timm==0.6.12 (expected version torch==1.12.1, found version 2.0.1)

Run upgrade.sh or pip install -U -r /workspace/kohya_ss/requirements.txt to resolve the missing requirements listed above...
root@b12c8b7fa1ad:/workspace/kohya_ss#

Furkan Gözükara SECourses•5/28/23, 10:35 AM

@AlaBeat did you make venv in that folder? like in video

AlaBeat•5/28/23, 10:35 AM

yes i have made venv

Furkan Gözükara SECourses•5/28/23, 10:36 AM

but it is using your system wide torch version

Furkan Gözükara SECourses•5/28/23, 10:36 AM

not using your venv

Furkan Gözükara SECourses•5/28/23, 10:36 AM

if you are our patreon supporter i can connect your pc and install

AlaBeat•5/28/23, 10:36 AM

i will install again torch in venv folder, even though i've done it already

Furkan Gözükara SECourses•5/28/23, 10:37 AM

something missing. it should use venv

Furkan Gözükara SECourses•5/28/23, 10:37 AM

not system wide default venv

AAlaBeat i will install again torch in venv folder, even though i've done it already

ashleyOP•5/28/23, 10:37 AM

Make sure you activate your venv, just creating it does not activate it automatically

AlaBeat•5/28/23, 10:40 AM

will do it again, got an error saying i'm out of space

AAlaBeat will do it again, got an error saying i'm out of space

Furkan Gözükara SECourses•5/28/23, 10:43 AM

ye you need to increase runtime space because temp files will take space

AlaBeat•5/28/23, 10:44 AM

ok....

message.txt6KB

Furkan Gözükara SECourses•5/28/23, 10:46 AM

try a fresh pod i think. /workspace/kohya_ss/venv/bin/python3: No module named pip

AlaBeat•5/28/23, 11:09 AM

ok now how to fix this error when i start the train

message.txt4.35KB

AAlaBeat ok now how to fix this error when i start the train

Furkan Gözükara SECourses•5/28/23, 11:22 AM

how much vram you have?

Furkan Gözükara SECourses•5/28/23, 11:22 AM

ah you are on runpod

Furkan Gözükara SECourses•5/28/23, 11:22 AM

dont use xformers

AlaBeat•5/28/23, 11:26 AM

i tried once with xformers installed and it worked, on runpod... will try a new pod without installing xformers

AlaBeat•5/28/23, 11:27 AM

do i do pip uninstall xformers on the new runpod too?

AlaBeat•5/28/23, 11:30 AM

when using this current runpod, not the new one, i get this thing (not error) WARNING:xformers:WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
PyTorch 2.0.1+cu118 with CUDA 1108 (you have 1.12.1+cu116)
when not using xformers i get oom errors with 3090...

AlaBeat•5/28/23, 11:30 AM

that was why i want to use xformers

AlaBeat•5/28/23, 11:31 AM

oh well.. fuck it no more runpod for me

ashleyOP•5/28/23, 11:34 AM

3090 has 24GB of VRAM so its an issue with your settings, you shouldn't face OOM with 24GB VRAM

ashleyOP•5/28/23, 11:35 AM

Also fix your xformers version

AlaBeat•5/28/23, 11:35 AM

settings where the same as my last session on runpod using xformers... something is wrong with runpod giving me all kinds of erros when i try to use xformers

AlaBeat•5/28/23, 11:35 AM

when i try to not use xformers i get oom on even batch size 2

AlaBeat•5/28/23, 11:36 AM

i'll just train on my pc until they fix xformers

ashleyOP•5/28/23, 11:36 AM

Did you do this?

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

AlaBeat•5/28/23, 11:37 AM

i've only done this:
git clone https://github.com/bmaltais/kohya_ss.git

cd kohya_ss

python3 -m venv venv

source venv/bin/activate

./setup.sh -n
source venv/bin/activate

apt update

apt-get install python3.10-tk

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
pip uninstall xformers
pip install xformers

GitHub

GitHub - bmaltais/kohya_ss

Contribute to bmaltais/kohya_ss development by creating an account on GitHub.

AAlaBeat i've only done this: git clone https://github.com/bmaltais/kohya_ss.git cd kohy...

Furkan Gözükara SECourses•5/28/23, 11:40 AM

this will change your torch version : pip install xformers

Furkan Gözükara SECourses•5/28/23, 11:40 AM

i think just uninstall xformers and dont reinstall

Furkan Gözükara SECourses•5/28/23, 11:40 AM

it is not necessary with 24 gb

Aashley Did you do this? ``` pip3 install torch==1.13.1 torchvision torchaudio --index-u...

AlaBeat•5/28/23, 11:43 AM

(venv) root@2fba617cc7bd:/workspace/kohya_ss# pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
Collecting https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
ERROR: HTTP error 404 while getting https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
ERROR: Could not install requirement https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6 because of HTTP error 404 Client Error: Not Found for url: https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6 for URL https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

AAlaBeat (venv) root@2fba617cc7bd:/workspace/kohya_ss# pip3 install https://huggingface.c...

ashleyOP•5/28/23, 11:44 AM

sorry copy and paste error by me:

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl

Aashley sorry copy and paste error by me: ```pip3 install torch==1.13.1 torchvision torc...

AlaBeat•5/28/23, 12:02 PM

yeah xformers just doesn't want to work...

ashleyOP•5/28/23, 12:16 PM

@Furkan Gözükara SECourses have you found this setting to make much difference within your experiments? I find setting it to 0.40 instead of 0.75 results in much less over training.

Furkan Gözükara SECourses•5/28/23, 1:08 PM

ye xformers didnt work

Furkan Gözükara SECourses•5/28/23, 1:08 PM

i will look for a working one

Aashley @Furkan Gözükara SECourses have you found this setting to make much difference w...

Furkan Gözükara SECourses•5/28/23, 1:08 PM

well this is a worthy experiment actually

Furkan Gözükara SECourses•5/28/23, 1:08 PM

i havent done yet

m3dia_offline•5/28/23, 1:21 PM

Hi everyone, just found my way to this discord after learning a lot from SECourses Youtube videos.

However I am stuck and I could really use some help.

I re-installed stable diffusion with the first method in this video - https://www.youtube.com/watch?v=AZg6vzWHOTA&t=726s

With this github repo - https://github.com/EmpireMediaScience/A1111-Web-UI-Installer

My Dreambooth extension after installing does not show up in my tabs, I have reloaded and restarted my UI a couple of times.

FYI I ended up reinstalling StableDiffusion web ui from scratch as I did have Dreambooth extension showing up earlier but not being able to generate any models, it would stop at 0 steps.

To further add on to this. I watched this video while attempting to trouble shoot the issue - https://www.youtube.com/watch?v=pom3nQejaTs&t=243s

Deleted the extension folder, deleted venv folder, started again with the reinstalls but nothing changed.

There is one thing though, that is beyond my understanding. The 'transformers' version in my dreambooth 'requirements' file is this transformers~=4.26.1 # > 4.26.x causes issues (db extension #1110) and the one in my 'requirement_version' file is this transformers==4.25.1. I tried copy pasting the version from my extension to the main webui, I don't think it helped either.

YouTubeSECourses

Easiest Way to Install & Run Stable Diffusion Web UI on PC by Using...

Our Discord : https://discord.gg/HbqgGaZVmr. How to download and install Stable Diffusion Automatic1111 Web UI interface. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

Playlist of Stable Diffusion Tutorials, Automatic1111 and Goog...

GitHub

GitHub - EmpireMediaScience/A1111-Web-UI-Installer: Complete instal...

Complete installer for Automatic1111's infamous Stable Diffusion WebUI - GitHub - EmpireMediaScience/A1111-Web-UI-Installer: Complete installer for Automatic1111's infamous Stable D...

YouTubeSECourses

How To Install New DREAMBOOTH & Torch 2 On Automatic1111 Web UI PC ...

Discord : https://bit.ly/SECoursesDiscord. Torch 2 / Pytorch 2 is now supported along with new DreamBooth Automatic1111 Web UI extension. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

In this video, I am explaining how you can man...

Mm3dia_offline Hi everyone, just found my way to this discord after learning a lot from SECours...

Furkan Gözükara SECourses•5/28/23, 1:26 PM

hi welcome

Furkan Gözükara SECourses•5/28/23, 1:26 PM

yes dreambooth installation now required different approach

Furkan Gözükara SECourses•5/28/23, 1:26 PM

here up to date tutorial : https://www.youtube.com/watch?v=pom3nQejaTs

YouTubeSECourses

How To Install New DREAMBOOTH & Torch 2 On Automatic1111 Web UI PC ...

https://www.patreon.com/SECourses

In this video, I am explaining how you can man...

FFurkan Gözükara SECourses yes dreambooth installation now required different approach

m3dia_offline•5/28/23, 1:29 PM

Hi @Furkan Gözükara SECourses thanks for the reply.

I have tried up until the deletion of the 'venv' folder from this tutorial actually, but the extension is still not showing up. Do you think it may be because of the differences in my 'requirements' file as I added on to my earlier message?

Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17, dedicated GPU pods

Similar Threads