Software Engineering Courses (SECourses)•3y ago

dev branch of automatic1111. they made a new release so do a git pull

Aashley For anyone considering using the RunPod endpoints for training, I recommend not ...

Furkan Gözükara SECoursesOP•5/28/23, 10:15 AM

yep runpod is still best option with good gpu and good prices. i wouldnt trust their endpoint though. do setup with my video it works :d

MManwani following this video tutorial Zero To Hero Stable Diffusion DreamBooth Tutorial...

Furkan Gözükara SECoursesOP•5/28/23, 10:16 AM

ok here updated how to install dreambooth tutorial : https://youtu.be/pom3nQejaTs

YouTubeSECourses

How To Install New DREAMBOOTH & Torch 2 On Automatic1111 Web UI PC ...

Discord : https://bit.ly/SECoursesDiscord. Torch 2 / Pytorch 2 is now supported along with new DreamBooth Automatic1111 Web UI extension. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on

https://www.patreon.com/SECourses

In this video, I am explaining how you can man...

AAlaBeat hello i get this error when i try to start kohya ss on runpod root@b12c8b7fa1ad:...

Furkan Gözükara SECoursesOP•5/28/23, 10:17 AM

looks like you didnt follow venv part correctly. it should activate venv

AlaBeat•5/28/23, 10:17 AM

yes i think i know what caused it, didn't run in the end
./setup.sh -n

AlaBeat•5/28/23, 10:17 AM

will do it now and see how it goes

FFurkan Gözükara SECourses ok here updated how to install dreambooth tutorial : https://youtu.be/pom3nQejaT...

Manwani•5/28/23, 10:18 AM

just watching it currently, git cloning is finished from my end

FFurkan Gözükara SECourses yep runpod is still best option with good gpu and good prices. i wouldnt trust t...

ashley•5/28/23, 10:20 AM

Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17, dedicated GPU pods can run for a little more than 2 days non stop for that price.

AlaBeat•5/28/23, 10:21 AM

works

Aashley Yep, just running a few tests to their dreambooth endpoint yesterday cost me $17...

Furkan Gözükara SECoursesOP•5/28/23, 10:23 AM

wow 17$ huge

Furkan Gözükara SECoursesOP•5/28/23, 10:23 AM

you could get like 50+ hours

FFurkan Gözükara SECourses you could get like 50+ hours

ashley•5/28/23, 10:27 AM

yes exactly

AlaBeat•5/28/23, 10:31 AM

so i tried to train, it didn't work, i think it was something either with torch or xformers, did a pip uninstall/install xformers, now i try to start kohya and get this root@b12c8b7fa1ad:/workspace/kohya_ss# bash gui.sh --share
Validating that requirements are satisfied.
Error: The following packages have the wrong version:

timm==0.6.12 (expected version torch==1.12.1, found version 2.0.1)

Run upgrade.sh or pip install -U -r /workspace/kohya_ss/requirements.txt to resolve the missing requirements listed above...
root@b12c8b7fa1ad:/workspace/kohya_ss#

Furkan Gözükara SECoursesOP•5/28/23, 10:35 AM

@AlaBeat did you make venv in that folder? like in video

AlaBeat•5/28/23, 10:35 AM

yes i have made venv

Furkan Gözükara SECoursesOP•5/28/23, 10:36 AM

but it is using your system wide torch version

Furkan Gözükara SECoursesOP•5/28/23, 10:36 AM

not using your venv

Furkan Gözükara SECoursesOP•5/28/23, 10:36 AM

if you are our patreon supporter i can connect your pc and install

AlaBeat•5/28/23, 10:36 AM

i will install again torch in venv folder, even though i've done it already

Furkan Gözükara SECoursesOP•5/28/23, 10:37 AM

something missing. it should use venv

Furkan Gözükara SECoursesOP•5/28/23, 10:37 AM

not system wide default venv

AAlaBeat i will install again torch in venv folder, even though i've done it already

ashley•5/28/23, 10:37 AM

Make sure you activate your venv, just creating it does not activate it automatically

AlaBeat•5/28/23, 10:40 AM

will do it again, got an error saying i'm out of space

AAlaBeat will do it again, got an error saying i'm out of space

Furkan Gözükara SECoursesOP•5/28/23, 10:43 AM

ye you need to increase runtime space because temp files will take space

AlaBeat•5/28/23, 10:44 AM

ok....

message.txt6KB

Furkan Gözükara SECoursesOP•5/28/23, 10:46 AM

try a fresh pod i think. /workspace/kohya_ss/venv/bin/python3: No module named pip

AlaBeat•5/28/23, 11:09 AM

ok now how to fix this error when i start the train

message.txt4.35KB

AAlaBeat ok now how to fix this error when i start the train

Furkan Gözükara SECoursesOP•5/28/23, 11:22 AM

how much vram you have?

Furkan Gözükara SECoursesOP•5/28/23, 11:22 AM

ah you are on runpod

Furkan Gözükara SECoursesOP•5/28/23, 11:22 AM

dont use xformers

AlaBeat•5/28/23, 11:26 AM

i tried once with xformers installed and it worked, on runpod... will try a new pod without installing xformers

AlaBeat•5/28/23, 11:27 AM

do i do pip uninstall xformers on the new runpod too?

AlaBeat•5/28/23, 11:30 AM

when using this current runpod, not the new one, i get this thing (not error) WARNING:xformers:WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
PyTorch 2.0.1+cu118 with CUDA 1108 (you have 1.12.1+cu116)
when not using xformers i get oom errors with 3090...

AlaBeat•5/28/23, 11:30 AM

that was why i want to use xformers

AlaBeat•5/28/23, 11:31 AM

oh well.. fuck it no more runpod for me

ashley•5/28/23, 11:34 AM

3090 has 24GB of VRAM so its an issue with your settings, you shouldn't face OOM with 24GB VRAM

ashley•5/28/23, 11:35 AM

Also fix your xformers version

AlaBeat•5/28/23, 11:35 AM

settings where the same as my last session on runpod using xformers... something is wrong with runpod giving me all kinds of erros when i try to use xformers

AlaBeat•5/28/23, 11:35 AM

when i try to not use xformers i get oom on even batch size 2

AlaBeat•5/28/23, 11:36 AM

i'll just train on my pc until they fix xformers

ashley•5/28/23, 11:36 AM

Did you do this?

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

AlaBeat•5/28/23, 11:37 AM

i've only done this:
git clone https://github.com/bmaltais/kohya_ss.git

cd kohya_ss

python3 -m venv venv

source venv/bin/activate

./setup.sh -n
source venv/bin/activate

apt update

apt-get install python3.10-tk

pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
pip uninstall xformers
pip install xformers

GitHub

GitHub - bmaltais/kohya_ss

Contribute to bmaltais/kohya_ss development by creating an account on GitHub.

AAlaBeat i've only done this: git clone https://github.com/bmaltais/kohya_ss.git cd kohy...

Furkan Gözükara SECoursesOP•5/28/23, 11:40 AM

this will change your torch version : pip install xformers

Furkan Gözükara SECoursesOP•5/28/23, 11:40 AM

i think just uninstall xformers and dont reinstall

Furkan Gözükara SECoursesOP•5/28/23, 11:40 AM

it is not necessary with 24 gb

Aashley Did you do this? ``` pip3 install torch==1.13.1 torchvision torchaudio --index-u...

AlaBeat•5/28/23, 11:43 AM

(venv) root@2fba617cc7bd:/workspace/kohya_ss# pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
Collecting https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
ERROR: HTTP error 404 while getting https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6
ERROR: Could not install requirement https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6 because of HTTP error 404 Client Error: Not Found for url: https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6 for URL https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_6

AAlaBeat (venv) root@2fba617cc7bd:/workspace/kohya_ss# pip3 install https://huggingface.c...

ashley•5/28/23, 11:44 AM

sorry copy and paste error by me:

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl

pip3 install torch==1.13.1 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
pip3 uninstall xformers
pip3 install https://huggingface.co/MonsterMMORPG/SECourses/resolve/main/xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl

Aashley sorry copy and paste error by me: ```pip3 install torch==1.13.1 torchvision torc...

AlaBeat•5/28/23, 12:02 PM

yeah xformers just doesn't want to work...

ashley•5/28/23, 12:16 PM

@Furkan Gözükara SECourses have you found this setting to make much difference within your experiments? I find setting it to 0.40 instead of 0.75 results in much less over training.

Furkan Gözükara SECoursesOP•5/28/23, 1:08 PM

ye xformers didnt work

Furkan Gözükara SECoursesOP•5/28/23, 1:08 PM

i will look for a working one

dev branch of automatic1111. they made a new release so do a git pull

Similar Threads

Similar Threads

Similar Threads