Software Engineering Courses (SECourses)•3y ago

@Dr. Furkan Gözükara I'm curious after watching a few of your tutorials – what do you currently reco

@Dr. Furkan Gözükara I'm curious after watching a few of your tutorials – what do you currently recommend as the best way to train a model to generate super realistic portraits of yourself? Kohya LoRA? Automatic1111 UI?

juliusOP•6/3/23, 6:57 AM

I'm using a macbook, so currently using rundiffusion.com to be able to generate images. I've been using the popular Google Colab "TheLastBen" to train my dreambooth models previously. It works great thb, but a bit inconsistent, especially now as I started experimenting generating photos for other people

NNesith Click to see attachment

The Elessar [OBOI]•6/3/23, 8:58 AM

hello, this happens because you used the version supplied by the microsoft store. you should download and install the version available through python.org

The Elessar [OBOI]•6/3/23, 8:58 AM

https://www.youtube.com/watch?v=B5U7LJOvH6g

YouTubeSECourses

How To Install Python, Setup Virtual Environment VENV, Set Default ...

How to install Python, have multiple Python installations, set system wide default Python version. How to compose venv for any Python installation, change Python default path, and install SD web UI properly. Discord: https://bit.ly/SECoursesDiscord.

If I have been of assistance to you and you would like to show your support for my work, please...

DDavid Ce Hey, please after launching relauncher.py on the terminal of the jupyter noteboo...

Shubham Agnihotri•6/3/23, 9:32 AM

change the port, or a restart will help as there is some application still running on this port

Aashley run in terminal: ```fuser -k 3000/tcp```

Shubham Agnihotri•6/3/23, 9:32 AM

killing the task at this port also works

Jjulius @Dr. Furkan Gözükara I'm curious after watching a few of your tutorials – what d...

Shubham Agnihotri•6/3/23, 9:34 AM

I feel Dreambooth gives the best accuracy, so if you got money, or good pc which means the same, if you got money, dreambooth will give the best results followed by Kohya and lora pretty much at the same level.. It is my experience

SShubham Agnihotri killing the task at this port also works

ashley•6/3/23, 9:36 AM

Takes more effort and more commands to detemine the process id and then to kill it

Shubham Agnihotri•6/3/23, 9:36 AM

restart the PC, the best option.. then

ashley•6/3/23, 9:36 AM

Also if Web Ui crashes during training, there will be multiple process ids to kill, so this command is better.

SShubham Agnihotri restart the PC, the best option.. then

ashley•6/3/23, 9:37 AM

For Windoews, Linux is not garbage like Windows

Aashley For Windoews, Linux is not garbage like Windows

Shubham Agnihotri•6/3/23, 9:37 AM

yea, true

NNom how do you mean? Do you mean that you dont get error using class images? Just t...

ashley•6/3/23, 9:49 AM

Is that when you don't have pregenerated classification images? There is a new commit on the Dreambooth dev branch that should fix it if you pull the dev branch. I will test it today.

The Elessar [OBOI]•6/3/23, 9:50 AM

there is a good guide to follow in order to have dreambooth working under windows? i managed to start it, but gives me warnings about cuda setup (with linux path errors)

TThe Elessar [OBOI]there is a good guide to follow in order to have dreambooth working under window...

ashley•6/3/23, 9:53 AM

What error are you getting?

Aashley What error are you getting?

The Elessar [OBOI]•6/3/23, 9:54 AM

Applying optimization: xformers... done.
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: Loading binary C:\A1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching /usr/local/cuda/lib64...
CUDA SETUP: WARNING! libcuda.so not found! Do you have a CUDA driver installed? If you are on a cluster, make sure you are on a CUDA machine!
CUDA SETUP: Loading binary C:\A1111\stable-diffusion-webui\venv\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
CUDA SETUP: Problem: The main issue seems to be that the main CUDA library was not detected.
CUDA SETUP: Solution 1): Your paths are probably not up-to-date. You can update them via: sudo ldconfig.
CUDA SETUP: Solution 2): If you do not have sudo rights, you can do the following:
CUDA SETUP: Solution 2a): Find the cuda library via: find / -name libcuda.so 2>/dev/null
CUDA SETUP: Solution 2b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_2a
CUDA SETUP: Solution 2c): For a permanent solution add the export from 2b into your .bashrc file, located at ~/.bashrc
Running on local URL: http://127.0.0.1:7860

TThe Elessar [OBOI]Applying optimization: xformers... done. CUDA_SETUP: WARNING! libcudart.so not f...

ashley•6/3/23, 9:55 AM

Is that with CUDA version 12.1 ?

ashley•6/3/23, 9:56 AM

bitsandbytes doesn't work properly with 12.1, you have to compile it from source, rather use CUDA 11.8

The Elessar [OBOI]•6/3/23, 9:57 AM

looks like i dont' have any CUDA library dev installed, it is that?

ashley•6/3/23, 9:57 AM

You need to install a CUDA driver, not sure how to do that for Windows

The Elessar [OBOI]•6/3/23, 9:58 AM

found an installer, let's see if this sorts

The Elessar [OBOI]•6/3/23, 9:58 AM

thank you

ashley•6/3/23, 9:59 AM

Just try 11.8 and not 12.1, 12.1 has alpha features which tend to cause issues and I don't think the bitsandbytes Python module which provides the 8bit Adam optimizer supports it without compiling the module from source.

The Elessar [OBOI]•6/3/23, 10:00 AM

yes, i found an archived 11.8 version on nvidia website

NNom how do you mean? Do you mean that you dont get error using class images? Just t...

Furkan Gözükara SECourses•6/3/23, 10:13 AM

on runpod currently i am using dev version it is working

Jjulius @Dr. Furkan Gözükara I'm curious after watching a few of your tutorials – what d...

Furkan Gözükara SECourses•6/3/23, 10:14 AM

currently i am working on a new workflow. until that time i find dreambooth + realistic vision

Furkan Gözükara SECourses•6/3/23, 10:15 AM

looks like time to time we need to delete venv entirely

Furkan Gözükara SECourses•6/3/23, 10:15 AM

my previous installation was adding noise to the generated images

Furkan Gözükara SECourses•6/3/23, 10:15 AM

new installation didnt make

Furkan Gözükara SECourses•6/3/23, 10:19 AM

generated over 5k 768x1024 px class images

Furkan Gözükara SECourses•6/3/23, 10:19 AM

also tested different models for realism

Furkan Gözükara SECourses•6/3/23, 10:19 AM

and realistic vision is still the best realistic one

Furkan Gözükara SECourses•6/3/23, 10:43 AM

there was a github repo which had real photos of real people

Furkan Gözükara SECourses•6/3/23, 10:43 AM

do you remember its address

Furkan Gözükara SECourses•6/3/23, 11:44 AM

very weird

Furkan Gözükara SECourses•6/3/23, 11:44 AM

1 extension is causing defects in image

FFurkan Gözükara SECourses 1 extension is causing defects in image

ashley•6/3/23, 11:54 AM

Which extension?

Aashley Which extension?

Furkan Gözükara SECourses•6/3/23, 12:08 PM

dont know yet

Furkan Gözükara SECourses•6/3/23, 12:08 PM

i have these

Furkan Gözükara SECourses•6/3/23, 12:08 PM

Furkan Gözükara SECourses•6/3/23, 12:09 PM

preparing the best ever class images dataset

Furkan Gözükara SECourses•6/3/23, 12:20 PM

cant find a good model that can properly identify abnormal images :/

Furkan Gözükara SECourses•6/3/23, 12:39 PM

maybe i should fetch real images from unsplash

David Ce•6/3/23, 2:18 PM

if you get this, is the best thing to do wait or to transfer to another gpu instance

Aashley Is that when you don't have pregenerated classification images? There is a new ...

Nom•6/3/23, 2:24 PM

yes I want it to generate class images because I dont have any. DrFurkan said dev is working for him so maybe its just a matter of updating it for the template somehow?

DDavid Ce if you get this, is the best thing to do wait or to transfer to another gpu inst...

ashley•6/3/23, 2:31 PM

Depends whether you are able to wait or not, you can try waiting, otherwise transfer your data to another pod if you don't want to wait, because you have no idea how long you will have to wait for a GPU to become available.

DDavid Ce if you get this, is the best thing to do wait or to transfer to another gpu inst...

Furkan Gözükara SECourses•6/3/23, 2:31 PM

yes

Furkan Gözükara SECourses•6/3/23, 2:31 PM

i decided to collect real images

Furkan Gözükara SECourses•6/3/23, 2:31 PM

written script to download from unsplah

Furkan Gözükara SECourses•6/3/23, 2:32 PM

can be used even for fine tuning

NNom yes I want it to generate class images because I dont have any. DrFurkan said de...

ashley•6/3/23, 2:32 PM

Just pull the dev branch

cd /workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension
git pull

cd /workspace/stable-diffusion-webui/extensions/sd_dreambooth_extension
git pull

@Dr. Furkan Gözükara I'm curious after watching a few of your tutorials – what do you currently reco

Similar Threads