Software Engineering Courses (SECourses)•3y ago

for batch size 1 : rtx 4090

Furkan Gözükara SECoursesOP•10/24/23, 7:18 PM

but for higher batch sizes you can go 80 gb

Furkan Gözükara SECoursesOP•10/24/23, 7:18 PM

increase batch size and keep gradient acc disabled

Rrafraf @Dr. Furkan Gözükara is there a tool to find duplicates within a large dataset?

Furkan Gözükara SECoursesOP•10/24/23, 7:18 PM

you mean duplicate images i presume

Mmikemenders yes, but you don't have the file extension display turned on in windows

vKorby•10/24/23, 7:18 PM

its still takin long for sum reason lol

Furkan Gözükara SECoursesOP•10/24/23, 7:18 PM

i think you can ask chat gpt to get quick python code

Mmikemenders Speaking of Adafactor: why can't I select the Adafactor scheduler if the optimiz...

Furkan Gözükara SECoursesOP•10/24/23, 7:19 PM

i never tried

FFurkan Gözükara SECourses you mean duplicate images i presume

rafraf•10/24/23, 7:19 PM

Yes

FFurkan Gözükara SECourses i think you can ask chat gpt to get quick python code

rafraf•10/24/23, 7:19 PM

Ok I’ll check it out

VvKorby Hey guys, i need some help here does anyone have any videos or advice if my SD i...

Furkan Gözükara SECoursesOP•10/24/23, 7:19 PM

yes add --medvram

Furkan Gözükara SECoursesOP•10/24/23, 7:19 PM

if be still too slow make --lowvram

BBarbaraM idk why but control net doesn't seem to work for me on sdxl models, (even with c...

Furkan Gözükara SECoursesOP•10/24/23, 7:20 PM

you must have error on cmd

FFurkan Gözükara SECourses you must have error on cmd

BarbaraM•10/24/23, 7:21 PM

error message on ther terminal?

VvKorby its still takin long for sum reason lol

mikemenders•10/24/23, 7:23 PM

How much VRAM have?

FFurkan Gözükara SECourses if be still too slow make --lowvram

vKorby•10/24/23, 7:23 PM

Oh ok,im thinkin its my computer also been runnin a bit slow lately so going to be tweaking some stuff. btw these are my specs

BBarbaraM error message on ther terminal?

Furkan Gözükara SECoursesOP•10/24/23, 7:24 PM

yes

FFurkan Gözükara SECourses you must have error on cmd

BarbaraM•10/24/23, 7:24 PM

i m using runpod, nothing on my terminal

VvKorby Oh ok,im thinkin its my computer also been runnin a bit slow lately so going to ...

Furkan Gözükara SECoursesOP•10/24/23, 7:24 PM

it is only 8gb sadly

Furkan Gözükara SECoursesOP•10/24/23, 7:24 PM

but you can do inference

FFurkan Gözükara SECourses yes

BarbaraM•10/24/23, 7:24 PM

Capture_decran_2023-10-24_a_21.24.41.png

BBarbaraM i m using runpod, nothing on my terminal

Furkan Gözükara SECoursesOP•10/24/23, 7:24 PM

please use my auto installr

Furkan Gözükara SECoursesOP•10/24/23, 7:25 PM

and start web ui as i do

Furkan Gözükara SECoursesOP•10/24/23, 7:25 PM

https://www.patreon.com/posts/84896373

FFurkan Gözükara SECourses please use my auto installr

BarbaraM•10/24/23, 7:26 PM

i have this auto installer

Capture_decran_2023-10-24_a_21.25.50.png

VvKorby Oh ok,im thinkin its my computer also been runnin a bit slow lately so going to ...

mikemenders•10/24/23, 7:26 PM

Sorry, there's no --lowvram-sdxl switch, so it's still slow because you're generating to regular memory, so you have full VRAM. You have 8 GB VRAM, I think. This is very marginal.

mikemenders•10/24/23, 7:27 PM

Check this options:
https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Command-Line-Arguments-and-Settings

GitHub

Command Line Arguments and Settings

Stable Diffusion web UI. Contribute to AUTOMATIC1111/stable-diffusion-webui development by creating an account on GitHub.

mikemenders•10/24/23, 7:28 PM

I have an RTX 3060 12 GB card and it is also a bit slow for SDXL generation, but it fits in VRAM. With AI, VRAM is very important, how much you have.

mikemenders•10/24/23, 7:29 PM

If you don't have enough VRAM, you're working in RAM, and even though I have DDR5 RAM with i9, it's definitely slower.

BBarbaraM i have this auto installer

Furkan Gözükara SECoursesOP•10/24/23, 7:30 PM

ye after that start web ui manually

Furkan Gözükara SECoursesOP•10/24/23, 7:30 PM

so kill previous one with

Furkan Gözükara SECoursesOP•10/24/23, 7:30 PM

fuser -k 3000/tcp

Mmikemenders If you don't have enough VRAM, you're working in RAM, and even though I have DDR...

vKorby•10/24/23, 7:34 PM

Yeah I do have 8 GB looks like Imma jus have to deal with that lol, I'm thinking of using this and leonardo ai image 2 image

FFurkan Gözükara SECourses shared disk space

EyeSpyBekoAI•10/24/23, 7:57 PM

Hey there, thanks for this! Network volume seems to be working quite well as I was able to see setup pods pop up after being closed and relaunched. I'm setting up more now. One thing I'm noticing though, is that getting port availability is considerably dodgy. Is there a way to get around this, or is it one of "it is what it is" situations?

Mmikemenders @Jas The large file is also good for styling, and can be reduced to 512 by lora....

Jas•10/24/23, 8:22 PM

Thanks for your recommendations, with the labelling, I am a bit uncertain how to do it as they are quite abstract. I will show you a couple of examples of the images I am training on, maybe you can suggest what to label.

Come to think of it, I am not sure I am really training a 'style' but it is more like a type of artwork / art object.

for the label I have something like "Ceramicblobstyle, pink, green and blue theme"

I don't know how to label it outside of mentioning the colours in the image, because I want to replicate the patterns, the shapes and blobs.