Software Engineering Courses (SECourses)•3y ago

i got super interesting finding with TE still researching. but we really need different LR for TE :

i got super interesting finding with TE still researching. but we really need different LR for TE : https://twitter.com/GozukaraFurkan/status/1710416135747748150

Furkan Gözükara (@GozukaraFurkan)

SDXL text encoder turns out to be very strong and becomes so quickly overtrained

Twitter

•

10/6/23, 10:05 PM

Rriccardo can someone explain why google colab gives me this error: ImportError ...

Furkan Gözükara SECoursesOP•10/6/23, 10:18 PM

which colab?

JJehex Hello guy's, How can I run 2 instances of SD ( a1111 ) at the same time ?

Furkan Gözükara SECoursesOP•10/6/23, 10:18 PM

yes

FFurkan Gözükara SECourses i got super interesting finding with TE still researching. but we really need di...

rafraf•10/6/23, 10:18 PM

yea, i saw the thread. Sounds like very difficult to test for TE? Have you got some idea about it? I thought there being two TE's made it impossible practically

Furkan Gözükara SECoursesOP•10/6/23, 10:18 PM

but it really doesnt worth unless you have 2 gpu

Rrafraf yea, i saw the thread. Sounds like very difficult to test for TE? Have you got s...

Furkan Gözükara SECoursesOP•10/6/23, 10:18 PM

i dont know still searching

SSandstormleader Could not create share link. Please check your internet connection or our status...

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

ye it wasnt working yesterday

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

and today for a while

rafraf•10/6/23, 10:19 PM

I am testing AdamW8bit quality with batch sizes 1, 2, 4, 6. I am seeing what is the best sweetspot for quality vs speed of training

PPIXLE Question for any of you: I have trained LORAs for my wife, myself, and my two ki...

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

you can try latent couple extension

Rrafraf I am testing AdamW8bit quality with batch sizes 1, 2, 4, 6. I am seeing what is ...

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

yep

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

this is necessary for companies

Furkan Gözükara SECoursesOP•10/6/23, 10:19 PM

i will also research this for a company

SSandstormleader @Dr. Furkan Gözükara have you tested results of data photos having a beard vs no...

Furkan Gözükara SECoursesOP•10/6/23, 10:23 PM

it adds beard hard

i tested not easy to get without a beard

rafraf•10/6/23, 10:25 PM

i got pretty impressive results with batch 2, which drove SDXL adamW8bit training by by 30% and bs 4 by 60%. For me it's somewhere in there. Need to check flexibility, but i am sure there are other experimental variables to test. Here's dataset of 12 images, vs xy plot with batch 2 up to 9 epochs (5000 steps), 5 hours vs 9 hours batch size 1

xyz_grid-0007-20231006232009-__lora_4du7_0103-lora_adamw8bit_40rep2bs-dim128-alpha64-000001_0.8___closeup_portrait_of_4du7_woman_green_studio_background_st.jpg

rafraf•10/6/23, 10:26 PM

interesting the level of variance in the dataset gets picked up in dim 128/alpha64. I guess the ultimate test will come when i run this LoRA on a Art Style model

REEM•10/6/23, 10:28 PM

@Dr. Furkan Gözükara Hello, I'm trying to train LoRa on objects but it's not working. What's the reason? All the sources I saw were for faces

RREEM @Dr. Furkan Gözükara Hello, I'm trying to train LoRa on objects but it's not wor...

Furkan Gözükara SECoursesOP•10/6/23, 10:30 PM

well it works but object training is a different methodology

Furkan Gözükara SECoursesOP•10/6/23, 10:30 PM

i can give private consultation

FFurkan Gözükara SECourses well it works but object training is a different methodology

REEM•10/6/23, 10:33 PM

How?

FFurkan Gözükara SECourses hi

king•10/6/23, 10:36 PM

I am looking for any dev task.
Cold you help me?

Kking I am looking for any dev task. Cold you help me?

Furkan Gözükara SECoursesOP•10/6/23, 10:37 PM

sorry i dont have any tasks

PIXLE•10/6/23, 10:40 PM

@Dr. Furkan Gözükara If I am training a model of my son, should I use reference images of boys his age instead of the ones I would use to train my own LORA?

Sandstormleader•10/6/23, 10:48 PM

Sandstormleader•10/6/23, 10:48 PM

looking better now.

Furkan Gözükara SECoursesOP•10/6/23, 10:53 PM

https://twitter.com/GozukaraFurkan/status/1710427890070786480

PPIXLE @Dr. Furkan Gözükara If I am training a model of my son, should I use reference ...

Furkan Gözükara SECoursesOP•10/6/23, 10:53 PM

if you can find yes better class dataset

Furkan Gözükara SECoursesOP•10/6/23, 10:53 PM

BS 2 brings 82% speed increase on A100

Sandstormleader•10/6/23, 11:26 PM

EEyeSpyBekoAI Hey @mikemenders , try RV5 (not 5.1) with the 8400 VAE. I personally had better ...

mikemenders•10/6/23, 11:43 PM

Thank you for tip, I will try it soon!

EEyeSpyBekoAI Hey @mikemenders , this is interesting. Do you know the difference between this ...

mikemenders•10/6/23, 11:44 PM

I've had no luck with adetailer, but ReActor works for me, and if the shape of the face fits, it can be a really good tool for creating new images to go with existing ones.

Mmikemenders I've had no luck with adetailer, but ReActor works for me, and if the shape of t...

EyeSpyBekoAI•10/6/23, 11:47 PM

Interesting. Thanks for the heads up I'll give it a shot.

Furkan Gözükara SECoursesOP•10/7/23, 12:03 AM

with batch size 3 but also xformers full sdxl dreambooth training is 20 min

Furkan Gözükara SECoursesOP•10/7/23, 12:03 AM

on a100 80 gb

Furkan Gözükara SECoursesOP•10/7/23, 12:03 AM

4160 steps

Furkan Gözükara SECoursesOP•10/7/23, 12:03 AM

160 epochs

Furkan Gözükara SECoursesOP•10/7/23, 12:03 AM

ofc when batch size is 3 it takes 1387 steps

licensething•10/7/23, 12:17 AM

After following this video when i press start training, I'm getting this error, without any data training progress at all https://www.youtube.com/watch?v=AY6DMBCIZ3A

File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1520.0_x64qbz5n2kfra8p0\Lib\dataclasses.py", line 1230, in dataclass
return wrap(cls)
^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1520.0_x64qbz5n2kfra8p0\Lib\dataclasses.py", line 1220, in wrap
return _process_class(cls, init, repr, eq, order, unsafe_hash,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1520.0_x64qbz5n2kfra8p0\Lib\dataclasses.py", line 958, in _process_class
cls_fields.append(_get_field(cls, name, type, kw_only))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.1520.0_x64qbz5n2kfra8p0\Lib\dataclasses.py", line 815, in _get_field
raise ValueError(f'mutable default {type(f.default)} for field '
ValueError: mutable default <class 'timm.models.maxxvit.MaxxVitConvCfg'> for field conv_cfg is not allowed: use default_factory

Can anyone please help??

YouTubeSECourses

First Ever SDXL Training With Kohya LoRA - Stable Diffusion XL Trai...

Updated for SDXL 1.0. How to install #Kohya SS GUI trainer and do #LoRA training with Stable Diffusion XL (#SDXL) this is the video you are looking for. I have shown how to install Kohya from scratch. The best parameters to do LoRA training with SDXL. How to use Kohya SDXL LoRAs with ComfyUI. How to do checkpoint comparison with SDXL LoRAs and m...

Sandstormleader•10/7/23, 12:19 AM

i think the latest automatic1111 still broken for training

Llicensething After following this video when i press start training, I'm getting this error, ...

Furkan Gözükara SECoursesOP•10/7/23, 12:29 AM

yep you have error

Furkan Gözükara SECoursesOP•10/7/23, 12:29 AM

uninstall all python

Furkan Gözükara SECoursesOP•10/7/23, 12:29 AM

https://youtu.be/B5U7LJOvH6g

YouTubeSECourses

How To Install Python, Setup Virtual Environment VENV, Set Default ...

How to install Python, have multiple Python installations, set system wide default Python version. How to compose venv for any Python installation, change Python default path, and install SD web UI properly. Discord: https://bit.ly/SECoursesDiscord.

If I have been of assistance to you and you would like to show your support for my work, please...