Software Engineering Courses (SECourses)•2y ago

@Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the full implementation i

@Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the full implementation in pytorch ? I would like to see the layers , connections and everything to change the architecture and see the impact for instance

rafraf•4/4/24, 12:47 PM

@Dr. Furkan Gözükara testing out FullFinetune on Kohya and having issues with metadata processing. Do i have to run a script to convert my txt caption files? Do you have a video for this?

rafraf•4/4/24, 12:53 PM

OSError: [Errno 22] Invalid argument: 'E:\studio Dropbox\studio\ai\libs\SD\1models\1styles\gr4ph1cW_v001admw8bt_50wd14_rep5_bs6\n_20240404-145300.json'

rafraf•4/4/24, 12:53 PM

this is the error

AIGambino•4/4/24, 1:49 PM

@Dr. Furkan Gözükara I followed your onetrainer tutorial with your preset and whenever I train a model its just broken. My current model wont even load in automatic1111

MMorpheus SX343 Hi all, has anyone yet tried to be more accurate while training specific body p...

Furkan Gözükara SECourses•4/4/24, 2:03 PM

never tried

SSebastianblood @Dr. Furkan Gözükara I did not notice you were training up to 150 epoch for just...

Furkan Gözükara SECourses•4/4/24, 2:03 PM

for such images

Furkan Gözükara SECourses•4/4/24, 2:03 PM

traing as much as you can

Furkan Gözükara SECourses•4/4/24, 2:04 PM

and save checkpoints every epoch

Yyunusos @Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the f...

Furkan Gözükara SECourses•4/4/24, 2:04 PM

you can look diffusers library i guess

AAIGambino @Dr. Furkan Gözükara I followed your onetrainer tutorial with your preset and w...

Furkan Gözükara SECourses•4/4/24, 2:04 PM

could be model corrupted somehow

Furkan Gözükara SECourses•4/4/24, 2:05 PM

i did over 15 training - different trainings - all working perfect

Furkan Gözükara SECourses•4/4/24, 2:05 PM

good news massed compute increased gpu pool

AIGambino•4/4/24, 2:23 PM

@Dr. Furkan Gözükara here are my settings, all setup but none of my models ever seem to work

AAIGambino @Dr. Furkan Gözükara here are my settings, all setup but none of my models ever...

Furkan Gözükara SECourses•4/4/24, 2:34 PM

try to download base model

Furkan Gözükara SECourses•4/4/24, 2:34 PM

into disk

Furkan Gözükara SECourses•4/4/24, 2:35 PM

and give its path

Furkan Gözükara SECourses•4/4/24, 2:35 PM

i wonder if your sdxl downloaded cache file is broken

Furkan Gözükara SECourses•4/4/24, 3:08 PM

by the way before starting training

Furkan Gözükara SECourses•4/4/24, 3:08 PM

i test base model with auto1111

Furkan Gözükara SECourses•4/4/24, 3:09 PM

and verify it is working or not

Diego•4/4/24, 3:25 PM

Hi @Dr. Furkan Gözükara small question, I have a volume storage on Runpod and I wanted to reduce space but since it's not possible, I created a new one and I just copypasted my entire ComfyUI folder. But now every time I start a new pod, I try to start comfyui (installed with your script) by typing:

apt update
apt install psmisc
fuser -k 3000/tcp
cd /workspace/ComfyUI/venv
source bin/activate
cd /workspace/ComfyUI
python main.py --listen 0.0.0.0 --port 3000

But everytime it asks me to install this:

pip install safetensors
pip install einops
pip install transformers
pip install scipy
pip install torchsde
pip install aiohttp

Any idea how I can solve it? Also as a request, would be great to have more scripts for ComfyUI and SDXL. Lots of thanks!

DDiego Hi @Dr. Furkan Gözükara small question, I have a volume storage on Runpod and I ...

Furkan Gözükara SECourses•4/4/24, 3:34 PM

well it shouldnt happen

Furkan Gözükara SECourses•4/4/24, 3:34 PM

because we install into venv

Furkan Gözükara SECourses•4/4/24, 3:34 PM

it must be related to your folder copy pasting

Furkan Gözükara SECourses•4/4/24, 3:34 PM

also how did you copy paste?

Furkan Gözükara SECourses•4/4/24, 3:35 PM

you cant copy paste between pods

Rrafraf @Dr. Furkan Gözükara testing out FullFinetune on Kohya and having issues with me...

ch1253•4/4/24, 4:01 PM

I am also facing this issue, I tried first autotrain-advanced but was not able to assign captions, then I am now trying Kohya but still facing issues. Also May I know which models you are testing with?

Yyunusos @Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the f...

ch1253•4/4/24, 4:02 PM

Interesting!

FFurkan Gözükara SECourses well it shouldnt happen

Diego•4/4/24, 5:19 PM

I made a new storage volume, then I used runpodctl to transfer my confyUI folder from one volume to another.

The issue happens everytime I start a new pod and try to run comfyui

DDiego I made a new storage volume, then I used runpodctl to transfer my confyUI folder...

Furkan Gözükara SECourses•4/5/24, 12:54 AM

that is wrong

Furkan Gözükara SECourses•4/5/24, 12:54 AM

you need to make a fresh install

Furkan Gözükara SECourses•4/5/24, 12:54 AM

you can only transfer models

crapthings•4/5/24, 5:04 AM

@Dr. Furkan Gözükara

crapthings•4/5/24, 5:05 AM

crapthings•4/5/24, 5:05 AM

crapthings•4/5/24, 5:07 AM

this break cache progress i have to redo the cache again

Tuanny•4/5/24, 5:44 AM

what settings do i adjust in supir so that it doesnt hallucinate as much. i did fidelity and v0-F

Kallamamran•4/5/24, 7:23 AM

@Dr. Furkan Gözükara Is it possible to add a checkbox or something to make it possible for CLIP Interrogator to batch process subfolders as well?!

Kkareem9000 so technically i would try to run the dataset by supir before i start training o...

Neo•4/5/24, 8:00 AM

Yes, I am doing that now on most smaller resolution datasets for concepts, however I would be very wary of any noticeable artificial enhancements it may be doing to your dataset as that "artificialness" may be enhanced in your SD outputs when you include the LoRA in your inference. I find that keeping the prompt text influence fairly low ~4 or less seems to keep the upscale/detail recovery adequate without introducing artificialness into the AI upscaled image. Your mileage may vary...

MMorpheus SX343 Hi all, has anyone yet tried to be more accurate while training specific body p...

Neo•4/5/24, 8:26 AM

Not sure who has responded but I train LoRAs (presently using Kohya, will attempt to transition to OneTrainer soon) that require a high amount of quality and accuracy due to celebrity reproduction. What I am finding is that approaching model sized datasets (~300 images) is the key to increased accuracy across the board of your concept. This is the easiest and most straight forward method, but not always available if you can't acquire a dataset with enough good quality representations of your concept(s). So alternatives:
1) Train multiple concepts - This from reports is a mixed bag. I've done it for a TV celebrity who plays an iconic character with OK success. If I did it again, I would increase the size of my dataset for each concept to ~250 or more images.
Further to this, you will also need to watch out when training lots of closeups to get it to learn a concept as it will lose reference with your MAIN subject (depending on what your concept). So say your concept is a male celebrity but you want the abs more accurate, doing all closeups of the abs may cause it to lose reference to the main subject you want. After all it is giving you what its learned (just abs closeups) from the trigger word you associated it with.
2) Train with color association or some other novel machine learning method - See Civitai article here: (sorry it appears he's removed the article and model). There is a reddit post still here about it: https://www.reddit.com/r/StableDiffusion/comments/1aolvxz/instructive_training_for_complex_concepts/?share_id=TyIZDSSNoYSqsqZVR0SzW
3) Train them as separate LoRAs, this would operate like 1) but remove the pitfalls people claim happens with multi-concept training in a single LoRA.
4) Learn how to train a model for ADetailer specific for your subject (tbh, I have no idea where to start with this one, but it may be what you and I both need to get body part accuracy)

From the StableDiffusion community on Reddit: Instructive training ...

Explore this post and more from the StableDiffusion community

NNeo Not sure who has responded but I train LoRAs (presently using Kohya, will attemp...

Neo•4/5/24, 8:29 AM

@Morpheus A quick update: regarding training a custom ADetailer model: I did find this but don't presently have time to read it through: https://civitai.com/articles/1224/training-a-custom-adetailer-model

Yyunusos @Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the f...

Neo•4/5/24, 8:31 AM

There is a Civitai article if I can find it that talks about manipulating the layers for LoRA optimisation, way over my head. I'll see if I can find it. here we go, not sure if it will help, but good luck LOL: https://civitai.com/articles/76/bdsqlsz-lora-training-advanced-tutorial1lora-block-training

bdsqlsz LoRA training Advanced Tutorial(1)：LoRA Block Training | Ci...

What is Lora block training? Lora Block training involves modifying the corresponding block weights during training through U-Net processing. First...

TTuanny what settings do i adjust in supir so that it doesnt hallucinate as much. i did...

Neo•4/5/24, 8:40 AM

I'm having great success with the text guidance set to 4 or lower to remove artificial influence from the base text prompt descriptions (or negative prompt).

NNeo Yes, I am doing that now on most smaller resolution datasets for concepts, howev...

kareem9000•4/5/24, 10:12 AM

Ahh I get you

Morpheus SX343•4/5/24, 10:36 AM

@Neo Thanks for all your answers. Good question if SD looses track of the concept or not when labeling the data correctly. I dont know if the trainer will understand a caption file like "abs of ohwx man" or not. For us humans it's clear, but not sure if the modell will understand to output those abs whenever I prompt a "naked body of ohwx man", that the abs will be part of it... Probably needed to be checked

Morpheus SX343•4/5/24, 10:39 AM

BTW guys, question of questions, everybody asks himself:
Any way to get better at avoiding being detected as AI image when using AI image detectors like HIV?

Morpheus SX343•4/5/24, 10:39 AM

HIVE

MMorpheus SX343 @Neo Thanks for all your answers. Good question if SD looses track of the concep...

Neo•4/5/24, 11:43 AM

Yeah if the base model has no idea what "abs" is, you will need to train it from scratch which means variation is king. You will need to do cropped shots, full shots, but always make sure the concept is present. Not sure how long it would take for it to understand abs if its not there in the base model you train off. I'd first run some inference checks or caption checks on the sourced model if you can for "abs" or "abdominals" etc.

Kallamamran•4/5/24, 11:47 AM

"photo of owhx man, abs, fit, abdominal muscles" and so on... That should suffice... If the model know abs it can generate ohwx man with abs.... I think!

NNeo Yeah if the base model has no idea what "abs" is, you will need to train it from...

Morpheus SX343•4/5/24, 12:05 PM

Yes but I hope the base model knows the basic concepts of body parts. I mean I'm not talking about special terms like "Musculus biceps brachii"

More like Legs, Knees, Abs, Arms, Chest, Breast, Back, Lower back, Shoulders... That's it. Very "generic" terms

@Dr. Furkan Gözükara , is there any LoRA model we can play with that shows the full implementation i

Similar Threads