Software Engineering Courses (SECourses)•17mo ago

I did 10 epoke and 10 steps, it's normal that's training during 4hours with 62 images?

Capture_decran_2024-08-25_a_02.32.02.png

Nnicearoni these are awesome

Furkan Gözükara SECourses•8/25/24, 12:37 AM

yep expanding testing prompts will update patreon

Ffadounav Very impressive

Furkan Gözükara SECourses•8/25/24, 12:38 AM

yes

Furkan Gözükara SECourses•8/25/24, 12:38 AM

flux is slow

Furkan Gözükara SECourses•8/25/24, 12:38 AM

i am going to add more detailed configs

Furkan Gözükara SECourses•8/25/24, 12:38 AM

like x GB y speed z tier

Ffadounav I did 10 epoke and 10 steps, it's normal that's training during 4hours with 62 i...

nicearoni•8/25/24, 12:39 AM

what did you set for saving? every x epoch or steps?

Nnicearoni what did you set for saving? every x epoch or steps?

fadounavOP•8/25/24, 12:40 AM

I set 0 for saving

Ffadounav I set 0 for saving

Furkan Gözükara SECourses•8/25/24, 12:43 AM

you should save checkpoints

Furkan Gözükara SECourses•8/25/24, 12:43 AM

like every 10 epoch

Furkan Gözükara SECourses•8/25/24, 12:43 AM

and compare them

Furkan Gözükara SECourses•8/25/24, 12:45 AM

newest trainings to compare

FFurkan Gözükara SECourses newest trainings to compare 😄

nicearoni•8/25/24, 12:53 AM

wow!!

Ffadounav I did 10 epoke and 10 steps, it's normal that's training during 4hours with 62 i...

nicearoni•8/25/24, 12:59 AM

your speed is good, at least that's what i get with a 3090 on windows 11. but math not adding up for me? by "10 steps" do you mean "10 repeats"? 1650 steps total at 10 epochs means 165 steps per epoch... you can't have repeats set at 10 because that would mean 16.5 images lol. my guess, not all 62 of your images were recognized, or you have batch set > 1?

Furkan Gözükara SECourses•8/25/24, 1:00 AM

first testing lora rank impact with 38 prompts

nicearoni•8/25/24, 1:01 AM

that grid is going to be a monster

�

𝔸𝖨ΞӾ•8/25/24, 1:04 AM

nvm just realized electricity was back on lol

Furkan Gözükara SECourses•8/25/24, 1:26 AM

lora rank really overfits model

Furkan Gözükara SECourses•8/25/24, 1:26 AM

but also improves resembalcen

Furkan Gözükara SECourses•8/25/24, 1:27 AM

128 vs 4

Furkan Gözükara SECourses•8/25/24, 1:27 AM

look clothing difference

Furkan Gözükara SECourses•8/25/24, 1:27 AM

so fine tuning may firs this issue

Furkan Gözükara SECourses•8/25/24, 1:27 AM

maybe rank 32 good

Furkan Gözükara SECourses•8/25/24, 1:31 AM

256 truly best resemblance

�

𝔸𝖨ΞӾ•8/25/24, 1:35 AM

Wow it's so much more incredibly detailed, the sword and the castle in the background. It looks like it kind of removes the background blur that Flux is known for, too

Furkan Gözükara SECourses•8/25/24, 1:38 AM

full lora rank impact https://huggingface.co/MonsterMMORPG/Generative-AI/resolve/main/Full%20LoRA%20Rank%20Impact.jpg

�𝔸𝖨ΞӾ Wow it's so much more incredibly detailed, the sword and the castle in the backg...

Furkan Gözükara SECourses•8/25/24, 1:38 AM

ye it overfits model

Furkan Gözükara SECourses•8/25/24, 1:41 AM

ok time to test higher resolution

FFurkan Gözükara SECourses full lora rank impact https://huggingface.co/MonsterMMORPG/Generative-AI/resolve...

fadounavOP•8/25/24, 2:05 AM

256 is very impressive quality

Ffadounav 256 is very impressive quality

Furkan Gözükara SECourses•8/25/24, 2:11 AM

yep

Furkan Gözükara SECourses•8/25/24, 2:11 AM

more learns better

Furkan Gözükara SECourses•8/25/24, 2:11 AM

fine tuning will be much better probably

Furkan Gözükara SECourses•8/25/24, 2:11 AM

testing higher res training impact right now

Furkan Gözükara SECourses•8/25/24, 2:11 AM

1280 and 1536

FFurkan Gözükara SECourses so fine tuning may firs this issue

GomezBro•8/25/24, 2:14 AM

whats the difference between fine tuning(ive never used it) and upscaling?

FFurkan Gözükara SECourses 1280 and 1536

fadounavOP•8/25/24, 2:16 AM

can i get this quality via massed compute or runpod? if i can create a lora that i could use all the time, i am ready to use several powerful gpu. i have to wait 2h to see the result of my training i am impatient