Software Engineering Courses (SECourses)•11mo ago

sure add my account some credits i can ttest

FFurkan Gözükara SECourses sure add my account some credits i can ttest

snowmonkey•2/23/25, 10:24 PM

adding!

snowmonkey•2/23/25, 10:24 PM

done

Ssnowmonkey done 🙂

Furkan Gözükara SECoursesOP•2/23/25, 10:42 PM

AAikage I tried switching to prodigy optimizer setting learning rate to 1 and cosine. Wi...

Renzo•2/24/25, 5:07 PM

What GPU did you use?

Aikage•2/24/25, 5:32 PM

4090ti

Aikage•2/24/25, 5:32 PM

I am having some trouble tbh it is like 80% there but I cannot push it to 100% if that makes sense

Aikage•2/24/25, 5:32 PM

I have tried to increase steps and decrease d coef

Aikage•2/24/25, 5:33 PM

decreasing d coef helped with theh ands and eyes a little but still getting heavy artifacting in many pictures

Aikage•2/24/25, 5:33 PM

well, not HEAVY, but visible here and there

Aikage•2/24/25, 5:33 PM

enough that it is irritating

Aikage•2/24/25, 5:33 PM

Maybe not for me after all

Renzo•2/24/25, 5:34 PM

Interesting. Would you say that Furkan's configuration based on Adafactor still gives higher quality results than with prodigy?

Renzo•2/24/25, 5:39 PM

Or what do you mean by 100%?

RRenzo Interesting. Would you say that Furkan's configuration based on Adafactor still ...

Aikage•2/26/25, 2:16 PM

sorry for delayed response, still playing around with it. So far, yes absolutely

Aikage•2/26/25, 2:16 PM

but the speed increase is undeniable so I will continue to experiment

Aikage•2/26/25, 2:18 PM

there are other parameters I am testing now (dropout, weight decay, further refining d coef) as well as changing batch size/repeats/epochs to see if I can arrive at a good setup

Aikage•2/26/25, 2:18 PM

https://github.com/derrian-distro/LoRA_Easy_Training_Scripts Also found some other program (not that it will be helpful to train but something to play with)

Aikage•2/26/25, 2:19 PM

I believe it is Khoya based

Aikage•2/26/25, 2:19 PM

but a different front end similar to how swarm is to comfy

Aikage•2/26/25, 2:21 PM

but I could be wrong

I'll take a look and see if I like it better than onetrainer. Khoya UI I didn't like much so this might be a nice solution

Renzo•2/26/25, 5:59 PM

Thank you for expanding on your experiments. Are you using an LLM to guide you through tunning parameters such as dropout or weight decay? I wonder if SOTA LLMs can help us arrive at the optimal ones faster than doing it on our own.

Renzo•2/26/25, 6:19 PM

Are you planning to share your findings? I once tried to fine-tune with prodigy on Kohya but I could not make it work.

Aikage•2/26/25, 10:32 PM

Sure if course

Aikage•2/26/25, 10:32 PM

I am not using llm just researching the old fashioned way

Aikage•2/26/25, 10:32 PM

And trial and error

Aikage•2/27/25, 12:58 PM

getting close - in fact I think i have it the only problem I have now is the problem I always have which is with unique features getting lost (moles on specific sides of faces, or heterochromia, etc.)

Aikage•2/27/25, 12:59 PM

I am going to go back and try to weight images which highlight those features more heavily in my training dataset

Aikage•2/27/25, 1:38 PM

No Access I'll show some results and the issue I have

Aikage•2/27/25, 1:41 PM

But it might be a day or two actually not feeling well today

Renzo•2/27/25, 2:03 PM

Nice. I appreciate it!

AAikage 4090ti

lazyboy2011•3/1/25, 4:33 AM

4090ti prototype?

sorry that catching for it but I was looking ti without success, as I know they decided not to Release it but I can be in mistake

Aikage•3/1/25, 4:37 AM

yeah i thought for sure i had ti

Aikage•3/1/25, 4:38 AM

but you're right

Aikage•3/1/25, 4:38 AM

i do not

Aikage•3/1/25, 4:38 AM

lol all this time people probably like what a douche hahahaha

lazyboy2011•3/1/25, 4:38 AM

Prototype photo

Aikage•3/1/25, 4:39 AM

it was canceled

Aikage•3/1/25, 4:39 AM

so just a regular 4090 I guess it is time to upgrade to 5090 then

Aikage•3/1/25, 4:39 AM

maybe they will actually release a 5090 ti

lazyboy2011•3/1/25, 4:39 AM

Yes you are right

lazyboy2011•3/1/25, 4:40 AM

In my case i will buy 5090 and together with 4090

lazyboy2011•3/1/25, 4:41 AM

Actually what is happening now on market with 5000 series, stories that 5080=4070ti,

lazyboy2011•3/1/25, 4:42 AM

Waiting for stabilisation

cyleap•3/1/25, 9:56 AM

@Furkan Gözükara SECourses hey im using the gradio app for WAN. im using it in RTX A6000 GPU. i set the vram 48GB. using 480p model with IMG2VID. this is regular speed right? or am i doing something wrong? Cause I put the 4k quality img (which is like 30MB) in the input, do i also need to put the smaller image?