Software Engineering Courses (SECourses)•16mo ago

Well ,maybe that's where I went wrong, I did use repeats

Furkan Gözükara SECourses•9/27/24, 9:31 PM

2130-photo20of20ohwx20man20riding20a20galloping20hor-FT_256_images_BS7_5e_01_xFormers-000040-1059077534.png

Mmacba Well ,maybe that's where I went wrong, I did use repeats

Furkan Gözükara SECourses•9/27/24, 9:31 PM

why?

Andrew•9/27/24, 9:31 PM

Has anyone had issues with the vae when trying to finetune in kohya? It looks like it's loading the full flux dev checkpoint as the vae rather than the vae I'm pointing it to in the config...and so it fails to generate latents. I think I can work around this by just not caching to disk and by turning off "use latent files".

Just wondering if anyone has seen this. kohya_ss is all up to date.

macbaOP•9/27/24, 9:32 PM

I thought I was using your settings, but maybe I increased the repeats in addition to the epochs to get more steps? I can't recall 100% but I guess it was a mistake on my part

AAndrew Has anyone had issues with the vae when trying to finetune in kohya? It looks li...

Furkan Gözükara SECourses•9/27/24, 9:33 PM

what do you train?

Furkan Gözükara SECourses•9/27/24, 9:33 PM

flux_?

Mmacba I thought I was using your settings, but maybe I increased the repeats in additi...

Furkan Gözükara SECourses•9/27/24, 9:33 PM

repeat always 1

Andrew•9/27/24, 9:33 PM

Yes, Flux using one of your presets on 24gb,

AAndrew Yes, Flux using one of your presets on 24gb,

Furkan Gözükara SECourses•9/27/24, 9:34 PM

then you need to give vae path

Furkan Gözükara SECourses•9/27/24, 9:34 PM

from your pc

FFurkan Gözükara SECourses then you need to give vae path

Andrew•9/27/24, 9:37 PM

Yep, I am, and I can see that it's in the .toml file under ae=.

FFurkan Gözükara SECourses from your pc

Andrew•9/27/24, 9:37 PM

FFurkan Gözükara SECourses then you need to give vae path

Andrew•9/27/24, 9:38 PM

AAndrew Click to see attachment

Furkan Gözükara SECourses•9/27/24, 9:38 PM

your vae is inaccurate

Furkan Gözükara SECourses•9/27/24, 9:38 PM

use my downloader downloaded vae

Andrew•9/27/24, 9:39 PM

I have a few in that directory, I also have ae.safetensors which is straight from huggingface

AAndrew I have a few in that directory, I also have ae.safetensors which is straight fro...

Furkan Gözükara SECourses•9/27/24, 9:39 PM

try mine

Andrew•9/27/24, 9:39 PM

Running the downloader now just to be sure though!

Furkan Gözükara SECourses•9/27/24, 9:39 PM

if something not working use mine

FFurkan Gözükara SECourses if something not working use mine 😄

Andrew•9/27/24, 9:43 PM

This is the issue I'm seeing...I'm pointing it to your vae now, but when kohya runs you can see in this output that it keeps trying to use the flux checkpoint as the vae. For some reason it's not use the vae in the gui or in the toml

AAndrew This is the issue I'm seeing...I'm pointing it to your vae now, but when kohya r...

Furkan Gözükara SECourses•9/27/24, 9:44 PM

show me gui screenshot please

FFurkan Gözükara SECourses show me gui screenshot please

Andrew•9/27/24, 9:45 PM

Furkan Gözükara SECourses•9/27/24, 9:45 PM

also did you install kohya via stability matrix?

AAndrew Click to see attachment

Furkan Gözükara SECourses•9/27/24, 9:45 PM

this is loading flux dev model as vae

Furkan Gözükara SECourses•9/27/24, 9:45 PM

Furkan Gözükara SECourses•9/27/24, 9:46 PM

get fresh config

Furkan Gözükara SECourses•9/27/24, 9:46 PM

from zip file

Furkan Gözükara SECourses•9/27/24, 9:46 PM

put itno c

Andrew•9/27/24, 9:51 PM

Kohya was installed via your scripts, my flux models just live under stability matrix. I just updated it to point to the flux model from your downloader but same thing, it's still setting the vae path to the full model. I'll try a git hard reset just to make sure kohya isn't stuck on an old commit

AAndrew Kohya was installed via your scripts, my flux models just live under stability m...

Furkan Gözükara SECourses•9/27/24, 9:51 PM

well thjis message

Furkan Gözükara SECourses•9/27/24, 9:51 PM

loading inaccurate

Furkan Gözükara SECourses•9/27/24, 9:51 PM

Andrew•9/27/24, 9:52 PM

I know, that's the strange part. I mean it's definitely the issue, but the toml file shows the ae being set to the one I'm specifying, not that path. So it's confusing why it's suddenly switching it at runtime

Andrew•9/27/24, 9:55 PM

It's similar to this issue: https://github.com/kohya-ss/sd-scripts/issues/1535
You can see in his screenshot that the VAE is listed as the full checkpoint

GitHub

VAE error with FLUX finetuning · Issue #1535 · kohya-ss/sd-scripts

Getting this error when I try to start a finetune training Happens when I try with the Full Flux Dev as well, what am I doing wrong? Am I using the wrong base model somehow? 2024-08-30 12:28:38 INF...

Furkan Gözükara SECourses•9/27/24, 9:56 PM

if you upgrade gold membership i can connect and check out if you need

Andrew•9/27/24, 10:06 PM

Just going to do a complete reinstall into a different directory...it's such an odd isolated issue, so I have to think a reinstall will do the trick

Mmacba I thought I was using your settings, but maybe I increased the repeats in additi...

CNOC•9/28/24, 2:05 AM

The dataset preparation section has 40 repeats in there by default when I load the settings in, it's mentioned in the youtube tutorial to change it but not in the example setup jpg. It is easy to miss so I assume that could be what you did. I have missed it a bunch of times trying to rush through and have been making sure to click this and review prior to starting training now

CCNOC The dataset preparation section has 40 repeats in there by default when I load t...

Furkan Gözükara SECourses•9/28/24, 2:08 AM

use 1

Furkan Gözükara SECourses•9/28/24, 2:08 AM

repeat

Furkan Gözükara SECourses•9/28/24, 2:08 AM

for flux

CCNOC The dataset preparation section has 40 repeats in there by default when I load t...

macbaOP•9/28/24, 5:40 AM

I just realized that, you’re right, thanks!

FFurkan Gözükara SECourses put models into diffusion_models folder

Latentnaut•9/29/24, 2:33 PM

is there a way of set the diffusion_models folder to another location? in the section "paths: settings related to file path" there is not option to that

LLatentnaut is there a way of set the diffusion_models folder to another location? in the se...

Furkan Gözükara SECourses•9/29/24, 7:04 PM

this was asked

Furkan Gözükara SECourses•9/29/24, 7:04 PM

u-net still works too

Furkan Gözükara SECourses•9/29/24, 7:05 PM

but can you ask again here : https://discord.gg/ZAd8fnqY

happy_in_happy•9/30/24, 2:55 PM

Good afternoon! There was a question about Kohya ss. It first installs and then deletes torchvision.

happy_in_happy•9/30/24, 2:55 PM

02:42:25-947966 INFO Kohya_ss GUI version: v24.2.0

02:42:26-515966 INFO Submodule initialized and updated.
02:42:26-517966 INFO nVidia toolkit detected
02:42:29-163644 INFO Torch 2.4.1+cu124
02:42:29-182644 WARNING Torch reports GPU not available
02:42:29-185644 INFO Python version is 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit
(AMD64)]
02:42:29-186644 INFO Verifying modules installation status from requirements_pytorch_windows.txt...
02:42:29-188644 WARNING Package wrong version: torchvision 0.20.0.dev20240929+cu124 required 0.19.1+cu124
02:42:29-189644 INFO Installing package: torchvision==0.19.1+cu124 --index-url
https://download.pytorch.org/whl/cu124
02:42:32-482224 INFO Installing package: xformers==0.0.28.post1 --index-url https://download.pytorch.org/whl/cu124
02:42:38-043874 INFO Verifying modules installation status from requirements_windows.txt...
02:42:38-046874 INFO Installing package: tensorflow>=2.16.1
02:43:08-250115 INFO Verifying modules installation status from requirements.txt...
02:43:08-252115 INFO Installing package: altair==4.2.2
02:43:10-972027 INFO Installing package: gradio==4.43.0
02:43:14-299235 INFO Installing package: lycoris_lora==2.2.0.post3
02:43:15-852875 INFO Installing package: open-clip-torch==2.20.0
02:43:19-852215 INFO Installing package: pytorch-lightning==1.9.0
02:43:23-240331 INFO Installing package: timm==0.6.12
02:43:36-565241 INFO headless: False
02:43:36-630241 INFO Using shell=True when running external commands...
Running on local URL: http://127.0.0.1:7860

happy_in_happy•9/30/24, 2:56 PM

Why is this happening? Can I fix it?

Well ,maybe that's where I went wrong, I did use repeats

Similar Threads