Software Engineering Courses (SECourses)•2y ago

oh no, error with Kosmos

error.txt4.04KB

rafrafOP•3/1/24, 1:21 AM

Ran one image ok, but batch crashed

rafrafOP•3/1/24, 1:22 AM

batch did do some 20 captions though

rafrafOP•3/1/24, 1:29 AM

batch works fine on my Windows. Same speed. but consistently and without crashing. Runpod Kosmos just errors out again and again, even after restarting the pod. 20 captions then crash consistently...

rafrafOP•3/1/24, 1:30 AM

sorry about the avalanche today, but is there a way to limit the number of tokens in the kosmos caption, to avoid overfeeding Supir prompt?

Rrafraf oh no, error with Kosmos

Furkan Gözükara SECourses•3/1/24, 1:31 AM

couldnt read your image

Furkan Gözükara SECourses•3/1/24, 1:31 AM

probably not uploaded accuratley

Furkan Gözükara SECourses•3/1/24, 1:31 AM

OSError: image file is truncated (20 bytes not processed)

rafrafOP•3/1/24, 1:31 AM

yea true

rafrafOP•3/1/24, 1:31 AM

ok, i can see that

rafrafOP•3/1/24, 1:32 AM

what about limiting tokens?

rafrafOP•3/1/24, 1:32 AM

The image features a close-up of a woman with short brown hair and blue eyes, wearing a white blouse and posing for a fashion shoot. She is wearing red lipstick and has her hair in a messy bun. The background is grey, and the woman appears to be in a studio setting.

The image features a close-up of a woman with short brown hair and blue eyes, wearing a white blouse and posing for a fashion shoot. She is wearing red lipstick and has her hair in a messy bun. The background is grey, and the woman appears to be in a studio setting.

rafrafOP•3/1/24, 1:32 AM

probably too long for Supir

Furkan Gözükara SECourses•3/1/24, 1:32 AM

i think limited to 77 tokens

rafrafOP•3/1/24, 1:34 AM

ok, that's it for tonight. got to get to the gym tomorrow too

Dazzastrous [4090]•3/1/24, 1:37 AM

[Tiled VAE]: Executing Encoder Task Queue: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5733/5733 [00:19<00:00, 287.36it/s]
[Tiled VAE]: Done in 20.535s, max VRAM alloc 10024.335 MB

says its done but not got any output just the orange shapes

Rrafraf `The image features a close-up of a woman with short brown hair and blue eyes, w...

leem0nchu•3/1/24, 1:38 AM

A tip that I don’t know if it will apply in your case. But I do most of my captions with Kosmos. I found that if you give a brief description (I do it for batches) eg; “This is an image of a [giant]. Describe the image in detail….

It will eliminate things like The image features, depicts, In the image, etc, etc.

DDazzastrous [4090][Tiled VAE]: Executing Encoder Task Queue: 100%|████████████████████████████████...

Furkan Gözükara SECourses•3/1/24, 1:39 AM

weird

Furkan Gözükara SECourses•3/1/24, 1:39 AM

check outputs folder

Furkan Gözükara SECourses•3/1/24, 1:39 AM

if saved

Lleem0nchu A tip that I don’t know if it will apply in your case. But I do most of my capti...

Furkan Gözükara SECourses•3/1/24, 1:39 AM

nice tips

FFurkan Gözükara SECourses if saved

Dazzastrous [4090]•3/1/24, 1:40 AM

Its popped up at last

Lleem0nchu A tip that I don’t know if it will apply in your case. But I do most of my capti...

rafrafOP•3/1/24, 1:42 AM

but does it matter that much? Did you see a difference when you dont have "The image features"?

Dazzastrous [4090]•3/1/24, 1:42 AM

didnt save into the outputs folder though

Rrafraf but does it matter that much? Did you see a difference when you dont have "The i...

leem0nchu•3/1/24, 1:43 AM

For training it does as captioning is so important as image quality.

DDazzastrous [4090]didnt save into the outputs folder though

Furkan Gözükara SECourses•3/1/24, 1:44 AM

it should save

Furkan Gözükara SECourses•3/1/24, 1:44 AM

did you define any other outputs?

Dazzastrous [4090]•3/1/24, 1:44 AM

nope

Lleem0nchu For training it does as captioning is so important as image quality.

rafrafOP•3/1/24, 1:44 AM

it's for supir upscaling prompt

Furkan Gözükara SECourses•3/1/24, 1:44 AM

check outputs again

Dazzastrous [4090]•3/1/24, 1:44 AM

lol delayed its now there

leem0nchu•3/1/24, 1:44 AM

Ah well I that case I couldn’t tell I haven’t used it for that purpose.

Dazzastrous [4090]•3/1/24, 1:47 AM

nice

Dazzastrous [4090]•3/1/24, 1:48 AM

heheh its his arm!!!

Dazzastrous [4090]•3/1/24, 1:55 AM

Dr have you got the link to the image slider?

Furkan Gözükara SECourses•3/1/24, 2:16 AM

the links are on the patreon post

VAMP•3/1/24, 2:16 AM

@DoctorCoach you need to check out EMO. . It's the heygen alternative that we have been looking for ..see the demo videos..it's crazy..it captures all the expressions , micro expressions, mouth,lip movement, eye movement....
https://youtu.be/4znFrPcnRnY

YouTubeMark Liberman

AlibabaSong1

From Linrui Tian, Qi Wang, Bang Zhang, & Liefeng Bo, "EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions", https://humanaigc.github.io/emote-portrait-alive/.