Software Engineering Courses (SECourses)•3y ago

Hey there, can someone help with my TensorRT exporter please? I want to use it for my SDXL Dreamboot

Hey there, can someone help with my TensorRT exporter please? I want to use it for my SDXL Dreambooth model, but I just can't generate an engine for it, it fails with the following error:

ERROR:root:Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

ERROR:root:Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

ERROR:root:Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

ERROR:root:Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat1 in method wrapper_CUDA_addmm)

I've searched around and people are saying that I should be on the 'dev' branch, which I am. Also I tried removing the --medvram
I installed a fresh installation of the A1111 with the .bat file from the Patreon, the same with TensorRT.
I'm using a 3060Ti 8GB VRAM

DDetesden Hey there, can someone help with my TensorRT exporter please? I want to use it f...

Furkan Gözükara SECourses•12/16/23, 11:01 PM

do this

Furkan Gözükara SECourses•12/16/23, 11:01 PM

update to the latest version automatic1111

Furkan Gözükara SECourses•12/16/23, 11:01 PM

remove --medvram and --lowvram

Furkan Gözükara SECourses•12/16/23, 11:02 PM

increase your virtual RAM if you dont have sufficient RAM

DetesdenOP•12/16/23, 11:03 PM

I think when I removed --medvram it was the same error and not anything about RAM. Let me check again

DDetesden I think when I removed --medvram it was the same error and not anything about RA...

Furkan Gözükara SECourses•12/16/23, 11:08 PM

those optimizations make it load

Furkan Gözükara SECourses•12/16/23, 11:08 PM

some part gpu

Furkan Gözükara SECourses•12/16/23, 11:08 PM

some part cpu

Furkan Gözükara SECourses•12/16/23, 11:08 PM

also use latest release

Furkan Gözükara SECourses•12/16/23, 11:08 PM

1.7

Furkan Gözükara SECourses•12/16/23, 11:08 PM

i would try a fresh install

DetesdenOP•12/16/23, 11:14 PM

Wait, I think it's actually doing something. It was the same install that I tried earlier, but now removing the --medvram does some progress. I just want to bash my head against a wall

DetesdenOP•12/16/23, 11:42 PM

@Furkan Gözükara SECourses So I was able to generate the TensorRT engine now. But I guess I can't use it because it was generated without --medvram, and now switching back to --medvram and using the engine is just 100 times slower

DDetesden <@205854764540362752> So I was able to generate the TensorRT engine now. But I ...

Furkan Gözükara SECourses•12/17/23, 12:10 AM

ye your vRAM low

Furkan Gözükara SECourses•12/17/23, 12:10 AM

but you can use SD 1.5 models

strakovic•12/19/23, 7:36 AM

how does it look like with pixart dreambooth training? any news?

Sstrakovic how does it look like with pixart dreambooth training? any news?

Furkan Gözükara SECourses•12/19/23, 10:48 AM

still didnt have chance to try yet

FFurkan Gözükara SECourses still didnt have chance to try yet

strakovic•12/19/23, 10:53 AM

thanks, looking forward to it

Mudassar Ahmed•12/19/23, 2:03 PM

im looking for kaggle notebook for kokhya anyone can help me?

MMudassar Ahmed im looking for kaggle notebook for kokhya anyone can help me?

Furkan Gözükara SECourses•12/19/23, 2:08 PM

yes it is available on our patreon

Furkan Gözükara SECourses•12/19/23, 2:08 PM

our kaggle notebooks here : https://www.patreon.com/collection/258108

David•12/19/23, 5:20 PM

Anybody here has a good tech for lips synch? I use wave 2 lips and it s really bad most of the time and really blured.

DDavid Anybody here has a good tech for lips synch? I use wave 2 lips and it s really b...

Furkan Gözükara SECourses•12/19/23, 5:21 PM

i think there arent public tech yet

Furkan Gözükara SECourses•12/19/23, 5:21 PM

better

FFurkan Gözükara SECourses i think there arent public tech yet

David•12/19/23, 5:23 PM

Ah ok, i ve been trying them all, but i was desperatly lookunh for the kind of ones used for heygen for instance.

DDavid Ah ok, i ve been trying them all, but i was desperatly lookunh for the kind of o...

Furkan Gözükara SECourses•12/19/23, 5:27 PM

probably they are hidden or paid

David•12/19/23, 5:31 PM

Yeah! I guess

Latest iPhone•12/20/23, 11:38 PM

what you guys think of my new lawyer logo? i stole it from Better Call Saul, can't help but feel like something is missing though.

what would you guys have done instead? or to improve it

Latest iPhone•12/20/23, 11:38 PM

world's first AI attorney hopefully

LLatest iPhone what you guys think of my new lawyer logo? i stole it from Better Call Saul, can...

Furkan Gözükara SECourses•12/21/23, 12:11 AM

nice

Furkan Gözükara SECourses•12/21/23, 12:11 AM

are you a lawyer?

xlads•12/22/23, 5:02 AM

@Furkan Gözükara SECourses What do you think about Air.ai? will open ai be distroying it like it did with Jasper.ai?

Xxlads <@205854764540362752> What do you think about Air.ai? will open ai be distroying...

Lirezh (cmp-nct)•12/22/23, 5:45 AM

Lirezh (cmp-nct)•12/22/23, 5:46 AM

They might end up taking themselves out

I listened to their demo and imagined I was the customer, if I found out I was "joking" with an AI and chatting about Musk and fights .. guess my mood about Apple ?

xlads•12/22/23, 5:47 AM

But the screenshot you sent is more of a text conversational, AI

xlads•12/22/23, 5:48 AM

Air ai is a “voice”

Lirezh (cmp-nct)•12/22/23, 5:48 AM

That voice has a normal language model behind it

Lirezh (cmp-nct)•12/22/23, 5:50 AM

But the demo is well done, it even included tts errors. so it's probably quite honest in capabilities.
However it was a perfect use case example, normal people are hard to predict.
In any case it's more for illegal spam callcenters than for businesses.

If it doesn't tell me right away that it is an AI I will be super pissed once I find out.
If it tells me it is an AI I'll hang up

xlads•12/22/23, 5:55 AM

I’ve been trying to automate a call center

Lirezh (cmp-nct)•12/22/23, 5:57 AM

It's the future of callcenters - just that we might not need people or centers anymore at one point.
Right now - everyone will absolutely hate AI calls. In EU it's illegal to use AI to "influence" people so they will probably just ban calls (and ban anything else with AI sooner or later).
In maybe 5 years you might actually want AI, especially for support. Because it's smarter and without waiting time until you need a transfer to a human supervisor.
In maybe 15-20 years you'll not find a human anywhere in that chain

Lirezh (cmp-nct)•12/22/23, 6:00 AM

I'm heading to bed, gnight

LLirezh (cmp-nct)It's the future of callcenters - just that we might not need people or centers a...

xlads•12/22/23, 3:02 PM

Sucks, but I agree ai has a huge side eye from a lot of call center kind of businesses. However, I don't think we'll see call center employees reciting the same script over and over again in the next two years.

LLirezh (cmp-nct)That voice has a normal language model behind it

xlads•12/22/23, 4:33 PM

So overall conversational AI for scheduling appointments isn’t really good yet, you think?

LLirezh (cmp-nct)Click to see attachment

xlads•12/22/23, 4:37 PM

This is very dangerous lol!!!

Xxlads So overall conversational AI for scheduling appointments isn’t really good yet, ...

Lirezh (cmp-nct)•12/22/23, 5:37 PM

Oh I think it definitely is good enough but most people will have problems implementing something that does the job sufficiently. It won't work out of the box.
The image I posted is just a good example what happens if you put someone incompetent behind it.
Models, finetunes and commercial APIs are all improving at a pace that is almost unseen in human technological progress, so it will get easier

Xxlads <@205854764540362752> What do you think about Air.ai? will open ai be distroying...

Furkan Gözükara SECourses•12/23/23, 1:23 AM

it will cause some unemployment certainly

Furkan Gözükara SECourses•12/23/23, 1:23 AM

by the way

Furkan Gözükara SECourses•12/23/23, 1:23 AM

if i i understand ai talking i dont talk anymore

FFurkan Gözükara SECourses if i i understand ai talking i dont talk anymore

xlads•12/23/23, 3:15 AM

What do you mean?

abdullah_hamza•12/23/23, 9:40 PM

Hey there, can someone help with my TensorRT exporter please? I want to use it for my SDXL Dreamboot

Similar Threads

Similar Threads

Similar Threads