Runpod•17mo ago

something went wrong *X when creating serverless vllm

see screenshot for more context, this happened when i click the deploy in vllm-worker setup in runpod quick deploy

yhlong00000•8/16/24, 6:49 PM

any extra information to help me to replicate this issue?

JasonOP•8/16/24, 6:52 PM

I don't remember, maybe runpod should just have user request logged, or if some front-end error occurred they should log it rather than asking for reproducible inputs or steps

JasonOP•8/16/24, 6:52 PM

Use some thing like sentry

JasonOP•8/16/24, 6:52 PM

Sentry.io or smth

yhlong00000•8/16/24, 6:54 PM

we have user session data, but there are tons of them

, need a bit more info to narrow

JasonOP•8/17/24, 5:10 AM

Well from that timestamp it happened at my time WIB 2:49

JasonOP•8/17/24, 5:11 AM

i was creating on serverless, vllm quick deploy

JasonOP•8/17/24, 5:12 AM

and used a token from hf, model is neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

JasonOP•8/17/24, 5:13 AM

that should narrow down my account's information by alot.. please ask if you know what informations should i provide

yhlong00000•8/17/24, 2:23 PM

Thanks for the info, this is help, btw, would you mind to dm me your email?

JasonOP•8/17/24, 2:31 PM

Yeah sure

something went wrong *X when creating serverless vllm

Similar Threads

Similar Threads

Similar Threads