Issue in pod
i'm facing issue from last 2 days, sometime RTX 4090 generates 60 token/second and sometime it 30-20 token/second to generate same response.
don't know what is behind this ????
don't know what is behind this ????
Join the Discord to continue the conversation
RWe're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!
21,906 Members
Join
RRunpod / ⚡｜serverlessRRunpod / ⚡｜serverlessRRunpod / ⚡｜serverlessRRunpod / ⚡｜serverless