© 2026 Hedgehog Software, LLC

TwitterGitHubDiscord
More
CommunitiesDocsAboutTermsPrivacy
Search
Star
Setup for Free
Cloudflare DevelopersCD
Cloudflare Developers•2y ago
eyetech

Workers AI: getting internal server error

When doing the following call
const res = await ai.run('@cf/mistral/mistral-7b-instruct-v0.1', { messages, max_tokens: 1000 });
    return c.json({ res })
const res = await ai.run('@cf/mistral/mistral-7b-instruct-v0.1', { messages, max_tokens: 1000 });
    return c.json({ res })
I'm getting InferenceUpstreamError, httpCode: 504. Any ideas, if i run with the default tokens size (not specifying max_tokens) it seems to work. Btw, running this locally.
Cloudflare Developers banner
Cloudflare DevelopersJoin
Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news
85,042Members
Resources

Similar Threads

Was this page helpful?
Recent Announcements

Similar Threads

Getting Internal Server Error from Workers AI
Cloudflare DevelopersCDCloudflare Developers / workers-and-pages-help
2y ago
workers.api.error.internal_server
Cloudflare DevelopersCDCloudflare Developers / workers-and-pages-help
2y ago
Workers AI Error
Cloudflare DevelopersCDCloudflare Developers / workers-and-pages-help
3y ago
"InferenceUpstreamError: ERROR 3026: Unknown internal error" when calling Workers AI
Cloudflare DevelopersCDCloudflare Developers / workers-and-pages-help
3y ago