I get these logs: ``` POST https://***.pages.dev/api/chat - Ok @ 3/24/2024, 9:34:08 PM (error) Err
I get these logs:
MTo bind Workers AI to your worker, add the following to the end of your wrangler.toml file:
[ai]
binding = "AI" #available in your worker via env.AI
source: https://blog.cloudflare.com/workers-ai/
[ai]
binding = "AI" #available in your worker via env.AI
source: https://blog.cloudflare.com/workers-ai/
The Cloudflare Blog
We are excited to launch Workers AI - an AI inference as a service platform, empowering developers to run AI models with just a few lines of code, all powered by our global network of GPUs
Ryep, the extra step required need to have it bound in your toml file
MHi there, i'm trying to follow this tutorial https://developers.cloudflare.com/workers-ai/tutorials/build-a-retrieval-augmented-generation-ai/
When I enter the command "npx wrangler vectorize create vector-index --dimensions=768 --metric=cosine"
into my terminal, I get: vectorize.not_entitled [code: 1005]
Is this because I'm using a free account and Vectorize is not provisioned?
When I enter the command "npx wrangler vectorize create vector-index --dimensions=768 --metric=cosine"
into my terminal, I get: vectorize.not_entitled [code: 1005]
Is this because I'm using a free account and Vectorize is not provisioned?
Cloudflare Docs
This guide will instruct you through setting up and deploying your first application with Cloudflare AI. You will build a fully-featured AI-powered …
Fit is there in the wrangler.toml file, if the clone worked correctly 
ZUnable to run even the simplest code on wrangler dev local (eg https://developers.cloudflare.com/workers-ai/configuration/workers-ai-sdk/). Getting
AI workers were working fine earlier, and starting giving an error now. Hence testing with boiler plate code.
[wrangler:err] InferenceUpstreamError: {"errors":[{"message":"Server Error","code":1000}],"success":false,"result":{},"messages":[]}
AI workers were working fine earlier, and starting giving an error now. Hence testing with boiler plate code.
RSome feedback regarding
The models seem to produce an output with a noticeable shift in color balance. Repeated inpainting will quickly shift the image towards purple. See the attached images below. The first image is the result of doing 10 passes (i.e. using the result as source) of inpainting with an empty (black) mask. The second is the same process but with an added "hack" (i.e. more of a band-aid than a solution) that does histogram matching after each pass. The third image is a typical result from a single pass of inpainting merged with unmasked pixels from the source. (Shown with mask overlayed on source.)
This seems to be a well-known problem that (possibly) can be traced back to the VAE, and (possibly) be solved by using an updated version of the VAE. Whether that's the case here is another question.
@cf/runwayml/stable-diffusion-v1-5-inpainting (and @cf/runwayml/stable-diffusion-v1-5-img2imgThe models seem to produce an output with a noticeable shift in color balance. Repeated inpainting will quickly shift the image towards purple. See the attached images below. The first image is the result of doing 10 passes (i.e. using the result as source) of inpainting with an empty (black) mask. The second is the same process but with an added "hack" (i.e. more of a band-aid than a solution) that does histogram matching after each pass. The third image is a typical result from a single pass of inpainting merged with unmasked pixels from the source. (Shown with mask overlayed on source.)
This seems to be a well-known problem that (possibly) can be traced back to the VAE, and (possibly) be solved by using an updated version of the VAE. Whether that's the case here is another question.
R(The black to the left is simply because the "safety checker" believes the image is harmful content without it.)
RI believe it's a problem with the model, so maybe it belongs to the catch all "cloudflare-ai". The result should be the same if using the API. Although using workers ai + client side javascript will involve more head-scratching and second-guessing your code. I found this https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/410 which seems to match my own testing.
I found this https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/410 which seems to match my own testing.
PHey, is there any way we can use
mistral-7b-instruct-v0.2 via the workers rest api ?PAlso I'm sometimes getting the same output for slightly different promps. Is this some sort of caching that i can maybe disable ?
Rare you using the ai gateway ?
DIm using model
@hf/thebloke/deepseek-coder-6.7b-instruct-awq It appears there is a character limit on the response (around 800 chars). Is this a known limit? any way to get the full response?PAccording to their API Docs you can set the
max_tokens property in the request. But don't see it mentioned anywhere else, so it might not work...Interact with Cloudflare's products and services via the Cloudflare API
YHey guys, I would like to integrate an AI interface into worker-rs. Does anyone know where I can find the source code for @cloudflare/ai?
R
Introducing Stable Code Instruct 3B, our new instruction tuned LLM based on Stable Code 3B. With natural language prompting, this model can handle a variety of tasks such as code generation, math and other software engineering related outputs.
This model’s performance rivals…
This model’s performance rivals…
3/25/24, 7:31 PM
Jnpm
Cloudflare's Workers AI SDK. Latest version: 1.1.0, last published: 19 days ago. Start using @cloudflare/ai in your project by running
npm i @cloudflare/ai. There are 3 other projects in the npm registry using @cloudflare/ai.Jor install locally etc
YIs it not ready for open source yet, or is there no plan to open source it?
JI believe the goal is to make AI a more native binding in workers and remove the need for the package entirely
YThx, I'm really looking forward to it.
Ryah more for calling inside of workers
NI'm calling Workers AI in a nextjs project, the project used the edge runtime in every page, because I want to deploy it on Cloudflare Pages. But the Workers AI calling continuously occur the error '⨯ Error: A Node.js API is used (DecompressionStream) which is not supported in the Edge Runtime.'. Has anyone had the same problem?
N
NI am using
@cloudflare/next-on-pages to adapte between nextjs and @cloudflare/ai , so maybe it's because there is no nodejs_compat
MWhat version and what parameters are used on Whisper? I'm testing asr and trying different encoders, sample rates and bitrates recording on Android. When I'm using Cloudflare Workers Whisper model it looks like very dumb. I tried Replicate hosted whisper and I got perfect transcription of my audio.
MHi - not sure if I should post here or in cloudflare-ai. I'm trying the @cf/runwayml/stable-diffusion-v1-5-inpainting model, and it's automatically resizing my images to 512x512. I need to be able to control the size. I don't see any parameters for the size... where can we vote for such features?
Lhi guys i can not deploy my worker ai application it keeps showing binding AI of type ai failed to generate: internal error; please try again later or contact
support [code: 10021]. I can still deploy my worker yesterday but this morning, this error occurs. Can any one help me. Thanks a lot
support [code: 10021]. I can still deploy my worker yesterday but this morning, this error occurs. Can any one help me. Thanks a lot
Loh thanks so i should sit down drink a coffee and wait :))))
Lanyway i just have another problem :< yesterday when i testing the worker ai inference i got this error. InferenceUpstreamError: ERROR 3001: Unknown internal error. for some models that need to read buffer from file for example. @cf/openai/whisper or some other images classification and image to text model (eg: @cf/microsoft/resnet-50, @cf/unum/uform-gen2-qwen-500m). The weirdo thing is that when i run wrangler dev in my local machine it just works fine but when i deploy my worker the error showed up. Any one have same problem like me and how can i fix it ?
LThank a lot sir
LOk i can deploy my worker ai now :v
UIs there a way to limit the tokens output like how you can in openAI?
Uif not, this would imo be a very important thing to have because uh, https://user.you-sk.id/IPzlj5FWbl54
Uthis happens way too frequently...
U3000 tokens from just one AI message because it randomly bugged out isnt exactly the greatest thing
II'm going to take a wild guess and say this is qwen.
II've had similar issues with Qwen running locally (i.e. not just Workers AI).
IEven if you prompt in English and tell it to reply in English it seems to randomly switch to Chinese and back. I eventually just gave up and switched models.
INot sure if the repetition is related but that's likely why it randomly replies in Chinese after the actual response.
