KK
R
@hf/thebloke won't generate a response if max_tokens is set to 597 or higher. (Fails with "3025: Unknown internal error".)
DD
UrunWithTools syntax change?UrunWithTools I get Error in runWithTools: Error in runAndProcessToolCall: Bad input: must have required property 'prompt', must have required property 'name', must have required property 'description', must have required property 'parameters', must have required property 'type', must have required property 'properties', must match exactly one schema in oneOf, must match exactly one schema in oneOf,U
E
! Please tell me if it is possible to understand how many Neurons were used in each request to the model?UUU
UU
@cf/qwen/qwen1.5-14b-chat-awqUU
Error in runWithTools: Error in runAndProcessToolCall: , making me think that maybe the "Bad input" part was a response from the apiUU
K
OR
parameters: {} I got past the error by changing it to parameters: { type: "object", properties: {} }.UUU
A
HH
R
K
K
C
B
raw parameterUUR
W
A
InferenceUpstreamError: undefined: undefined fixed? I'm getting the same error using @cf/microsoft/resnet-50 with a PNG and this code https://gist.github.com/net-tech/0eb5e0caa05c6be931ab373cbb35f360
I
Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc and how it's been trained.
AAA
MT
@hf/theblokerunWithToolsrunWithToolsError in runWithTools: Error in runAndProcessToolCall: Bad input: must have required property 'prompt', must have required property 'name', must have required property 'description', must have required property 'parameters', must have required property 'type', must have required property 'properties', must match exactly one schema in oneOf, must match exactly one schema in oneOf,@cf/qwen/qwen1.5-14b-chat-awqError in runWithTools: Error in runAndProcessToolCall: parameters: {}parameters: { type: "object", properties: {} }rawInferenceUpstreamError: undefined: undefined@cf/microsoft/resnet-50Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-incexport async function onRequest(context) {
const input = { prompt: "What is the origin of the phrase Hello, World" }
const answer = await context.env.AI.run('@cf/meta/llama-3.1-8b-instruct', input);
return Response.json(answer);
}A ReadableStream branch was created but never consumed. Such branches can be created, for instance, by calling the tee() method on a ReadableStream, or by calling the clone() method on a Request or Response object. If a branch is created but never consumed, it can force the runtime to buffer the entire body of the stream in memory, which may cause the Worker to exceed its memory limit and be terminated. To avoid this, ensure that all branches created are consumed.