Requesting help with my community help request: "Request AI Streaming Binding Access". Can't post t
Requesting help with my community help request: "Request AI Streaming Binding Access". Can't post the link :(.
Issue is that this toy request (as well as my real ones) fail to return stream body:
export default {
async fetch(req, env) {
const model = “@cf/meta/llama-2-7b-chat-int8”;
const response = await env.DOCTALK_AI.run(model, {
prompt: “What is a tomato?”,
stream: true,
});
console.log(“response:”, response);
return new Response(response.body ? “
Stream OK” : “
No stream body”, {
status: 200,
});
},
};
No stream body
“[Worker] AI error: Error: No stream body returned”
any assistance greatly appreciated!!!
Issue is that this toy request (as well as my real ones) fail to return stream body:
export default {
async fetch(req, env) {
const model = “@cf/meta/llama-2-7b-chat-int8”;
const response = await env.DOCTALK_AI.run(model, {
prompt: “What is a tomato?”,
stream: true,
});
console.log(“response:”, response);
return new Response(response.body ? “
Stream OK” : “ No stream body”, {status: 200,
});
},
};
No stream body“[Worker] AI error: Error: No stream body returned”
any assistance greatly appreciated!!!
