like what exactly? nothing is too complicated and it's better to know what actually happening
like what exactly? nothing is too complicated and it's better to know what actually happening
DI like how there's an LLM class
Swe used to be friends
Dthis will probably be the postmark situation v2 in the end
Drelated question, if you don't actually "need" to stream your response back to the client, is there any real benefit to doing streaming instead of awaiting for the full response? (My guess is it's better to not stream if you don't need to, since that would cause more CPU usage on the Worker.)
Syeah probably better to not stream if you don't need it but with OpenAI we have seen weird issues and actually stream everything even if we just buffer in the worker
DYou’ve seen weird issues if you stream, or if you don’t stream?
Sdon't stream but it's possible it was happening with streaming too because by the time I added logging and pushed it the behavior went away but I was thinking there was some sort of network timeout happening between CF and Workers without streaming. it was strange
Salso there's a major outage right now with OpenAI
DPerfect timing, I was just heading to bed. 
Sit might have gotten me out of bed
BI can't open devtools when running "wrangler dev", any ideas?
HTry
http://internal/hash
Ddid you set up https://status.openai.com/ in your Slack? I did that a few days ago, it's really handy.
Welcome to OpenAI's home for real-time and historical data on system performance.
D
Sin our Discord yeah
SSlack 
Dsorry, I'm making this a bit too #off-topic lol
DDoes anyone have a public "ping" utility that uses a Worker to check the latency to a hostname?
DIs there a aws4fetch equivalent but for Google GCP?
KWhat's wrong with using it in GCP 
KIt's for anything that has the
fetch
DI want free authentication checks before getting billed for a request to my container(s).
Dhttps://github.com/aimoda/cloudflare-worker-to-aws-lambda-function-url-example <- I want this but with Google Cloud Run
KI still don't follow 
KThat just uses values from env. so what would stop you from doing that with a GCS Service Account & https://cloud.google.com/run/docs/authenticating/service-to-service
Doh https://cloud.google.com/run/docs/authenticating/service-to-service#acquire-token might be exactly what I wanted, thank you!
D
.Hey, I'm kinda new to workers. Why in the logs does it show that my post request was cancelled?
D@kian thanks a ton, got it working!
Dhmm, does Azure OpenAI have the same outages as OpenAI? I wonder if using both would fix a lot of issues.
Dyep, it would fix downtime issues. Azure OpenAI is hosted separately by Microsoft, see https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy
The Azure OpenAI Service is fully controlled by Microsoft; Microsoft hosts the OpenAI models in Microsoft’s Azure environment and the Service does NOT interact with any services operated by OpenAI (e.g. ChatGPT, or the OpenAI API).
Syeah would fix it and so would dedicated instance
R
Show is this a "masked link"? just looks like some Markdown conversion fail
Rthats the official name for markdown link with name iirc
Sno
Rbut the
[access controls](<link>)if it was just
https://you're just making up terms don't put this on me
Rohh ok, sorry thats what discord calls it
Swhat's Discord?
Ryeah its just link for markdown things online
Rummm