so I can't cache the return value of the OpenAI constructor between invocations?

L

localλorseOP•11/26/23, 10:16 AM

(in a global var or otherwise)

Llocalλorse so I can't cache the return value of the OpenAI constructor between invocations?

H

Hello, I’m Allie!•11/26/23, 10:17 AM

You could, but you can’t actually construct it until you have received a request

L

localλorseOP•11/26/23, 10:18 AM

ok, so what would you recommend for doing that? some kind of nullable memoization type

Llocalλorse ok, so what would you recommend for doing that? some kind of nullable memoizatio...

H

Hello, I’m Allie!•11/26/23, 10:19 AM

Just have a variable that can be an OpenAI API client, but by default is null. Then, whenever you need it, use the variable if present, otherwise initialize it first

HHello, I’m Allie!Just have a variable that *can* be an OpenAI API client, but by default is null....

L

localλorseOP•11/26/23, 10:19 AM

ah ok, thanks :)

�

🎄pog troll🔔🎄•11/26/23, 2:20 PM

@Helpflare cloudflare keeps on saying failure

F

fengyangsi•11/26/23, 4:02 PM

hi, I code a worker and it can solve POST request but I get 403

F

fengyangsi•11/26/23, 4:03 PM

Why the respond is 403?

F

fengyangsi•11/26/23, 4:04 PM

rn_image_picker_lib_temp_4a397703-060a-4134-8bf6-1c00910026de.jpg

F

fengyangsi•11/26/23, 4:05 PM

And 421

F

fengyangsi•11/26/23, 4:05 PM

But my program haven't return 403 or 421

Ffengyangsi hi, I code a worker and it can solve POST request but I get 403

I

Isaac McFadyen•11/26/23, 5:06 PM

Those kind of error pages usually appear if your browser is making a request that isn't valid according to the HTTP specification.

I

Isaac McFadyen•11/26/23, 5:06 PM

For example, if you send a body in a GET request then you might get that. Or if you send a header name that isn't valid. Or any number of other things really.

I

Isaac McFadyen•11/26/23, 5:06 PM

Take a look and make sure that the POST request you're making is valid and looks fine syntactically

S

scotto•11/26/23, 6:07 PM

There is any good project example for workers and D1 to start from ? Like with multiples APIs / files

D

dave•11/26/23, 7:47 PM

Question, for those of you who have had their Workers DDoS'd, how was the experience? Does CF do a decent job of blocking requests before they hit the Workers?

D

dave•11/26/23, 7:51 PM

nice. I was debating if I should use Google Cloud Run without Workers, but I think it makes sense to always use Workers in front.

D

dave•11/26/23, 7:51 PM

it does increased the cost from $0.20/million requests to $0.50/million requests when stacking a Worker on top, but the benefit of DDoS protection makes it nice.

Original message was deleted

Z

zegevlier•11/26/23, 8:04 PM

You can even block by header value on, so if they did have a valid authentication token somehow they would still get blocked.

M

meow•11/26/23, 9:29 PM

Is middleware only available for Cloudflare Pages and not Workers?

J

James•11/26/23, 9:41 PM

Middleware is a thing for Functions since they have file-based routing, and the concept of Middleware makes a lot of sense there for handling auth, etc.

J

James•11/26/23, 9:41 PM

Many popular routers and frameworks for Workers also support Middleware though, such as https://hono.dev/

F

Fun Miles•11/27/23, 12:12 AM

My cron worker job got killed for exceeding time (32,000 ms). Is there a way to increase that number?

F

Fun Miles•11/27/23, 12:15 AM

The docs, under CPU time say

When the schedule interval is more than 1 hour, a scheduled Worker may run for up to 15 minutes.

When the schedule interval is more than 1 hour, a scheduled Worker may run for up to 15 minutes.

. My job runs once per month.

S

Shane•11/27/23, 12:43 AM

wrangler 3.17.1
-------------------
⎔ Starting local server...
✘ [ERROR] service core:user:search: Uncaught TypeError: Incorrect type for map entry 'DEFAULT_PAGE_SIZE': the provided value is not of type 'function or ExportedHandler'.

Is there a way to get a more detailed error here? I removed default_page_size from my code entirely and I'm still getting the error for some reason

S

Shane•11/27/23, 12:47 AM

odd, no error when I turn off local mode

S

Shane•11/27/23, 12:52 AM

tried deleting node modules and .wrangler and reinstalling with yarn, no luck there either, something gotta be cached somewhere

S

Shane•11/27/23, 12:57 AM

ofc it just randomly works now without me changing anything Sadge

IIsaac McFadyen Those kind of error pages usually appear if your browser is making a request tha...

F

fengyangsi•11/27/23, 2:36 AM

I'm sure the request is valid, and when I

wrangler dev

wrangler dev

in local it work, but

wrangler deploy

wrangler deploy

to cloudflare it doesn't work

I

Isaac McFadyen•11/27/23, 2:37 AM

It's unrelated to Wrangler. That error page is something you'd receive before the request even hits the Worker, nothing you're doing in your Worker should trigger that.

F

fengyangsi•11/27/23, 2:42 AM

I even not send any body when i test, just a null POST, in local, it return

Can't deserialize json to pass value

Can't deserialize json to pass value

and 400 write in my code, but in cloudflare, it return 403

#[event(fetch)]
async fn main(mut req: Request, _env: Env, _ctx: Context) -> Result<Response> {
    if req.method() == Method::Post{
        if let Ok(body) = req.text().await{
            match serde_json::from_str::<TVSignal>(&body) {
                Ok(tvs)=> {
                    match Fetch::Request(tvs.request()).send().await {
                        Ok(_) => Response::ok("Success"),
                        Err(_) => Response::error("Error to send request to OKX", 502),
                    }
                },
                Err(_) => Response::error("Can't deserialize json to pass value", 400),
            } 
        }else {
            Response::error("Need text body",400)
        }
    }else {
        Response::error("There are apis, please request with POST",400)
    }
}

#[event(fetch)]
async fn main(mut req: Request, _env: Env, _ctx: Context) -> Result<Response> {
    if req.method() == Method::Post{
        if let Ok(body) = req.text().await{
            match serde_json::from_str::<TVSignal>(&body) {
                Ok(tvs)=> {
                    match Fetch::Request(tvs.request()).send().await {
                        Ok(_) => Response::ok("Success"),
                        Err(_) => Response::error("Error to send request to OKX", 502),
                    }
                },
                Err(_) => Response::error("Can't deserialize json to pass value", 400),
            } 
        }else {
            Response::error("Need text body",400)
        }
    }else {
        Response::error("There are apis, please request with POST",400)
    }
}

#[event(fetch)]
async fn main(mut req: Request, _env: Env, _ctx: Context) -> Result<Response> {
    if req.method() == Method::Post{
        if let Ok(body) = req.text().await{
            match serde_json::from_str::<TVSignal>(&body) {
                Ok(tvs)=> {
                    match Fetch::Request(tvs.request()).send().await {
                        Ok(_) => Response::ok("Success"),
                        Err(_) => Response::error("Error to send request to OKX", 502),
                    }
                },
                Err(_) => Response::error("Can't deserialize json to pass value", 400),
            } 
        }else {
            Response::error("Need text body",400)
        }
    }else {
        Response::error("There are apis, please request with POST",400)
    }
}

#[event(fetch)]
async fn main(mut req: Request, _env: Env, _ctx: Context) -> Result<Response> {
    if req.method() == Method::Post{
        if let Ok(body) = req.text().await{
            match serde_json::from_str::<TVSignal>(&body) {
                Ok(tvs)=> {
                    match Fetch::Request(tvs.request()).send().await {
                        Ok(_) => Response::ok("Success"),
                        Err(_) => Response::error("Error to send request to OKX", 502),
                    }
                },
                Err(_) => Response::error("Can't deserialize json to pass value", 400),
            } 
        }else {
            Response::error("Need text body",400)
        }
    }else {
        Response::error("There are apis, please request with POST",400)
    }
}

F

fengyangsi•11/27/23, 2:45 AM

maybe this is a SSL error? local use http and http1.1 but couldflare use https and http2?

U

Unsmart•11/27/23, 2:46 AM

Its not an SSL error or an error in the workers code. Cloudflare does some basic validation on requests and if it does not pass the basic validation you get the generic 403 error. That generic 403 error means it never even attempted to forward the request to your worker or to an origin

UUnsmart Its not an SSL error or an error in the workers code. Cloudflare does some basic...

F

fengyangsi•11/27/23, 2:48 AM

thank, i understand, but why my request can't pass validation?

U

Unsmart•11/27/23, 2:49 AM

Not sure. What browser are you using, and how are you doing the request?

F

fengyangsi•11/27/23, 2:56 AM

firefox

Ffengyangsi firefox

U

Unsmart•11/27/23, 2:58 AM

Yeah that request is getting blocked because of the host header being "127.0.0.1:8787" the host header should be whatever the domain is.

UUnsmart Yeah that request is getting blocked because of the host header being "127.0.0.1...

F

fengyangsi•11/27/23, 3:06 AM

ok, it work on workers.dev, but in my domain, it return 405

F

fengyangsi•11/27/23, 3:11 AM

it's because the pages?

F

fengyangsi•11/27/23, 3:32 AM

just a router error, it can work now, thank you

C

Cedrick•11/27/23, 6:06 PM

Hello everyone, I am integrating the workerAI with Langchain4j to bring visibility to this great asset https://github.com/clun/langchain4j/tree/provider-workerai. Most of the features are their. I have question regarding the

text-to_Image

text-to_Image

(1) a few times i got the "upstream too busy", (2) is there any plan to add the resolution in the input request (3) what would be great value for num steps... i can try and guess but explanation would help

P

Pato•11/27/23, 7:12 PM

hey im getting this error with wrangler

✘ [ERROR] Error while creating remote dev session: TypeError: fetch failed
      at fetch
 {
    cause: Error: connect ETIMEDOUT 2606:4700:3031::ac43:cb34:443
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
      errno: -60,
      code: 'ETIMEDOUT',
      syscall: 'connect',
      address: '2606:4700:3031::ac43:cb34',
      port: 443
    }
  }

✘ [ERROR] Error while creating remote dev session: TypeError: fetch failed
      at fetch
 {
    cause: Error: connect ETIMEDOUT 2606:4700:3031::ac43:cb34:443
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
      errno: -60,
      code: 'ETIMEDOUT',
      syscall: 'connect',
      address: '2606:4700:3031::ac43:cb34',
      port: 443
    }
  }

✘ [ERROR] Error while creating remote dev session: TypeError: fetch failed
      at fetch
 {
    cause: Error: connect ETIMEDOUT 2606:4700:3031::ac43:cb34:443
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
      errno: -60,
      code: 'ETIMEDOUT',
      syscall: 'connect',
      address: '2606:4700:3031::ac43:cb34',
      port: 443
    }
  }

✘ [ERROR] Error while creating remote dev session: TypeError: fetch failed
      at fetch
 {
    cause: Error: connect ETIMEDOUT 2606:4700:3031::ac43:cb34:443
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
      errno: -60,
      code: 'ETIMEDOUT',
      syscall: 'connect',
      address: '2606:4700:3031::ac43:cb34',
      port: 443
    }
  }

P

Pato•11/27/23, 7:12 PM

it worked fine like 5 minutes ago

P

Pato•11/27/23, 7:26 PM

anyone knows what might be going on? There`s nothing on cloudflares status page

CCedrick Hello everyone, I am integrating the workerAI with Langchain4j to bring visibili...

C

Cedrick•11/28/23, 1:15 AM

https://github.com/langchain4j/langchain4j/pull/320

GitHub

Support for WorkerAI Provider by clun · Pull Request #320 · langcha...

Support for Worker AI
CloudFlare opened a Beta of a new service Called WorkerAI
https://developers.cloudflare.com/workers-ai/
They do provide a REST API for different operations.

Text Generation
T...

G

gonz•11/28/23, 10:53 AM

Hi all. Say I have a zone called

foo.bar.com

foo.bar.com

and a workers route for

*.foo.bar.com/*

*.foo.bar.com/*

that goes to my worker, plus a proxied DNS record for

*.foo.bar.com

*.foo.bar.com

. All that works fine. Then we decide to create a zone for

bar.com

bar.com

and migrate off

foo.bar.com

foo.bar.com

into this zone. Added the same proxied DNS record to this

bar.com

bar.com

zone and the same workers route. Issue we're seeing is that the requests seem to go straight to the origin server but they don't seem to be hitting the worker at all.

Any ideas/thoughts?

Correction: it seems to break whenever I remove the workers route from the old

foo.bar.com

foo.bar.com

zone. I want the new

bar.com

bar.com

to process these requests, not the old zone

F

Fun Miles•11/28/23, 1:44 PM

What is the CPU limit accounting when using a bound worker with the new billing system? Does the worker called with fetch get counted as part of the caller's CPU usage, or does it get its own limit?

F

Fun Miles•11/28/23, 1:46 PM

If it were called via the network, it would get its own limit and the caller time would pause while awaiting for the result of the fetch, right? Is it similar for a bound worker call?

L

liam | helius.dev•11/28/23, 8:34 PM

Are there any plans to reduce the cold start latency of workers? Its quite bad right now

Original message was deleted

L

liam | helius.dev•11/28/23, 8:43 PM

Do you have any idea how much this can help/what target cold start time is? Articles like this even claim there is zero cold start, but in practice I see anywhere between 50-500ms

so I can't cache the return value of the OpenAI constructor between invocations?

Similar Threads

Similar Threads

Similar Threads