Smart placement isn't available for cron trigger i believe

CChaika You mean like wildcard? You can use HTTP Routes and a proxied wildcard, (ex: `*....

I

Ian•5/26/23, 9:33 PM

it doesn't seem possible for workers

HHarris Smart placement isn't available for cron trigger i believe

J

James•5/26/23, 9:33 PM

Yeah they don't work together yet unfortunately

IIan it doesn't seem possible for workers

C

Chaika•5/26/23, 9:33 PM

For Workers? 100% it is, I have a worker just like that. You just have to use Http Routes and not Custom Domains

I

Ian•5/26/23, 9:34 PM

Interesting, let me check

C

Chaika•5/26/23, 9:34 PM

Also for each domain you don't want to be controlled by the worker, you need to add a seperate route with a service of none

C

Chaika•5/26/23, 9:35 PM

You'd end up with something like:

api.example.com/*

api.example.com/*

api.example.com/*

api.example.com/*: service none (for normal origins)

*/*

*/*

to match all or

*.example.com/*

*.example.com/*

*.example.com/*

*.example.com/* to match all subdomains besides apex, service: Worker

C

Chaika•5/26/23, 9:36 PM

(It may be worth keeping in mind as well the default universal cert you get only covers first level subdomains, while your worker could respond on gifhigfohgfd.workers.example.com, your cert won't cover it unless you use ACM for

*.workers.example.com

*.workers.example.com

*.workers.example.com

*.workers.example.com)

H

HarrisOP•5/26/23, 9:47 PM

Question on limits:

I'm using the Unbounded Usage Model, but my worker sends a HTTPS request that has a streaming body, and can take longer than 30 seconds, however my worker runs every 5 minutes. How do these limits interact?

K

kian•5/26/23, 9:49 PM

30 seconds is CPU time

K

kian•5/26/23, 9:49 PM

Streaming a body from a

fetch

fetch

subrequest isn't going to use up any CPU

H

HarrisOP•5/26/23, 9:49 PM

even if I am using the main function to log something like time to first byte?

H

HarrisOP•5/26/23, 9:52 PM

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })
      .then((res) => response.body)
      .then((body) => {
        const reader = body.getReader()

        // do stuff with reader
      })

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })
      .then((res) => response.body)
      .then((body) => {
        const reader = body.getReader()

        // do stuff with reader
      })

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })
      .then((res) => response.body)
      .then((body) => {
        const reader = body.getReader()

        // do stuff with reader
      })

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })
      .then((res) => response.body)
      .then((body) => {
        const reader = body.getReader()

        // do stuff with reader
      })

K

kian•5/26/23, 9:56 PM

What is happening in

do stuff with reader

do stuff with reader

do stuff with reader

do stuff with reader?

K

kian•5/26/23, 9:57 PM

It'll probably use up CPU time, but I doubt it's anywhere near 30 seconds

H

HarrisOP•5/26/23, 10:03 PM

const startTime = Date.now()

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })

    if (!response.ok) {
      console.log(
        `Unexpected response from OpenAI API: ${response.status} ${response.statusText}`
      )
      return
    }

    if (!response.body) {
      console.log("No response body")
      return
    }
    const reader = response.body.getReader()

    // Get first byte
    let chunk = await reader.read()

    // Log first byte time
    const firstByteTime = Date.now() - startTime

    // Read the rest of the response
    while (!chunk.done) {
      chunk = await reader.read()
    }

const startTime = Date.now()

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })

    if (!response.ok) {
      console.log(
        `Unexpected response from OpenAI API: ${response.status} ${response.statusText}`
      )
      return
    }

    if (!response.body) {
      console.log("No response body")
      return
    }
    const reader = response.body.getReader()

    // Get first byte
    let chunk = await reader.read()

    // Log first byte time
    const firstByteTime = Date.now() - startTime

    // Read the rest of the response
    while (!chunk.done) {
      chunk = await reader.read()
    }

const startTime = Date.now()

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })

    if (!response.ok) {
      console.log(
        `Unexpected response from OpenAI API: ${response.status} ${response.statusText}`
      )
      return
    }

    if (!response.body) {
      console.log("No response body")
      return
    }
    const reader = response.body.getReader()

    // Get first byte
    let chunk = await reader.read()

    // Log first byte time
    const firstByteTime = Date.now() - startTime

    // Read the rest of the response
    while (!chunk.done) {
      chunk = await reader.read()
    }

const startTime = Date.now()

    const response = await fetch(url, {
      method: "POST",
      headers: {
        "Content-Type": "application/json",
        Authorization: `Bearer ${env.OPENAI_API_KEY}`,
      },
      body,
    })

    if (!response.ok) {
      console.log(
        `Unexpected response from OpenAI API: ${response.status} ${response.statusText}`
      )
      return
    }

    if (!response.body) {
      console.log("No response body")
      return
    }
    const reader = response.body.getReader()

    // Get first byte
    let chunk = await reader.read()

    // Log first byte time
    const firstByteTime = Date.now() - startTime

    // Read the rest of the response
    while (!chunk.done) {
      chunk = await reader.read()
    }

H

HarrisOP•5/26/23, 10:03 PM

the event stream might not finish within 30s, and this code would be executing on the main thread, wouldn't it?

K

kian•5/26/23, 10:04 PM

the event stream might not finish within 30s

It's 30 seconds of CPU time, none of this is particularly heavy compute.

H

HarrisOP•5/26/23, 10:04 PM

oooh i see

H

HarrisOP•5/26/23, 10:04 PM

basically CPU time = time to process

K

kian•5/26/23, 10:04 PM

You could just do your TTFB after the

const response = await ...

const response = await ...

const response = await ...

const response = await ... and then

return response

return response

return response

return response, couldn't you?

H

HarrisOP•5/26/23, 10:04 PM

there's more code underneath

H

HarrisOP•5/26/23, 10:05 PM

 const totalTime = Date.now() - startTime

    console.log("Time to first byte: " + firstByteTime + "ms")
    console.log("Total response time: " + totalTime + "ms")

    // Log response time
    const client = new Client(env.DB_URL + "?sslmode=require")
    await client.connect()

    const text =
      "INSERT INTO response_times(model, date, ttfb, duration) VALUES($1, $2, $3, $4) RETURNING *"
    const values = [
      "gpt-4",
      new Date(event.scheduledTime),
      firstByteTime,
      totalTime,
    ]

    try {
      const res = await client.query(text, values)
      console.log(res.rows[0])
    } catch (err) {
      console.error(err)
    } finally {
      ctx.waitUntil(client.end())
    }

 const totalTime = Date.now() - startTime

    console.log("Time to first byte: " + firstByteTime + "ms")
    console.log("Total response time: " + totalTime + "ms")

    // Log response time
    const client = new Client(env.DB_URL + "?sslmode=require")
    await client.connect()

    const text =
      "INSERT INTO response_times(model, date, ttfb, duration) VALUES($1, $2, $3, $4) RETURNING *"
    const values = [
      "gpt-4",
      new Date(event.scheduledTime),
      firstByteTime,
      totalTime,
    ]

    try {
      const res = await client.query(text, values)
      console.log(res.rows[0])
    } catch (err) {
      console.error(err)
    } finally {
      ctx.waitUntil(client.end())
    }

 const totalTime = Date.now() - startTime

    console.log("Time to first byte: " + firstByteTime + "ms")
    console.log("Total response time: " + totalTime + "ms")

    // Log response time
    const client = new Client(env.DB_URL + "?sslmode=require")
    await client.connect()

    const text =
      "INSERT INTO response_times(model, date, ttfb, duration) VALUES($1, $2, $3, $4) RETURNING *"
    const values = [
      "gpt-4",
      new Date(event.scheduledTime),
      firstByteTime,
      totalTime,
    ]

    try {
      const res = await client.query(text, values)
      console.log(res.rows[0])
    } catch (err) {
      console.error(err)
    } finally {
      ctx.waitUntil(client.end())
    }

 const totalTime = Date.now() - startTime

    console.log("Time to first byte: " + firstByteTime + "ms")
    console.log("Total response time: " + totalTime + "ms")

    // Log response time
    const client = new Client(env.DB_URL + "?sslmode=require")
    await client.connect()

    const text =
      "INSERT INTO response_times(model, date, ttfb, duration) VALUES($1, $2, $3, $4) RETURNING *"
    const values = [
      "gpt-4",
      new Date(event.scheduledTime),
      firstByteTime,
      totalTime,
    ]

    try {
      const res = await client.query(text, values)
      console.log(res.rows[0])
    } catch (err) {
      console.error(err)
    } finally {
      ctx.waitUntil(client.end())
    }

HHarris basically CPU time = time to process

I

Isaac McFadyen•5/26/23, 10:09 PM

CPU time = the time an operation takes on the CPU

I

Isaac McFadyen•5/26/23, 10:09 PM

It's not related to real time at all, really

I

Isaac McFadyen•5/26/23, 10:10 PM

A CPU intensive operation taking 1 second could use up to 1 second of CPU time (ignoring Workers limits of course), but that would mean it's using 100% of the CPU for 100% of the time which never happens, so it's usually far less

I

Isaac McFadyen•5/26/23, 10:10 PM

Fetch requests take a few ms of CPU time, for example, even though they might wait far longer for a response from wherever you're fetching from

H

HarrisOP•5/26/23, 10:12 PM

makes sense, thank you

N

nikiv.dev•5/26/23, 11:01 PM

does this mean my variables i set in dashboard will be overriden?

N

nikiv.dev•5/26/23, 11:01 PM

my config is just this

N

nikiv.dev•5/26/23, 11:03 PM

N

nikiv.dev•5/26/23, 11:03 PM

is this ok still?

N

nikiv.dev•5/26/23, 11:03 PM

Or you can put the vars in your wrangler.toml

N

nikiv.dev•5/26/23, 11:04 PM

so i thought about this option although i don't get how to securely have them in the file

N

nikiv.dev•5/26/23, 11:04 PM

via process.env or something perhaps

W

Walshy•5/26/23, 11:06 PM

If you added secrets, they'll be ok

W

Walshy•5/26/23, 11:06 PM

If you added normal env vars, you should put them in your wrangler.toml really

W

Walshy•5/26/23, 11:06 PM

The warning is just there in case you do something destructive. If it was just secrets, you're ok

CChaika You'd end up with something like: `api.example.com/*`: service none (for normal ...

I

Ian•5/27/23, 1:22 AM

Thanks I totally missed that, I did manage to find the settings for workers, however I couldn't find Routes for pages or R2, planning on deploying static files that would benefit from the cdn cache.

I

Ian•5/27/23, 1:23 AM

I think I have a workaround which is to monkey patch

<script>

<script>

<script>

<script> on the html Copium

IIan Thanks I totally missed that, I did manage to find the settings for workers, how...

C

Chaika•5/27/23, 1:42 AM

ahh yea you can't do that with Pages or R2, neither work with wildcards like that. You could use a worker fetching from R2 if the extra worker invocation costs don't bother you

CChaika ahh yea you can't do that with Pages or R2, neither work with wildcards like tha...

I

Ian•5/27/23, 1:44 AM

well yeah the extra invocation cost kinda bother me a bit, but I guess I have no other option, I will just return a minimal html from the worker that contains metadata to monkey patch a

<script>

<script>

<script>

<script> that grabs the static files from

static.domain.com

static.domain.com

static.domain.com

static.domain.com R2

CChristopher Victorovich Where can I ask something about Zero Trust?

C

Cyb3r-Jak3•5/27/23, 3:35 AM

#general-help or #general-discussions

B

b-fuze (Mike32)•5/27/23, 5:18 AM

Is it possible to deploy a worker function with

wrangler

wrangler

and then invoke an older deployed version that hasn't been updated to the new code?

B

b-fuze (Mike32)•5/27/23, 5:20 AM

I'm asking because it seems that this has happened to me. If so, I'm curious if there's like a period of time that I should wait before invoking my worker functions to ensure that the new deployment has fully saturated all of the edge locations

Bb-fuze (Mike32)Is it possible to deploy a worker function with `wrangler` and then invoke an ol...

H

Hello, I’m Allie!•5/27/23, 5:23 AM

Unless there is an incident, it should take less than a minute to update everywhere

B

b-fuze (Mike32)•5/27/23, 5:24 AM

Ah, okay, I definitely invoked it a lot faster than that. Thanks

B

b-fuze (Mike32)•5/27/23, 2:33 PM

const [client, webSocket] = Object.values(webSocketPair);

const [client, webSocket] = Object.values(webSocketPair);

const [client, webSocket] = Object.values(webSocketPair);

const [client, webSocket] = Object.values(webSocketPair);

looks like quite a precarious assumption...

B

b-fuze (Mike32)•5/27/23, 2:34 PM

I'm not sure what the properties are, but it'd be much safer to write something like

const {client, webSocket} = webSocketPair;

const {client, webSocket} = webSocketPair;

const {client, webSocket} = webSocketPair;

const {client, webSocket} = webSocketPair;

Smart placement isn't available for cron trigger i believe

Similar Threads

Similar Threads

Similar Threads