I just tried spinning up a VM on Vultr

zegevlier · 2023-08-26T13:10:22.685Z

I just tried spinning up a VM on Vultr in the Amsterdam region, and I can't reproduce this. Once the pages project was in cache, all requests took <0.5s. I also tried a site that's just proxied, and files hosted on R2, and they all have normal response times

B

Bjarn•8/26/23, 1:30 PM

These were confirmed:

CF Pages:
https://spectate.net (static)
https://docs.spectate.net (static)
https://realify.net (static)
https://app.spectate.net (ssr)
https://lightbase.nl (static)

Proxied through CF:
https://api.spectate.net
https://afzetbak.nl
https://vvhierden.nl

Z

zegevlierOP•8/26/23, 1:30 PM

How many requests are you sending for it to happen once or twice an hour?

B

Bjarn•8/26/23, 1:31 PM

once every 30 seconds to 2 minutes, varies per monitor, once I see a spike I also test manually with this command;

B

Bjarn•8/26/23, 1:31 PM

curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -4 &&  curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -6

curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -4 &&  curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -6

curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -4 &&  curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -6

curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -4 &&  curl -w "%{time_starttransfer}\n" -s -o /dev/null https://spectate.net/ -6

B

Bjarn•8/26/23, 1:32 PM

lightbase.nl, afzetbak.nl and vvhierden.nl aren't my projects they're from 2 other CF users who noticed these issues

B

Bjarn•8/26/23, 1:33 PM

these were the MTRs, but unreliable as I don't know if the CF router has ICMP rate limiting

B

Bjarn•8/26/23, 1:35 PM

This is the chart of docs.spectate.net and app.spectate.net with spikes >1s

B

Bjarn•8/26/23, 1:38 PM

Haven't received any notifications in ~45 mins, and can no longer reproduce slow requests with that curl command, but will keep an eye out on the monitoring.

This night it also was quiet since 02:37 AM but then issues started again at 10:34 AM UTC+2

Z

zegevlierOP•8/26/23, 1:39 PM

Alright. I've set some scripts running to request both spectate.net and my site repeatedly so that if it happens again I can hopefully catch it.

B

Bjarn•8/26/23, 1:39 PM

Awesome, thanks! Curious wat they will return

B

Bjarn•8/26/23, 1:45 PM

This is spectate.net's chart of the last 24 hours, showing last evening's issues

B

Bjarn•8/26/23, 2:06 PM

@zegevlier it's going off again

B

Bjarn•8/26/23, 2:06 PM

also R2 unavailable

B

Bjarn•8/26/23, 2:06 PM

https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg for example

B

Bjarn•8/26/23, 2:07 PM

R2 works again, but failed to load a couple of seconds

B

Bjarn•8/26/23, 2:07 PM

Lightbase.nl's chart (Pages)

B

Bjarn•8/26/23, 2:09 PM

API proxied through CF:

B

Bjarn•8/26/23, 2:16 PM

while true; do
  curl -w "IPv4: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -4 &&  curl -w "IPv6: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -6
  sleep 1
done

while true; do
  curl -w "IPv4: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -4 &&  curl -w "IPv6: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -6
  sleep 1
done

while true; do
  curl -w "IPv4: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -4 &&  curl -w "IPv6: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -6
  sleep 1
done

while true; do
  curl -w "IPv4: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -4 &&  curl -w "IPv6: %{time_starttransfer}\n" -s -o /dev/null https://content.spectate.cloud/status-pages/logos/spectate-638bf88fc3fd6.svg -6
  sleep 1
done

B

Bjarn•8/26/23, 2:16 PM

Z

zegevlierOP•8/26/23, 2:30 PM

I see some higher numbers as well

7fccaf24ebef0c39-AMS
Time v6: 0.226411
7fccaf45d805b7c4-AMS
Time v4: 0.305495
7fccaf47c94bb932-AMS
Time v6: 0.281405
7fccaf68ee990b36-AMS
Time v4: 0.315264
7fccaf6b1d47b6f1-AMS
Time v6: 0.359328
7fccaf8ca96fb948-AMS
Time v4: 0.338977
7fccaf8ebe66b924-AMS
Time v6: 0.237156
7fccafaf8e211cb0-AMS
Time v4: 0.316206
7fccafb1cd49b968-AMS
Time v6: 0.305367
7fccafd2fe20b98c-AMS
Time v4: 0.965351
7fccafd90bba0b6e-AMS
Time v6: 1.041992
7fccafffddb00a68-AMS
Time v4: 3.308685
7fccb013a8ef06ca-AMS
Time v6: 1.977213
7fccb03f7e550a49-AMS
Time v4: 1.014775
7fccb045ec530e84-AMS
Time v6: 0.630028
7fccb06939940115-AMS
Time v4: 0.641248
7fccb06d3ef70e30-AMS
Time v6: 1.025666
7fccb0931ba40e10-AMS
Time v4: 1.526998
7fccb09ccc5e0b5a-AMS
Time v6: 1.094398
7fccb0c2eb720e87-AMS
Time v4: 0.394867
7fccb0c59f9c0dfb-AMS
Time v6: 0.544657
7fccb0e8f867b950-AMS
Time v4: 1.837291
7fccb0f3dee5b7bb-AMS
Time v6: 0.441511
7fccb115ff430ba8-AMS
Time v4: 0.589952
7fccb119ba230a78-AMS
Time v6: 0.910290
7fccb13eb9f61c82-AMS
Time v4: 1.468965
7fccb1480d080bd5-AMS
Time v6: 1.330203
7fccb16fb8c20e44-AMS
Time v4: 0.862632
7fccb1752dd80e00-AMS
Time v6: 0.529395
7fccb197fe79b78b-AMS
Time v4: 0.800222
7fccb19d0f0f0ae3-AMS
Time v6: 1.756292
7fccb1c749e90bdb-AMS
Time v4: 1.495685
7fccb1d0bb920a4c-AMS
Time v6: 0.936594
7fccb1f5ff320b07-AMS
Time v4: 1.359551
7fccb1ff28dc0bb0-AMS
Time v6: 1.204113
7fccb2258dc30eb0-AMS
Time v4: 0.581097
7fccb2292bc30e3c-AMS
Time v6: 0.612664
7fccb24cfc0db776-AMS
Time v4: 0.507134
7fccb24fa9551ca4-AMS

7fccaf24ebef0c39-AMS
Time v6: 0.226411
7fccaf45d805b7c4-AMS
Time v4: 0.305495
7fccaf47c94bb932-AMS
Time v6: 0.281405
7fccaf68ee990b36-AMS
Time v4: 0.315264
7fccaf6b1d47b6f1-AMS
Time v6: 0.359328
7fccaf8ca96fb948-AMS
Time v4: 0.338977
7fccaf8ebe66b924-AMS
Time v6: 0.237156
7fccafaf8e211cb0-AMS
Time v4: 0.316206
7fccafb1cd49b968-AMS
Time v6: 0.305367
7fccafd2fe20b98c-AMS
Time v4: 0.965351
7fccafd90bba0b6e-AMS
Time v6: 1.041992
7fccafffddb00a68-AMS
Time v4: 3.308685
7fccb013a8ef06ca-AMS
Time v6: 1.977213
7fccb03f7e550a49-AMS
Time v4: 1.014775
7fccb045ec530e84-AMS
Time v6: 0.630028
7fccb06939940115-AMS
Time v4: 0.641248
7fccb06d3ef70e30-AMS
Time v6: 1.025666
7fccb0931ba40e10-AMS
Time v4: 1.526998
7fccb09ccc5e0b5a-AMS
Time v6: 1.094398
7fccb0c2eb720e87-AMS
Time v4: 0.394867
7fccb0c59f9c0dfb-AMS
Time v6: 0.544657
7fccb0e8f867b950-AMS
Time v4: 1.837291
7fccb0f3dee5b7bb-AMS
Time v6: 0.441511
7fccb115ff430ba8-AMS
Time v4: 0.589952
7fccb119ba230a78-AMS
Time v6: 0.910290
7fccb13eb9f61c82-AMS
Time v4: 1.468965
7fccb1480d080bd5-AMS
Time v6: 1.330203
7fccb16fb8c20e44-AMS
Time v4: 0.862632
7fccb1752dd80e00-AMS
Time v6: 0.529395
7fccb197fe79b78b-AMS
Time v4: 0.800222
7fccb19d0f0f0ae3-AMS
Time v6: 1.756292
7fccb1c749e90bdb-AMS
Time v4: 1.495685
7fccb1d0bb920a4c-AMS
Time v6: 0.936594
7fccb1f5ff320b07-AMS
Time v4: 1.359551
7fccb1ff28dc0bb0-AMS
Time v6: 1.204113
7fccb2258dc30eb0-AMS
Time v4: 0.581097
7fccb2292bc30e3c-AMS
Time v6: 0.612664
7fccb24cfc0db776-AMS
Time v4: 0.507134
7fccb24fa9551ca4-AMS

7fccaf24ebef0c39-AMS
Time v6: 0.226411
7fccaf45d805b7c4-AMS
Time v4: 0.305495
7fccaf47c94bb932-AMS
Time v6: 0.281405
7fccaf68ee990b36-AMS
Time v4: 0.315264
7fccaf6b1d47b6f1-AMS
Time v6: 0.359328
7fccaf8ca96fb948-AMS
Time v4: 0.338977
7fccaf8ebe66b924-AMS
Time v6: 0.237156
7fccafaf8e211cb0-AMS
Time v4: 0.316206
7fccafb1cd49b968-AMS
Time v6: 0.305367
7fccafd2fe20b98c-AMS
Time v4: 0.965351
7fccafd90bba0b6e-AMS
Time v6: 1.041992
7fccafffddb00a68-AMS
Time v4: 3.308685
7fccb013a8ef06ca-AMS
Time v6: 1.977213
7fccb03f7e550a49-AMS
Time v4: 1.014775
7fccb045ec530e84-AMS
Time v6: 0.630028
7fccb06939940115-AMS
Time v4: 0.641248
7fccb06d3ef70e30-AMS
Time v6: 1.025666
7fccb0931ba40e10-AMS
Time v4: 1.526998
7fccb09ccc5e0b5a-AMS
Time v6: 1.094398
7fccb0c2eb720e87-AMS
Time v4: 0.394867
7fccb0c59f9c0dfb-AMS
Time v6: 0.544657
7fccb0e8f867b950-AMS
Time v4: 1.837291
7fccb0f3dee5b7bb-AMS
Time v6: 0.441511
7fccb115ff430ba8-AMS
Time v4: 0.589952
7fccb119ba230a78-AMS
Time v6: 0.910290
7fccb13eb9f61c82-AMS
Time v4: 1.468965
7fccb1480d080bd5-AMS
Time v6: 1.330203
7fccb16fb8c20e44-AMS
Time v4: 0.862632
7fccb1752dd80e00-AMS
Time v6: 0.529395
7fccb197fe79b78b-AMS
Time v4: 0.800222
7fccb19d0f0f0ae3-AMS
Time v6: 1.756292
7fccb1c749e90bdb-AMS
Time v4: 1.495685
7fccb1d0bb920a4c-AMS
Time v6: 0.936594
7fccb1f5ff320b07-AMS
Time v4: 1.359551
7fccb1ff28dc0bb0-AMS
Time v6: 1.204113
7fccb2258dc30eb0-AMS
Time v4: 0.581097
7fccb2292bc30e3c-AMS
Time v6: 0.612664
7fccb24cfc0db776-AMS
Time v4: 0.507134
7fccb24fa9551ca4-AMS

7fccaf24ebef0c39-AMS
Time v6: 0.226411
7fccaf45d805b7c4-AMS
Time v4: 0.305495
7fccaf47c94bb932-AMS
Time v6: 0.281405
7fccaf68ee990b36-AMS
Time v4: 0.315264
7fccaf6b1d47b6f1-AMS
Time v6: 0.359328
7fccaf8ca96fb948-AMS
Time v4: 0.338977
7fccaf8ebe66b924-AMS
Time v6: 0.237156
7fccafaf8e211cb0-AMS
Time v4: 0.316206
7fccafb1cd49b968-AMS
Time v6: 0.305367
7fccafd2fe20b98c-AMS
Time v4: 0.965351
7fccafd90bba0b6e-AMS
Time v6: 1.041992
7fccafffddb00a68-AMS
Time v4: 3.308685
7fccb013a8ef06ca-AMS
Time v6: 1.977213
7fccb03f7e550a49-AMS
Time v4: 1.014775
7fccb045ec530e84-AMS
Time v6: 0.630028
7fccb06939940115-AMS
Time v4: 0.641248
7fccb06d3ef70e30-AMS
Time v6: 1.025666
7fccb0931ba40e10-AMS
Time v4: 1.526998
7fccb09ccc5e0b5a-AMS
Time v6: 1.094398
7fccb0c2eb720e87-AMS
Time v4: 0.394867
7fccb0c59f9c0dfb-AMS
Time v6: 0.544657
7fccb0e8f867b950-AMS
Time v4: 1.837291
7fccb0f3dee5b7bb-AMS
Time v6: 0.441511
7fccb115ff430ba8-AMS
Time v4: 0.589952
7fccb119ba230a78-AMS
Time v6: 0.910290
7fccb13eb9f61c82-AMS
Time v4: 1.468965
7fccb1480d080bd5-AMS
Time v6: 1.330203
7fccb16fb8c20e44-AMS
Time v4: 0.862632
7fccb1752dd80e00-AMS
Time v6: 0.529395
7fccb197fe79b78b-AMS
Time v4: 0.800222
7fccb19d0f0f0ae3-AMS
Time v6: 1.756292
7fccb1c749e90bdb-AMS
Time v4: 1.495685
7fccb1d0bb920a4c-AMS
Time v6: 0.936594
7fccb1f5ff320b07-AMS
Time v4: 1.359551
7fccb1ff28dc0bb0-AMS
Time v6: 1.204113
7fccb2258dc30eb0-AMS
Time v4: 0.581097
7fccb2292bc30e3c-AMS
Time v6: 0.612664
7fccb24cfc0db776-AMS
Time v4: 0.507134
7fccb24fa9551ca4-AMS

7fccb3504b2f41bc-AMS
Time v6: 0.586263
7fccb3736e7db8ba-AMS
Time v4: 0.445791
7fccb3762b71b90f-AMS
Time v6: 1.023112
7fccb39c0f070bbf-AMS
Time v4: 0.750187
7fccb3a0cc5cb972-AMS
Time v6: 0.465151
7fccb3c2fa670a58-AMS
Time v4: 0.485257
7fccb3c60d5c1c98-AMS
Time v6: 0.271645
7fccb3e719d8b7a2-AMS
Time v4: 0.758511
7fccb3ec0f520b68-AMS
Time v6: 0.373128
7fccb40d9eaeb7c1-AMS
Time v4: 0.429454

7fccb3504b2f41bc-AMS
Time v6: 0.586263
7fccb3736e7db8ba-AMS
Time v4: 0.445791
7fccb3762b71b90f-AMS
Time v6: 1.023112
7fccb39c0f070bbf-AMS
Time v4: 0.750187
7fccb3a0cc5cb972-AMS
Time v6: 0.465151
7fccb3c2fa670a58-AMS
Time v4: 0.485257
7fccb3c60d5c1c98-AMS
Time v6: 0.271645
7fccb3e719d8b7a2-AMS
Time v4: 0.758511
7fccb3ec0f520b68-AMS
Time v6: 0.373128
7fccb40d9eaeb7c1-AMS
Time v4: 0.429454

7fccb3504b2f41bc-AMS
Time v6: 0.586263
7fccb3736e7db8ba-AMS
Time v4: 0.445791
7fccb3762b71b90f-AMS
Time v6: 1.023112
7fccb39c0f070bbf-AMS
Time v4: 0.750187
7fccb3a0cc5cb972-AMS
Time v6: 0.465151
7fccb3c2fa670a58-AMS
Time v4: 0.485257
7fccb3c60d5c1c98-AMS
Time v6: 0.271645
7fccb3e719d8b7a2-AMS
Time v4: 0.758511
7fccb3ec0f520b68-AMS
Time v6: 0.373128
7fccb40d9eaeb7c1-AMS
Time v4: 0.429454

7fccb3504b2f41bc-AMS
Time v6: 0.586263
7fccb3736e7db8ba-AMS
Time v4: 0.445791
7fccb3762b71b90f-AMS
Time v6: 1.023112
7fccb39c0f070bbf-AMS
Time v4: 0.750187
7fccb3a0cc5cb972-AMS
Time v6: 0.465151
7fccb3c2fa670a58-AMS
Time v4: 0.485257
7fccb3c60d5c1c98-AMS
Time v6: 0.271645
7fccb3e719d8b7a2-AMS
Time v4: 0.758511
7fccb3ec0f520b68-AMS
Time v6: 0.373128
7fccb40d9eaeb7c1-AMS
Time v4: 0.429454

Z

zegevlierOP•8/26/23, 2:30 PM

That's for my site, hosted on pages

B

Bjarn•8/26/23, 2:30 PM

Ah thank god... not that it's good - but at least I'm not the only one, if you know what I mean haha

B

Bjarn•8/26/23, 2:30 PM

Yep same here on Pages

B

Bjarn•8/26/23, 2:31 PM

my latest results were directly from R2

B

Bjarn•8/26/23, 2:31 PM

I noticed images weren't loading, so quickly updated the curl request and it showed >2s

B

Bjarn•8/26/23, 2:33 PM

Is it useful if I share the ticket with you? Or is it something you can escalate without?

Z

zegevlierOP•8/26/23, 2:38 PM

I'm not an employee, just a community member, but if I can reproduce it, it means it's not just an issue on your side. I've asked in one of the private channels what the best course of action is.
If you can share your ticket ID(s) here, I'll make sure they're attached

B

Bjarn•8/26/23, 2:39 PM

Yea of course, true! Really, really appreciate your help and time, fyi.

The ticket is #2909617. I also posted the latest findings I shared here in there

B

Bjarn•8/26/23, 7:26 PM

https://x.com/salu_o/status/1695516904885309685?s=46&t=o2YtZD2dH5IkcpFTInQhow someone replied who is also experiencing these issues

O_o (@salu_o)

@BjarnBronsveld @Vultr @digitalocean @AMS_IX @Cloudflare @CloudflareSys @CloudflareDev Yes. since late 25th August

Twitter

•

8/26/23, 7:21 PM

B

Bjarn•8/26/23, 7:26 PM

Haven’t noticed anything in the last 4 hours tho!

B

Bjarn•8/26/23, 7:26 PM

Could that make sense?

B

Bjarn•8/26/23, 7:51 PM

Jinxed it - just started seeing issues again

B

Bjarn•8/26/23, 8:02 PM

B

Bjarn•8/26/23, 8:03 PM

B

Bjarn•8/26/23, 8:05 PM

I hate to ping, really apologise, but do you maybe have heard anything? @zegevlier Support hasn't replied in almost 24 hours now, sadly, kinda stuck - but I understand you can't do anything else either, just curious atm.

I just tried spinning up a VM on Vultr

Similar Threads

Similar Threads

Similar Threads