Pages Deploys Get Permanently Stuck in a "Queued" State
For months, we've been having an issue where pages deploys get permanently stuck in the "Queued" state.
There seems to be a cap of 3 builds on the number of concurrent builds that can be running. If there are already 3 builds running, new builds enter the "Queued" state (as expected). However, the queueing mechanism seems completely broken, and I've never seen a build actually exit the queued state.
Has anyone else encountered this issue? We're hoping to switch to cloudflare pages for our production servers, and this is something of a blocker.
(I've tried deleting all of our deployments, but that didn't help.)
Thanks!
Account ID: f1dbe97421dbe1f3d0000e74d2ace970
Example Stuck Deployment ID: https://dash.cloudflare.com/f1dbe97421dbe1f3d0000e74d2ace970/pages/view/remnote-new/5bde14b0-f22f-4201-9342-6d4ccde75030
Domain: https://remnote-new.pages.dev/
18 Replies
Hey. Looks like your builds are running fine now, can you confirm?
@Vero 🐙 Thank you for the reply!
Unfortunately not; you can see that there's successful builds, then a chunk of stuck "Queued" builds, then new "successful" builds.
(This is because > 3 deploys got triggered at once here I think.)
So this is still an issue.
Even the main production build gets stuck, so we have to micro-manage all of the deploys 😅
Hey, I'm escalating this internally for the team to check
@Vero 🐙 Appreciate it!
Quick update: the team investigated this and found out there's a query that is taking too long, resulting in a timeout. Now they are discussing different approaches to fix this
This is now awaiting release
Hey @remnote_martin the fix has been released, could you please check if the issue persists?
@Vero 🐙 Appreciate the follow-up! Unfortunately, the issue remains the same:
Is there some other info I can provide on my end?
I passed this to the team again yesterday, they're investigating
(No luck yet, just an FYI)
ok, no updates yet
(Still an issue here. Thanks! (Sorry to nag - this does mean most of our deploys get permanently stuck still though.))
Hey I'm pinging the team again
Now an engineer is looking into it
Hey @remnote_martin sorry for the delay, just got a solution from the team. The problem is that you have over 3,000 queued builds, so it's not that your builds get stuck, it's just that we're working through a very large backlog.
The solution will be to delete old "stuck" deployments. An engineer modified the script found here https://developers.cloudflare.com/pages/platform/known-issues/#delete-a-project-with-a-high-number-of-deployments and adapted it to specifically delete the queued deployments in your backlog. So you'll have to download the file I've DM'd you and follow the directions in the readme
Cloudflare Docs
Known issues · Cloudflare Pages docs
Here are some known bugs and issues with Cloudflare Pages:
Greatly appreciate the follow-up!
I'm doubtful that this is the issue - I've tried that script to delete all of the old deployments already, and that didn't help. I'll try again though, and follow-up.
Hi - this unfortunately didn't work. I deleted all old deployments and only have 135 now, but you can still see this new run gets stuck:
https://dash.cloudflare.com/f1dbe97421dbe1f3d0000e74d2ace970/pages/view/remnote-new/f077cbf4-1330-4ea4-89d0-21ed37050605
We've identified the issue and have a fix in review
The fix has been released. Can you confirm this is fixed? @remnote_martin
This is working great now, thanks! It's made our workflow a lot easier. Please send my thanks to the team, if possible
perfect, thanks 🙂