CD
Cloudflare Developers•3w ago
fforres

An internal error occurred. Please retry your build. If this problem persists, contact Cloudflare

Hey folks, I've been constantly seeing this in cloudflare builds, in a lot of my CI runs. 🙁 Organization ID: b75ee9798c9c48a874af240b29724270 ID of One example Build with the issue: 8b86c4a4-8f9a-4ce4-941d-459c782e1cde We have to re-run a lot of our builds, and It's common enough (Combined with a few other issues we have seen on cloudflare builds like pnpm cache not working) that the team is looking to move to github and deploy via the API, would love some help here. I don't know why this is happening, but having to re-run at list one build per CI run is super annoying 🙁
8 Replies
Walshy
Walshy•3w ago
Heyo, let me look - can you share some more build ids so i can dig into them all? Very possible it's different causes and not just one Team is looking into it
fforres
fforresOP•3w ago
For sure 🙂 Seeing a few others: b051a9af-f569-4f79-9075-aea19fb77267 
12:03:49.236    ✘ [ERROR] Received a malformed response from the API
12:03:49.236    
12:03:49.236      <!DOCTYPE html>
12:03:49.236      <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
12:03:49.236      <!--[if I... (length = 4522)
12:03:49.237    
12:03:49.237      POST /accounts/b75ee9798c9c48a874af240b29724270/workers/scripts/skyward-dashboard-staging/versions -> 403 Forbidden
12:03:49.237      
12:03:49.237      If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose
12:03:49.237    
12:03:49.237    
12:03:49.368    Failed: error occurred while running deploy command
12:03:49.236    ✘ [ERROR] Received a malformed response from the API
12:03:49.236    
12:03:49.236      <!DOCTYPE html>
12:03:49.236      <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
12:03:49.236      <!--[if I... (length = 4522)
12:03:49.237    
12:03:49.237      POST /accounts/b75ee9798c9c48a874af240b29724270/workers/scripts/skyward-dashboard-staging/versions -> 403 Forbidden
12:03:49.237      
12:03:49.237      If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose
12:03:49.237    
12:03:49.237    
12:03:49.368    Failed: error occurred while running deploy command
Previous deploys of the same issue: 2a0f5495-b8cf-4668-9033-76c9c876226a 38bb3427-cde2-4290-a85d-ffa98203fa45 8e23c983-10ad-4ba1-87ed-1aa43afac724 7ca51c8f-c7c8-4f0e-8729-cf3b389263c9 this one 6a833609-57d0-49cd-80a3-e05e9bbb2cae WHere issue happens on installation. 
11:24:55.905    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2259, added 2255
11:24:56.905    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2416, added 2416
11:24:57.906    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2518, added 2525
11:25:13.057    An internal error occurred. Please retry your build. If this problem persists, contact Cloudflare support.
11:24:57.906    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2518, added 2525
11:24:58.908    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2533, added 2535
11:24:55.905    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2259, added 2255
11:24:56.905    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2416, added 2416
11:24:57.906    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2518, added 2525
11:25:13.057    An internal error occurred. Please retry your build. If this problem persists, contact Cloudflare support.
11:24:57.906    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2518, added 2525
11:24:58.908    ../..                                    | Progress: resolved 2671, reused 0, downloaded 2533, added 2535
And it seems it added the log "out of order" like in the time? 🤔 Other IDs of the rerans same build, that also failed 66fd102e-1867-47e9-a149-e81df8af5706 2fa1a486-97ef-4066-9c32-5c1e7dac81fd d01fa516-57ad-423e-9ab8-55e5dfce91a0 (This one is a bit stranger than the others, failed with unable to verify worker) 
11:06:52.079    Build initialization failed: unable to verify Worker
11:11:52.907    Build failed to initialize and was timed out
11:06:52.079    Build initialization failed: unable to verify Worker
11:11:52.907    Build failed to initialize and was timed out
11:06:52.079    Build initialization failed: unable to verify Worker
11:11:52.907    Build failed to initialize and was timed out
11:06:52.079    Build initialization failed: unable to verify Worker
11:11:52.907    Build failed to initialize and was timed out
If it helps @Walshy | DevPlat EE Also seeing issues with: [ERROR] Received a malformed response from the API 
12:03:49.236    ✘ [ERROR] Received a malformed response from the API
12:03:49.236    
12:03:49.236      <!DOCTYPE html>
12:03:49.236      <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
12:03:49.236      <!--[if I... (length = 4522)
12:03:49.237    
12:03:49.237      POST /accounts/b75ee9798c9c48a874af240b29724270/workers/scripts/skyward-dashboard-staging/versions -> 403 Forbidden
12:03:49.237      
12:03:49.237      If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose
12:03:49.237    
12:03:49.237    
12:03:49.368    Failed: error occurred while running deploy command
12:03:49.236    ✘ [ERROR] Received a malformed response from the API
12:03:49.236    
12:03:49.236      <!DOCTYPE html>
12:03:49.236      <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
12:03:49.236      <!--[if I... (length = 4522)
12:03:49.237    
12:03:49.237      POST /accounts/b75ee9798c9c48a874af240b29724270/workers/scripts/skyward-dashboard-staging/versions -> 403 Forbidden
12:03:49.237      
12:03:49.237      If you think this is a bug, please open an issue at: https://github.com/cloudflare/workers-sdk/issues/new/choose
12:03:49.237    
12:03:49.237    
12:03:49.368    Failed: error occurred while running deploy command
Build ID 234be7ce-3760-4fc4-9ca4-467adfc0133d https://discord.com/channels/595317990191398933/779390076219686943/1402346583684550698
Walshy
Walshy•3w ago
403 is very interesting.. cc: @Maximo It seems WAFy based on a HTML page being returned but we shouldn't be WAF'd on that endpoint..
fforres
fforresOP•3w ago
With the 403, I have had it all day. So we haven't been able to deploy at all. Was thinking it was related to issues I saw on https://www.cloudflarestatus.com/ on the morning. not sure if there's anything we can help on? Happy to give you folks access to our account/maybe codebase?
Cloudflare Status
Welcome to Cloudflare's home for real-time and historical data on system performance.
Maximo
Maximo•3w ago
Thank you @fforres for all of this data, this is super useful. cc @Yomna Shousha for visibility As a debugging step do you think it would be possible to create a new api token in your workers builds settings, and updating your wrangler to the latest version? ( for the deploy issue ) Also, does this error happen when you try deploying from your local machine? Also, it would be incredibly helpful if you could add WRANGLER_LOG: debug as an environment variable in your build!
fforres
fforresOP•3w ago
Will do. Had to go to a meeting, sending it in a sec bit
Maximo
Maximo•3w ago
Hey @fforres , no worries I was able to repro. We've put up a status page for the deploy issue https://discord.com/channels/595317990191398933/895794943182909470/1402464392507031633 Hey @fforres deploys should now be fixed! thank you for reporting! we are investigating the other issues you brought up as well
fforres
fforresOP•3w ago
🙏 very much appreciated @Maximo 🙏 Tested the whole thing and it's so stable now 😄 Appreciate you jumping into the issue and the team's work 🧡

Did you find this page helpful?