Simultaneous fetches over 6 are being dropped instead of being queued.

K · 2024-03-14T15:14:54.653Z

Hi. I'm doing multiple Http calls to external server via fetch(). It works locally. But anything over 6 on deployed version throws error instantly. Docs say that additional fetches should be automatically queued and executed when older ones get freed up.

K

kian•3/14/24, 3:19 PM

What's the error you're getting?

K

KOP•3/14/24, 3:33 PM

"Response closed due to connection limit"

K

kian•3/14/24, 3:33 PM

How many calls are you making?

K

KOP•3/14/24, 3:38 PM

I've tested with 7, 10 and 30.

K

KOP•3/14/24, 3:38 PM

Even with 7 it throws error.

K

KOP•3/19/24, 10:03 PM

I'm still interested in having this solved

K

KOP•3/29/24, 11:46 AM

I found out that the error happens when trying to resolve
fetches in

Promise.all()

Promise.all()

Promise.all()

Promise.all()

So with this code:

let promises=[];
let results=[]
for (let i =0;i<10;i++){            
    let url = new URL("https://echo.free.beeceptor.com/")
    promises.push(fetch(url, {cf:{cacheEverything: false,cacheTtl:0}}))            

        }

let promises=[];
let results=[]
for (let i =0;i<10;i++){            
    let url = new URL("https://echo.free.beeceptor.com/")
    promises.push(fetch(url, {cf:{cacheEverything: false,cacheTtl:0}}))            

        }

let promises=[];
let results=[]
for (let i =0;i<10;i++){            
    let url = new URL("https://echo.free.beeceptor.com/")
    promises.push(fetch(url, {cf:{cacheEverything: false,cacheTtl:0}}))            

        }

let promises=[];
let results=[]
for (let i =0;i<10;i++){            
    let url = new URL("https://echo.free.beeceptor.com/")
    promises.push(fetch(url, {cf:{cacheEverything: false,cacheTtl:0}}))            

        }

this won't work:

await Promise.all(promises).then(results2=>{results = results2})

await Promise.all(promises).then(results2=>{results = results2})

await Promise.all(promises).then(results2=>{results = results2})

await Promise.all(promises).then(results2=>{results = results2})

but this code below works

await Promise.all(
promises.map(
    async (task)=>{
        await task.then(
            async (r)=>{
            results.push(await r.json() )
            })
        })
    )    
console.log(results)

await Promise.all(
promises.map(
    async (task)=>{
        await task.then(
            async (r)=>{
            results.push(await r.json() )
            })
        })
    )    
console.log(results)

await Promise.all(
promises.map(
    async (task)=>{
        await task.then(
            async (r)=>{
            results.push(await r.json() )
            })
        })
    )    
console.log(results)

await Promise.all(
promises.map(
    async (task)=>{
        await task.then(
            async (r)=>{
            results.push(await r.json() )
            })
        })
    )    
console.log(results)

Judging by time it takes working code to resolve, it
seems to be doing 6 fetches concurrently.

I think it might be error in how worker parses code for queing.
And promise.all seems to be omitted.

Simultaneous fetches over 6 are being dropped instead of being queued.

Similar Threads

Similar Threads

Similar Threads