You should be able to get them all, even if they are registered in multiple ways?

L

lokiwind•5/23/23, 5:36 PM

https://prnt.sc/DsL11rMgEl5c

Lightshot

Screenshot

Captured with Lightshot

Llokiwind https://prnt.sc/DsL11rMgEl5c

H

Hello, I’m Allie!OP•5/23/23, 5:36 PM

Put the IPs in a

Set

Set

, which will collapse them into a single unique instance

HHello, I’m Allie!You should be able to get them all, even if they are registered in multiple ways...

L

lokiwind•5/23/23, 5:37 PM

if I register the ip address to the key , I cannot register that ip address again

Llokiwind if I register the ip address to the key , I cannot register that ip address agai...

H

Hello, I’m Allie!OP•5/23/23, 5:39 PM

No, I mean if you keep it like you have it now, iterate through all of the keys, and put the values in a

Set

Set

, so that you then dedupe them

L

lokiwind•5/23/23, 5:39 PM

Translation is very bad

L

lokiwind•5/23/23, 5:40 PM

Can you show me an example?

L

lokiwind•5/23/23, 5:41 PM

https://prnt.sc/r8ReTQmo9WEg

Lightshot

Screenshot

Captured with Lightshot

HHello, I’m Allie!No, I mean if you keep it like you have it now, iterate through all of the keys,...

L

lokiwind•5/23/23, 5:41 PM

I can do it this way, I think this is the solution

Llokiwind Can you show me an example?

H

Hello, I’m Allie!OP•5/23/23, 5:44 PM

Assuming that you have less than 1k keys

const { keys } = await env.KV.list();
const ips = new Set();
for(const { name } of keys) {
  ips.add(await env.KV.get(name));
}
console.log(Array.from(ips.values()));

const { keys } = await env.KV.list();
const ips = new Set();
for(const { name } of keys) {
  ips.add(await env.KV.get(name));
}
console.log(Array.from(ips.values()));

const { keys } = await env.KV.list();
const ips = new Set();
for(const { name } of keys) {
  ips.add(await env.KV.get(name));
}
console.log(Array.from(ips.values()));

const { keys } = await env.KV.list();
const ips = new Set();
for(const { name } of keys) {
  ips.add(await env.KV.get(name));
}
console.log(Array.from(ips.values()));

HHello, I’m Allie!Assuming that you have less than 1k keys```ts const { keys } = await env.KV.list...

L

lokiwind•5/23/23, 5:47 PM

why if it's less than 1k

L

lokiwind•5/23/23, 5:48 PM

cloudflare only allows us to read 1k data?

L

lokiwind•5/23/23, 5:48 PM

I will save about 1 million data :d

Llokiwind why if it's less than 1k

H

Hello, I’m Allie!OP•5/23/23, 5:53 PM

At a time. You can run more lists, but the code above only handles 1k

HHello, I’m Allie!At a time. You can run more lists, but the code above only handles 1k

L

lokiwind•5/23/23, 5:55 PM

why this code can run 1k data.
I don't understand this part.

L

lokiwind•5/23/23, 5:55 PM

I need to check all the data

Llokiwind why this code can run 1k data. I don't understand this part.

H

Hello, I’m Allie!OP•5/23/23, 5:56 PM

A

list()

list()

returns at max 1k keys at a time. You can then paginate through it to get the rest

L

lokiwind•5/23/23, 5:56 PM

aah okey

HHello, I’m Allie!A `list()` returns at max 1k keys at a time. You can then paginate through it to...

L

lokiwind•5/23/23, 5:57 PM

Can I read the whole list when I remove the list() function

Llokiwind Can I read the whole list when I remove the list() function

H

Hello, I’m Allie!OP•5/23/23, 5:57 PM

No, you have to run it multiple times to get all of the entries

Llokiwind https://prnt.sc/r8ReTQmo9WEg

L

lokiwind•5/23/23, 5:59 PM

That's how I'll record the keys.
And when I list the keys, I can see them all, right?

Llokiwind That's how I'll record the keys. And when I list the keys, I can see them all, r...

H

Hello, I’m Allie!OP•5/23/23, 5:59 PM

If you continue looping through them, then yes

HHello, I’m Allie!If you continue looping through them, then yes

L

lokiwind•5/23/23, 6:01 PM

2a06:98c0:3600::103<802
2a06:98c0:3600::103<306
2a06:98c0:3600::103<303
....
I'll record the keys like this.
Can I read them all at once without the list() function

Llokiwind 2a06:98c0:3600::103<802 2a06:98c0:3600::103<306 2a06:98c0:3600::103<303 ......

H

Hello, I’m Allie!OP•5/23/23, 6:01 PM

Not with KV

L

lokiwind•5/23/23, 6:02 PM

Oh, how am I gonna do it? It's a joke.

L

lokiwind•5/23/23, 6:03 PM

I don't want to use the D1, the Wrangler's so lousy.

Llokiwind Oh, how am I gonna do it? It's a joke.

H

Hello, I’m Allie!OP•5/23/23, 6:05 PM

I don't think that there is any easy solution for storing/retrieving millions of IPs.

H

Hello, I’m Allie!OP•5/23/23, 6:05 PM

KV is a decent option, but you would have to list it out

L

lokiwind•5/23/23, 6:05 PM

I don't know how to list it, that's the problem

L

lokiwind•5/23/23, 6:06 PM

@onur1881 türk müsün

L

lokiwind•5/23/23, 6:06 PM

bende

L

lokiwind•5/23/23, 6:06 PM

konu ne

OOnur is there anyone about that ?

C

Chaika•5/23/23, 6:09 PM

I would assume it does for http/https apps, since they go through the normal request flow, but not sure about normal tcp. If you have Enterprise, could ask chat/your csm

Llokiwind I don't know how to list it, that's the problem

H

Hello, I’m Allie!OP•5/23/23, 6:09 PM

Here's one that should work for more than 1k keys:

const ips = new Set();
let cursor = undefined;
while(true) {
  const result = await env.KV.list({ cursor });
  for(const { name } of result.keys) {
    ips.add(await env.KV.get(name));
  }
  if(result.list_complete) {
    break;
  }
  cursor = result.cursor;
}
console.log(Array.from(ips.values()));

const ips = new Set();
let cursor = undefined;
while(true) {
  const result = await env.KV.list({ cursor });
  for(const { name } of result.keys) {
    ips.add(await env.KV.get(name));
  }
  if(result.list_complete) {
    break;
  }
  cursor = result.cursor;
}
console.log(Array.from(ips.values()));

const ips = new Set();
let cursor = undefined;
while(true) {
  const result = await env.KV.list({ cursor });
  for(const { name } of result.keys) {
    ips.add(await env.KV.get(name));
  }
  if(result.list_complete) {
    break;
  }
  cursor = result.cursor;
}
console.log(Array.from(ips.values()));

const ips = new Set();
let cursor = undefined;
while(true) {
  const result = await env.KV.list({ cursor });
  for(const { name } of result.keys) {
    ips.add(await env.KV.get(name));
  }
  if(result.list_complete) {
    break;
  }
  cursor = result.cursor;
}
console.log(Array.from(ips.values()));

L

lokiwind•5/23/23, 6:10 PM

@onur1881 kanka @chaika.me sana bu arkadaş yardım eder

L

lokiwind•5/23/23, 6:11 PM

@HardAtWork Thank you. I'll try and let you know, brother.

OOnur en iyisi mailden devam edeyim burda kimse tcp application için cf kullanmıyor an...

L

lokiwind•5/23/23, 6:12 PM

Vardır da geç cevap alırsın konuyu forumda açmayı denesene bir de https://community.cloudflare.com/

Cloudflare Community

A place for Cloudflare users to engage with each other and with Cloudflare staff

OOnur i have a demo but it seems doesnt support this feature just want to know is ther...

C

Chaika•5/23/23, 6:15 PM

You've got Edge TLS Termination on, I assume? If with that on, it doesn't do it, I don't know of any other hidden setting for it, and there's nothing in the documentation about it. If you need this feature and you are Enterprise I would reach out to your customer success manager.

OOnur en iyisi mailden devam edeyim burda kimse tcp application için cf kullanmıyor an...

C

Chaika•5/23/23, 6:15 PM

Arbitrary TCP is Enterprise only, not many people in here will have experience with it

J

justaname•5/23/23, 7:33 PM

i missed the Wrangler v3 Demo is there a place i can watch it

D

DaniFoldi•5/23/23, 7:43 PM

a voice recording was made, let me ask if it'll get posted somewhere

D

dave•5/23/23, 7:44 PM

Is there an HTTP header that I can use to tell browsers that they shouldn't be requesting the resource, ever?

I was thinking of adding:

Access-Control-Allow-Origin: asdf.invalid

Access-Control-Allow-Origin: asdf.invalid

Since

.invalid

.invalid

is promised to not exist, right?

You should be able to get them all, even if they are registered in multiple ways?

Similar Threads