AE isn't in local currently, no

V

Victor•6/17/23, 1:05 AM

It worked earlier exactly 1 time (there are 2 instances where it should drop data points), and never worked again

UUnsmart If you run --remote does it work?

V

Victor•6/17/23, 1:07 AM

D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:30632
            throw a;
            ^

Error: WebSocket was closed before the connection was established
    at WebSocket2.close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108484:11)
    at close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127164:14)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127272:7
    at jh (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29688:15)
    at exports2.unstable_runWithPriority (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25660:16)
    at Pc (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:26308:16)
    at Qg (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29651:18)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29640:13
    at V (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25585:22)
    at Timeout.w [as _onTimeout] (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25420:13)
Emitted 'error' event on WebSocket instance at:
    at emitErrorAndClose (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108931:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:30632
            throw a;
            ^

Error: WebSocket was closed before the connection was established
    at WebSocket2.close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108484:11)
    at close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127164:14)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127272:7
    at jh (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29688:15)
    at exports2.unstable_runWithPriority (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25660:16)
    at Pc (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:26308:16)
    at Qg (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29651:18)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29640:13
    at V (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25585:22)
    at Timeout.w [as _onTimeout] (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25420:13)
Emitted 'error' event on WebSocket instance at:
    at emitErrorAndClose (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108931:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:30632
            throw a;
            ^

Error: WebSocket was closed before the connection was established
    at WebSocket2.close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108484:11)
    at close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127164:14)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127272:7
    at jh (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29688:15)
    at exports2.unstable_runWithPriority (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25660:16)
    at Pc (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:26308:16)
    at Qg (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29651:18)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29640:13
    at V (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25585:22)
    at Timeout.w [as _onTimeout] (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25420:13)
Emitted 'error' event on WebSocket instance at:
    at emitErrorAndClose (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108931:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:30632
            throw a;
            ^

Error: WebSocket was closed before the connection was established
    at WebSocket2.close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108484:11)
    at close (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127164:14)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:127272:7
    at jh (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29688:15)
    at exports2.unstable_runWithPriority (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25660:16)
    at Pc (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:26308:16)
    at Qg (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29651:18)
    at D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:29640:13
    at V (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25585:22)
    at Timeout.w [as _onTimeout] (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:25420:13)
Emitted 'error' event on WebSocket instance at:
    at emitErrorAndClose (D:\GitHub\chainfuse-api\node_modules\wrangler\wrangler-dist\cli.js:108931:17)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)

Kkian AE isn't in local currently, no

V

Victor•6/17/23, 1:11 AM

It seems to work when fully published. Weird why it worked once locally

K

kianOP•6/17/23, 1:11 AM

It probably works with

wrangler dev --remote

wrangler dev --remote

K

kianOP•6/17/23, 1:12 AM

Just not normal

dev

dev

which uses #workerd

V

Victor•6/17/23, 1:12 AM

But I can't even get

--remote

--remote

to start up

U

Unsmart•6/17/23, 1:23 AM

The limit is increased but not updated on the docs assuming the docs still say that

U

Unsmart•6/17/23, 1:23 AM

It is 96 bytes: https://github.com/cloudflare/workerd/pull/481

GitHub

Increase Analytics Engine index byte limit 32 -> 96 by harrishancoc...

V

vassbence•6/21/23, 11:36 AM

Hi! If i want to give my users analytics like how many clicks did their website on my platform get.

Hi!

Let's say I have a website builder SaaS where users create their own site and publish them.
If I want to add an analytics feature where I track how many clicks an user's site get is this product a good fit?

I have a workers queue recieving these pageview events and now I need to figure out where to store the data from the events so that I can serve it up later on the users' dashboard.

My ideas were D1, R2 with a files for each batch that later gets combined via a cronjob or this new engine.

Which storage option would be the best for my use-case? In terms of scale and maybe even pricing?

J

JustinNoel•6/21/23, 7:35 PM

Is local development support planned for AE?

JJustinNoel Is local development support *planned* for AE?

D

DaniFoldi•6/21/23, 9:31 PM

definitely planned, there was even a PR for miniflare v2 - I haven't seen anything for v3 but I'd assume eventually they want all bindings to function locally

K

kianOP•6/21/23, 9:56 PM

there's an open PR for workerd

K

kianOP•6/21/23, 9:57 PM

so

W

Walshy•6/21/23, 10:31 PM

workerd part is only half the work though

W

Walshy•6/21/23, 10:32 PM

it can invoke a HTTP service but there still needs to be the storage part done

K

kianOP•6/21/23, 10:32 PM

always applies

J

JustinNoel•6/22/23, 9:23 PM

There's a problem with Pages -> <project_name> -> Settings -> Functions -> Analytics Engine bindings

You can't delete any existing bindings. Console shows this error.

U

Unsmart•6/22/23, 9:24 PM

pretty sure sparrow is just analytics I would look at the actual request

A

Advany•6/22/23, 9:40 PM

Will analytics engine be available in snippets?

A

Advany•6/22/23, 9:41 PM

If not, is there a other way to ingest data from clients (browsers)? That doenst involve calling a worker for each ingestion?

S

sdan•6/23/23, 9:09 PM

i parsed in json data and am getting a response via SQL as such:

"response_data": "200,[object Object]"

"response_data": "200,[object Object]"

"response_data": "200,[object Object]"

"response_data": "200,[object Object]"

with the sql query:

SELECT
    blob3 AS response_data

SELECT
    blob3 AS response_data

SELECT
    blob3 AS response_data

SELECT
    blob3 AS response_data

is there anyway to parse json in sql?

Ssdan i parsed in json data and am getting a response via SQL as such: ``` "response_d...

H

Hello, I’m Allie!•6/23/23, 9:14 PM

What are you writing in your Worker? Looks like you are trying to store an object that can’t be serealized

HHello, I’m Allie!What are you writing in your Worker? Looks like you are trying to store an objec...

S

sdan•6/23/23, 9:17 PM

[response.status, response.headers]

Ssdan [response.status, response.headers]

H

Hello, I’m Allie!•6/23/23, 9:18 PM

Try

[response.status, Object.fromEntries(response.headers.entries())]

[response.status, Object.fromEntries(response.headers.entries())]

[response.status, Object.fromEntries(response.headers.entries())]

[response.status, Object.fromEntries(response.headers.entries())]

LLiudmila Hey everyone, silly question: I'm trying to understand what is Cloudflare Analyt...

H

Hello, I’m Allie!•6/26/23, 11:47 AM

1) Yes, analytics events
2) https://clickhouse.com/
3) No
4) No
5) Basically like

console.log

console.log

a place to quickly and easily dump data to, but querying said data generally shouldn't be in the hot path of your app.

ClickHouse

Fast Open-Source OLAP DBMS - ClickHouse

ClickHouse is a fast open-source column-oriented database management system that allows generating analytical data reports in real-time using SQL queries

DDeleted User Is JDBC/ODBC on the roadmap?

J

John Spurlock•6/26/23, 4:52 PM

Have you tried https://clickhouse.com/docs/en/integrations/java ? the ClickHouse driver appears to support custom headers

Java Language Client Options for ClickHouse | ClickHouse Docs

Options for connecting to ClickHouse from Java

DDeleted User Does this work with Cloudflare AE?

J

John Spurlock•6/26/23, 9:23 PM

doesn't look like it supports custom endpoint urls - probably not usable without some kind of local proxy

B

BGwin•6/26/23, 9:59 PM

Beta 16 OS

DDeleted User I'll give it a shot later

J

John Spurlock•6/26/23, 11:05 PM

I poked around with it to see if I could get it to work given AE's constraints. Turns out there is a secret option called

web_context

web_context

web_context

web_context to set a custom endpoint path, so it kind of works. Basic sample here: https://tsplay.dev/m3Eyqw

TS Playground - An online editor for exploring TypeScript and JavaS...

The Playground lets you write TypeScript or JavaScript online in a safe and sharable way.

J

John Spurlock•6/26/23, 11:06 PM

The results are always returned in text lines though, not sure why - you get one string column called "results" for the text line, so best to use line-based formats like TSV or JSONEachRow

Similar Threads

Similar Threads

Similar Threads