how to cache d1 requests? - Cloudflare Developers

© 2026 Hedgehog Software, LLC

More

Communities Docs About Terms Privacy

JoeDoe

J

JoeDoeOP•6/10/24, 6:42 PM

I'm using workers for a web api, but I need simple data like total users to be cached for like 60seconds or similiar

JoeDoe

JJoeDoe how to cache d1 requests?

Unsmart

U

Unsmart•6/10/24, 6:57 PM

the cache api https://developers.cloudflare.com/workers/runtime-apis/cache/

Unsmart

UUnsmart the cache api <https://developers.cloudflare.com/workers/runtime-apis/cache/>

JoeDoe

J

JoeDoeOP•6/10/24, 7:05 PM

is there some good examples on how to use this with workers?

JoeDoe

JJoeDoe is there some good examples on how to use this with workers?

Max (@rozenmd)

M

Max (@rozenmd)•6/10/24, 7:14 PM

https://developers.cloudflare.com/workers/examples/cache-api/

Cloudflare Docs

Using the Cache API · Cloudflare Workers docs

Documentation for Cloudflare Workers, a serverless execution environment that allows you to create entirely new applications or augment existing ones …

Using the Cache API · Cloudflare Workers docs

JoeDoe

J

JoeDoeOP•6/10/24, 7:21 PM

hmmmmm interesting thank you

maj

M

maj•6/10/24, 10:45 PM

FWIW: I'm using KV to cache some query results I'd like to share across requests. The Cache API would only cache the result of HTTP requests, wouldn't it?

Unsmart

U

Unsmart•6/10/24, 11:06 PM

The cache api can cache anything... normal http requests you can cache with just the fetch api

maj

M

maj•6/11/24, 4:45 AM

Maybe I'm missing the obvious, but you have to pass it a response object, with caching headers set etc. How would I define the expiration if I wanted to cache a random blob?

maj

M

maj•6/11/24, 4:46 AM

From https://developers.cloudflare.com/workers/reference/how-the-cache-works/#cache-api:

The Cache API can be thought of as an ephemeral key-value store, whereby the Request object (or more specifically, the request URL) is the key, and the Response is the value.

Cloudflare Docs

How the Cache works · Cloudflare Workers docs

How Workers interacts with the Cloudflare cache.

How the Cache works · Cloudflare Workers docs

maj

Mmaj From https://developers.cloudflare.com/workers/reference/how-the-cache-works/#ca...

Max (@rozenmd)

M

Max (@rozenmd)•6/11/24, 7:21 AM

make a new Response, put your blob in the body

Max (@rozenmd)

MMax (@rozenmd)make a new Response, put your blob in the body

maj

M

maj•6/11/24, 7:30 AM

My comment was in response to use @Unsmart | Tech debt claiming that the Cache API could cache anything. But you basically confirm that I can't cache the blob alone (because I want to reuse it in other handlers), don't you? Using the Cache API I can only cache the full response?

maj

Mmaj My comment was in response to use @Unsmart | Tech debt claiming that the Cache A...

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 7:39 AM

Well no? You create a new, completely separate Response, that is just the blob+cache headers. That Response is never served to the client, it is just used to interact with the Cache API

Hello, I’m Allie!

HHello, I’m Allie!Well no? You create a new, completely separate Response, that is just the blob+c...

maj

M

maj•6/11/24, 9:15 AM

It's not a general purpose cache, is it? It's based on HTTP requests and responses. Even if you provide a random string as the cache key "it is interpreted as the URL for a new Request object." (https://developers.cloudflare.com/workers/runtime-apis/cache/). So in order to cache the raw result of a d1 query I'd have to wrap and unwrap the result. This only adds complexity and overhead, and still doesn't provide a global cache like using KV does. The original question was "how to cache d1 requests?". Not "how to cache http requests".

maj

Mmaj It's not a general purpose cache, is it? It's based on HTTP requests and respons...

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:19 AM

Well, yeah, it isn't a perfect system, but it is the best option to do it for free. You can use KV/DOs/an external service like Redis, but that would be at cost to you

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:19 AM

And it not being a "general-purpose" cache isn't much of an issue. Open a custom cache that you reserve for D1 Caching, then use bogus URLs

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:20 AM

It won't be cached in more than one datacenter, but it is better than no cache at all

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:24 AM

Though it would be cool to have an arbitrary-object cache that didn't require wrapping stuff in a Request/Response, especially if it could auto-serialize values like DO storage can

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:24 AM

Since that is one thing that you can't do manually unless you bring a serializer yourself(which is kind of heavy-handed)

Max (@rozenmd)

M

Max (@rozenmd)•6/11/24, 9:32 AM

you could also write an abstraction on top of the cache api so it'd just be .get(key).get(key) and .put(key,value).put(key,value)

Max (@rozenmd)

MMax (@rozenmd)you could also write an abstraction on top of the cache api so it'd just be `.ge...

Hello, I’m Allie!

H

Hello, I’m Allie!•6/11/24, 9:34 AM

That too

Hello, I’m Allie!

HHello, I’m Allie!Well, yeah, it isn't a perfect system, but it is the best option to do it for fr...

maj

M

maj•6/11/24, 11:32 AM

Yeah, cost. I'm still being cheap, using the free plan to the extreme

. So in my case using KV is more cost effective than running the query on each request, as I easily cross the threshold for daily rows read by running that one query a few times... but I don't need up to date data all the time. Running it twice a day and otherwise read from KV is the most cost effective solution for me, as it's few reads (a few hundred per day) but lots of rows (1.6M per request).

kian

K

kian•6/12/24, 7:52 AM

Run EXPLAIN QUERY PLAN SELECT * FROM objects WHERE object = '${key}'EXPLAIN QUERY PLAN SELECT * FROM objects WHERE object = '${key}' and it'll tell you what it's doing

peshakoo

Ppeshakoo that answers my first question, thanks. Secondly, if I do something like `SELECT...

Max (@rozenmd)

M

Max (@rozenmd)•6/12/24, 10:56 AM

but generally yes, if the rows_read and rows_written are 0 (might be a bug), you're not getting billed for that query

Max (@rozenmd)

M

Max (@rozenmd)•6/13/24, 1:08 PM

You can now delete multiple rows at a time in the D1 UI btw

Max (@rozenmd)

MMax (@rozenmd)You can now delete multiple rows at a time in the D1 UI btw

Max (@rozenmd)

M

Max (@rozenmd)•6/13/24, 1:09 PM

also when you modify records, the back/cancel buttons now take you back to the page you were just on

Disciple of Caoximeihao

D

Disciple of Caoximeihao•6/14/24, 9:12 AM

help

Disciple of Caoximeihao

D

Disciple of Caoximeihao•6/14/24, 9:12 AM

Disciple of Caoximeihao

D

Disciple of Caoximeihao•6/14/24, 9:12 AM

d1 error in hono insert data

Disciple of Caoximeihao

DDisciple of Caoximeihao Click to see attachment

Max (@rozenmd)

M

Max (@rozenmd)•6/14/24, 10:49 AM

post your query

Hannes

H

Hannes•6/14/24, 3:04 PM

Hi, I have a very strange behaviour I don't really understand.
When I run a migration adding a column in Table A (by deferring foreign keys ON, creating a new table, copying all data, deleting the old table, renaming the new table to the name of the old table and setting defer foreign keys OFF), all relations of table B to table A (with the id of A in table B) are now

null

null

...
How can I work around this? The migration is generated by Prisma and looks like this:

-- RedefineTables
PRAGMA defer_foreign_keys=ON;
CREATE TABLE "new_Product" (
    "id" TEXT NOT NULL PRIMARY KEY,
    "createdAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
    "updatedAt" DATETIME NOT NULL,
    "name" TEXT NOT NULL,
    "description" TEXT,
    ...some more rows
    CONSTRAINT "Product_eventId_fkey" FOREIGN KEY ("eventId") REFERENCES "Event" ("id") ON DELETE RESTRICT ON UPDATE CASCADE,
    CONSTRAINT "Product_totalCapacityId_fkey" FOREIGN KEY ("totalCapacityId") REFERENCES "Capacity" ("id") ON DELETE SET NULL ON UPDATE CASCADE
);
INSERT INTO "new_Product" ("createdAt", "description", "id", "name", "updatedAt", ...) SELECT "createdAt", "description", "id", "name", "updatedAt", ... FROM "Product";
DROP TABLE "Product";
ALTER TABLE "new_Product" RENAME TO "Product";
PRAGMA foreign_key_check("Product");
PRAGMA defer_foreign_keys=OFF;

-- RedefineTables
PRAGMA defer_foreign_keys=ON;
CREATE TABLE "new_Product" (
    "id" TEXT NOT NULL PRIMARY KEY,
    "createdAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
    "updatedAt" DATETIME NOT NULL,
    "name" TEXT NOT NULL,
    "description" TEXT,
    ...some more rows
    CONSTRAINT "Product_eventId_fkey" FOREIGN KEY ("eventId") REFERENCES "Event" ("id") ON DELETE RESTRICT ON UPDATE CASCADE,
    CONSTRAINT "Product_totalCapacityId_fkey" FOREIGN KEY ("totalCapacityId") REFERENCES "Capacity" ("id") ON DELETE SET NULL ON UPDATE CASCADE
);
INSERT INTO "new_Product" ("createdAt", "description", "id", "name", "updatedAt", ...) SELECT "createdAt", "description", "id", "name", "updatedAt", ... FROM "Product";
DROP TABLE "Product";
ALTER TABLE "new_Product" RENAME TO "Product";
PRAGMA foreign_key_check("Product");
PRAGMA defer_foreign_keys=OFF;

Any idea? Thanks in advance

Hannes

HHannes Hi, I have a very strange behaviour I don't really understand. When I run a migr...

Hannes

H

Hannes•6/14/24, 3:08 PM

Oh - probably this is due a ON DELETE SET NULL. Is there a way to work around that in the migration?
However, I wonder if that is the expected behaviour...

SonyC

S

SonyC•6/14/24, 4:05 PM

hey guys, good day to all, I'm trying to alter a table and modify a table row like this:

wrangler d1 execute db-name --command "ALTER TABLE items MODIFY COLUMN user_id INT NOT NULL;"

wrangler d1 execute db-name --command "ALTER TABLE items MODIFY COLUMN user_id INT NOT NULL;"

but I'm getting a syntax error so I asume MODIFY is not supported, HELP!

kian

K

kian•6/14/24, 4:25 PM

D1 is SQLite which doesn't have MODIFYMODIFY - https://www.sqlite.org/lang_altertable.html

SonyC

S

SonyC•6/14/24, 4:39 PM

ty!

Hannes

HHannes Oh - probably this is due a ON DELETE SET NULL. Is there a way to work around th...

Hannes

H

Hannes•6/14/24, 7:26 PM

Actually, it seems like D1 behaves different here than SQLite. In SQLite, those actions are not triggered when using PRAGMA foreign_keys=OFF;PRAGMA foreign_keys=OFF;. In D1, however, with PRAGMA defer_foreign_keys=ON;PRAGMA defer_foreign_keys=ON;, the referential actions still run. That happens in Miniflare and in remote D1...

Hannes

HHannes Actually, it seems like D1 behaves different here than SQLite. In SQLite, those ...

Hannes

H

Hannes•6/14/24, 7:48 PM

Here's a minimal reproduction: https://github.com/hrueger/prisma-24540 (not really prisma specific).

GitHub

GitHub - hrueger/prisma-24540

Contribute to hrueger/prisma-24540 development by creating an account on GitHub.

GitHub - hrueger/prisma-24540

Hannes

HHannes Here's a minimal reproduction: https://github.com/hrueger/prisma-24540 (not real...

Hannes

H

Hannes•6/14/24, 8:10 PM

For completeness: I just found the GitHub Issue of that bug: https://github.com/cloudflare/workers-sdk/issues/5438
I'd love to see this fixed, I almost lost staging (luckily not productiond) data due to this today.

GitHub

🚀 Feature Request: Allow turning off foreign key check while migrat...

Some table altering tasks in SQLite cannot be achieved without replacing it with a new table (by dropping - recreating the table) (like adding foreign keys, changing primary keys, updating column t...

🚀 Feature Request: Allow turning off foreign key check while migrat...

Zillo Beast

Z

Zillo Beast•6/15/24, 5:32 AM

I created a simple library for D1 in python ... https://github.com/Suleman-Elahi/D1py

GitHub

GitHub - Suleman-Elahi/D1py: A very simple wrapper for Cloudflare D...

A very simple wrapper for Cloudflare D1 Databases' REST API in using Python for Python xD - Suleman-Elahi/D1py

GitHub - Suleman-Elahi/D1py: A very simple wrapper for Cloudflare D...

Nob

N

Nob•6/15/24, 7:04 PM

Hi it seem like there is a small mistake with "Databas"

Walshy

W

Walshy•6/15/24, 7:13 PM

got a fix up: https://github.com/cloudflare/workers-sdk/pull/6062

Walshy

WWalshy got a fix up: <https://github.com/cloudflare/workers-sdk/pull/6062>

Nob

N

Nob•6/15/24, 7:23 PM

is d1 replicated yet ?

Nob

N

Nob•6/15/24, 7:23 PM

or its still one single primary db atm

Nob

NNob or its still one single primary db atm

Hello, I’m Allie!

H

Hello, I’m Allie!•6/15/24, 7:31 PM

One DB Instance

notjoemartinez

N

notjoemartinez•6/15/24, 10:02 PM

I'm having trouble understanding my d1 bill. If it's a formatting problem and the number is 55,835,335.9555,835,335.95 or 558,353,359.5558,353,359.5 how do I read a fraction of a row? Also if first 25 billion included rows is included is the real number 25 billion25 billion + 55,835,335.9555,835,335.95 ? What's the number under the 55,835,335,9555,835,335,95 , does that mean I uses 55,835,335,95 x 355,835,335,95 x 3 ?

-- RedefineTables
PRAGMA defer_foreign_keys=ON;
CREATE TABLE "new_Product" (
    "id" TEXT NOT NULL PRIMARY KEY,
    "createdAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
    "updatedAt" DATETIME NOT NULL,
    "name" TEXT NOT NULL,
    "description" TEXT,
    ...some more rows
    CONSTRAINT "Product_eventId_fkey" FOREIGN KEY ("eventId") REFERENCES "Event" ("id") ON DELETE RESTRICT ON UPDATE CASCADE,
    CONSTRAINT "Product_totalCapacityId_fkey" FOREIGN KEY ("totalCapacityId") REFERENCES "Capacity" ("id") ON DELETE SET NULL ON UPDATE CASCADE
);
INSERT INTO "new_Product" ("createdAt", "description", "id", "name", "updatedAt", ...) SELECT "createdAt", "description", "id", "name", "updatedAt", ... FROM "Product";
DROP TABLE "Product";
ALTER TABLE "new_Product" RENAME TO "Product";
PRAGMA foreign_key_check("Product");
PRAGMA defer_foreign_keys=OFF;

-- RedefineTables
PRAGMA defer_foreign_keys=ON;
CREATE TABLE "new_Product" (
    "id" TEXT NOT NULL PRIMARY KEY,
    "createdAt" DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
    "updatedAt" DATETIME NOT NULL,
    "name" TEXT NOT NULL,
    "description" TEXT,
    ...some more rows
    CONSTRAINT "Product_eventId_fkey" FOREIGN KEY ("eventId") REFERENCES "Event" ("id") ON DELETE RESTRICT ON UPDATE CASCADE,
    CONSTRAINT "Product_totalCapacityId_fkey" FOREIGN KEY ("totalCapacityId") REFERENCES "Capacity" ("id") ON DELETE SET NULL ON UPDATE CASCADE
);
INSERT INTO "new_Product" ("createdAt", "description", "id", "name", "updatedAt", ...) SELECT "createdAt", "description", "id", "name", "updatedAt", ... FROM "Product";
DROP TABLE "Product";
ALTER TABLE "new_Product" RENAME TO "Product";
PRAGMA foreign_key_check("Product");
PRAGMA defer_foreign_keys=OFF;