6 replies

Wrapper cache misses

Help: Zero Cache Hits – Hyperdrive Queries Bypassing Cache Straight to DB!

Hey team, I'm scratching my head over this caching mystery. Every query skips the cache and hits my Postgres DB directly (running on a Hetzner VPS), resulting in 0 cache hits for weeks. No performance magic happening here!

Quick Context:

- Using Hyperdrive for connection pooling.
- Drizzle queries are wrapped in a custom runWithDB function (code below). Reason: Prevent CF Workers from opening too many connections
- Is this wrapper the culprit? If so, what's the fix to enable proper caching?
The Suspect Code: runWithDB Function

    export async function runWithDB<T>(
      context: unstable_RouterContextProvider,
      callback: (db: PostgresJsDatabase) => Promise<T>
    ): Promise<T> {
      const { HYPERDRIVE } = getBindings(context);
    
      const sql = postgres(HYPERDRIVE.connectionString, {
        prepare: false,
        max: 5,
        fetch_types: false,
        idle_timeout: 5,
        connect_timeout: 5,
        max_lifetime: 60,
      });
    
      try {
        const db = drizzlePostgresJs(sql);
    
        const result = await callback(db);
    
        return result;
      } catch (err) {
        console.log('err', err);
        throw err;
      } finally {
        const ctx = await getExecutionContext(context);
        ctx.waitUntil(sql.end());
      }
    }

    export async function runWithDB<T>(
      context: unstable_RouterContextProvider,
      callback: (db: PostgresJsDatabase) => Promise<T>
    ): Promise<T> {
      const { HYPERDRIVE } = getBindings(context);
    
      const sql = postgres(HYPERDRIVE.connectionString, {
        prepare: false,
        max: 5,
        fetch_types: false,
        idle_timeout: 5,
        connect_timeout: 5,
        max_lifetime: 60,
      });
    
      try {
        const db = drizzlePostgresJs(sql);
    
        const result = await callback(db);
    
        return result;
      } catch (err) {
        console.log('err', err);
        throw err;
      } finally {
        const ctx = await getExecutionContext(context);
        ctx.waitUntil(sql.end());
      }
    }

How I Use It (Example Query):

    export const getUserByEmailAddress = async (
      email: string,
      context: unstable_RouterContextProvider
    ) => {
      const [user] = await runWithDB(context, async (db: PostgresJsDatabase) => {
        return await db
          .select()
          .from(UserTable)
          .where(eq(UserTable.email, email))
          .limit(1);
      });
    
      return user;
    };

    export const getUserByEmailAddress = async (
      email: string,
      context: unstable_RouterContextProvider
    ) => {
      const [user] = await runWithDB(context, async (db: PostgresJsDatabase) => {
        return await db
          .select()
          .from(UserTable)
          .where(eq(UserTable.email, email))
          .limit(1);
      });
    
      return user;
    };

Any insights or tweaks to get those cache hits working again? Thanks a ton!

Cloudflare Developers•7mo ago•

6 replies

bloushi

Wrapper cache misses

    export async function runWithDB<T>(
      context: unstable_RouterContextProvider,
      callback: (db: PostgresJsDatabase) => Promise<T>
    ): Promise<T> {
      const { HYPERDRIVE } = getBindings(context);
    
      const sql = postgres(HYPERDRIVE.connectionString, {
        prepare: false,
        max: 5,
        fetch_types: false,
        idle_timeout: 5,
        connect_timeout: 5,
        max_lifetime: 60,
      });
    
      try {
        const db = drizzlePostgresJs(sql);
    
        const result = await callback(db);
    
        return result;
      } catch (err) {
        console.log('err', err);
        throw err;
      } finally {
        const ctx = await getExecutionContext(context);
        ctx.waitUntil(sql.end());
      }
    }

    export async function runWithDB<T>(
      context: unstable_RouterContextProvider,
      callback: (db: PostgresJsDatabase) => Promise<T>
    ): Promise<T> {
      const { HYPERDRIVE } = getBindings(context);
    
      const sql = postgres(HYPERDRIVE.connectionString, {
        prepare: false,
        max: 5,
        fetch_types: false,
        idle_timeout: 5,
        connect_timeout: 5,
        max_lifetime: 60,
      });
    
      try {
        const db = drizzlePostgresJs(sql);
    
        const result = await callback(db);
    
        return result;
      } catch (err) {
        console.log('err', err);
        throw err;
      } finally {
        const ctx = await getExecutionContext(context);
        ctx.waitUntil(sql.end());
      }
    }

How I Use It (Example Query):

    export const getUserByEmailAddress = async (
      email: string,
      context: unstable_RouterContextProvider
    ) => {
      const [user] = await runWithDB(context, async (db: PostgresJsDatabase) => {
        return await db
          .select()
          .from(UserTable)
          .where(eq(UserTable.email, email))
          .limit(1);
      });
    
      return user;
    };

    export const getUserByEmailAddress = async (
      email: string,
      context: unstable_RouterContextProvider
    ) => {
      const [user] = await runWithDB(context, async (db: PostgresJsDatabase) => {
        return await db
          .select()
          .from(UserTable)
          .where(eq(UserTable.email, email))
          .limit(1);
      });
    
      return user;
    };

Any insights or tweaks to get those cache hits working again? Thanks a ton!

Wrapper cache misses

Similar Threads

Wrapper cache misses

Similar Threads

Similar Threads

Similar Threads