N
Neon•2y ago
stormy-gold

Issue with Cyrillic Search Using pg_trgm on Neon.tech

Hello everyone, I'm encountering an issue with searching Cyrillic text in a table on Neon.tech. Searching for the substance name Глицерин (Glycerin) using Latin letters works fine both locally on my Postgres database and in the Neon SQL Editor. However, when I attempt to search using Cyrillic letters, I get perfect results on my Postgres, but no results on Neon. Below are the queries for both search attempts: Search using Latin letters (works): 
SELECT 
    handy_tools_substance.name AS substance_name,
    SIMILARITY(handy_tools_substance.name, 'glycerin') AS name_similarity,
    SIMILARITY(handy_tools_substance.description, 'glycerin') AS description_similarity
FROM 
    handy_tools_substance
WHERE 
    (SIMILARITY(handy_tools_substance.name, 'glycerin') + SIMILARITY(handy_tools_substance.description, 'glycerin')) > 0.3
LIMIT 1;
SELECT 
    handy_tools_substance.name AS substance_name,
    SIMILARITY(handy_tools_substance.name, 'glycerin') AS name_similarity,
    SIMILARITY(handy_tools_substance.description, 'glycerin') AS description_similarity
FROM 
    handy_tools_substance
WHERE 
    (SIMILARITY(handy_tools_substance.name, 'glycerin') + SIMILARITY(handy_tools_substance.description, 'glycerin')) > 0.3
LIMIT 1;
Search using Cyrillic letters (Query completed with no result.): 
SELECT 
    handy_tools_substance.name AS substance_name,
    SIMILARITY(handy_tools_substance.name, 'глицерин') AS name_similarity,
    SIMILARITY(handy_tools_substance.description, 'глицерин') AS description_similarity
FROM 
    handy_tools_substance
WHERE 
    (SIMILARITY(handy_tools_substance.name, 'глицерин') + SIMILARITY(handy_tools_substance.description, 'глицерин')) > 0.3
LIMIT 1;
SELECT 
    handy_tools_substance.name AS substance_name,
    SIMILARITY(handy_tools_substance.name, 'глицерин') AS name_similarity,
    SIMILARITY(handy_tools_substance.description, 'глицерин') AS description_similarity
FROM 
    handy_tools_substance
WHERE 
    (SIMILARITY(handy_tools_substance.name, 'глицерин') + SIMILARITY(handy_tools_substance.description, 'глицерин')) > 0.3
LIMIT 1;
This leads me to suspect that pg_trgm on Neon might not fully support Cyrillic characters. Has anyone encountered a similar issue, or does anyone have insights on whether pg_trgm supports Cyrillic characters on Neon? Any advice on how to ensure Cyrillic searches return the expected results would be greatly appreciated!
0 Replies
No replies yetBe the first to reply to this messageJoin

Did you find this page helpful?