Basically, I aggregate product data from different providers.
As the descriptions are often in different languages, they are run through the Deepl API again and are to be written to a database.
And a few more preprocessing steps to check how reputable the provider is...
And the product images are uploaded to a blob storage or CDN to avoid relying on the provider's image service
In the end, this data should be displayed on a website where you can view and compare the active products.
Basically, a user will not be able to retrieve large amounts of data in one go. However, I would like to keep every single data record with very good performance.
A search function is also planned, but not necessarily the most important thing.
I have already tried it with Meilisearch, but I had problems searching for a single ID, which is sometimes useful for my use case.