1.9.2 - Indexing and Search Performance ContentBrowser
In general I really like Dash and the features it provides. One of the most important feature for me is the ContentBowser because I have many assets and many projects. For quick prototyping and world building I wanted to rely on the ContentBrowser to get all assets I need from my other projects and one library project I set up, that contains only assets. Sadly (even with AI feature disabled) computing new assets and searching for assets is too slow (depending on asset types i t can take seveeal minutes fornonly ~100) items. I'm wondering which information is stored and computed for each asset to take such a long time? I have around 50k-55k assets - if I open my library project (which contains 47.000) and then open Dash it needs ~15 minutes to even initialize all the already indexed items. Searching in this project via Dash also takes ~1 minute. Like that it's really unusble for me 🙁 As a PoC I set up a simply RocksDB where I added all my assets with basic information like name, UserAssetData, Path and Type. Indexing all items (60k, because I include types that Dash doesn't include) with these information takes less then 30 seconds. Searching for e. g. a name takes less then 1second. That's why I'm wondering what kind of backend dash is using to index the data and look up items and if there is anything planned to optimize/change that?
2 Replies
Hey!
Thanks for sharing your experience🙌
Let me try and adress your questions:
1. Indeed it can be quite slow for complex assets. And I would assume, at least one part of why it is slow for more complex assets is that we are generating thumbnails. But if you want more details on the data that is generated you can check the metadata storage folder of course.
2. When you say initialize, do you mean after you open the Content Browser and have the assets/thumbnails load in? And yeah you are defintely pushing the system/CB to its limits and we are aware if these limits. We got some plans to try and improve the performance a lot in the future. But no timeline yet unfortunately.
So sadly right now, I don't have much tips for you how to improve your performance. But I am linking to this thread in our to-do list item of improving the CB performance!
Improving search speed in our asap list 👍🏽 You can expect massive improvements in search in 1-2 releases. I hope we will be able to pack in next release