Support for PostgresML on GPUs?
Hi, do you have plans to support https://github.com/postgresml/postgresml and be able to run on machines with GPU?
GitHub
GitHub - postgresml/postgresml: The GPU-powered AI application data...
The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models. - postgresml/postgresml
2 Replies
rising-crimson•2y ago
Hey, I had a PoC with a compiled extension (https://github.com/neondatabase/neon/pull/4835), but it blew up compute storage. Therefore, we put it on pause.
Regarding running Neon on GPU – we didn't have such plans. Currently, we're focusing on x86-64 CPUs because of the virtualization we implemented and autoscaling. Autoscaling doesn't work with ARM, btw, because Linux doesn't support hot-plug for ARM CPUs 😦
extended-salmonOP•2y ago
OK thanks for the explanation.