problem timeout nginx + plguin lua
Hello! I'm getting LAPI timeouts in my Kubernetes setup.
Error:
live_query(): ... timeout
Troubleshooting done:
- Network is OK: curl from Nginx pod to LAPI's /health endpoint works fine.
- Resources Increased: LAPI pod has 500m CPU / 500Mi Memory.
My analysis points to a performance bottleneck. My Helm values show the LAPI is using the default SQLite database on a Persistent Volume with storageClassName: "nfs-storage".
I believe the timeouts are caused by running SQLite over NFS, which is known to be slow.
Question: Can you confirm this is the likely cause? What is the recommended fix for production on k8s: switching to a fast SSD-based StorageClass for SQLite, or migrating to an external PostgreSQL/MySQL database? Thanks!2 Replies
Important Information
Thank you for getting in touch with your support request. To expedite a swift resolution, could you kindly provide the following information? Rest assured, we will respond promptly, and we greatly appreciate your patience. While you wait, please check the links below to see if this issue has been previously addressed. If you have managed to resolve it, please use run the command
/resolve or press the green resolve button below.Log Files
If you possess any log files that you believe could be beneficial, please include them at this time. By default, CrowdSec logs to /var/log/, where you will discover a corresponding log file for each component.
Guide Followed (CrowdSec Official)
If you have diligently followed one of our guides and hit a roadblock, please share the guide with us. This will help us assess if any adjustments are necessary to assist you further.
Screenshots
Please forward any screenshots depicting errors you encounter. Your visuals will provide us with a clear view of the issues you are facing.
© Created By WhyAydan for CrowdSec ❤️
I'd recommend moving to an external database.
sqlite is used by default for convenience, but in k8s, it's almost never a good idea (to such a point, I'm thinking about forcing usage of an external database when running in k8s)