Pod 100% Mem usage freeze
Building wheels for collected packages: flash-attn
Building wheel for flash-attn (setup.py) ... \
Gets stuck on the above when trying to run:
pip install flash-attn==2.8.0.post2 --no-build-isolation
Memory usage and CPU at 100% and following in system log:
WARN: container is unhealthy: triggered memory limits (OOM)
WARN: very high memory utilization: 57.74GiB / 57.74GiB (100 %)
Building wheel for flash-attn (setup.py) ... \
Gets stuck on the above when trying to run:
pip install flash-attn==2.8.0.post2 --no-build-isolation
Memory usage and CPU at 100% and following in system log:
WARN: container is unhealthy: triggered memory limits (OOM)
WARN: very high memory utilization: 57.74GiB / 57.74GiB (100 %)