Why system says I do not have enough memory?

I have an Ollama service run inside a docker compose project, when I try to use phi, ollama run phi it says:
Error: model requires more system memory (4.6 GiB) than is available (2.6 GiB)
Error: model requires more system memory (4.6 GiB) than is available (2.6 GiB)
My server has 8GB RAM, why does the systems "see" it only 2.6GB? I do not limit any resource in my project/services.
2 Replies
Flo
Flo10mo ago
check with htop if you actually have that much avialiable I assume you are already running some stuff
Sang Dang
Sang DangOP10mo ago
you're correct T_T it shows 4.9/7.5GB

Did you find this page helpful?