Very slow external connections to PostgreSQL

Hi,
Starting of today it takes forever to connect to my DB using PGadmin or any other way which is not the build it "SQL Editor".
This already happened once, a several days ago, and after several hours was back to normal.
Why does this happen? and how can it be fixed ?