You've reached 100% of your monthly storage limit.
Good day everyone. I have reached 100% of my monthly storage limit. I was busy migrating my database from MongoDB to Neon and was running several Python scripts on the data to make sure that all the data gets to its new home in the desired format; thus I was running the psql command in my terminal often to copy the data over to Neon once a new variation of my Python script was done executing...
When it seemed like I finally worked out all the kinks in my Python script I got "ERROR: could not extend file because project size limit (512 MB) has been exceeded" and was not able to successfully import any of my data from the CSV.
The Neon database as is has hardly anything on it and the history setting is set to only retain the history for 1 hour.
I am feeling puzzled as to what these errors mean or where they come form?
Am I correct in assuming that this limitation is more with regards to the size of all the data that I have transferred in and out of the database this month rather than the database itself? AND if so, does that mean that if I wait until 1 September that I will be able to run my psql copy command again to import my CSV data successfully then?
Thank you very much!
13 Replies
passive-yellow•15mo ago
I've been using neon for a few months and experienced (what sounds like) the same issue today for the first time - posted here:
https://discord.com/channels/1176467419317940276/1276195810983284778/1276195810983284778
I hope this issue gets some visibility and is resolved soon.
fair-rose•15mo ago
Hey! Do you mind DM-ming me your project ID?
You either ran into a storage or a data transfer limit
Do you mind also sharing a screenshot of the Neon console where it shows the storage size?
equal-aquaOP•15mo ago
Hey Mahmoud! I'm not quite sure what happened, but I reformatted my data and copied it over from my CSV to my Neon table again and this time it copied over successfully. When I wanted to copy over everything into my dev database I got the 512 max error, but that I can understand as it is quite a large file with many rows. So I have now successfully transferred my data over over into the table after refactoring the CSV file and reached the project storage size limit. All is clear and makes sense now. I assume my CSV had some strange formatting in it as I tried uploading it to MongoDB and got the same initial errors before refactoring it.
I am thus now sorted. Thank you very much for the support. 🙏🏼 🙏🏼
fair-rose•15mo ago
Glad to hear that this issue is resolved!
Feel free to reach out if you have any questions or run into any issues 😄
equal-aquaOP•15mo ago
Dear Mahmoud. I see that my project is using more than 0.5Gig storage and that I have thus reached my limit. The banner at the top of my dashboard says that I reached my monthly limit, but I assume it is the overall project limit as that is how I interpret the free tier. I have now dropped half the rows of my biggest table and expected the storage amount to change significantly after doing that, but it seems that nothing has happened. I am now unable to proceed with any development as my queries are failing. Do you have any advice for my please? 🙏🏼
graceful-blue•15mo ago
@Elzabé Els , Can you vacuum your table ?
VACUUM table_name;
Also, Can you set yourl History retention to 0 if you don't need it ?
To set it to 0 , Go to Settings -> Storage -> History retention and set it to 0equal-aquaOP•15mo ago
Thank you for your response. I have now vacuumed my tables, but there has been no change to the storage usage.
I have tried this a few times, but it also does not seem to make a difference. 🤔
graceful-blue•15mo ago
@Elzabé Els , Vacuuming table and history retention to
0 will always fix it
Also, After vacuuming you need to wait around an hour or three before space gets recoveredequal-aquaOP•15mo ago
I will wait and see. Thank you very much!
fair-rose•15mo ago
Hey @Elzabé Els, did your issue get resolved?
equal-aquaOP•15mo ago
Hey @Mahmoud no it has not. I have vacuumed and set saving the history to 0 (it just jumps back to 1 if I do that), but the amount of storage I'm using has stayed exactly the same even after I dropped half of my rows.
fair-rose•15mo ago
Do you mind sharing your Project ID? You can find it in your project settings
equal-aquaOP•15mo ago
fragrant-resonance-87196081 Thank you!!