Uploading a large file using a HttpClient
I'm using Methanol (an extension over the standard
HttpClient) to upload a large file to a server.
When I track the file upload progress is appears to buffer 2GB at a time. This causes OOM errors unless I increase the memory allocation pool for the JVM which is undesirable.
I've looked through all the documentation and all mentions of internal buffers have the default around 16KB which is much smaller than what I am seeing.
I initially thought the issue was either due to sending it as multipart form data or because it was trying to read the entire file into a buffer before sending it but I see the same behavior with just a regular BodyPublishers.ofFile.
I'd appreciate any insight into this behavior.1 Reply
⌛ This post has been reserved for your question.
Hey @undoublethink! Please useTIP: Narrow down your issue to simple and precise questions to maximize the chance that others will reply in here./closeor theClose Postbutton above when your problem is solved. Please remember to follow the help guidelines. This post will be automatically marked as dormant after 300 minutes of inactivity.
💤 Post marked as dormant
This post has been inactive for over 300 minutes, thus, it has been archived.
If your question was not answered yet, feel free to re-open this post or create a new one.
In case your post is not getting any attention, you can try to use /help ping.
Warning: abusing this will result in moderative actions taken against you.