What is the best practice for large data insertion and updates

Zzikalol11/3/2022
Hello, I have kind of large data that I'm getting from external API. I need to insert this data in my database and update it nightly with a cron job. i'd like to know what's the best practice to do it
MMMayor McCheese11/3/2022
Research bulk instead options for whatever database tech you’re using. For some there are multiple options.
MMMayor McCheese11/3/2022
How large are you talking?
HHass11/3/2022
Maybe SqlBulkCopy if you're using sql? It's pretty straightforward to use
HHass11/3/2022
I'm doing an identical thing at my job and it's been a good option so far
A/CAtakan / Cracker11/3/2022
Do you get all the data from single call to external API ? Or you just keep loading the data during the day through external API ?
A/CAtakan / Cracker11/3/2022
if you get all the data from single call, bulk insert is okay to use, If you are partially gathering the data, should consider different approaches
Zzikalol11/7/2022
Thank you guys, yes i've used bulkinsert (just saw the messages) didnt got notifications.