Slow iOS backup
Hello, I'm experiencing backup on iOS at a rate of roughly 1 image every 2 to 3 seconds. I believe I saw somewhere that the capability is up to 10 images per second, roughly, so I'm curious as to what's going wrong for me. What information would be helpful in troubleshooting?
34 Replies
Are you using WIFI or DNS?
I'm using the docker host's IP, if that's the question
no DNS
so you are using local IP and accessing the instance over WIFI, correct?
that's correct
How far is it from your AP and are you on 2.4GHz or 5Ghz band WIFI?
I've had this rate anywhere from 1 foot to across my house, and I'm on 5GHz (802.11ac, 40MHz, -45 dBm) currently
I have an AP in nearly every room, and this issue occurs everywhere
that is pretty strange that it is that slow
hmm
is there any throttling on your server by chance?
it seems fast to upload, but it sticks at 100% for like a second or two before continuing
no throttling that I'm aware of
the progress bar goes from 0 to 100% nearly immediately, but then it stays at 100% for a couple of seconds before moving on
Are your photos all Apple ProRaw?
I do have ProRAW turned on
That is probably why, the files might be bigger (20MB each) so it take a while for the server to write onto disk I assume
sorry, ProRAW camera option is enabled, but RAW is not turned on in the camera
Hmm 🤔
Do you have a different device that you can try to upload to your server?
hard to explain, there's an option in the camera settings to show the options within the camera app. that option is turned on. however, in the camera app, the option to actually use RAW is turned off.
I don't at the moment
I'll share a video with you of what the upload progress looks like
I understand this, I use iPhone as well
I'll check to see what the size of IMG_2702 is
How is your server IO wait stats?
looks like it upload very fast but the server has some problem writing it?
how do I check that? lol
it's a docker container on a synology NAS
interesting, then I am not sure how to check it 😄
dost synology have some disk IO metric?
ls -al IMG_2702.HEIC
-rwxr-xr-x+ 1 root root 3866681 Jul 19 11:06 IMG_2702.HEIC
this is like a 3.8MB file
yeah this shouldn't be an issue
I don't think the app has any issue
as the upload is very quick, it was waiting for the server to response that the file is on the server and the info is created in the database before moving on to accept the next upload
so IO looks like a bottleneck here
unsure how to measure this on synology
You might want to search around?
yep, I'll try to hunt around for something
iostat
Linux 4.4.180+ (Alexandria) 07/19/23 _x8664 (2 CPU)
avg-cpu: %user %nice %system %iowait %steal %idle
6.92 0.08 3.59 3.89 0.00 85.51
Device tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd
sata1 35.76 41.73 836.11 0.00 130613753 2617225114 0
sata2 37.78 115.79 844.67 0.00 362455309 2644017550 0
md0 0.71 2.36 7.62 0.00 7394160 23859796 0
loop0 0.03 0.07 2.79 0.00 230811 8742748 0
zram0 0.30 0.42 0.77 0.00 1323204 2407852 0
zram1 0.30 0.42 0.77 0.00 1326552 2407856 0
md1 0.00 0.00 0.00 0.00 1060 8 0
synoboot 0.00 0.00 0.00 0.00 68 6 0
usb1 0.00 0.01 0.00 0.00 34808 35 0
md2 41.57 155.15 835.86 0.00 485660128 2616439968 0
dm-0 0.00 0.00 0.00 0.00 416 0 0
dm-1 41.53 155.15 835.86 0.00 485649308 2616439968 0
iowait is very slow so technically it shouldn't have any issue.
this is for the whole host
what is your raid config?
@bo0tzz do you have any idea where to hunt down disk performance like this?
RAID is SHR
I would consider not using the synology as the disk store for this, but that's sort of the point 🫠
docker stats shows no blocking IO
out of curiosity, how do you run immich? not within a docker container I presume?
Is this while idle or while uploading files?
this is while uploading files:
Linux 4.4.180+ (Alexandria) 07/19/23 _x8664 (2 CPU)
avg-cpu: %user %nice %system %iowait %steal %idle
6.92 0.08 3.59 3.90 0.00 85.50
Device tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd
sata1 35.82 42.03 838.61 0.00 131653481 2626561770 0
sata2 37.84 116.43 847.17 0.00 364663417 2653374770 0
md0 0.71 2.36 7.62 0.00 7405616 23878676 0
loop0 0.03 0.07 2.79 0.00 230811 8742748 0
zram0 0.30 0.42 0.77 0.00 1325376 2413084 0
zram1 0.30 0.42 0.77 0.00 1328648 2413084 0
md1 0.00 0.00 0.00 0.00 1060 8 0
synoboot 0.00 0.00 0.00 0.00 68 6 0
usb1 0.00 0.01 0.00 0.00 35640 35 0
md2 41.66 156.10 838.37 0.00 488896508 2625788556 0
dm-0 0.00 0.00 0.00 0.00 416 0 0
dm-1 41.61 156.09 838.37 0.00 488885688 2625788556 0
as mentioned, this is running within a docker container, so maybe there is some contention there, idk
Hmmm
Docker shouldn't have any effect on performance
run fio in the container maybe?
what exactly do you mean @Sweepy , that's a new one for me lol
fio is a disk benchmark
it’ll show you sequential, random, iops etc
see if something is unusual
As it is a Synology you could try and run this on the disks:
https://mariushosting.com/synology-how-to-benchmark-your-disks/