[thedaly]

I've starting using rclone over rsync for this application. Rclone can do segmented transfers and handles large numbers of files better, at least in my experience.

[xnx]

rclone is great! So useful as an alternative/superior client for cloud storage too (Google Drive, OneDrive, etc.)

[sneak]

What are segmented transfers?

[daveguy]

Send multiple pieces of the file and reconstruct the file on the other end. It's more reliable to send smaller chunks and the transfer can be hash validated on individual chunks and after reconstruction. Multiple download streams typically performs better too (from single or multiple servers).

e.g. BitTorrent for the multiple servers case.