We also transfer a huge number of video files.
The files vary in size — from very large to very small ones.
It seems to me that your question lacks some details.
For example, what hardware are you using?
But to answer and share some of our experience — we use network interfaces aggregated via the LACP protocol.
Our servers have RAID arrays (RAID 10 or RAID 50), depending on the task.
We also use storage systems with flash drives, such as Dell Unity, IBM, etc.
Data transfer mainly happens over NFS.
As I understand it, your issue is related to network bandwidth, right?
Maybe you should try bonding your network interfaces.
The files vary in size — from very large to very small ones.
It seems to me that your question lacks some details.
For example, what hardware are you using?
But to answer and share some of our experience — we use network interfaces aggregated via the LACP protocol.
Our servers have RAID arrays (RAID 10 or RAID 50), depending on the task.
We also use storage systems with flash drives, such as Dell Unity, IBM, etc.
Data transfer mainly happens over NFS.
As I understand it, your issue is related to network bandwidth, right?
Maybe you should try bonding your network interfaces.
