So you would have to read 17x the data to recreate it. Given disk latency, network bandwidth, etc. I'm guessing it'll take quite a while to recreate a 6TB HDD if it fails.
So you would have to read 17x the data to recreate it. Given disk latency, network bandwidth, etc. I'm guessing it'll take quite a while to recreate a 6TB HDD if it fails.
Sending 102TB of data to the pod that's rebuilding would take forever, this is true.
Instead you have each peer pod be responsible for 1/17th of the parity calculations.
1. 17 pods each read 17 megabytes and sends them across the network.
2. Pod A gets all 17 of megabyte 1. Pod B gets all 17 of megabyte 2. etc.
3. Each pod calculates their megabyte of the replacement drive and send it off.
4. Repeat until 6TB have been processed.
So this way each pod reads 6TB from disk, sends 6TB across the network, receives 6TB across the network, and calculates one nth of the data for the replacement drive.
It scales perfectly. It's no slower than doing a direct copy over the network.
Just make sure your switch can handle the traffic (which it already has to handle for filling the vault in the first place).