I need a system or a method of building that i can transfer data (shit tons of data) to different drive banks but do it fast. It takes me 3-4 days to move 8 tb of data from one drive to my networked drive bank. I want to move a lot more data faster.

So i looked into what motherboard has the fastest bandwidth and mine says it moves at 1 gb / sec but im actually getting speeds of 150-200 mb/s.

so lets say i want to format a 8 tb drive:
1. move data from drive on to storage drive : 4 days
2. special formatting 4 days (archive tape drives)
3. move data from storage drive to formatted drive 4 days

also i dont want to use "toy" operating systems like apple just stick with rock solid reliability of linux


are there any purpose built systems just for moving massive amounts of bulk data?

I'll be honest it is normally gated but your harddrive

Your mobo is usually the LAST thing that would bottle neck

m.2 drive nvme or whatever are some of the fastest but you're gonna pay insane amounts of mount for LARGE storage.

Faster CPU may help but again, really thinking you're gonna be bottlenecked by your R/W speeds on your Hard drives.

speeds go slowest to "fastest" respectively

HDD
SSD
m.2 nvme style newer ones (pci-e slot ones as well I think?)


https://www.techradar.com/news/best-solid-state-drives-ssds


lastly, if you do ANYTHING over the internet the transfer speeds probably gonna be hella slow. If its a intranet type of network it may be much different since you're not bottle necked by websites or ISPs etc

This post was edited by Bayonet on Jul 22 2020 02:45pm