: How do I get a TB of data to a new web server? I have a TB of compressed media files that I need to get to a remote web server with a bit of urgency. (from my office) Our upload rate

@Dunderdale272

As the other questions suggest, it mostly boils down to find someone around you with a good connection.

One group you could talk to are university or college admins. Just make sure, that the guy you're talking to is authorized to let you pipe some TB through their wire, and I'm sure you can get to an agreement.

Many faculties at universities, e.g. Particle Physics, post petabytes of data around, so this might be another possible option.

Vote Up Vote Down

@Heady270

aws.amazon.com/importexport/
Ship your device to AWS and they will take care of the rest.

Vote Up Vote Down

@Cody1181609

You could if you have friends or employees willing to lend you a hand with their home connection, set up a torrent for the large file and set up your employees/friends as seeds. Of course you'd have to cart and copy the file to everyone. Even then, you could split the file into .rars and have "teams" send portions (taking care to make sure they don't download the files they don't have). Crowd sourcing ftw!

Vote Up Vote Down

@BetL925

If the data is in your office on the slow connection you are in a pickle. If the data is on or at your old host you could try a server to server transfer. Using the ISP pipes instead of your tight office pipe.

If you did it in chunks via a wget from ssh it would be a hell of a lot faster than shipping a drive for install. That said, I have never had to move more than 250GB.

Vote Up Vote Down

@Michele947

Find a regional ISP that's locally owned and bring a nice fat external drive that can hold all this. Walk into their office with 0 in cash, credentials for your server, and a 12-pack of beer. Pray that they have a gigabit uplink because a maxed-out 100mbit will take you over 24 hours.

That failing, look for local internet internet exchange point and find any AS that's connected to it. Make really good friends with somebody local from NANOG. Odds are you'll need to be creative. Try looking for any co-location near you.

Vote Up Vote Down

@Si4351233

These guys are in Tulsa, which you have in your profile so if you're in the area call them or stop by and let them know your situation.
www.datastorageinc.com/

Vote Up Vote Down

@YK1175434

I just want to add to the existing answers something that might improve your transfer once you've got your hard drive connected to a server with good bandwidth.

I needed to transfer large amounts of data several times between two web servers and instead of using common FTP or WGET commands to upload or download the data, I have been using the Linux SCP command. You can find more info here: www.go2linux.org/scp-linux-command-line-copy-files-over-ssh
You will need SSH access to both servers and then you can copy one file, or many files recursively.

So, if you only have large files instead of many small ones, I think it will copy fast enough.

At a transfer rate of 11MB/second between servers the transfer would last about 25 hours.

Good luck! ;)

Vote Up Vote Down

@Berryessa370

Get a temporary hosting company you can mail your drive to, and then transfer from the temporary host to the permanent host at a faster rate.

Vote Up Vote Down

@Turnbaugh106

I would contact some of your local data-centers (rack-hosting, managed service providers, etc) and see about renting a vps or virtual machine for a day or two. Just be sure they allow you to bring in a disk for the initial transfer and they are aware of your bandwidth needs.

You might also just ask if they would simply help you with the upload.. They often tend to be opportunistic, inventive, and might be willing to accommodate you for the chance at getting some of your business.

Vote Up Vote Down

@Kristi941

If the files are text files or otherwise cmpress well you can zip them up before uploading which could reduce the file size by up to 90%. Then you can decompress them on the server.

You can also try splitting the uploading between multiple locations. Each one then can give you their maximum speed.

Vote Up Vote Down