Continue to Site

Eng-Tips is the largest engineering community on the Internet

Intelligent Work Forums for Engineering Professionals

  • Congratulations IDS on being selected by the Eng-Tips community for having the most helpful posts in the forums last week. Way to Go!

Efficient Data back-ups 2

Status
Not open for further replies.

OptiEng

Mechanical
Oct 30, 2009
149
Hello All,

This is my first post on the computer forum. I would like some data back-up advice.

I work in two locations (lets call them L1 and L2). I would like to keep my main base for the data files at L1. However, whilst I am working at L1 at the end of the day I would like to take the latest data with me without quickly (without having to wait ages to copy the files to a external harddrive). Then after updating the data at L2, I would like to update the data at L1. I will have at least 50-60GB of data soon. I hope this makes sense?

Any advice on this, with options and ideal solutions?

Thanks

OptiEng
 
Replies continue below

Recommended for you

I use Goodsync, which allows you to set periodic updates throughout the day, so that the COB sync would only be of the files that you worked on in the last half hour or hour. Your description sounds a little hazy, so I'm not sure if Goodsync is appropos.

TTFN

FAQ731-376
 
I think that's one of a multitude of things that rsync is supposed to be able to do.

{I personally have never been able to get rsync to do _exactly_ what I thought it was going to do, but that may well be pilot error. There are many options, and the man pages are written in geeklish.}



Mike Halloran
Pembroke Pines, FL, USA
 
Thanks for your responses, sorry if the description did not make sense. Basically I would like to keep my files updated (at least daily) in two locations, as efficiently as possible. Thanks for your advice.
 
How are the locations related, i.e., are they on the same network? What's the transport mechanism for actually moving files between L1 and L2?

TTFN

FAQ731-376
 
IRstuff, no they are not on the same network, but I do have remote access to L1 from L2. At the moment I am just using a USB stick and transferring all the files every time I leave the office, which takes ages. When I get to L2 I just delete all my delete all my files and upload the latest data from the usb stick.

You would probably think I could just transfer the things that have changed. But I change things I lots of folders and keeping a track of that would be tricky.

Thanks for you input everyone
 
OK like I said, something like GoodSync can run the background throughout the day, and update files as necessary on your stick. The program only updates files that have changed, so you're only copying whatever you've actually touched during the day.

When you get to L2, the program can then hunt down the differences and update L2 with the changed files.

Note that the program will transfer two-ways, so any file on L2 that has been updated would cause the program to update the stick with the changed file, and the next time you get back to L1, the program will then update the corresponding file on L1.

While I use GoodSync, the built-in "Briefcase" functionality in Windows will supposedly do the about same thing. I've had problems with Briefcase, but it does work. I can't quite remember if it does periodic updates; I vaguely recall that it needed to be manually commanded to update.

GoodSync has a demo that you can download to test it out:
TTFN

FAQ731-376
 
I use a batch file to run robocopy. It has a good range of options and should only copy newer or changed files.

Like the others said, if you setup a batch file to run about an hour before you leave, then it won't take so long at the end of the day.

Of course, if you really are *changing* 50gb of data per day, then you are still at the mercy of the speed of the USB stick when you get to L2.

I haven't had any personal experience with it, but isn't eSATA supposed to be fairly fast? Might be something to look into (but could require new hardware at both locations)
 
There's no need to manually do anything with GoodSync, once you've set up the jobs. I've got a 25 minute cycle during the day that updates as I work. The jobs are configured to do a final update when my laptop is shutdown for the evening, and will keep the laptop running until all the updates are completed. Likewise, when the program is started up the next day, it runs update automatically.

It's probably a couple of minutes extra for about 10 different folders that I synchronize.

TTFN

FAQ731-376
 
Hello all,

Thanks for your help and advice. Is there any freeware software that can do a similar job to GoodSync?

What happens if you have a file open and Goodsync tries to make a backup of it?

Thanks again.

OptiEng
 
As Mike Halloran pointed out above, rsync. It is free, open source, secure, reliable, has a long time history, and can work over a wide variety of network configurations.

 
GoodSync can override the locked file bit, and will the copy file, assuming that's it's been tagged as changed.

TTFN

FAQ731-376
 
Hi ajack1,

Thanks for your input, you suggestion is good. However, I already have remote access, but this only allows me "access" to the files. I would need to electronically transfer this file from the computer I am accessing remotely to the computer I am working from.

For exmaple if I am working on graphics, this seems to run very slowly when through "remote access".

Thanks
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor