|
Post by Romy Ocon on Jun 5, 2009 12:14:02 GMT
Looks like Neon's 1 TB HDD went down without a backup. birdphotoph.proboards.com/index.cgi?board=news&action=display&thread=3112&page=1#24728I opened this thread to remind everybody about the serious need to back up your work. Now. Although manual data recovery from a downed HDD by specialty companies might be possible, it's costly, time-consuming and inconvenient. Losing one's original photos built up in so many trips and countless hours of birding is a nightmare one wouldn't wish to experience. Let me share my simple CF card and HDD usage: 1. Shoot in RAW only. If I get a rarity, I remove the CF card from the camera (I might accidentally erase the pics when chimping), set it aside for safety, then use the next free CF card. 2. Upon getting home, I upload my photos from the CF card to one of my internal HDD. I don't reformat the CF card yet at this point. 3. I cull the obviously unuseable photos (OOF, blurred, badly exposed, etc.) from the lot. After cleaning up the lot, I copy everything from the internal HDD to an external HDD as a back up. This external HDD goes to another part of my house when not in use, as a safety measure against fire damage if ever. 4. Next, I burn a set of DVDs of the lot as a back up to the back up. These DVDs are stored in another part of my house which is different from the area where my external HDD is kept. 5. It is only at this point (when I have 3 independent sets of files - int. HDD, ext. HDD and DVDs) that I reformat my CF cards. 6. I also make it a regular practice to print 12x15s of my keepers and just store these, ready for any use or exhibit. This printing practice has a left-over DVD that contains a processed, hi-res TIFF that can be a 4th set of files to back up the first 3 sets. External HDDs are very cheap now (less than PHP 7K for 1 TB), so this makes backing up much more affordable than a few years ago.
|
|
|
Post by Ding Carpio on Jun 5, 2009 12:38:22 GMT
Here's my contibution to the backup methodologies.
On field, aside from the 8gb CF in camera, my camera strap has two card pockets, each one holds a 4gb CF card. In my other pockets are all the other CF cards I've collected in years; 2gb, 1g, etc. The idea is never to have to erase a CF card onfield to make room for more shots.
I also carry two portable data storage devices (essentially a hard disk with CF card reader slots) to back up what's on the CF card. Each device has a 160gb drive. The intent is that any CF card that leaves my camera is backed up onto these drives.
In Baler, I carried only one portable data storage device but I also carried my notebook so I essentially also had two backups.
When I get home, I upload all into my computer with a 1.5TB RAID system. Everything is backed up onto a 1.5TB NAS device (also in RAID) at the basement through my home LAN. That's the online/nearline storage bit.
For offline backup, everything gets backed up onto 2 sets of DVDs, one I keep at home, the other in my office.
Now, I'm contemplating some eSATA external disks as backups instead of DVDs because 1. hard disks are getting much cheaper and 2. DVDs are cumbersome.
Despite all these paranoia-like hardware and processes, I still lose data. Most dangerous culprit is myself. Sometimes, I hit delete when I shouldn't have.
|
|
|
Post by Romy Ocon on Jun 5, 2009 12:45:12 GMT
Thanks for sharing, Ding! Despite the back ups, when one runs afoul Murphy's Law and really needs a HD data recovery service provider, let me cross-post here this: Here's a thread at www.philmug.ph/ with some of their highly recommended HD data recovery service providers - one of these offers a "no recovery - no pay" deal. www.philmug.ph/forum/showthread.php?t=19637
|
|
|
Post by Toto Gamboa on Jun 5, 2009 14:11:30 GMT
Hi guys ... hope Neon gets his files back.
Being into the business of databases and data protection, I would say that doing back up is not enough. The backup process is just 50% of the entire process to secure and protect your data.
I would add to what Mastah and Ding has shared, that after you do your backup, do a restore, restore, restore. Your backup is only as good if you can restore it. You have to make sure that your backup is restorable, especially if you are using some form of proprietary storage device/facility.
Countless of times I have heard and seen a client curse heavens after they have known that their backups arent restorable for various reasons. Always remember, what is the use of your backups if they can't be restored, so check.
Here are some other imporatant tips to secure your data at all times:
- DVDs arent good backup devices. Writable CDs/DVDs can only last a few years. You get lucky if you can still get to use old backups in DVDs with no read errors. Harddisk and tapes are much better and will last longer. If you rely on DVDs, make sure you have multiple copies. Transfer your old backups to newer media like every 2-3 years. Store backups in dust-free environment preferably on a room temperature or cooler.
- Backup the versions of software that you use (OS, RAW converters, photoshop, etc). You might ran into software compatibility problems in the future. You might have a good backup but you might have upgraded your system already and old formats become incompatible. Though this is more unlikely to happen ... we can never tell as we dont have control what our software makers want with their software in the future.
- When you upgrade software, always try to check if your old RAW files can still be opened in newer version of the software that you use. It wont be nice if after so many years, when you need to open some old RAW files, the files can't be opened in your new setup. There are cases when old software become incompatible with your new computer. So before you dispose your old computers, be sure that you can open old files into your new system.
- Using RAID and other proprietary storage system. Be warned that in some cases, you just cant swap devices or disks from one system to another in case the host device gets busted. Some NAS devices today only support some proprietary format and can only be opened on platforms supporting that format. So before you buy those storage devices, be sure that your device of choice support popular, open formats.
- Again, dont be over too confident with your backups. Regularly check if they can still be opened and restored.
Hope this helps!
|
|
|
Post by Jun Osano on Jun 5, 2009 15:59:26 GMT
Wow, a very helpful information here guys! Thanks for sharing.
Ka Mastah and Ding, after downloading your files to your Internal HDD's and other backups, do you delete the files in the CF card or you reformat the card? Where do you delete or reformat? Computer or Camera?
|
|
|
Post by Eric Patdu on Jun 5, 2009 16:44:38 GMT
Thanks Sir Romy! I was just thinking about this last night since I just got my new DSLR.
I was searching the net last night for a good external RAID system and my wifey quipped "Oh, oh... I knew the DSLR is just the start of it." Hehehe.....
Anyway, what do you guys think about online backups? I mean, like Flickr? Flickr offers unlimited uploads and downloads of both photos and videos at a very reasonable price. Do you think it is more safer?
|
|
|
Post by Romy Ocon on Jun 6, 2009 0:18:45 GMT
Wow, a very helpful information here guys! Thanks for sharing. Ka Mastah and Ding, after downloading your files to your Internal HDD's and other backups, do you delete the files in the CF card or you reformat the card? Where do you delete or reformat? Computer or Camera? I always format in-camera.
|
|
|
Post by Romy Ocon on Jun 6, 2009 0:23:40 GMT
Online sites are good repositories for very important files, but note that upload and download speeds are very slow even with fast broadbands (try downloading a 100 5d2 RAW files ;D). Likewise, one has no control on the site's hardware, software and security. I'd still prefer traditional back up modes, like redundant HDDs, supported by hi-cap optical media (DVD and blu-ray). Thanks Sir Romy! I was just thinking about this last night since I just got my new DSLR. I was searching the net last night for a good external RAID system and my wifey quipped "Oh, oh... I knew the DSLR is just the start of it." Hehehe..... Anyway, what do you guys think about online backups? I mean, like Flickr? Flickr offers unlimited uploads and downloads of both photos and videos at a very reasonable price. Do you think it is more safer?
|
|
|
Post by Ding Carpio on Jun 6, 2009 0:28:03 GMT
Ka Mastah and Ding, after downloading your files to your Internal HDD's and other backups, do you delete the files in the CF card or you reformat the card? Where do you delete or reformat? Computer or Camera? I always reformat using the camera. I'm sure you can reformat the CF card in a card reader/writer device while plugged into your computer. But I'm not sure if my camera has some extra control files or folder structure that it installs into the CF card during in-camera format. Last thing I want is to suddenly find out onfield that my CF card is unusable due to improper formatting. But, perhaps, this is more paranoia than anything else. Still, there's nothing to lose formatting in-camera, I think. I was searching the net last night for a good external RAID system Anyway, what do you guys think about online backups? I mean, like Flickr? Flickr offers unlimited uploads and downloads of both photos and videos at a very reasonable price. Do you think it is more safer? For external raid, I use the DLink DNS323. It's a 2-bay enclosure and I use striped RAID mainly for performance. RAID5 would've been ideal but too expensive. I just mirror my online disks to this. I mainly compared this device with the Linksys NAS200 (both available locally). The Linksys looks a hell of a lot sexier but, from technical and user reviews, seems the DLink has the edge. I recall trying FLickr before (still have my account) but they reduce photos down in resolution. Can't store the original size. I now use smugmug, a paid account, but it also has an 8mb limit per photo and can store only JPEGs. I use smugmug mainly as a photo-sharing site, not as a backup. There are other sites that offer unlimited backup at a reasonable fixed price. But, personally, I'm not comfortable entrusting protection of my files to some company a continent away. Again, this is probably paranoia. I will, perhaps, consider internet backup as an extension of existing backup strategies (i.e. backup of my backups).
|
|
|
Post by Tonji Ramos on Jun 6, 2009 1:25:21 GMT
Yikes! I was just thinking about this last week. Sylvia does a good job with her files backing up with an external and DVD's. I have them all in an external drive and ordered a 1tb external which I will get this morning. Aside from a virus or an HD crash another reason why all your files might get wiped out is a fire. When I was in highschool ( a long time ago) our house burned. The whole house did not burn down but everything got wet from the water of the firetrucks. Wet as in slippers floating in the water wet even in the unburned portion. Aside from the burn damage and the water damage there was also the smoke. It got into everything and all the things in the house smelled like they were in a week long BBQ. Another kind of damage was heat. Some places did not burn, like the bathrooms because they were marble or tile walls but the heat melted a lot of the things inside those unburned areas. Watches, jewelry, and metal stuff melts. I don't think any files or media can survive a fire. Even a fireproof safe only works for a while. It may be a good idea to keep some files physically apart from your home. Hmmm...I may need another external HD.
|
|
|
Post by ppaaoolloo on Jun 6, 2009 2:34:02 GMT
Have you fellas consider enterprise-level backup solutions like RAID 01 setup or a backup tape drive?
Considering the economics of optical media I would not rely on them for long term archival use.
FYI over time magnetic media like HDD lose their magnetic charge thus erase all data. Also strong enough magnetic fields can make magnetic media unusable.
To avoid disasters like fires you may want to make redundant backups located in a different locations.
Apple has a simple but elegant solution to backups called "Time Mahcine" those with Macs with OS X Leopard may want to consider using it. I keep one HDD at home and sync with that and have another HDD in the office and sync with that. Oh yeah no such thing as a Mac OS X virus; worm "meron" but no virus. ;D
|
|