You are here

How I Backup my Aperture Library (Part 2)

Mel Ashar's picture
August 22, 2013 - 4:01am

Today’s guest post is by Mel Ashar. Mel is a landscape and architectural photographer based in San Francisco. His clients include architects, designers and real estate professionals around the Bay Area. You can read more about him and see Mel’s work at melashar.com, read his blog at melashar.com/blog or follow him on Twitter @melashar.

How I Backup my Aperture Library (Part 2)

by Mel Ashar

(go here to read part 1)

Offsite backup

I wanted to do this in a way that didn’t require changing my life drastically, go out of my way, or regularly mail disks somewhere. Those are all easy to stop doing after a few tries and habits are very hard to change.

My wife’s parents live about 15 miles away in South San Francisco. We visit them a couple times every month for family dinners or just to drop in. Keeping a backup at their house would meet my bar for “offsite”, and wouldn’t require doing anything I wasn’t doing anyway. Now I just had to find a way to automate this offsite backup as much as possible so I wouldn’t forget to do it. For this, I once again use Time Machine, specifically a new feature that was recently introduced — multiple disk backup. Many people don’t realize this, but Time Machine can backup to two or more separate drives, each with its own state. In OS X 10.8 Mountain Lion, you get all the simplicity and automation of Time Machine but with multiple drives.

Did you know that you can have multiple backups in Time Machine? Well, you can!

I keep an inexpensive 320 GB USB drive in a drawer at the in-laws’ house. When I’m visiting them, all I have to do is turn on the MacBook and plug in the drive. Time Machine automatically does the rest while we’re enjoying dinner. No configuration, no changing settings, or UI — it just works! I do this about once a month, and the process couldn’t be easier. I thought this was one of the best new features of Mountain Lion when it came out. Here’s an article on how to set up Time Machine with multiple disks the first time. 

If you have an offsite office or residence you regularly visit, this is a great way to backup with the least amount of hassle.

Now let’s talk about online, or cloud, backup.

Online/cloud backup

Long before I discovered the beauty of Time Machine, I instinctively thought about backing everything up to the cloud. It just seemed like the obvious choice to store stuff on redundant data centers around the world.

Over the years, I have tried almost every online backup service including those mentioned above. I’ve used apps like Arc that backup to Amazon S3 and Glacier. Every time I read a review of a new online backup service, I evaluate its offerings and give the software a spin.

The sad truth however, is that backing up an entire library online is simply not a practical option for me today. Current bandwidth and upload speeds are insufficient to keep up with the volume of data I’m generating.

In my experience, uploading 5 GB of data can take up to 8 hours, and often longer over WiFi. Anything close to 200 GB can take weeks, and put the computer into a perpetual upload cycle if new data is generated faster than existing data is backed up. Being a one laptop kind of person, I don’t like my computer being bogged down by backup processes while I’m actively using it.

At the risk of sounding controversial, I’m going to state a personal opinion that consumer-grade backup services like Carbonite and Backblaze probably aren’t suitable for professional photographers today. They’re perfectly fine for people creating Word and Excel documents, or shooting low volume, 10 MB JPGs. But for people generating gigs of RAWs, TIFFs and PSDs every week, online backup can be an unsatisfactory experience — especially if it ties up your Aperture library or Lightroom catalog in the process.

Editor’s note: Regular readers know that I’m a huge proponent of Backblaze as a cloud backup solution. I’ve been using it for years and have recovered many files (although never an entire system) from it. I currently have 4 TB of data on Backblaze, and while my system can’t run in automatic mode anymore (there’s so much data that the regular automated scans for new files slow my system down), I manually click backup at the end of nearly every day — and certainly days I have a shoot. I do have good badnwidth (about 7 Mbps upload) but many have faster, and the compression that Backblaze uses on upload is significant. It’s very rare, even after a big shoot, that my backup is still going when I return to the studio in the morning. –Joseph

That said, I wasn’t going to give up on the benefits of online backup entirely. I wondered if there was a “hybrid” approach, where I can take advantage of a cloud service without getting stuck in an infinite upload loop. I came up with a strategy that work well, with software I already use — Dropbox.

Now, I don’t backup my entire Aperture library to Dropbox. That would surely result in the aforementioned infinite loop. Instead, I cherry pick which photos I want to back up, export them out of Aperture, and store them in a separate folder that is synced with Dropbox.

How do I pick what to back up? At the end of every shoot, after my culling and post-processing is done, I go through and assign a “5 star” rating to about 5-10% of the photos. These are usually the best photos in the project, and worthy of sharing online or showing to customers. These photos are my best work, and the bar is very high. They are the foundation for my photography business, and must be protected for decades to come.

A 5-star Smart Album filters out my best images for Dropbox archiving

I’ve been doing this “5 star” rating thing consistently for many years now. I don’t use the other star ratings. So a photo in my library can either be 5 stars or no stars. Using an Aperture Smart Album, I have one-click access to all my 5-star photos across all projects. About once a month, I export all the newly added 5-star photos from this Smart Album into the Dropbox folder. Dropbox then syncs the newly added files to the cloud, which usually only takes a few hours (depending on how many new photos were added). I do this when I have a reliable Ethernet connection and/or my computer is not going to be in use for a few hours. So my online backup happens at a convenient time and interval of my choosing.

What I like about this approach is I have a lot more control over what gets backed up, when it gets backed up, and my most valuable data is maintained by a billion dollar company that’s going to be around for the long haul. I could accomplish the same thing with the other services, but as long as I’m just syncing a few hundred files, I might as well use the simplicity of Dropbox.

Currently my folder of 5-star photos is about 75 GB, and I’m using Dropbox’s 100 GB annual plan ($99). So that leaves me 25 GB for non-photo documents, which is plenty of space for me. Most of my non-photo documents go into Google Drive anyway, so I’m pretty much using Dropbox just for syncing my collection of 5-star photos.

One drawback of this approach is I’m wasting space on my SSD drive by duplicating those 5-star photos outside Aperture. With a 750 GB drive, this hasn’t become an issue yet, but I’ll have to deal with this in the future. I also realize that the numbers I’ve shared are probably on the lower side, and many photographers have 2-3 times as much data as me. But as I said before, this strategy can scale several orders of magnitude (Dropbox offers 200 and 500 GB plans).

Summary

To summarize, I use Apple’s Time Machine for offline and offsite backup, and Dropbox for selective online backup (< 100 GB). While not perfect, these tools give me the most seamless, controlled and practical backup experience for now. And just like my photographic style, this strategy will evolve over time as technology and bandwidth improves.

Please use the comments below to suggest improvements and share how you backup your photos.

App:
Apple Aperture Backblaze Time Machine
Platform:
macOS
Author:
Mel Ashar

Mel,

Nice article; your strategy seems quite sound for your Library.

I concur with your observation that cloud backups really aren’t quite there yet for heavy users. I’ve been trying to find a service with a local branch where I can take my RAID in and seed my initial backup (16 TB) directly. Then I could live with incremental backups over the web.

Last I checked, Crashplan was offering a single 1TB seed drive service using Lacie Rugged external drives, but that’s inadequate.

I’m curious to know if you (or any reader) is aware of any data storage company that offers this sort local seeding option.

Gordon

Thank you for the post Gordon,
….Gary

Gordon,

Regarding the Crashplan+ seed service. I have an unlimited Crashplan+ family plan with eight computers being backed up. The individual computers vary from just a tiny 50MB backup… up to the 1.5 TB backup of my personal iMac.

I decided to use the seed service to back up my iMac. As you stated, the drive that arrived via Fed-Ex was 1.0 TB. Per the directions, I did an initial local backup to the drive and with compression, 1.2 TB was able to fit.

Note that I made sure that the most important data was backed up first. For example, I excluded the least important data from my backup set (ex: any data that was easily re-obtainable). I made sure that all of my personal “irreplaceable data” was backed up, including my entire Aperture library (at the time 360 GB) and all of my personal camcorder recordings and documents and such. After everything important was backed up… I removed the exclusions, and let the backup continue until the drive was full. As stated above, 1.2 TB was backed up.

At this point, I FedEx’d the drive back top Crashplan, and in a couple of days, my backup was seeded back in their datacenter. At that point, I redirected my Crashplan destination to “Crashplan Central” per directions… and my backup continued… uploading the remaining ~300 GB of data. In a few days, that had completed and I was 100% backed up in about a week. It worked flawlessly.

For me… Crashplan has no problems keeping up with my workflow, but I do not fit the professional catagory. The most I’ve ever attempted to upload in one day was 165GB of data after my daughter’s wedding. That was the data from 5 cameras shooting RAW, plus 2 camcorders. It took several days (about a week) for that to complete… but I did have local backups, plus offsite backups (via HDD sneaker net) so I still had multiple backups of that irreplaceable data.

I realize that this would not work with you 16TB collection of data. However, I just wanted to point out how my experience went.

As you probably know, Crashplan does allow cloud based backup to a different destination that you control (ex: a friends house). You could seed your 16TB to an array locally, and then connect the array to to a remote location… and then resume backup over the net. This service is 100% free.

/Jim

/Jim Pappas

I use a synology nas to backup my current aperture libary and to store the older ones. And I’m using the Strato HiDrive (German Hosting Company owned by Deutsche Telekom) to backup my stuff outside my flat. This is enough for about 200 GByte of external storage.

@Gordon: Think about buying two NAS, create a first backup locally and then put the second NAS at the home of a friend or in your office. I think that this will make more sense then an account at crashplan or where ever. Or you should think about Amazon S3 as they offer a send in service up to 16 GByte (http://aws.amazon.com/de/importexport/#supported_devices)

I’m curious as to why you use the Time Machine rather than the Vault backup option?

I sure wish I only had to back that little of data. As of today, I’ve already shot 119220 images this year….not including my daughter’s volleyball game I shot last night.

I average about 10k per month but often shoot more. In June I shot over 21k.

This amount of data presents a much more difficult and expensive back up solution. One I’m barely able to keep up with.

It usually results in deleting photos, which I hate doing. Some of what I shoot has historical significance….even within the sports genre.

I hope someday there’s a cheaper solution than buying hard drives and online space.

Perhaps we could rename the online aka “cloud” backup as ‘sharing’ backup? I would like to believe that it’s safe, putting valuable photos in the ‘cloud’ but one network security geek I asked about this replied: yea, I could do it but when I do, I effectively lose control of the files. Presumably he was referring to the distance between my client machine and the cloud server i.e. NSA and others scooping it up in transit. I’m not worried about the government arresting me for taking a photo of a cop beating an “occupier” but perhaps Monsanto will come after me for that photo of Mr. Potato-head with two heads. You know, intellectual property rights.

We shall not cease from exploration.
And the end of all our exploring
Will be to arrive where we started
And know the place for the first time. --TS Elliot

Hi Everybody.

I read all this information, but I was wondering if my solution is possible, I haven’t done yet, but I am expecting to do that.

1. I am buying a WD My Cloud. Which is basically a NAS with an additional feature that allow me to share photos and documents in a Cloud, which I control because is this external hard drive. 

2. I have a license of Chronosync, which allow me to sync documents and my library between two mac or one mac and one hard drive (NAS). With the advantage that only sync the changed files or new files and no the all library. 

So I will have my Aperture library mounted in my iMac but I will be able con sync my library with my NAS. My only question is: Am I going to be able to view my library in other devices and softwares, or I should see my pictures only in Apertura or Iphoto applications? Any ideas?

 

 

 

 

 

You may login with either your assigned username or your e-mail address.
Passwords are case-sensitive - Forgot your password?
randomness