* Posts by smsm

2 publicly visible posts • joined 19 Aug 2013

Optical archival system - where to buy from?

smsm

I've been working in Storage, Archive, Backup and Recovery for about fifteen years. My background is UK financials, but I now work for one of the large Software/Hardware manufacturers.

I would say that optical is pretty much dead, no-one really uses it any more and the disks - unless you're talking super-expensive magneto-optical enterprise quality systems - only last about 5-10 years, and that's with good handling, in a climate controlled room.

If you have a lot of data and a lot of money, go for a tape robot, with a couple of the current generation of LTO drives, never use only one drive as you should really write on one and verify on another to make sure readability as sometimes drives will be fussy about tapes they will and won't read. Record the data on one tape and clone it to another, store one tape offsite at an offsite storage company. Chose your software wisely, it's all very good to have a tape system, but you need to have software to manage the data on those tapes. TAR on its will not do for anything above trivial use, archive software is typically expensive.

As you're currently using Drobo, I'm going to guess that the above isn't a goer, as it's really a low end of midrange solution and a Drobo is a workgroup device.

One of the currently available CAS (Content Addressed Storage) solutions would be a good, although probably too expensive solution. Then you have the problem of backup/protection of your CAS system and you're back to the initial problem. That said possibly you can replicate to a remote CAS system, this would be an acceptable solution. Again, this won't be cheap.

A filesystem which checks it's contents' integrity, such as zfs or refs is probably the way forward, however you are stuck with disk and an alterable filesystem, this is not really an archive. Personally this is pretty much what I use, my backup server's datastore is replicated to a disk, which is stored off-site during the week and replicated on Mondays, before being taken offsite again. By offsite, I mean my garage, which is about 600m from my house, so a nice distance away in case of fire/burglary etc. The nice thing about this solution is it's inexpensive and easily upgraded over time.

You could use a system like the above and replicate over DSL to a friend's house, however bandwidth issues will likely put a stop to this. Also, don't use anything like real-time replication, this is an excellent way to lose everything.

Reliability and expense are the key issues. Tape, such as LTO, will only read n-1 or n-2 generations, this means you're on an expensive upgrade cycle of tapes and drives every few years, sustainable for an Enterprise, but not a private individual. Tapes do occasionally snap, so you will need to keep two of each tape. They are also not a random access device, so can be slow.

Optical disks don't last, unless you're paying mega-bucks.

It would be nice to have something different, but I suspect your best option is good old fashioned spinning rust.

smsm

Re: Optical is dead, dead, dead.

Seconded. Don't buy Sony. They (not archival specifically, but all product lines I've come across...) tend to be pricey; hardware tends to be nice IF you don't hit any problems that make it unusable. There's the rub, I have encountered bugs ranging from minor to "makes the product useless" on almost all products I've come across. This is of course not unique to Sony.

What IS fairly unique to Sony is unwilingness to FIX these bugs even when it's easy, their "fix" is to buy the next model. I have two examples.

1) My friend got a Sony DVD player which, after about 6 months, failed to play certain newer DVDs. This was not an optical fault but some firmware problem. Despite the drive saying ON THE BOX that it was firmware updateable, Sony released *0* updates for it, he called and they flat out told him to just buy the next model (which was the same model he had with the firmware update they failed to release for his.)

2) Second example, a Sony notebook that began shutting down. This turned out to be a chipset flaw making it falsely trigger thermal shutdown, and it took a year or two in the field for this problem to develop. Fair enough, not Sony's fault it was Intel's. BUT, it turned out to be a *2 byte* BIOS patch to work around this, and every vendor BUT SONY released a BIOS update. Sony said "too bad, buy a new one."

These are by no means isolated incidents. They ship DVD drives that are LiteOns, but Sony writes their own firmware, actually making them buggy compared to if they just stuck a Sony ID string into stock LiteOn firmware. Newer Vaios have some "off the shelf" parts but with Sony-proprietary firmware for no discerniable reason (which based on reviews make it buggier than stock.) I guess the big exception is Playstation, I can't fault them on the PS3.