
@John T
Interesting reply, sounds like a nice set-up.
I should probably expand my musical horizons as I do tend to hear the same songs a lot!
Being a hardcore music geek of a certain age, I own several thousand LPs, CDs, and cassettes that I accumulated over the course of several decades. But as any serious record buff knows, collections like this are not remotely scaleable. I have several closets bursting with music in assorted physical media and I know people who …
I think this story got my view straight across ;)..
What I want is something that cost 30% that of traditional storage, allows me to "mount" it like a drive on my network, and have it include high level encryption out of the gate.
Why 30%?.. Because I want at least 3 seperate cloud units running at one time, with sync software running that will make them appear all as one logical unit.
Until We get to that point I am more than happy to keep my lib's stored on multiple PC/Drives.
Just because so many cloud companies are getting data backups wrong doesn't mean you have to assume that everyone is. I don't trust the cloud with my data. But I don't trust my own local backups either. Any sysadmin who has even a half a clue knows that you need more than one backup technique built on different architectures, each of which is geographically separate by at least 10 miles. NEVER assume that one backup solution is sufficient. ALWAYS assume that there will be a failure in any design. This is Basic Backup 101!
A guy at work recommended SpiderOak a while back. After reading this page I was willing to drop $100/year to back up 100 GB:
https://spideroak.com/engineering_matters
My only affiliation with SpiderOak is as a satisfied customer. I've been using SpiderOak to provide a remote back up my wife's critical business files and my own personal files for about a year and a half. It's reasonably priced and has been remarkably stable. Only one glitch that lasted about 2 days, and that may have been due to a PEBKAC error on my part. All in all, I think they provide a very solid backup solution.
Given what I've said above, does that mean that I no longer keep a local copy of everything? Nope, of course not. In fact, I've got a couple of local backups driven by simple rsync jobs. But I'm damn glad I've got a solid offsite backup solution at a reasonable cost, too. In my view that's what a cloud solution really buys you.
This post has been deleted by its author
Another problem with 3rd party cloud data storage is that even if you found the perfect solution for your needs, which manages to tick all your checkmarks and you're 100% happy with their Terms & Conditions and other promises that your data is yours and they will never never ever ever monetize them....
You can't be sure that 18months from now they won't be acquired by Google/Facebook/Twitter/whatever promising that never ever will they change anything to the services they offer, and 6 months later, through a cunning update of their T&Cs, start doing the very thing you believed would never happen!!
Worse, even if you decided to cancel the service at the time of acquisition or at the time of the T&Cs update, you have no guarantee whatsoever, and no means of checking, that your data was effectively removed from their storage.
"...both Apple and Google have experienced multiple cloud outages..."
No need to wait for that. Your ISP may screw up, or your cable modem may go bust and a technician's visit to replace it will be scheduled a few days from now, or any one of a trillion different things may happen between you and the treasure stored in a different county or a different country.
Having no Internet access (make it "convenient internet access" - you probably have email at work and on the phone/tablet these days) is a minor irritation, while having no access to *any* of your stuff may be a big problem.
Having read the comments here it appears the author has an axe to grind with cloud. Having been in the cloud arena for the past 8 years and sitting on the board of many cloud associations and organisations I have a more pragmatic view that users should choose the most applicable form factor (be it cloud, cloud/on network mixed or on network) for each applications use dependent on the need, cost and feeling about data held in each case.
Limiting yourself and avoiding cloud will put you at a disadvantage in terms of flexibility and adaptability and in business potentially lose your competitive edge. The customers are choosing with their feet and purses as many major historic bricks and mortar brand approaches have already found out to their peril. Take Blockbuster video, once the darling and now the gone or surviving against Netflix and lovefilm serving up online movies. Take Tower Records gone against the online music world, books stores, Kodak photography and many more join this throw.
Cloud with the demands of mobile access from any device delivers more flexibility than we have ever had and be it public or private cloud is here to stay. We will see an increase in the speed of innovation and new uses for hosted services and an increased demand as younger users expect and demand availability anywhere, anytime on any device at a low price point that traditional mediums cannot deliver.
If you are afraid of losing music in the cloud, buy it on standard media, ripit, upload it and gain the benefits of cloud with a localised traditional media copy for your peace of mind and safety. However bear in mind this will cost you more in money and time to achieve. Yes Cloud may have had outage examples in the past year, but one local device outage or loss later and a user will be switching to cloud and relying on it for backups quickly. There are bad stories in any medium, and the story of one user’s lost kindle files is rare and amongst the volume of users offers a low chance it will be you. You can argue this the same for any failure, I am sure there are those out there who have had their local device just crash and burn and not switch on as expected at a random moment leaving them high and dry.
Ian Moyse
www.ianmoyse.co.uk
""Limiting yourself and avoiding cloud will put you at a disadvantage in terms of flexibility and adaptability and in business potentially lose your competitive edge." - possible, but is moving your data handling to the "cloud" a contributor to competitive edge?
"The customers are choosing with their feet and purses as many major historic bricks and mortar brand approaches have already found out to their peril. Take Blockbuster video, once the darling and now the gone or surviving against Netflix and lovefilm serving up online movies. Take Tower Records gone against the online music world, books stores, Kodak photography and many more join this throw." - [citation needed], specifically one that puts these failures down to not being in the cloud rather than just a general failure to modernise (ie Kodak - sticking with chemical film in the face of digital offerings and then thinking "uh-oh"), or mismanagement. Unrelated points don't make another point, y'know!
Back in 2001, being of limited resources, I used several free webhosting services to stash sundry files, as my laptop had a 2-GB drive and no CD burner. One of them must have had their operation in the World Trade Center, as the service disappeared without a trace one day in September. Other people had bigger problems and there was nothing mission critical there, but when the biz got going I was a believer in redundant backup methods I alone controlled. When the Cloud drifted over the horizon I wasn't even tempted.
Actually, my experience with stuff like this goes back further, to when I worked at a major monthly rag. The Powers decided to put MS Word on the server so we editors could run it over the LAN. I didn't trust that so I downloaded a copy onto my HD and renamed it . Came the day when we were nearing deadline and the server or the LAN or something blew up, and there was much screaming, tearing of hair etc in the halls, while I was able to keep working. The message, which all of you pro IT folks know is, you have to expect and plan for failure. If the Powers say, "What are the odds?," reach for the cattle prod and nudge them toward the elevator shaft.
I had gear at Sun in (and on top of) the WTC. The functionality was available under half an hour later, with hardware I had access to in Nyack NY, albeit with a trifle less bandwidth.
Yes, it was a planned fall-back option. No, I didn't foresee the extent of the equipment failure.
A very one-sided rant. Which I guess it was written to be.
Compare the risks listed with those of trying to maintain data yourself, as most commentards here seem to be doing. Such as
- your RAID controller has a bug that blitzes all your data when a disk dies
- your OS or iTunes or whatever devices to overwrite all your files with zeros
- your house gets burgled and the thieves take all your electronics
- combine any of the above with a silent failure of your off site backup regime for the past 6 months.
Never mind that most people wouldn't know a backup regime if it came and burnt their house down.
The cloud has its place as part of a sensible data storage strategy. All computing relies on trusting someone else to a greater or lesser extent, unless you are building your own CPUs. And if you don't like the privacy aspects then encrypt your data before uploading using something that doesn't store the key centrally (ie not dropbox).
I'm glad that I'm not the only one who groks this. I've seen it from the consumer end and from the inside. How many times do I have to cringe, as someone on the inside of a technology company, when a customers account get hosed by some internal error or issue from some botched entry on an account profile that wrecks the service in question. Then we find out when the customer calls in and can't repair the issue due to internal tools issues/limitations and the account has to be closed and a new one written up. God forbid there's a cloud storage or email attached to the account. The reality is that many of these accounts can lose all data at the push of a button on an account interface but the same tools can't retrieve what's lost. You go to Tier 2 or 3 only to find they don't even have server access and the company has so compartmentalized I.T. from the customer service techs that neither has contact with the other and lost data is just lost. Bottom line, no one can take care of your data better than you can. Thanks Dave for the common sense and reality check here.
The trick is "to know what you are doing". Majority of people don't. That's a fact. Some people do have staged backup policy with multiple geographic locations and/or use P2P backup but some other people who never lost their data will call this anal retentive and hence they will, inevitably, lose more data as a result (everyone does, the trick is to limit the loss, in other words to define the RPO).
The problem with cloud (as in Dropbox, Google and friends) is that it is far more susceptible to influences you cannot control and which you know nothing about (especially if you reside in a different country than your cloud provider). So the actual GUARANTEED availibility of cloud backup is for foreign natural person far, far lower than almost anything else (do you know what actual steps would you perform should a foreign company stop abruptly the service to you and as a result you'd lose access to your data? Remember, consumer organizations work usually within single country).
Cloud service is better than nothing, usually, but that's not what we can term as "good", right?
One aspect of this is privacy. Almost everyone has some kind of "unlicensed" material, should we say (grabbed CD or BD is such a case, even if you do that as a hedge against burglary). That's DMCA territory. The fact that no one does care what you have stored there NOW is no guarantee - cloud providers are actually centralized points for data storage (and those cloud providers will search the data for clues on what's popular). Before, investigators had tens/hundreds of millions of households to search (impossible). In the future they will have only a handful of datacenters to search (and their access actually depends on lawmakers and lawyers understanding technicalities - good for you if you really, really trust them).
In order to be reasonably safe and future-proof, you have to encrypt your data on the client and THEN send it to the cloud or use P2P backup with people whom you trust. But it means you have to employ some kind of key management and data preprocessing or slightly more complicated backup configuration you have to consult with others. This isn't a panacea either. Not mentioning the fact that fetching your HDDs for rotation from granny has often far higher bandwidth than uploading/downloading your data to cloud. And given the usual TB sizes, such a poor person geo backup is often cheaper and, if done sensibly, with RPO you are actually comfortable with.
In the future they will have only a handful of datacenters to search (and their access actually depends on lawmakers and lawyers understanding technicalities - good for you if you really, really trust them). … bri Posted Tuesday 25th December 2012 18:53 GMT
Morning, bri,
Actually it is so much easier than that whenever there are no laws, or laws which regularly broken and/or ignored by lawyers and lawmakers and clients desperate for access to technicalities and intellectual property which they don't understand or possess or have licence to/permission to use under proprietary terms and conditions.
And it happens all the time whenever systems are in collapse because of intelligence failings ……. http://www.allgov.com/news/top-stories/congress-at-last-minute-drops-requirement-to-obtain-warrant-to-monitor-email-121225?news=846578
* Mega Anonymous Occupied IntelAIgent Space Territory.
In order to be reasonably safe and future-proof, you have to encrypt your data on the client and THEN send it to the cloud or use P2P backup with people whom you trust. .... bri Posted Tuesday 25th December 2012 18:53 GMT
Is that what Kim Dotcom is offering?
I have written a PhD Thesis, back in the days of 1.4Mb 'floppies'. One set was in my office and was used day to day. Once a day they were backed up onto the set that was in my backpack. Once a week that was left at home and the set at home came in to be backed up (no home computer back then). To wipe out my thesis two locations (one with sprinklers) would have to burn down and I would have to be crushed or incinerated travelling between them, in which case it would have been moot.
A colleague at the time told of a PhD candidate he had known in a previous, non computerised era. He had given his, handwritten, thesis to a typist to take away and type up, as was common practice. She put it on the back of her moped and set off across town. By the time she got there it was no longer there. He had to recreate it from scattered notes. That was NOT going to happen to me.
I have lost count of the number of colleagues and family members who have lost stuff because it was not backed up. This machine is backed up to an easily grabable FW drive by Time Machine.
You DO have a secure link to your own systems when on the road, right? Extend the favo(u)r to friends & family, to the benefit of all ... How? I'm glad you asked ...
Get three (or four, or five ...) freely available Celeron systems. They should come with enough disk & RAM ... Load any of the freely available OSes on each machine (I prefer BSD). Install one at home (Sonoma, CA), one at DearOldMum's (Duluth, MN), one at Great Aunt Florie's (Padstow, UK), one at the ubiquitous Uncle Bob's (Christchurch, NZ), and etc ... Hook the machines up to their so-called "broadband" Internet modem.
Install encryption software, and simple scripting to automagically backup user generated code (personal files) at all locations to all other locations on a regular basis.
So-called "cloud" sorted ... without the hype, or the privacy issues. Or the cost.
If you can be arsed, add in FTP, Usenet[1], email, HTTP and other servers over the same encrypted links. It's been working for me since before Flag Day ... although granted, I didn't have the encryption capability right from the git-go ;-)
Given that google drive, sky drive, et al work by syncing a _local copy_ at each location they are installed (i.e., desktop and laptop), ignoring the scaremongering 'big brother' arguments, doesn't that make online backup about as robust as you can get (i.e., online, a laptop and a desktop all end up with copies without intervention, and are probably all in different physical locations)
A few months ago I visited a website - perfectly innocuous and SFW - that required a login. Because it was a trivial site, I happily allowed Google to remember the ID and password. I missed the distinction - I was not giving Chrome the local browser, but Google the "cloud", the right to keep my data. This only became apparent a few months later when on a clean Linux install I visited the same site, and to my horror discovered the ID and password fields correctly populated. Google may have brainy engineers and security people, but would I trust them to protect sensitive data against all possible attacks? No.
Being a lazy etc, I just back up my stuff to a portable hard drive and stick the hard drive in the safe - fire rated to fricking a lot. We can't really get flooded and the thing weighs way too much to move by tealeafs. Oh, and you'd have to contend with the floor bolts.
The added bonus of a safe is you can put, say, actual prints of old photos and other stuff in there. All safe and sound. No offsite, no NAS, no network required, just a hunk of steel.
Old skool (just don't lose the bloody keys!)
....this goes for all of it. If I buy /' own something it's mine, and I'm f*cked if I'm leaving it to any corporate slimebag to `look after for me`... along with all the loss of traditional ownership rights that comes with that arrangement.
Clouds. What a load of hyperbole and marketing crap. Set up your own storage system - space is cheap enough these days. Buy 10 2TB drives for example, hang it off the back of a web server on a 100/200mb connection. Connect to it over the internet. What's the problem?
Having data on the single location is asking for trouble.
Backup to tape and storing to off-site,
Network based off-site backup (aka Cloud backup)
Running over two DCs, (remote sync, DFS-R, RSYNC, etc)
or low level replications done at the storage level.
its not about trust CLOUD providers or not, its how the recovery plan and where YOU save the data. If a cloud provider does not provide good recovery plan, its up to you to select one that does, or deploy data on the additional providers (or store locally)
In Australia, Brisbane, 2011 Jan flood had managed to cause havoc and resulted in massive data losses everywhere. Japan's 2011 earth quake and tsunami and rendered many business near useless.
Yet, Im surprised to see so many ppl believes local premises RAID, SAN, NAS are good enough to data protection.
At work, we backup to the remote network, all VMs are cloned and ready to fire up at remote site as needed.
At home, I use crashplan to backup my photos and images to their sites.
I'm not sure what the problem is. I love Dropbox plus the Boxcryptor encryption system.
I have also installed many portable apps on Dropbox (unencrypted).
(Sadly some older apps are still tied to a specific PC .. but that's life)
So I now have several PCs at different sites .. each with a local copy of my files (encrypted). My files are also in the cloud (again encrypted). I use a complex layer of password managers to (hopefully) ensure that nothing can go wrong if I have a PC stolen. I also have a 500GB USB backup disk to backup the (encrypted) cloud.
So, if a PC fails or is stolen, no problem. If Dropbox or the links to it fail, no problem.
Also I no longer have to worry about losing USB memory sticks on which I have shoved a 'just in case' backup of some files or emails. In fact I rarely save stuff on memory sticks nowadays.
Each PC is essentially now a Windows system which is a Dropbox client.
Nothing private is held unencrypted on any PC. - but an encrypted volume of my world IS held on multiple PCs.
That leaves privacy issues : well, Google etc monitor almost everything I do on my PC so that battle has already been lost. All my (and probably your) emails pass through insecure external systems and so are already at risk.
Migrating to the cloud has also been beneficial in other ways : I have been forced to review all my files etc to see if they are worth keeping. I now have a much tidier folder structure and I can find all those photos from that holiday in 2001. They are no longer hidden on unbackedup PC #3 in a folder called p1.
The deduplication & tidying process was revealing ... I had ZILLIONS of duplicate files all over the place, some with differing names ... but now I have just one copy of each.
So for the first time in many decades I have control of my files ... and they are all tidy too!
Would I use the cloud etc if I was a copyright pirate or a drug dealer ... probably not.
However for 'ordinary' use I don't see any increased risk of using the cloud ... we are already spied on every second of every day.
What's old is new again with reboots of classic devices for gaming and music coming out all the time. But that kitsch value comes at a cost, even if the tech is from the current era.
Audiophiles want digital music players that leave out cellular components in favor of sound-quality-maximizing gadgets – or at least that's what Sony appears to be betting on with the introduction of a $3,700 so-called Walkman this week.
Before you ask, no it can't play actual tapes, which means it's not really a Walkman at all but rather an Android 11 media player that can stream and play downloaded music via apps, much like your smartphone can probably do. But we won't talk about that because gold plating.
Apple has ended production of the last remaining version of the iPod – the iPod Touch.
A May 10 announcement broke the news gently, referring to the iPod Touch being available "while supplies last".
Apple pointed out that the iPod's core function – storing truckloads of songs in a portable device – has long since migrated into its smartphones, tablets, and wearable devices.
The US Attorney's Office of Arizona on Wednesday announced the indictment of two men on charges that they defrauded musicians and associated companies by claiming more than $20m in royalty payments for songs played on YouTube.
The 30-count indictment against Jose Teran, 36, of Scottsdale, Arizona, and Webster Batista, 38, of Doral, Florida, was returned by a grand jury on November 16, 2021. It accuses the two men of conspiracy, wire fraud, transactional money laundering, and aggravated identity theft in connection with a scheme to steal YouTube payments.
"In short, Batista and Teran, as individuals and through various entities that they operate and control, fraudulently claimed to have the legal rights to monetize a music library of more than 50,000 songs," the indictment [PDF] alleges.
Poor Spencer Elden. Not only does the chap have to live with his "unauthorised" baby pic on the cover of Nirvana's breakthrough record Nevermind – the image has now been immortalised on the streets of Adelaide via GPS exercise tracker Strava.
In case you missed it, Nevermind, one of the greatest guitar albums ever made, turned 30 on Friday (feel old yet?), but the anniversary has been soured somewhat by the sleeve art's subject suddenly deciding he doesn't like his infant body being exposed on the shelves of every record store in the world.
Elden has sued the surviving members of the punk power trio – drummer Dave Grohl, now of Foo Fighters, and bassist Krist Novoselic – and the estate of late frontman Kurt Cobain, along with a number of other defendants, for sexual exploitation.
People who listen to rock or hip hop are harder for music recommendation algorithms to please, according to a study by machine-learning experts and data scientists.
The problem appears to be this, we're told:
GitHub has warned it may ban users who fork a DMCA'd YouTube download tool on its platform – while at the same time hinting at how netizens can continue distributing the software without drawing fire.
Last month, the Recording Industry Association of America, aka the RIAA, asked GitHub to take down the repository of YouTube-DL, a popular public-domain program that can save to disk copies of videos streamed from the Google-owned mega-site. The request also asked for the removal of any forks of the software.
The RIAA, which represents music labels in the States, is upset the code can be used to pirate copyrighted music tracks hosted on YouTube, and claims YouTube-DL breaks US law – specifically, the Digital Millennium Copyright Act – that prohibits the circumvention of anti-piracy mechanisms. Defenders of the software say there are many legit reasons for using YouTube-DL, such as archiving material.
Biting the hand that feeds IT © 1998–2022