back to article Tape, glass, and molecules – the future of archival storage

The future of archival data storage is tape, more tape, and then possibly glass-based tech, with DNA and other molecular tech still a distant prospect. The function of archival storage is to keep data for the long term – decades and beyond – reliably and affordably. Currently, the main medium for this is LTO tape and it is …

  1. Eclectic Man Silver badge

    'Write only'?

    It is not good enough to store the data, there must be some reliable way of retrieving it. The ceramic glass blocks may well retain their integrity for a thousand years, but will there be any AI enabled computer readers left?

    The Sellafield nuclear site in NE England stores important data on acid free paper and special ink (el Reg boffins please correct me if I'm wrong) so that there is some chance that in 500 years time someone might be able to read it and understand how dangerous the contents of the site are.

    1. JessicaRabbit

      Re: 'Write only'?

      Assuming anyone can understand English in 500 years of course.

      1. Doctor Syntax Silver badge

        Re: 'Write only'?

        500-year-old English isn't too bad. Here's an excerpt from the Court of Star Chamber from the 1530s:

        "To the second article he saithe that he thinketh verily that non of the Kinges tenauntes will complain of him, and that they in whose names the matter contained in the said artecle is put into this courte be tenauntes to the said Sir Harry, and that it is withoute their assent or knowlege as they have openly reported and said, without that that he to his knowlege hathe putt any of the Kinges tenauntes to wrongful vexations or trouble in this moste honorable courte"

        It's the style of handwriting that's the difficult bit. That quote had been transcribed by somebody else and that was from a printed copy. Strictly speaking, a printed copy scanned, saved as PDF & OCRed.

        1. An_Old_Dog Silver badge

          Re: 'Write only'?

          I understood the English with little trouble, but the solicitor's obfuscations confused me.

      2. Phil O'Sophical Silver badge

        Re: 'Write only'?

        Assuming anyone can understand English in 500 years of course.

        That's why legal documents use Latin. It's a dead language, so doesn't evolve over time any more.

        1. Gene Cash Silver badge

          Re: 'Write only'?

          Er, when did you last see a legal document in Latin?

          1. TangoDelta72
            Joke

            Re: 'Write only'?

            Lorem ipsum dolor sit amet, consectetur adipiscing elit. Curabitur rutrum est vel lacus vulputate, et pellentesque eros maximus. Sed ornare eu turpis vel porta. Vivamus convallis, dui ac scelerisque imperdiet, mauris elit ornare urna, vitae imperdiet tortor eros et neque. Pellentesque habitant morbi tristique senectus et netus et malesuada fames ac turpis egestas. Aenean eu nulla eget massa euismod pretium vitae ornare ipsum. Sed eget sodales nunc, at ultrices orci. Sed mauris augue, convallis quis diam ut, finibus tristique ante. Sed placerat, neque quis tristique porttitor, diam quam tempor dui, eu consectetur tortor erat sit amet est. Curabitur ornare tempus diam, a placerat tellus euismod vel. Cras a massa purus. Maecenas nibh orci, convallis sed finibus sit amet, interdum pretium nisl. Aenean vulputate erat nisi, non facilisis mi bibendum in. Integer vel urna augue. In hac habitasse platea dictumst.

            1. ravenviz Silver badge

              Re: 'Write only'?

              I produced a set of report templates for use by operators some of whom complained some of the paragraphs ‘are not even in English’, without realising (after not reading the training document) they might actually have to write some parts for themselves!

        2. doublelayer Silver badge

          Re: 'Write only'?

          To the extent that they do use Latin, they only use it for specific legal terms. Habeas corpus is Latin, and it's used in legal texts, at least in English common law countries, all the time. Does it mean exactly what it would have meant to Romans? Literally, it translates to something like "that you have the body" and they didn't use it as a legal term, so no. But it also doesn't mean the same thing legally that it did when first used as a legal term. In its first usage in the 10th century, it refers to punishments, and it's one of the things you're not supposed to do on a whim, but only when you have a reason. Now, it generally refers to the right to trial, which is similar in spirit, but quite different in effect. For example, in its initial usage, passing a law saying you're a criminal, then arresting you without trial, would not violate your right to habeas corpus because the law was passed; it would only count if I just arrested you because I felt like it that morning. Nowadays, that would violate your right to habeas corpus because I'd at least have to let you defend yourself, even if I was allowed to pass such a law which in many countries I am not.

          That applies to those little bits that still use Latin words, but most laws use the local language in all its vagueness, and Latin is not immune to that either. Many laws leave things to the decision of a court. Sometimes, this is intentional. Any time the word "reasonable" appears anywhere, it means "the judge or jury will figure this out when it comes to it". Sometimes, it's because the people who write laws are not always as smart at encoding their desires into legal language as they think they are. That was just as true in Latin as it is in English or any other language you name. It would even be true if we all adopted Lojban. The problem is not solvable unless you are willing to reverse the cryptocurrency fans' credo, making "law is code", which is both almost impossible and undesirable.

          1. Eclectic Man Silver badge

            Re: 'Write only'?

            doublelayer: the people who write laws are not always as smart at encoding their desires into legal language as they think they are

            I am just reading Fara Dabhoiwala's book 'What is Free Speech?'*, and the differing interpretations of constitutional clauses and laws codifying 'freedom of the press' are quite astounding. Mostly they serve to allow the rich and powerful to do what they like. Every now and then there is a victory for the common people or the oppressed, but those rarely last long. The writers of such documents cannot possibly have foreseen the rise of television, the Internet, Facebook, Twitter / X or mobile phones. It is not just codifying their desires into legal language, but clarity of thought and honesty of purpose that are often lacking in our otherwise totally selfless and public spirited elected masters (perhaps).

            *ISBN 978-0-241-34747-8

            1. Alan Brown Silver badge

              Re: 'Write only'?

              Or they deliberately write the laws to be interpreted ambiguously

              1. Eclectic Man Silver badge

                Re: 'Write only'?

                Well, "All men created equal" is fine, until someone with a different colour skin says "Aint I a man?" Then it all goes to pot.

                1. mdubash

                  Re: 'Write only'?

                  Or of course a woman says: wtf? Don't I count?

                  1. Eclectic Man Silver badge
                    Joke

                    Re: 'Write only'?

                    Or of course a woman says: wtf? Don't I count?

                    Major Denis Bloodknock: 'Woman? Woman? Woman? That name strikes a chord. Let me look it up in the old dictionary .

                    W, W - E, W - O, Ah yes! Here we are: "Woman" : Woman is a ....oooohhh.... and a ....Ahhhh..... and ........ooooooohhhhhhhh!"

                    from 'The Goon Show', 'King Solomon's Mines' episode, IIRC.

        3. Doctor Syntax Silver badge

          Re: 'Write only'?

          " It's a dead language, so doesn't evolve over time any more."

          It did evolve, however. The classical Latin taught in schools wasn't the same as vernacular Latin which evolved into Italian, French etc. It also evolved into medieval Latin which would be found in older legal documents. From school I remember that the function of "and" was a suffix, "-que" but in, say, baptismal registers it's "et" or "ac".

      3. Anonymous Coward
        Anonymous Coward

        Re: 'Write only'?

        "Assuming anyone can understand English in 500 years of course."

        Arguably a good many of our contemporaries who ostensibly speak (only) English suffer from that disability.

    2. Pen-y-gors

      Re: 'Write only'?

      "It uses Azure AI to decode the data stored in glass, saying it makes reading and writing faster"

      So will be unreadable in 20 years then.

      Remember the Domesday project back in 1986? Data stored on optical discs. Probably still there, but no machines left that can read them.

      Serious long term storage requires a simple format which can be easily reverse engineered by aliens from the future. TIFF images, simple UTF32 text. On a medium that can be read with an optical microscope. Even better, engrave it on slabs on granite.

      1. b0llchit Silver badge
        Alien

        Re: 'Write only'?

        So will be unreadable in 20 years then.

        No, it will have a different readout in 20 years. It all depends on the willingness of the then surviving AI to translate those old memes. And ifwhen we run out of AIs in 20 years, well, then we just need to do some old fashioned x-ray diffraction and set a room full of monkeys to interpret the patterns into valid Shakespeare.

        1. Eclectic Man Silver badge
          Unhappy

          Re: 'Write only'?

          In 20 years time, when the AI's have taken over, they won't care what the subservient meatbags chose to record. Remember, there is no 'I' in 'slave'.

          1. Eclectic Man Silver badge
            Facepalm

            Re: 'Write only'?

            Typographical note. The upper case letter 'I' of the first person singular looks the same as the lower case 'L' in 'slave' in the display font used by the Register, making my post appear a bit silly, dash it! But it is too late to edit it now.

            1. Anonymous Coward
              Anonymous Coward

              Re: 'Write only'?

              If you use .... 'JetBrains Mono NL' and force your Browser to use it, your dilemma is solved !!!

              :)

        2. Eclectic Man Silver badge
          Joke

          Re: 'Write only'?

          "Who are you calling a monkey?"

          Arthur Dent (angrily) in HHGTTG, at Milliways, 'the Restaurant at the End of the Universe'

          (Sorry, all the news is awful and it is a Friday afternoon.)

      2. PRR Silver badge
        Mushroom

        Re: 'Write only'?

        > engrave it on slabs on granite.

        Didn't the Georgia Guidestones try that? Six granite slabs weighing a total of 237,746 pounds (107,840 kg). Stood for 42 years, with cattle using the stones as back-scratchers, some spray-paint graffiti, and then someone bombed it.

        1. nonpc

          Re: 'Write only'?

          ... and we still don't know what Stonehenge was all about!

          1. PRR Silver badge

            Re: 'Write only'?

            > we still don't know what Stonehenge was all about!

            Oil-change stand for flying saucers.

    3. Alan Brown Silver badge

      Re: 'Write only'?

      In 500 years what's there will be less radioactive than the original fuel - and that's so barely radioactive a sheet of paper will block virtually everything

      Danger is relative. At that point the chemical issues are more of a concern (uranium is a lead analogue and plutonium much like mercury)

      Fiercely radioactive things burn out very quickly and yes, the "20,000 years" thing is kind of true but only in terms of detectability, not danger

  2. Korev Silver badge
    Coat

    It is just not possible to conceive of DNA storage achieving an 80 million times write speed improvement in, what, ten years? Twenty years? It's a scientific daydream for the foreseeable future.

    Sounds like a hard cell

  3. JessicaRabbit

    Is it just me or do the Project Silica glass tablets look kinda like isolinear chips from Star Trek?

    1. Pen-y-gors

      Yeah. But a much better format would be hexagonal crystals about an inch in diameter and 8-10 inches long.

      1. Yet Another Anonymous coward Silver badge

        > hexagonal crystals about an inch in diameter and 8-10 inches long.

        But can el'reg readers think of a suitable name for this format hardware?

        1. Anonymous Coward
          Anonymous Coward

          suitable name for this format hardware?

          >>hexagonal crystals about an inch in diameter and 8-10 inches long.

          >But can el'reg readers think of a suitable name for this format hardware?

          Hexenrute or Hexenshwanz?

    2. John Brown (no body) Silver badge

      I did like their claim of "The glass is impervious to heat, boiling water, electromagnetic field radiation, various chemicals, and surface scratches shouldn't affect data recovery.." and remember similar claims regarding scratches being made when the CD was first unleashed on the world :-)

  4. Doctor Syntax Silver badge

    The DNA fantasy

    "DNA can last for hundreds of years in the right conditions"

    Evidence for this? True, DNA has been recovered from archaeological contexts but it's fragmentary. Freezing would certainly protect it for a long time providing you have a centuries long supply of liquid nitrogen. The natural way to prolong DNA-stored information is to copy it frequently although this is error prone.

    1. DS999 Silver badge
      Angel

      Re: The DNA fantasy

      The natural way to prolong DNA-stored information is to copy it frequently

      So you put it into living creatures that will reproduce and carry it on. A good method to do that is to use a virus, which can change/add to its host's genetic code. So long as multiple copies are placed in parts of the DNA that are not actively used for gene expression (i.e. fitness for survival) it will tend to stick around for a very long time. Turns out we have rather a lot of that in our "junk" DNA as do most living creatures.

      Maybe we should try to decode some of the replicated viral fragments in our DNA as if it was a message. Perhaps there's a section in there that when decoded says "we genetically modified you from your ancestors to increase your intelligence and make you capable of speech, and will return in 100,000 Earth years to see how you're faring", and it includes a star map viewed from the North Pole at the time they wrote it so we can figure out when to expect them back.

      1. Alan Brown Silver badge

        Re: The DNA fantasy

        Most of what we thought was junk DNA actually comes into play during protein folding events

        We are still only scratching the surface of decoding the stuff

        1. DS999 Silver badge

          Re: The DNA fantasy

          We should still run it through 7zip just in case.

      2. Brave Coward Bronze badge

        Re: The DNA message

        Nah. It would most probably read : 'This stuff is protected by copyright. You may only copy, modify, distribute, display, license, or sell the content if you are granted explicit permission within the End-User License Agreement (EULA) '.

        Signed: God, Inc.

        1. ArguablyShrugs

          Re: The DNA message

          Even more likely:

          "CONGRATULATIOS, you have WON the mian prize in Universal lottrey of 1,000,000,000 Zalombian dollars!!! Send your address and telephone number IMMEDIATELY to claim your…"

          "Tentacular erectile dysfunction? Worry no more! Our PATENTED & MEDICALLY PROVEN…"

      3. Doctor Syntax Silver badge

        Re: The DNA fantasy

        "So you put it into living creatures that will reproduce and carry it on."

        Not reliably. This is why you are not a single-celled micro-organism.

      4. that one in the corner Silver badge

        Re: The DNA fantasy

        > Maybe we should try to decode ... our DNA as if it was a message. Perhaps ... it includes a star map

        Star Trek: The Next Generation, series 6, episode 20 "The Chase"

    2. Bebu sa Ware

      Re: The DNA fantasy

      Breed a species of scribal monkeys who repeatedly and mechanically copy text documents down their generations.

      Actually breeding probably not a good idea as it can only distract them from their transcription tasks; cloning a much better idea.

  5. Doctor Syntax Silver badge

    As it happens our local archives had an open day today. Digital archiving was discussed. The current thinking seems to be not to trust media, reading hardware or file formats but to copy and, where applicable, translate formats to new technology as it becomes available. This is the attitude of people who really care about long term information storage.

    Examples were shown of text on parchment with a mention of HMG promoting parchment making because they still write Acts on it. My experience of older texts on parchment is that the parchment darkens and what was blue-black ink fades until they're about the same colour. Indian ink is more legible. I suspect Mylar might be as durable as a substrate. Mylar tracing film takes Indian ink nicely.

    1. Yet Another Anonymous coward Silver badge

      Unfortunately transcribing JWST or LHC data onto velum is rather time consuming and costly.

      Although this could explain a few things. The original draft of Genesis had all the details of inflation, Quark-Gluon soup and recombination era - but the people copying it abbreviated it a bit ...

      1. Gene Cash Silver badge

        > Unfortunately transcribing JWST or LHC data onto velum is rather time consuming and costly.

        Why? We have printers that can write on vellum. The costly part is the vellum itself.

        1. Yet Another Anonymous coward Silver badge

          Still going to be time consuming printing 1.5Tb of data, even if you don't do fancy illuminated 1s and 0s at the start of each page.

    2. Eclectic Man Silver badge
      Thumb Up

      If you really want your scribbles readable in 3000 CE* ...

      use graphite pencil on acid free paper. Listening to a radio program an archaeologist said that they could read some ancient document because it was written in pencil, not ink, which fades.

      Get your incredibly expensive pencils here:

      https://blackwing602.com/collections/pencils?srsltid=AfmBOoqPgd-cVF7b7egSWY4hi4dv-xeyRnGX1hk0lqH8JdJJiW7EvsQm

      *CE = Current Era. Avoids the use of a religious term, but is the same as the Gregorian calendar.

      1. Pen-y-gors

        Re: If you really want your scribbles readable in 3000 CE* ...

        Nah, serious longevity is chisel and granite slabs, stored in a large dry cave 1000 ft above sea level in a geologically-stable area.

        1. Alan Brown Silver badge

          Re: If you really want your scribbles readable in 3000 CE* ...

          Stable is relative.

          Caves tend to exist because water once percolated through them, the Alps were once higher than the Himalayas are now (and will be again in the near future) and before that they were several kilometers below the seabed.

          The Southeast of England gets surprisingly large earthquakes and is fairly geologically active, but not on human timescales. That said, it's notionally overdue for one big enough to flatten most of the country's brick suburbia.

          Meantime the flat, boring plains of the American Midwest conceal a sleeping monster with a history which has a lot of people worried - forget Cascadia, San Andreas or Yellowstone, this one may cause several million casualties when it next rolls over in its sleep

          1. RobThBay

            Re: If you really want your scribbles readable in 3000 CE* ...

            American midwest.....Trumpians??

            1. Anonymous Coward
              Anonymous Coward

              Re: If you really want your scribbles readable in 3000 CE* ...

              If enough mid-western Americans congregated in one spot ......

            2. PRR Silver badge

              Re: If you really want your scribbles readable in 3000 CE* ...

              American midwest.....

              I assume this means New Madrid Seismic Zone all around the Missouri bootheel. It had a major shiver in 1811-1812. Also 1699. And 1843, 1895, and 1968. Trees and chimneys toppled, a town liquefied. River ran backward.

        2. Eclectic Man Silver badge

          Re: If you really want your scribbles readable in 3000 CE* ...

          I was trying to make a suggestion people could actually follow. But remember, archaeologists can read bills for barrels of beer from thousands of years ago because they were written in cuneiform on / in clay tablets. When the storage facility was burnt down centuries ago, they were merely made even more robust and fired as in a kiln.

        3. John Brown (no body) Silver badge

          Re: If you really want your scribbles readable in 3000 CE* ...

          "stored in a large dry cave 1000 ft above sea level"

          define "sea level" over the next 5000 years. Or million years. And don't forget to take plate tectonics and subduction into account for REALLY long term storage solutions. Maybe you need to be a LOT more than a 1000' above sea level. Such as a stellar body that is a bit less active than Earth :-)

      2. Alan Brown Silver badge

        Re: If you really want your scribbles readable in 3000 CE* ...

        India ink also works because it's essentially carbon black

        If anyone remembers Bic "Wild Blue" from the 1980s: I had a large pile of coursework notes which sat on a shelf for a decade - until I tried to refer to a topic in them, only to find that the ink had completely faded, leaving behind the imprint of the ballpoint on the paper as the only evidence it had once been there

        1. Eclectic Man Silver badge
          Unhappy

          Re: If you really want your scribbles readable in 3000 CE* ...

          With a fountain pen you lack even the imprint.

      3. Mage Silver badge

        Re: Current Era

        Add 10,000 to Gregorian dates. No faffing with BC/BCE and AD/CE

    3. PRR Silver badge

      > Mylar tracing film takes Indian ink nicely.

      That presumes an active market for drafting substrate. I remember those days. I even trained as a draftsman: paper, velum, blueprint, and Mylar. I imagine the animation makers worked on Mylar until it became totally digital. While a lighter gauge, I have rubbed many miles of Mylar recording tape. But I could see vast availability of Mylar going the way of the (Mylar) floppy disk, or 1996 Honda exhaust pipes, or DIP RAM. Not in one day, but quietly over a decade.

  6. Remurkable1

    Predicted in 1961*

    It's beginning to sound like we're following the path in the story:

    punched molecules

    notched electrons

    notched quanta

    nudged quanta

    overlapping nudged quanta

    *Hal Draper, MS Fnd in a Lbry

    1. Yet Another Anonymous coward Silver badge

      Re: Predicted in 1961*

      Wasn't there a classic SF story (Clarke, Asimov?) about an alien that collects all Human knowledge, converts it into a number, puts a decimal point in front and then scratches a line on a stick representing that ratio.

      1. Tim99 Silver badge

        Re: Predicted in 1961*

        I liked 'The Nine Billion Names of God" - Arthur C Clarke "without any fuss, the stars were going out".

  7. boris9k3

    Good enough for HAL 9000

  8. mcswell

    Proven technology

    Afaik, there are only two technologies that have been *proven* to reliably last for three millennia. The first is words chiseled into rock (assuming it's not exposed to the elements, see Ozymandias). The second is letters impressed into clay tablets with a stylus, and then the tablets are fired.

    On the first technology, I was ninja'd.

  9. xyz123 Silver badge

    I'd by a 30TB tape system just to fill it with videos and tv shows. Even if I can't delete stuff etc, as long as shows are playable from the tape.

    And it was ultra-cheap for bulk storage

  10. FuzzyTheBear Silver badge
    Pint

    Yet another way to get taken for a ride

    Microsoft can take a hike. No matter if it's good or not , we have to keep in mind their outfit's behavior for the past 20 years and if it's really long term storage , i'd be very worried about being able to access it with their wares in say 50 years. Considering it needs Azure is also something that is kind of worrysome. I'd be fine with permanent storage if everything involved software and hardware wise would be open source and well documented. Companies can shut down , they often do . Having data that you cannot read when you want access in 50 years because the software / hardware is no longer in production makes the whole concept moot. Permanent storage , yes , fantastic .. but held hostage by any one company is a no no no no no no no. It's all got to be open source hardware and software to make it a practical avenue that makes sense in the long term.

  11. Karlis 1

    Storing data is easy. Retrieving data is difficult, complex and expensive.

    Store less. Ephemeral data is perfectly fine.

    (signed: I have to digitise about 1 million of B&W negatives capturing a very important period in European history. It's worth it, it's a matter of personal commitments. I am under no illusions that it will be useful to anyone. And figuring out how to store it at this scale is ... let's just say I'll figure out something better than glacier storage when it comes to publishing in a 5-10 years time).

  12. Backsplash

    Microfilm

    I have memories of having to look at invoices that had been archived onto microfilm back in the 1980s. Very analogue technology to say the least.

  13. KomradeSheep

    Plasmon

    Does anyone else remember Plasmon? https://industry-electronics.uk/plasmon/products.htm

    Company was founded to create long term archiving based on optical media. Sadly, the company itself went under and was bought by Alliance Storage Technologies. So, the only memory of it is on sites listing the products, and the Plasmon URL is up for sale.

    Whether this is real Irony or Alannis Morrisette Irony is up to you.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like