back to article OVH writes off another data centre – SBG1 – and reveals new smoking battery incident

OVH has written off a second data centre because of the March 10th fire that destroyed its SBG2 facility. In a Saturday update, OVH founder and CTO Octave Klaba wrote: “We don’t plan to restart SBG1. Ever.” Previous guidance on SBG1 suggested only a few racks were destroyed, while others were considered recoverable. The fire …

  1. Anonymous Coward
    Anonymous Coward

    You get what you pay for

    OVH is cheap and cheerful

    Perhaps they could take out a subscription for OVH Zerto "Disaster Recovery"? Oh, wait ...

    1. Starace
      Devil

      Re: You get what you pay for

      Maybe cheap, but definitely not cheerful right now.

    2. ricardian

      Re: You get what you pay for

      30 years in Scarborough (N Yorks) BT were publicising their new remote sensing option to detect domestic fires. A few days later Scarborough's main exchange, located in the centre of town, burned down; the alarm was only raised because a passerby (at 3am!) noticed smoke coming through a broken window.

      1. Rabbit80

        Re: You get what you pay for

        That's nothing..

        Our fire station burnt down a few years ago!

        https://www.thenorthernecho.co.uk/news/10785971.ripon-fire-station-catches-fire---busiest-day-year-crews/

  2. RM Myers
    FAIL

    power outage.... Klaba described as “the worst incident that can happen to us.”

    I strongly suspect he no longer believes that a power outage is the worst thing. OVH seems to have taken the reactive rather than proactive approach to management.

  3. Fruit and Nutcase Silver badge
    Joke

    Ratners

    How long before Klaba does a Gerald Ratner and describes OVH as Crap

  4. Anonymous Coward
    Anonymous Coward

    The datacenter has been written off, but not all servers.

    If I'm not wrong, they are moving the servers from SBG1 to other datacenters, they didn't write off them all. The infrastructure is not recoverable, though, so any server that can be recovered will take some more time to be available again.

  5. Kevin McMurtrie Silver badge

    Good night with nightmares

    The pictures of their datacenters (before and after) are terrifying. Imagine the claustrophobia of servicing metals boxes packed full of high power electronics from a long narrow corridor. And nothing stopped or extinguished the fire at all. OVH somehow modified the containers so that flames from batteries and fire resistant plastic raced across the compartments and melted open steel plates. It's the Titanic burning like the Hindenburg blimp.

    1. Sceptic Tank Silver badge
      Facepalm

      Re: Good night with nightmares

      Not the type of containerisation we were expecting in their DC.

  6. Pascal Monett Silver badge

    "we believe that this is part of our internal standard"

    You mean you "wishful thinking" that it is part of your internal standard. SBG was obviously not built following your own standards and, at €2 million per electrical line, I think we can all guess why two centers were loaded on the same line : beancounter interference.

    So, beancounters, are you happy with your "savings" ?

    1. DS999 Silver badge

      Re: "we believe that this is part of our internal standard"

      So, beancounters, are you happy with your "savings"

      If they got a bonus for the cost cutting, they probably are. The bosses who get bonuses for cutting costs never seem to get penalized when the cost cutting comes home to roost. If they do see consequences like "we're going to take these losses out of your next few bonus checks" they'll just move on to a different job and their resume highlighting their cost cutting will get them hired somewhere else.

    2. Potemkine! Silver badge

      Re: "we believe that this is part of our internal standard"

      SBG was obviously not built following your own standards

      AFAIK, SBG first DCs were built long time ago, before the aforementioned standards were put in place. That's why they didn't follow the rules.

      This doesn't explain why the noncompliance was identified four years ago and not corrected for all these years.

  7. Anonymous Coward
    Anonymous Coward

    Looking at the photo, I doubt that the building construction complies with regulations for fire protection and compartmentalisation.

    1. Xalran
      Devil

      Oh, it met the requirement ( relevant type of fire extinguisher at relevant location ).

      It just didn't meet the Industry Standard. But that's something well known about OVH, they don't care about the Industry Standard, they know better.

      1. LRanger

        Your reply is regarding active fire supression, my comment was related to compartmentalisation & passive fire protection to ensure the fire & smoke doesn't spread and the structure collapse.

  8. newspuppy

    What my first Electrical Engineering Prof taught us.....

    I shall never forget... and have found his advice to be absolutely usefull in every domain...

    He called them the 7 sacred P's.

    Proper Prior Planning Prevents Piss Poor Performance.

    1. Yet Another Anonymous coward Silver badge

      Re: What my first Electrical Engineering Prof taught us.....

      Or more importantly "know your customers" OVH are specialists in running spam farms, if their customers really cared they would use a more expensive supplier with lots backups. They want the cheapest possible host and that's what OVH supply

      1. diadomraz

        Re: What my first Electrical Engineering Prof taught us.....

        Actually not all of their customers are spammers - it is more a case of being intentionally short-staffed. They don't do a lot of verification so basically anyone with a credit card can get a working server in minutes and keep it running until someone complains, which is obviously great for spammers and bots.

        1. Potemkine! Silver badge

          Re: What my first Electrical Engineering Prof taught us.....

          Add to this that many users renting servers for cheap at OVH don't know a thing about basic cybersecurity, and have their servers turned into bots.

      2. sitta_europea Silver badge

        Re: What my first Electrical Engineering Prof taught us.....

        "... OVH are specialists in running spam farms ..."

        Correct. I block *everything* from OVH servers at the firewalls.

  9. Sparkus

    OVH is going to have to

    be vary transparent about who supplies the batteries and maintenance for their power systems......

  10. diadomraz

    OVH experience

    I have a server in SBG and it was fully restored yesterday evening. I don't exactly know which datacenter it was in and now it is listed as SBG6. This incident didn't really affect us a lot - the server load was migrated to another provider 10 minutes after the server went down and apart from some old data being inaccessible for less than 2 weeks there were no issues. Considering the severity of the damage we got lucky.

    1. Korev Silver badge
      Pint

      Re: OVH experience

      > the server load was migrated to another provider 10 minutes after the server went down

      > Considering the severity of the damage we got lucky.

      This isn't luck, this is competence - you'd designed your infrastructure and the implemented it in a way you only had a few minutes downtime.

      One for the sysadmins -->

  11. Eclectic Man Silver badge
    Flame

    Shipping containers

    In a previous article I commented that they looked like shipping containers. I assume me that they only met building regulations due to the technicality of them not being used to house people working, only the occasional technician plugging and unplugging wires etc.

    One property of steel is that it is a rather good conductor of heat (which is one of the reasons why saucepans are made from it). Concrete and bricks, on the other hand are not so efficient at thermal conductivity, which is why buildings are often made from them. I wonder whether the new DC will be made from steel shipping containers or concrete and brick, let me guess...

    1. TRT Silver badge

      Re: Shipping containers

      Steel shipping containers full of concrete, sand and bricks. They make a rather effective bund wall if you're, say, storing fuel and munitions in a desert environment military base.

    2. Anonymous Coward
      Anonymous Coward

      Re: Shipping containers

      I was wondering, last week, seeing the pics, why it didn't at all look like a DC building or any building at all, despite the fact it was hard to see through the damage of the fire.

      SPOILER ALERT: ain't no building there ! Was a stack of shipping containers !

      If that's not a double, even triple facepalm, I don't know what is.

      My town is impacted: web site down, and townhall mail down. I'm sure mail will eventually be restored, but for the web site, nothing is sure. I have yet to call the lady in charge to explain she may have to rebuild from scratch. But sure, she'll then have free backups, now.

      1. Anonymous Coward
        Anonymous Coward

        Re: Shipping containers

        And that's why it's important to do some due diligence on where the kit is held, and to understand why the services is so cheap in the first place. Data centres are expensive pieces of infrastructure.

    3. Potemkine! Silver badge

      Re: Shipping containers

      It seems that ship containers transformed in houses are not so uncommon

      See also this one

      1. Eclectic Man Silver badge

        Re: Shipping containers

        Upvote for the correctness of your comment, however, although I have not seen all of Kevin McCloud's 'Grand Designs' programs, I don't think there were many that featured shipping containers as major items in the design. There was one where he was doing 'huts' and cabins that did use them, but few architects would build a house from them.

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like