The key statement is at the end - you need multiple suppliers, principally to allow for competitive pricing. Alternatively to allow for double the pork-barrelling.
NASA trusted 'traditional' Boeing to program its Starliner without close supervision... It failed to dock due to bugs
At a press conference on Tuesday, NASA confirmed why Boeing's CST-100 Starliner spaceship failed to hook up with the International Space Station last year. The answer: as expected, buggy code. Crucially, NASA admitted it did not supervise Boeing closely enough during the craft's software development stage because the agency …
COMMENTS
-
-
Wednesday 8th July 2020 11:05 GMT Anonymous Coward
@Mark 65 the reverse
The issue is that with a single source supplier, that supplier has a monopoly and therefore can control prices regardless of quality.
Having two vendors allows you to play one vendor off another yields a better price, albeit you have potentially higher maintenance costs because you have to support two different systems.
That said, the issue is that NASA trusted Boeing to actually hire competent staff. You always run the risk of not controlling the use of subcontractors and the quality of their code.
-
Wednesday 8th July 2020 11:15 GMT Anonymous Coward
Re: @Mark 65 the reverse
"That said, the issue is that NASA trusted Boeing to actually hire competent staff. You always run the risk of not controlling the use of subcontractors and the quality of their code."
There are many coders able to write and maintain good-quality code. There are many managers able to manage people and projects.
The trick is getting both groups together. Boeing seem to be excelling at getting the other coders and other managers - or maybe the good coders and the other managers - but we should not assume that all Boeing staff are not competent just because a few idiots are signing off on products that are not fit for purpose.
-
-
Wednesday 8th July 2020 13:01 GMT Anonymous Coward
Competitive pricing
The key statement is at the end - you need multiple suppliers, principally to allow for competitive pricing. Alternatively to allow for double the pork-barrelling.
You also really need to build a proportion of the stuff yourself, so you know how much it really costs. Otherwise you won't spot the cartel or the price gouging. It's not hard to smell a rat if they charge billion quid each when you've just built one for a quarter of that.
The Royal Navy did precisely that for its ships from the fifteenth century until the 1960s. Whilst the majority of their ships were built by private companies, the navy had its own dockyards where it built a small proportion itself. The last one was a frigate launched at Portsmouth Dockyard in 1967.
-
Wednesday 8th July 2020 14:53 GMT Rich 11
Re: Competitive pricing
The last one was a frigate launched at Portsmouth Dockyard in 1967.
That would be one of the last Leander-class frigates built. My uncle was a CPO on the Arethusa and gave me a tour round the ship one Sunday morning, when she was being refitted at Portsmouth in 1976. I'll never forget looking along the length of the cavernous hull, with all the lower decks ripped out, and walkways and strings of lights hanging between the ribs and bracing.
-
-
Wednesday 8th July 2020 03:22 GMT aki009
So what happened?
Were they designing in Seattle, implementing in India and testing in Zimbabwe? (Not that I fault Zimbabwe's space program for the failures.)
It seems to me that Boeing shifted its focus from engineering to "share holder value" some time ago, and this is the result (along with what happened to the 737MAX MCAS software). Perhaps a few C-class firings without their pretty golden parachutes is what the company needs now.
And maybe bring software development back to the USA. The guys who can't make the firmware on a coffee maker work right shouldn't be writing this kind of critical stuff.
-
-
Wednesday 8th July 2020 07:23 GMT Chris G
Re: So what happened?
It certainly looks to be a near terminal infection of bean counters, corner cutting wherever possible and relying on the too big to fail mantra.
I bet one of the main reasons they are still innthe running is the size if the Boeing hole that NASA has already thrown money into.
It says a lot about Boeing that they are unable to even make 'traditional' docking programming work.
-
Thursday 9th July 2020 15:56 GMT Muscleguy
Re: So what happened?
<quote>It says a lot about Boeing that they are unable to even make 'traditional' docking programming work.</quote>
Exactly the ISS is hardly ultra modern tech and the Americans and Soviets managed to create common docking technologies in the ‘70s iirc. Also Soyuz is hardly hi-tech any more just more reliable than the American supposedly hi-tech stuff.
I can see the Americans going into Space and trying to colonise Mars and the Moon etc then the Chinese and Indians will come along and do it better, cheaper and more reliably and end up having to rescue the Americans when some crucial bit of hi-tech goes awry and cannot be fixed and Boeing and Space X have just gone bust so no resupply.
Chinese scifi such as Cixin Liu just take Chinese dominance as read with varying degrees of internationalism. The original Enterprise crew should have had more Chinese but back then a Chinese space program would have been a joke but the population would still suggest lots of Chinese and Indians in Space. Indian Engineers were hardly unknown in the ‘60s either.
-
-
Wednesday 8th July 2020 07:43 GMT Flocke Kroes
Re: Bean counters
Calling Boeing management "bean counters" implies an unproven ability to count. Boeing management do have an extremely valuable skill for their shareholders: They can get laws passed requiring NASA to buy from Boeing. They are able to do this because of Boeing's proven record of late and over budget delivery of defective equipment requiring purchase of yet another law forcing NASA to spend even more tax payers' money on Boeing.
-
Wednesday 8th July 2020 07:53 GMT AlanS
Re: So what happened?
The software company I worked for was owned by McDonnell Douglas 1988-91 and there was no shortage of engineering-based management then, so Boeing's decline likely has other causes.
My view from England is that the US stock market drive changed: preferring rising share price to dividends. In the short term it's easier to cut costs and increase profit margins, rather than improve the product and increase market share.
(Icon 'cos SpaceX mostly use Linux.)
-
Wednesday 8th July 2020 09:47 GMT goldcd
This
Although they seemed to have adopted the much simpler approach, of buying back their own shares.
I've no idea why this isn't seen as a giant red-flag.
You, as a company, have say 500 million you're not quite sure what to do with. Traditionally you'd leverage your resources and expertise to invest in new research/manufacturing with a view that you'll get a decent return on the investment, and ultimately an increase in your share price. Current approach is to just buy your own shares - same result to share price, but a lot easier.
-
Wednesday 8th July 2020 14:15 GMT lglethal
Re: This
Not defending it completely, but it can have a benefit, by reducing the amount of dividends (i.e. profits) you have to pay out to shareholders each year. Therefore, increasing your future ability to invest in research R&D etc.
However, most of the time thats not the reason companies are doing it, I know...
-
Thursday 9th July 2020 08:37 GMT Justthefacts
Re: This
No, that’s not the reason:
Share price is two things (simultaneously) - a fraction share of the company value, and a fraction share of the whole company income stream. Share buybacks give investors a bigger share of both, such that the Price/Earnings Ratio remains theoretically unchanged.
The actual rationale is that if you give dividends, investors have to pay dividend tax. Share buybacks are tax avoidance, pure and simple. If they do neither, the cash sits in the companies bank account, earning less interest than (hopefully) the company normal business - the overall margin of the business drops.
Another way to look at it: a company making 10 planes a year, at 10% margin, would be looking to expand that to making 20 planes at 10% margin. But if they can’t, they can leverage up so that half their shareholders get the “user experience” of being invested in the 20-plane company, without any transaction friction. The other half shareholders were willing sellers.
-
-
-
Wednesday 8th July 2020 14:53 GMT iron
Re: So what happened?
You're about 10 years too early. The damage was done when Boeing management, who used to be McDD management, decided to divorce themselves from engineering and move almost 2k miles away. The Atlantic has a very good writeup on how Boeing got into this state:
https://www.theatlantic.com/ideas/archive/2019/11/how-boeing-lost-its-bearings/602188/
-
Wednesday 8th July 2020 15:16 GMT conel
Re: So what happened?
This quote from Boeings CEO on why they moved the headquarters goes a long way to explaining the problems they're having.
Condit makes no secret of another factor: as CEO, he didn’t want to be bothered with tiresome “how-do-you-design-an-airplane stuff”.
https://www.forbes.com/sites/stevedenning/2013/01/21/what-went-wrong-at-boeing/
They've been going wrong for about 20 years now.
-
Wednesday 8th July 2020 16:08 GMT Anonymous Coward
Re: So what happened?
I worked with a whole bunch of ex Boeing software people just after the merger. Best software team ever. And I had worked in the Valley for more than 20 years.
McDD had a toxic shark pool reputation for middle / upper management and the sentiment in Boeing at the time of the merger was that even though McDD was the much smaller company the McDD people would quickly clear out the Boeing people.. Which is what happened. The numbers I heard was when HQ was moved to Chicago all the McDD people from St Louise offered relocation took it whereas only about 20 of the 300 plus in the Seattle HQ took relocation. Hardly surprising. Chicago is a huge step up from St Louis but a huge step down from Seattle.
Anyway in the next few years basically 70 years of Boeing institutional memory walked out the door. One way or another. Pretty much one whole generations of the most experienced engineers took early retirement or other positions. And the management culture was very deliberately destroyed. The consensus at the time was that it would take a while, a decade or two, but the company would suffer some huge catastrophe that would probably kill the company. Which is what just happened.
So the there maybe a company called Boeing still building aircraft buts its definitely not the same company as the one that built aircraft until twenty years ago. In the same way that AT&T is not the old At&T. Or Bank Of America. Or even IBM for that matter. Which by this stage is really just PWC. Only the names are the same. The culture and people that created the original great company are long gone.
-
-
-
Wednesday 8th July 2020 15:06 GMT conel
Re: So what happened?
It was the McDonnell Douglas acquisition, the same thing happened when McDonnell purchased Douglas.
The below paper was written by a Boeing engineer 19 years ago and is eerily prescient about the problems they're having now.
https://pdfs.semanticscholar.org/e9da/f5cc1c94c6e34e29095ca168e8fa2d750df9.pdf
-
-
Wednesday 8th July 2020 11:29 GMT not.known@this.address
Re: So what happened?
"That's the fault of the merger with McDonnell Douglas, who pushed out the engineering meritocracy based management at Boeing [...]"
That would be the beancounter mentatilty that took the Naval air superiority fighter proposal and turned it into the world-beating Phantom 2, the Air Force's air superiority fighter and turned it into the world-beating F15-E Strike Eagle, developed the MD-500 series helicopters, etc etc etc?
And exactly how many world-beating designs have come out of Boeing since the 1950s? Ones not relying on technology acquired from other companies, that is.
-
Wednesday 8th July 2020 21:46 GMT Snake
@not_known@this_address
"And exactly how many world-beating designs have come out of Boeing since the 1950s?
Oh, that would ONLY be the 707, the world's most successful first-generation jet airliner; the 737, the world's most successful airliner period; and then the 747, the world's first, and most successful, jumbo jet.
You give McDonnell-Douglas FAR too much credit: when you have been given a blank check by the government, one that covers cost overruns, 'unforeseen' expenses AND allowances for product delays, you'll be amazed at what even an incompetent can accomplish.
As proof, witness the "success" of MD's in-house, self-developed, self funded project, that ended up going over like a lead balloon: the infamous DC-10. So good that the sequel was renamed, to "MD-11", in order to avoid the stink of the original.
-
Thursday 9th July 2020 12:07 GMT imanidiot
Re: So what happened?
F-15? The design closely resembling the Grumman F-14 and based heavily on work done by NASA? Referred to by many as the last good aircraft they designed?
MD500 helicopter. You mean the Hughes 500, initially developed for the army as the OH-6? Only named the MD500 after Hughes was bought by MD?
McD-D wasn't always a bad company, but the rot set in somewhere in the 70s. By the time of the "merger" (or reverse hostile take-over) McD-D certainly was a hot mess in many aspects. The consequences were predicted by many (see links provided by others above)
-
-
-
Wednesday 8th July 2020 06:06 GMT lglethal
Re: So what happened?
"And maybe bring software development back to the USA."
I think you can stop trying to lay the blame on "dirty foreigners", there tiger. Unless things have changed significantly in recent years, only Americans can work on Starliner (and most NASA funded programs but especially anything to do with Human Spaceflight).
So this is completely down to American programmers. Or more likely their bosses, refusing to allow additional resources to be wasted on little things like reviews, testing, and hardware/software testing.
Leave the Xenophobia out of it...
-
Wednesday 8th July 2020 07:48 GMT ComputerSays_noAbsolutelyNo
Re: So what happened?
I would not trust Boing on that, surely they could out-source some components of the software. After all, if you're developing some top-secret military aircraft, an engine is an engine; and the sub-contractor is none the wiser.
Heck, in the aircraft industry it seems you need certification for every cable, nut and rivet you use. I wonder whether the 9$/hour Indian programmer involved in the MCAS system was FAA or otherwise certified for safety critical stuff?
https://www.bloomberg.com/news/articles/2019-06-28/boeing-s-737-max-software-outsourced-to-9-an-hour-engineers
In theory, it might be only Americans being allowed to work on Starliner; in practice, who knows?
Outsourcing done right, will return the same result as in-house development. However, what you save in in-house dev-work, you need to invest in a clear definition of the project, since you are by definition way outside the loop. Furthermore, you need to invest much more into quality control and oversight. Now, factor-in the bean-counters and wait for disaster to strike.
-
Wednesday 8th July 2020 08:49 GMT lglethal
Re: So what happened?
Well done on spouting complete bollocks and not knowing what you're talking about. But dont let that get in the way of making up conspiracy theories.
When working for NASA or on NASA funded Human Spaceflight projects you need to be an American. Fullstop. I can point to procurement documents that say that. Try and outsource around that and get caught and you would lose your preferential status, costing Boeing potentially billions. Not too mention the media and political fallout that would accompany it, and frankly not even Boeing management are that stupid.
As for comparing this with the 737, civilian aircraft have zero nationality requirements. You can outsource you're design and construction work wherever you want and indeed aircraft companies do, because it encourages those nations where the work is being carried out to buy Boeing aircraft and support their own local industry. Airbus does the same thing.
Even with military aircraft there are usually no nationality requirements. It's entirely based on getting a certain level of security clearance. Of course at the higher levels, you wont get the security clearance without being of the right nationalities, but that only applies to a small percentage of positions in the aircraft design.
As for your statement that "an engine is engine; the sub-contractor is none the wiser". All i can say is thank god you're not in charge of anything security related. Security through obscurity is what you're advocating and when your opponents (other nations in this case) are actively trying to find out more about your aircraft designs (and military aircraft specs are very high on the list of every intelligence services wishlist!), you really think that outsourcing like that is going to remain a secret? Intelligence agencies would have a field day with such an approach.
Whilst Boeing are definitely infected with Beancounter disease at the moment - cutting corners, failing to test critical items, and dropping the ball on quality - their are some rules you cant get away with cutting if you want to keep your cash cows. But by all means if you've got evidence that Boeing have been outsourcing their space program by all means - post it here. It would absolutely be newsworthy and El Reg would love to report it. But frankly you're talking bollocks.
-
Wednesday 8th July 2020 11:16 GMT macjules
Re: So what happened?
After all, if you're developing some top-secret military aircraft, an engine is an engine; and the sub-contractor is none the wiser.
Oh dear. "That engine looks like it could run at Mach 15: are we going to put it in a Project X jet? No, its just an engine - we are fitting it in a 737MAX."
-
Wednesday 8th July 2020 15:28 GMT Marcelo Rodrigues
Re: So what happened?
"I would not trust Boing on that, surely they could out-source some components of the software. After all, if you're developing some top-secret military aircraft, an engine is an engine; and the sub-contractor is none the wiser."
Tell that to the SR-71 and the Mig31. Both used unique developed engines. Or the GAU-8, that used the A-10 (yes, the cannon used the aircraft, not the other way around). By the way, it's engines where unique too: made to run continuously at 100% thrust at sea level, as required to close ground support.
One could outsource the commodity part of a military project, but even this must be done with extreme care - sometimes the most innocent piece of hardware can give a secret away.
-
-
-
-
-
Wednesday 8th July 2020 12:36 GMT ChrisC
Re: So what happened?
As per DS's suggestion - "Just require *them* to be passengers".
Some execs might be cold hearted ruthless bastards who wouldn't think twice about putting their partners, children etc. at risk if the payoff for a successful test was a bigger bonus cheque at the end of the year, but if you enforce requirement for them to put their *own* lives on the line, rather than allowing them to delegate the responsibility to anyone else (even their closest family members as per JSG), then maybe it would make a difference...
-
Wednesday 8th July 2020 13:55 GMT Anonymous Coward
Re: So what happened?
It reminds me of that story at an amusement park, where rollercoasters were experiencing (fortunately non-serious) issues even after passing daily inspections.
The issues stopped when the boss made the inspectors ride the first ride of the day, after they'd done the inspections!
I can't find a link. This story may be
apropheticalan urban legend.
-
-
-
Wednesday 8th July 2020 11:47 GMT Anonymous Coward
Re: So what happened?
Perhaps a few C-class firings without their pretty golden parachutes is what the company needs now
Nah. Mandate that the brass goes up and down with the vehicles they're designing, ditto for their planes. Personal exposure to dramatic and potentially lethal failure tends to wonderfully refocus the mind on delivering quality.
After all, once you get the quality right, shareholder value pretty much takes are of its own.
-
Wednesday 8th July 2020 16:48 GMT Anonymous Coward
Re: So what happened?
I once saw a TV show on US Army paratroopers. Part of the show covered the soldiers who packed the chutes. To ensure high quality work, the following measures were used:
1) all chutes went into a big pool and were issued randomly (no chance to be extra careful, or "extra careful, wink wink" with a chute for your buddy or your commanding officer)
2) those packing the chutes were fully-qualified paratroopers, who jumped regularly.
3) at any time, the supervisor could order you to immediately go on a jump with the chute you just packed.
I think I've related the story before, but it's a good one.
-
-
Wednesday 8th July 2020 14:12 GMT Bearshark
Re: So what happened?
Boeing troubles started immediately after the McDonald Douglas acquisition in the late '90s. As aki009 noted:
"Boeing shifted its focus from engineering to "share holder value"
People ask even today, "Who really bought who" during that acquisition. Once the transaction was complete, the MD executives basically took over. MD's culture has always been the "Share Holder" comes first.
That's 20years Boeing will never get back. And it seems this culture has spread to their industrial military complex businesses (including NASA).
Such a shame, Boeing used to the one of the worlds premier engineering companies.
-
Wednesday 8th July 2020 14:14 GMT A random security guy
Re: So what happened?
Rocket technology: even Elon Musk can’t hire foreign nationals. You have to hire US nationals.
Plus it is the management that needs to enforce quality hiring and practices.
You can’t have anyone to blame but yourself if you hire bad implementing and don’t run the system well. Money wasn’t the problem.
-
-
Thursday 9th July 2020 20:05 GMT Terry 6
Re: So what happened?
Not, from what I gather the C-Suite suits a sucj
h. One or two. These are beancounters put into place by the big shareholders, who want short term gains. And since everyone in and around the C level keeps their insanely well paid job and gets paid big bonuses for achieving those short term gains no one is going to challenge the strategy that creates them.
-
-
Wednesday 8th July 2020 19:35 GMT jelabarre59
Re: So what happened?
Were they designing in Seattle, implementing in India and testing in Zimbabwe? (Not that I fault Zimbabwe's space program for the failures.)
If it was engineered in Seattle, they probably hired their engineers in Chaz/Chop... (yeah, I know, the timeline is backwards...)
-
-
Wednesday 8th July 2020 07:39 GMT Caver_Dave
Re: History repeats...
I work with DERs (company representatives and FAA).
The FAA tend to do a good job with what resources they have. Unfortunately they seem to be constantly running with about 1/2 the staff they would need to provide comprehensive oversight. Thus, company DERs are often given far too much rein on the quality side, whilst they still receive the corporate pressure.
And the US government still has the FAA hands tied when it comes to space qualification.
-
Wednesday 8th July 2020 20:32 GMT F111F
Re: FAA Hands Tied w/Space Qualification
For very good reason. The Space industry is in its infancy, so until and if/when rocket transportation moves mainstream, let the rich folks pay their money/take their chances. They'll build up the knowledge and processes to build/operate/maintain a transportation node that can, hopefully, eventually translate to the public sector.
-
-
Wednesday 8th July 2020 15:37 GMT bazza
Re: History repeats...
To further extend the exploration of history. Anyone remember NASA not doing a full up integration test of Hubble before it was launched? You'd think that anyone with a passing knowledge of Things That Have Gone Wrong With Space Projects would know the mistakes that happened with Hubble and would be resolved not to repeat them.
I wonder if there's any internal emails from engineers to managers in Boeing saying "I advise that a full integration test is performed"?
Another thing I suspect is that, technically, as written, there's nothing wrong with Boeing's development processes. I suspect that their management is incapable of adherring to what's actually written down. This would explain why NASA seems to have been unsighted; they'd read the process docs from Boeing, the docs were fine, but the practice on the shop floor differed...
-
Wednesday 8th July 2020 22:44 GMT swm
Re: History repeats...
"Anyone remember NASA not doing a full up integration test of Hubble before it was launched?"
I believe that the main mirror of the Hubble telescope was figured with very precise laser interferometric testing. Unfortunately there was a .01" in the dimension of part of the test setup. This was cross checked with a knife edge test that showed the error but, since the laser interferometer was much more precise, it was assumed that the laser interferometer was correct.
You really can't do a "full up integration test" on this kind of system.
-
-
-
Wednesday 8th July 2020 08:30 GMT Gonzo wizard
It feels like Boeing suffered from overconfidence and the desire to grow the share price and therefore cutting corners, while SpaceX have more skin in the game (relatively speaking). I hope Boeing succeed, not just to give SpaceX a run for their money but because they are trying different things.
I like the idea of returning to land rather than the sea, with Boeing refurbishing the capsule whereas SpaceX will build a new capsule for each manned mission, the 'used' capsules being repurposed for cargo only. Lots to look forward to.
-
Wednesday 8th July 2020 10:43 GMT tonybarry
NASA has decided to allow SpaceX to use refurb Crew Dragon and Falcon 9 for crew launches. There are caveats - the units must not be leading-edge reuse numbered I.e. if the booster to be used is at six relaunches (and no booster has done seven relaunches) then it does not get used.
https://spacenews.com/nasa-to-allow-reuse-of-crew-dragon-spacecraft-and-boosters/
Regards.
-
-
Wednesday 8th July 2020 20:41 GMT F111F
Powered vs Parachute Landings
SpaceX planned on extending 4 legs through the heat shield and using the Super Dracos to fly a powered descent, with parachute backup. NASA, understandably, was concerned that poking 4 holes through the heat shield was not a proven procedure, and a powered landing vs parachute was a radical departure from the norm. So, if SpaceX was willing to invest a billion or so on their own dime and possibly delay the Crew Dragon, they could do it. SpaceX wisely backed down and changed over to parachutes and water.
Boeing all along designed their Starliner capsule to have impact-cushioning bags and not interfere with the heat shield, so since the Russians had done it forever, NASA said it was OK to proceed. SpaceX was too far along with Dragon to redesign to include impact bags, so they stayed with water landings.
-
-
-
Wednesday 8th July 2020 10:16 GMT Elledan
Nothing wrong with 'traditional' engineering
Traditional engineering techniques got humans into space, men on the Moon and allows us to this day to communicate with space probes outside of our solar system (Voyager 1 & 2). Flawed as the STS program was, it was not due to poor engineering. US companies like Boeing didn't roll all over competitors to their airplane business because they were famous for sloppy engineering, instead the US managed to churn out hit after hit with the 7x7 and a number of highly impressive military airplanes, most of which were designed before the advent of the IBM PC.
Speaking as someone who has been introduced to the miracles of 'modern' engineering (hi Agile/Scrum), I can tell you that it is definitely not the method, but the people. That includes not only the engineers, but also the managers, customers and everybody else in the same chain. Clearly something has gone horribly wrong within Boeing that they have stuff literally falling out of the sky and catching on fire, and I very much doubt it is because they don't hold enough daily stand-up meetings and retrospectives.
-
Wednesday 8th July 2020 12:28 GMT Mike 137
"“Perhaps we didn’t have as many people embedded in that process as we should have,” she said"
Perhaps you didn't have sufficiently competent people embedded in that process.
Software development is not yet a mature engineering discipline, but we're now using software for things that make that an imperative.
-
-
Wednesday 8th July 2020 17:08 GMT vogon00
Re: A calculation
Nice little calculation, that.....however, based on my thought/opinion of:
“The strategy was because we’re buying a service, NASA did not have a requirement to have a systems engineering management plan,"
Errrrr, if they were at all professional here, NASA should have at least had a requirement to *see* a plan, and preferably review it.
....that makes me want to suggest a modification of the formula to (S*T)+(N*(P*P))*K = R.
IMO the 'P' term is the one that is the prime cause of risk at the moment so I think it should be P-squared,..and it's influenced & modified by K, which is a measure of common sense (Ranging from 1=a healthy engineering based scepticism, to 100="We don't know how, but it'll be OK - it will just happen" optimism.
Space operations require quality, not cost and speed.
PS Full disclosure : I doubt I could do better now, as I've just caught myself with my nose inches from the screen when trying to figure out if I'd typed quotes or apostrophes. Damn getting older, and Damn small fonts :-) Looks like I need to change the handle to 'Magoo'...
-
-
Wednesday 8th July 2020 13:29 GMT Version 1.0
But "bugs" are normal these days
Today's software environment (look at Android phones) is that you write code and if it looks like it works you release it. No need to check that the code is completely bug free because you can release an update tomorrow... the "problem" that the management and bean counters see is that verifying that code is bug free costs money and takes too much time. Why bother doing a comprehensive test when you can post an update tomorrow?
As for Boeing's problems, do you think that anyone running the projects has ever read The Mythical Man Month?
-
Wednesday 8th July 2020 13:53 GMT Anonymous Coward
Certification and Funding
Hardware certification is something NASA and the FAA know how to do but both are constrained by their funding. Software certification is something neither of them really knows how to do and their funding doesn't allow them to build up a competent staff to do it. Plus, both are subject to political pressure and artificial deadlines.
Boeing, OTOH, has few funding constraints due to their Congressional support won by political donations and lobbyists reminding Congress that they or their subcontractors have a significant presence in almost every Congressional district.
Boeing could use a small portion of this largess to improve its software development process but it's cheaper for them to chop up the software and farm it out to subcontractors. Ultimately, this approach benefits the shareholders and that is management's top priority.
Besides, their contracts allow them to increase the price to fix the problems that they should have seen earlier.
-
Wednesday 8th July 2020 14:15 GMT Charlie Clark
Re: Certification and Funding
This isn't really about the quality of the engineers or programmers but how heavily politicised any large project at NASA is. Funding is continually being allocated, reallocated and removed. As a result, companies favour lobbying over product: it will only cost a couple of million to get a law that requires your company gets involved.
The next question: are the problems so severe that they can't be fixed? Seeing as the failure was not catastrophic that does look to be the case.
-
Thursday 9th July 2020 07:28 GMT Stoneshop
The next question: are the problems so severe that they can't be fixed?
Even a sufficiently large piece of space hardware dropping through the roof of the Capitol won't fix it as the lobbyists won't be affected and will just resume their work with the next bunch of representatives and senators.
-
-
-
Wednesday 8th July 2020 14:09 GMT A random security guy
Holding people accountable
Having headed security for a few tech companies, I realized that the biggest obstacle to developing quality code is the management, not the engineers.
Managers who are not measured on quality but on features and schedules will ignore quality even when they know it is important.
It is almost like a death wish.
-
Wednesday 8th July 2020 14:37 GMT Anonymous Coward
FIFY
"The full report detailing these changes will not be publicly released, however, as it contains Boeing's proprietary information that could allegedly provide its competitors an unfair advantage. That's amusing given Boeing is far behind rival SpaceX, and its tech doesn't even work properly. "
The unfair advantage is in the pointing and laughing part.
SpaceX has made mistakes, but less so like this. I do hope Boeing do better elsewhere, for the safety of those flying on them.
-
Wednesday 8th July 2020 15:47 GMT Stevie
Bah!
For shame, Boeing! No Red Team? Even after the Aeroplane Of Death fiasco?
I expect there will be a sizeable refund of taxpayer monies ... why are you all laughing?
And WTFingF are "traditional methods"?
Prediction:
"Of course, using FLOAT just because we were operating in zero-g was, in hindsight, a mistake."
-
Wednesday 8th July 2020 17:34 GMT Boris the Cockroach
Sounds typical
Aerospace crap to me
When we get new aerospace stuff in, its examined, inspected, process written up and 16 different forms created before we even cut any metal... and then its 100% with the inspection, check methods, dump the programs to the backing store and sign off the dump (means we know who created it all and when.... so no modifying)
Then send the parts to the customer with all the paperwork and hope it all flies through... heh flies.. get it... ok I'll quit that.
Take an aerospace part we've been making for years , its all 'meh' it looks ok... its size... send it... and the programs were changed about 3 yrs ago by someone to make it a bit quicker but we cant remember who changed it or what the change actually was....
Its the same attitude from NASA SpaceX.. new... check everything 14 times and then 15 more for luck... oh its Boeing... they know what they're doing... plus its 5 hrs from DC to Seattle.... it will be ok....
-
-
Wednesday 8th July 2020 22:34 GMT diodesign
More detail
Unfortunately, we're going on what the NASA people said on the phone call. If the report emerges, even in a redacted version, we'll go over it.
I imagine it's something like Boeing using a traditional waterfall development process, and SpaceX using an Agile process. At a guess.
C.
-
-
Sunday 12th July 2020 16:35 GMT kbutler.toledo
The article states: "At a press conference on Tuesday, NASA confirmed why Boeing's CST-100 Starliner spaceship failed to hook up with the International Space Station last year. The answer: as expected, buggy code."
Can anybody confirm that the same people who did the code for the 767MAX are NOT working on the Starliner?
-
Monday 13th July 2020 23:34 GMT jtaylor
"Can anybody confirm that the same people who did the code for the 767MAX are NOT working on the Starliner?"
I confirm that nobody who worked on the Starliner also worked on an airplane called 767MAX.
Look, these problems aren't the result of some rogue employee at Boeing. They're the result of deeply flawed management. And I'd bet more than lunch money that the problems go all the way to the top.
Turn it around: a capable manager can deal with an uncooperative employee. At Boeing, they successfully buried warnings from their employees in order to deliver an unsafe product.
-