back to article Open source databases: What are they and why do they matter?

For developers, there is no debate. The future of the database is open source. A glance at the 2022 Stack Overflow survey of around 70,000 code-wranglers shows nearly all pros use one of the two leading open source RDBMSes, PostgreSQL (46.5 percent) or MySQL (45.7 percent), although they use other systems as well. Oracle, …

  1. F. Frederick Skitty Silver badge

    "MariaDB was sharded out of MySQL"

    I first read that as *sharted* out of MySQL, which would probably be more appropriate.

  2. Charlie Clark Silver badge
    Stop

    Nuff said

    "The investor community was pretty clear that open source is a dying business model…

    It never was a business model. This just tells us all we need to know about the investors: they know nothing about software.

    1. Anonymous Coward
      Anonymous Coward

      Re: Nuff said

      Course they do how else would you explain Meta?

    2. Steve Channell

      Re: Nuff said

      In the real world "For developers, there is no debate. The future of the database is open source" is misleading, developers have a preference for open-source because they don't have to pay for it, but they also don't want to be the one to support it - devs would rather be an Oracle developer rather than a PostgresSQL DBA.

      For businesses the question does not primarily relate to license costs, but to recovery cost in failure, or support cost with performance problems. The problem comes with complex HA clusters and DR failover where there is little interest devoting time, and those that do, do-so because they work for a cloud vendor. Total cost of ownership of PostgresSQL vs MS SQL/Server is not necessarily in favor of open-source, especially when management insist on a support contract.

      The "investor community was pretty clear that open source is a dying" either relates to dumb investors, or investors looking at Snowflake and thinking that $12billion company shouldn't exist if the answer is open-source.

      With the move to cloud computing, the cost driver is scalability of managed instances rather than license cost of instances

      1. Charlie Clark Silver badge

        Re: Nuff said

        TCO is always difficult to work out but anything is cheaper than the system not running. But a lot of companies have found out that despite all the pay for licences and support, they get poor support. I've heard this particularly from Oracle. After all they've already got the cash and know that companies can't switch easily, especially if they buy up the competition, which both Oracle and IBM are good at. S&P 500 companies can probably afford to pass things up to the C-suite but there are plenty of smaller companies for which Oracle, et al look like costs plus contracts.

        With the rise of companies providing commercial support for open source databases and managed hosting some companies are finding they have a choice. Companies that provide support only have a greater incentive to provide solutions than those that can also look forward to juicy licence fees.

        Personally, I'm not keen on companies thinking they can skimp on DBAs by moving their data entirely onto someone else's platform but I can certainly see arguments for some degree of managed hosting.

      2. FIA Silver badge

        Re: Nuff said

        devs would rather be an Oracle developer rather than a PostgresSQL DBA.

        Trust me, no dev wants to be an Oracle developer. PL/SQL is arcaine, and using Oracle as anything more than a database is a path to vendor lock in hell.

        Oracle's a very competent database, but using it feels like typing all the way back to the 90s.

        COMMIT WORK; RELEASE;

        1. Steve Channell
          Unhappy

          Re: Nuff said

          fair point.. using oracle currently - nice that the RDBMS hasn't changed since '90s, shame that applies to the tools too

      3. standbythree

        Re: Nuff said

        "devs would rather be an Oracle developer rather than a PostgresSQL DBA"

        Absolutely not, no way. Your average developer would rather chew their own arm off than go back to dealing with the Oracle ecosystem.

        1. chasil

          SQL/PSM

          This is not entirely true.

          Fragments of PL/SQL have been adopted as an ISO standard, and implemented by several databases.

          The exception is Microsoft.

          https://en.m.wikipedia.org/wiki/SQL/PSM

      4. Anonymous Coward
        Anonymous Coward

        Re: Nuff said

        devs would rather be an Oracle developer rather than a PostgresSQL DBA

        Yeah-nah.

  3. sreynolds

    Could have fooled me....

    How much do Amazon give back to Postgress? SFA.

    1. Charlie Clark Silver badge

      Re: Could have fooled me....

      A rising tide lifts all ships… apparently.

      It will cost Amazon more to maintain their own completely private fork of Postgres than contribute relevant patches to the project now and then. But they're perfectly able to do that if they wish. Seeing as their revenue is based on the service they provide (managing the infrastructure rather than developing application) they're quite free to do just that.

      1. sreynolds

        Re: Could have fooled me....

        Amazon forked off long ago and they can go and fork themselves over and over again.

        1. Charlie Clark Silver badge

          Re: Could have fooled me....

          The licence was chosen to make it easy to fork. And, of course, they'll have forked if they want a version tuned for their needs, not least for release management. But that doesn't meant they don't engage with upstream developments: they'd be missing out on some pretty good stuff and incorporating in a completely separate tree will become increasingly difficult.

      2. Anonymous Coward
        Anonymous Coward

        Re: Could have fooled me....

        You're absolutely right - just look at what happened with Elasticsearch,

        Amazon doesn't want to fork $DB product because of money and cost, not because of some altruistic reason,

        To add - there actually *is* a fork of Postgres... sort of. The "serverless" databases they offer as the Aurora product run Postgres (and MySQL), and the code underneath is surely a hacked-up fork of that DB.

  4. Tom7

    Free is, well, free

    It seems odd to talk about how FOSS databases are dominant in startup culture without mentioning that an Oracle database license costs five figures per CPU. If you're using Postgres or similar and you become capacity constrained and want to expand, you shell out an extra $10 per month to AWS or whoever and spend a few hours configuring it all. If you run Oracle and want to do the same, you call your local salesman and tell him you're bent over, ready and waiting. In a time when software scalability is everything, what sort of startup wants to expose themselves to the risk that they'll be successful and need to buy more Oracle licenses at whatever the hell the going rate is then? It's not like you'll have a choice; shell out or your service will fall over.

    1. Anonymous Coward
      Anonymous Coward

      Re: Free is, well, free

      If you're one of the in fashion, investor backed startups even Oracle licenses are a drop in the ocean compared to the rest of the money going round your company :-)

      1. EmilPer.

        Re: Free is, well, free

        I guess you have not used Oracle, else you'd know about the extra expenses with trained DBAs: Oracle has horrible usability and primitive auxiliary tools.

      2. DJV Silver badge

        Re: Free is, well, free

        Hi Larry. Are you nearly out of yachts or something?

    2. Anonymous Coward
      Anonymous Coward

      Re: Free is, well, free

      " In a time when software scalability is everything, what sort of startup wants to expose themselves to the risk that they'll be successful and need to buy more Oracle licenses at whatever the hell the going rate is then? It's not like you'll have a choice; shell out or your service will fall over."

      This not only applies to startups but big companies as well. When Oracle changed their licensing to apply by CPU, in the mid 00s if I recall, the big DC I was working in received eyes watering bills to cover.

      After that, every new DB would be on OSS, and they desperately tried everything to get rid of Oracle DBs.

      I'm wondering who is still installing Oracle DBs those days ...

  5. Doctor Syntax Silver badge

    MariaDb and BSL

    MariaDB seems to have become the favoured RDBMS for many FOSS applications. This mention of BSL, therefore, worries me somewhat. I run a NextCloud server at home on a Pi. This is undoubtedly production - several directories on my laptop sync with it every day. Should I have a paid for licence? If not, how is this differentiated from production that does require a paid-for licence?

    1. F. Frederick Skitty Silver badge

      Re: MariaDb and BSL

      Based on my own research while at a former employer, the BSL only applies to the MaxScale feature and an add on for the column store engine.

    2. Anonymous Coward
      Anonymous Coward

      Re: MariaDb and BSL

      That confused me as well, this was the first I have ever heard of this BSL thing (when did that come into being?). Most, if not all, Linux distros have been gradually moving away from MySQL to MariaDB over the past few years, with no mention of this new licence and any potential issues that it may cause (or, at least, not being very vocal about it, if they have noted it).

      But the MariaDB(.com) website still says there is a free MariaDB Community Server edition, although it doesn't make it very obvious what licence applies to it. Presumably you can find the details on further digging, but it's very definitely not good practice to not make the terms clear up-front.

      Interestingly, the MariaDB page on Wikipedia (and they might just happen to have a particular interest, given that they use it themselves!) says that:

      The MariaDB Foundation mentions:

      MariaDB Server will remain Free and Open Source Software licensed under GPLv2, independent of any commercial entities.

      Perhaps not surprisingly, it seems that the .com website tries to confuse in a spew of marketroid dribble, whereas the .org site tries to explain, but maybe relies too much on volunteers and 'copious free time' to keep it properly up to date?

      1. unimaginative
        Facepalm

        Re: MariaDb and BSL

        The .com site is perfectly clear too. The author of the article got confused for no good reason.If you hover on "products" or click "pricing" or "downloads" in the main navigation its made clear, and if you go to the licensing FAQ

        In fact MariaDB cannot make changes to the core product license because the copyright belongs to Oracle. Not unlike Apple and Google and others with Blink/Webkit browsers derived from KHTML.

        Cockroach DB is partially BSL, but note that the BSL now means features are released as proprietary and automatically relicensed as open source a few years later. Its somewhat like the terms for Qt - although that is enforced by a contract with the KDE Qt Foundation AFAIK rather than being part of the license.

    3. Tim99 Silver badge

      Re: MariaDb and BSL

      If you are running on a Pi, have you considered SQLite? It is more capable than many think: SQLite.org - Appropriate Uses for SQLite (Websites).

      1. swm

        Re: MariaDb and BSL

        I like SQLite. Firefox uses it for its various databases. I use it for creating a large website. The database is all in a single file but has no authentication controls but it is fast and light weight.

      2. Doctor Syntax Silver badge

        Re: MariaDb and BSL

        NextCloud only recommends SQLite for testing and minimal instances. I suppose this does count as minimal but I take that as "not really for production".

        But I'm developing a desktop application for my own use and inclined to SQLite for that.

      3. find users who cut cat tail

        Re: MariaDb and BSL

        Second that. Here, have a useful DB decision chart for free:

        Can SQLite handle this?

        Yes → Use SQlite.

        No → Consider other options.

      4. Charlie Clark Silver badge

        Re: MariaDb and BSL

        I like SQLite a lot but the lack of data types can be a real problem.

    4. AVee

      Re: MariaDb and BSL

      Firstly, if you install something from Raspbian repositories it is save to assume you can use it pretty much any way you want, they probably would not distribute something with restrictions like that. And if you want to be extra sure you can always use plain Debian, which is really strict about licenses.

      Alternatively, you could consider using Postgresql instead. I run a Nextcloud instance with Postgresql on a low end VPS just fine. I have no reason to assume it won't also work fine on a Raspberry Pi.

  6. EmilPer.

    it is not about open source, it is about usability

    Oracle is a horrible beast to use ... had it been free I'd still go for MySQL or Postgresql ... hell, I'd expect to be paid to use Oracle, it is that unpleasant to work with

  7. elDog

    So you talk about relational DBs and touch on one NoSQL. What about other models? Graph-based DBs?

    If this article had stated its restriction to primarily RDBMS then that would be fine. But there are many other types of DBs in use in real production.

  8. deadlockvictim

    Microsoft SQL Server

    There is a new version of SQL Server in CTP (aka preview) edition at the moment: SQL Server 2022, but you'd never know it.

    Microsoft treats SQL Server as a burden these days. It's Azure or nothing. And not everyone wants to go cloudy.

    How dare you run software on-premises?

    SQL Server is not going to go away but with the amount of love it is receiving, I do wonder if there will be another version this decade.

    And with all the love & support that SQL Server receiving from Microsoft, I see posts for PostgresSQL more often now on SQL Server noticeboards, fora and the like.

    It is good to see Microsoft indirectly supporting Open Source.

    1. HereIAmJH

      Re: Microsoft SQL Server

      SQL Server is a mature product. SSMS is a pretty good tool. So serious question, what does it need that would require a new release? The only thing that really causes me grief is the config program for SSRS has to run as local admin. I'd also prefer the Failover Cluster manager to run under some group besides local admin so that DBAs could move roles between nodes, but that isn't part of SQL Server.

      1. Alex Stuart

        Re: Microsoft SQL Server

        > SQL Server is a mature product. SSMS is a pretty good tool. So serious question, what does it need that would require a new release?

        Barring a few nice-to-haves - some of which will be in 2022 - I'd agree with this.

        I work with SQL Server by trade so I'm biased, but I've also used Oracle, Postgres and MySQL.

        What you get with SQL Server is a very mature product with excellent tooling, documentation and support, nothing else ticks all those boxes at once. It's also excellent at doing what it's designed for - crunching *relational data*.

        If you want to do non-relational stuff or some massive custom scaling solution then yeah, look elsewhere.

        1. AMBxx Silver badge

          Re: Microsoft SQL Server

          Few new features in 2022: you can truncate dates and they've added greatest and least functions. All of those are already in PostgreSQL.

          I've move from MS SQL to Postgres over the last 2 years. Mainly due to customer pressure. There are things I miss about MS SQL (SSMS mostly). The problem for MS is that once people are on open source, there is little reason to go back to paying for this stuff.

    2. werdsmith Silver badge

      Re: Microsoft SQL Server

      Not only on-premise, but using SQL Server in a cloud provider other than Azure seems to be a bit awkward these days. Not necessarily as as a server DB, but hosted on virtual infrastructure within a cloud provider.

      I notive htere's a thing going on now when a new solution is provided, the thought process is to see if it can be done with Postgres or Maria, and if there is anything in SQL Server that compels its use. SQL Server still a strong candidate, but more and more stuff is being picked up by Postgres. There has been for a long time a thing for avoiding Oracle and removing Oracle if it's infested anywhere.

    3. bombastic bob Silver badge
      Devil

      Re: Microsoft SQL Server

      perhaps if Micros~1 were to switch to PostgreSQL (and stop calling it "sequel") rather than using SQL Server as its basis. A handful of compatibility add-ons for PG could be easier than maintaining an entirely separate code base...

      but of course the add-ons would have Micros~1 licensing so not sure how well THAT would work out.

  9. cschneid

    stack overflow survey participants as a representative sample

    Perhaps taking the results of the Stack Overflow developer survey as representative of whatever point you would like to make isn't as persuasive as you might imagine.

    Just as an example, you won't see much DB2 or IMS or VSAM because mainframe developers mostly don't ask their questions on SO. They usually have a support structure built into their organization.

  10. VoiceOfTruth Silver badge

    MariaDB licensing

    -> MariaDB, a fork of MySQL, and CockroachDB, a distributed RDBMS, adopt what they call a Business Source License (BSL). This is a "new alternative to closed source or open core licensing models,"

    MariaDB was forked from the GPL version of MySQL. How is it possible to relicense it under a different license?

    1. Irony Deficient

      MariaDB was forked from the GPL version of MySQL.

      How is it possible to relicense it under a different license?

      The answer hinges on use of the proper pronoun: MariaDB is a “them” rather than an “it”. The MariaDB server was forked from MySQL, and remains under the GPL. The MariaDB client libraries similarly remain under the LGPL. Neither the server nor the client libraries have been relicensed. To date, only the MaxScale and ColumnStore Cluster Management API products are licensed by MariaDB Corporation Ab under the BSL.

      1. VoiceOfTruth Silver badge

        Re: MariaDB was forked from the GPL version of MySQL.

        Fair enough. But if they create programs linked (in the programming sense like ld) to MySQL, do they not need to be GPL to? I don't know how MaxScale or ColumnStore works.

        1. Irony Deficient

          But if they create programs linked […] to MySQL, do they not need to be GPL too?

          Not necessarily — see here for a non-legalese explanation (e.g. the “Internal usage is free” paragraph).

  11. Abominator

    Stock Postgres thanks.

  12. RichardB

    Interesting to get through that and not see any reference to the incredible but commercially failed RethinkDB, and the story written about it's demise.

    https://www.defmacro.org/2017/01/18/why-rethinkdb-failed.html

  13. IamAProton

    Tooling for devs

    I work almost exclusively with MSSQL, both as a dev and dba.

    I would like to use Postgre, but as far as I know there is no 'decent' tool for deploying a the db changes from version control.

    This is the major issue for me switching to PG for new projects, I do not want to deal with manual db deployments/ incremental scripts etc. especially when multiple devs work on it (devs are usually pretty bad with DB)

    SSDT/Database projects, despite taking sometime to get right, work amazingly, It's a pity there is no such a thing for PG

    1. This post has been deleted by its author

    2. Pierre 1970
      Megaphone

      Re: Tooling for devs

      AFAK, there is no management and administrive tooling as the one for SQL Server Databases. I'm working also with MySQL, Redshift, MongoDB and no client get no even close to that.

      I've to agree that in this new days of Devops methodologies the way to go is go back to scripting all, but for certain task, having the managements tools, both graphical and text, provided by the main vendor should be a must.

      (and yes, I'm old enough and definitively not fond of this new shiny web consoles)

POST COMMENT House rules

Not a member of The Register? Create a new account here.

  • Enter your comment

  • Add an icon

Anonymous cowards cannot choose their icon

Other stories you might like