Oracle Has More Flaws Than SQL Server 229
jcatcw writes, "Next Generation Security Software Ltd. of Surrey, England, compared bugs in Oracle and SQL Server that were reported and fixed between December 2000 and November 2006. The tally: Oracle had 233; MS SQL had 59. The products compared were Oracle 8, 9, and 10g; SQL Server 7, 2000 and 2005. From the article: '[The head of the survey said,] "The results show that the reputation that Microsoft SQL Server had back in 2002 for relatively poor security is no longer deserved."' Oracle's response: 'Measuring security is a very complex process, and customers must take a number of factors into consideration — including use-case scenarios, default configurations, as well as vulnerability remediation and disclosure policies and practices.'"
translation (Score:5, Funny)
Oracle's response in english: Clearly you have no idea what you're doing, because your results showed us in a poor light. Perhaps you'd like to try again. We have a bag of money for you.
Re:translation (Score:5, Insightful)
Re:translation (Score:5, Insightful)
Oracle is a huge robust database with lots of extremely security conscious clients. A high number of reported bugs and fixes shows that they're executing due diligence, and working to keep their system as secure as possible. MSSQL's low number of bugs suggests that Microsoft isn't digging hard into their code, but only waiting for big public flaws.
They used the same argument in claiming that IE was less buggy than Firefox (see this crappy article [informationweek.com]) and it's just as untrue in this case.
Re:translation (Score:5, Informative)
Thor (Hammer of God) wrote:
David Litchfield is one of the most predominant security researchers in the field, particularly in the area of database security. He and NGS have discovered more combined security vulnerabilities in leading DBMS products than anyone else in the world.
Given this fact, I think that not only is it appropriate for David to give whatever opinions he chooses in his research, but that it is his opinions that actually give the research real, tangible, applicable value. With his indisputable status as an authority on database security and his unwavering integrity, I have no problem whatsoever in considering Dave's opinions to be "fact."
Actually the whole discussion on BUGTRAQ is definitely worth reading. By the way the vulnerability behind Slammer was discovered by guess who - David Litchfield.
Re: (Score:2, Interesting)
Slammer anyone?
The slammer worm was released in 2003, and affected a vulnerability that had been patched eight months prior. The last discovered vulnerability for SQL 2000 was in January 2004.
A high number of reported bugs and fixes shows that they're executing due diligence, and working to keep their system as secure as possible.
heh. You used Oracle and Due Diligence in the same sentence.
MSSQL's low number of bugs suggests that Microsoft isn't digging hard into their code, but only waiting for big public flaws.
Possibly. There is another possible reason for the low number of discovered flaws, but I don't think you want to hear that one.
Re: (Score:3, Insightful)
Re:translation (Score:5, Insightful)
Lets face it, a bug report can be anything from a misspelled error message to a gaping sa/root/admin (whatever oracle calls it) compromise.
Severity is important. For instance, most popular linux distros (minus gentoo) have quite a few security holes do to third party package inclusion. Often the holes are not severe, but they do make linux look artificially insecure compared to some other operating systems. If redhat pushed 90 updates a month at you and Microsoft only 35... well who looks less secure? How many were feature enhancements? How many did each vendor NOT include a fix for?
Disclaimer: My above reference to linux distros only includes bloated packages like redhat, suse, etc. Most people using these distros tend to do a "full install". I'm a mysql or sql server user whenever possible.
Often one could argue that smaller companies get less attention so a large number of vulnerabilities would indicate a very insecure product. Oracle is obviously smaller than microsoft as a whole. In this case, oracle gets a lot of attention as its used for large scale deployments as well as their *lovely* business practices.
Re:translation (Score:4, Interesting)
If that is the case, oracle's mgmt tools heavy reliance not only on java, but *specific* version of java
w/o updates I'm aware of, would explain a lot.
off the top of my head:
Input fields that don't register the first key press, menu item that don't redraw for some reason, refreshes and connection errors that require exit/relaunch.
Other frustrations like that, that aren't oracle's "fault" per se, but don't help the spec/check sheet for bugs.
Didn't RTFA (yet), but are those counted as bugs? I'd like to know.
Re:translation (Score:5, Insightful)
This is like saying that Fire Department A put out less fires than Fire Department B. That's nice, but what I really want to know is how long it took for the trucks to arrive, the size of the fires, and also if there are any houses that burned down before the Fire Department got there.
Re: (Score:3, Interesting)
The bottom line is of course "Am I more likely to have a security problem while using Database A or while using Database B?" Perhaps some studies ought to be done to determine the relationship between measurable things like number of bugs, time to patch, etc, and various user's perception (or perhaps security pros' perception) of how many security problems were actually had. Then we'd be able to actually assign some sembl
Re: (Score:3, Interesting)
My biggest surprise here is that they only found/or reviewed less than a couple hundred bugs each. Strange, because I am sure that I can find more bugs than that in 4 days work on each product. This research can't be all that deep. I must be missing something???
Any normal QA person would be able to find that many bugs in 10 or 20 days.
If you offer a ton of additional features... (Score:3, Interesting)
...then it stands to reason that you will have a ton of additional bugs.
This argument in no way excuses Oracle for their timely patch cycle (or lack thereof), but may explain the higher number of patches.
I haven't looked at the Sybase/SQL Server family for awhile, but I assume that it still doesn't offer anything like Flashback, LogMiner, richer indexing, direct LGWR connection to DataGuard, resumable transactions, or even basic multiversioning.
Re:If you offer a ton of additional features... (Score:4, Insightful)
It is also important that Oracle supports virtually any server platform in current use, while SQL Server only supports a small number of similar platforms. Back in 2001 I was still getting support for Oracle 7.0 on VAX/VMS! One get Oracle on Linux, AIX, Solaris, HP-UX, zOS, OS400, Windows, a variety of Alpha platforms, Itanium platforms, etc. And this isn't shallow level support. Oracle can utilize their own file systems, so they are going at the bare hardware on all these systems. Care to guess what that does to the QA cycle?
Oracle is the shiznit when it comes to high performance general database work. It will scale far beyond almost everything else, with DB2 a close #2. Niche players like TeraData have their place too, but only Oracle can scale across the entire enterprise.
Re: (Score:2)
> with DB2 a close #2. Niche players like TeraData have their place too, but only Oracle can scale across the entire enterprise.
Sure, if you're talking transactional systems (like airline reservations). But if you're talking about data warehousing, very large scale analytics - then db2 and teradata have the upper hand. Oracle's clustering is for failover, db2's clustering
Re: (Score:2)
Plus con
Re: (Score:2)
Re: (Score:2, Funny)
Re: (Score:3)
Re: (Score:2)
Arguably every OS should come with an RDBMS and applications should make more use of it instead of depending on a broad assortment of different mini-databases like sqlite and such. There's nothing wrong with them on their own but with ten programs that each use them, I've effectively got ten copies of sqlite (tiny - not a big deal) which each may be of a different version (which i
Re: (Score:2)
There's no good reason that such a facility would be open to remote exploitation or even have a facility that could be set up in a remotely exploitable fashion.
Although this isn't about what your mother stores all of her recipes on. This is about what your bank stores your net worth on.
Re: (Score:3)
Re: (Score:2)
I'm going to assume a great deal of the bitterness towards SQL Server on here is just because it's Microsoft. However, it has its roots in Sybase, which when I used it several years back I found to be very good. We've not had any
Re: (Score:2)
Re: (Score:2)
Try ubuntu. It comes with one version of sqlite (3.0), and every piece of software can use only this version. So from amarok to xine, they all use the *same* sqlite library. And you get security upd
Re: (Score:2)
Re: (Score:2)
Re: (Score:2, Insightful)
Re: (Score:2)
I would not be at all surprised if Microsoft has banks of servers do nothing but continuous randomized testing of their database product.
Summary title is vague (Score:5, Insightful)
Granted, the summary does explain that the article does indeed refer to MSSQL Server, but please stop calling it just SQL Server. MSSQL Server != SQL Server
(OK, I feel better. What is the moderation for RANT?)
Re: (Score:2)
Re: (Score:2)
Re: (Score:3, Funny)
Re: (Score:3, Informative)
Re: (Score:3, Funny)
Re: (Score:2)
Re: (Score:2)
Re:Summary title is vague (Score:4, Interesting)
Re: (Score:2)
Re: (Score:2)
> of another product of theirs was actually "Windows" and not "Microsoft
> Windows"
They didn't. They were about to lose their suit against Lindows and with it the WINDOWS trademark when they ponied up enough cash to buy an out of court settlement.
Firefox Has More Flaws Than Web Browser? (Score:2)
yes, what exactly is the title talking about?
Re: (Score:2)
They are called context clues. "SQL Server" is used above as a proper noun, look at the usage: "than SQL Server".
It's not "than an SQL server", not "than other SQL Servers", just "than SQL Server".
If you don't know that they are talking about Microsoft's product, then you are not in the DB business, and the story wasn't intended for you. (Not to say you can't read it, in fact if you RTFA you will learn that SQL Server is a PROPER NOUN).
Re: (Score:2)
Re: (Score:2, Insightful)
That would just be silly.
So, your anger is Microsoft's gain. And every time you get angry at Microsoft, they kill a kitten.
Re: (Score:2)
As in: Why is &#@*& Oracle ignoring my indexes and forcing a hash join on two 1M+ row tables AGAIN? GAAAAH!
People will know what you mean.
Re: (Score:2)
Re: (Score:2)
-1, You know what he meant you pedantic ass
Re: (Score:2)
I understand where it comes from, but SQL and SERVER are both industry terms, link ANSI, ASCII or C. When someone says a program is written in C, do we assume that it was written with Borland C? I just don't like the way MS trademarks generic names to try
Re: (Score:2)
Oracle is more complex (Score:5, Insightful)
Re: (Score:2)
Oracle is right (Score:5, Insightful)
Re: (Score:3, Insightful)
Re: (Score:2)
Stop counting flaws! (Score:5, Funny)
Re: (Score:2)
Re: (Score:3, Funny)
You are vastly oversimplifying, and clearly have not funded a study of the market. Cottage cheese passes an ACID test, and I hear that Swiss Cheese is full of holes.
Re: (Score:2)
Re: (Score:2)
Check the data and the criteria before deciding (Score:4, Funny)
Not least the criteria for selecting and enumerating flaws, and any differences between those criteria for the two products. Not saying that there is a problem, just that any prospective customer needs to take this into consideration and check his facts.
This whole study reminds me of a couple of years ago, when someone decided to make a comparative list of security flaws between Windows and Linux. For the former, they only included official Microsoft security fixes. For the latter, they included just about every bug in every open source project known to man. Big surprise, Windows was found to have less flaws.
When it comes to security, trust no one. Especially not research firms, security "specialists" and people mouthing off about security on Slashdot.
Hey, waitaminute....
Reported AND fixed (Score:5, Interesting)
Reported and fixed means that the company which doesn't fix bugs looks more secure. Not that I'm implying that MS is worse than Oracle on this, mind you. I just wanted to point out that this metric has loads of potential flaws.
What, specifically, are those "bugs"? (Score:5, Insightful)
Let's see that again.
The study looked at vulnerabilities that were reported and fixed...
So, if it wasn't fixed, was it counted?
Huh? Security is not about "software development life-cycle".
That's why you have almost daily updates of anti-virus software for Microsoft products.
Big time. One remote root vulnerability is worth 10,000 local app crash vulnerabilities.
Yep. Because Ubuntu has, by default, no open ports. So it is, by default, 100% resistant to worms.
Remember, you can never count on a user applying a patch. Your system has to be as secure as possible in the default, unpatched, configuration.
Not only is it not "the best approach", it is a fucking idiotic approach only used by morons who have no understanding of what "security" is.
It's not the number of bugs. It's what access can be gained by that bug and how easily it is to invoke that bug in the various "standard" configurations.
Re:What, specifically, are those "bugs"? (Score:5, Insightful)
Not all worms require open ports to spread - a worm might target a low-level kernel flaw in the network stack (remember the ping-of-death?).
Re: (Score:2)
It's not a Good Thing that this is necessary (which, I'm guessing, was GP's point - Microsoft, and its software development lifecycle, produces OSes that are so insecure that they require anti-virus tools to be updated daily).
If MS SQL Server only had one vulnerability (Score:2, Interesting)
More bugs fixed == less secure? Since when? (Score:2)
Maybe it's just me, but wouldn't it be more important from a security standpoint to determine which had more bugs that were reported and not fixed? Or even which has more bugs that weren't reported (which is, of course, undefined, and therefore invalidates this ridiculous study)?
Or perhaps weight the severity of the bugs?
I'm bitter
More FUD (Score:3, Interesting)
Who cares?
They both sound like risky propositions (Score:2)
David Litchfied (Score:4, Informative)
NGS have of course done work on SQL Server for Microsoft; I refer you to the brief and rather one-sided flamewar on Bugtraq/FD that erupted when this was pointed out... actually see for yourself [neohapsis.com]... (and here's the Bugtraq thread [neohapsis.com]). I predict this will deal with 75% of the "but this is nonsense, because..." posts ;)
He's got a lot of credibility. This is the point I'm trying to make :)
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
59 bugs reported and fixed... (Score:4, Funny)
Re: (Score:2)
My experience (Score:5, Informative)
We never contacted Microsoft with anything but the most severe bugs, and only those not documented on their web site. Even having the highest contract possible with Microsoft, they charged us for each phone call. Never once did the first 3 people we talked to have a clue. After going through 3 or 4 people we got to speak to a developer. For every bug except one, we were told to wait for the next official patch or Service Pack to fix our issue. One time we were fortunate enough to have a DLL updated by a developer and sent to us directly. Response by developers was very quick, but the other staff responded slow.
At the same time, Oracle was paying out $10,000 for each bug found. I thought I found the golden ticket. Turns out someone else had reported this extremely obscure bug I found earlier, but it wasn't yet published online anywhere. Every time we contacted Oracle we got to speak to a developer very quickly. On at least one occassion they sent a developer to our office to help investigate a bug. Every bug we reported got a patch very quickly.
The support from Oracle was far far superior to Microsoft. The bugs I ran into with Oracle were also far more obscure than those I found in Microsoft's SQL Server. I couldn't believe some of the things Microsoft left broken for months. Even if Oracle has a larger number of reported bugs I'd pick them over Microsoft any day.
Re: (Score:2, Informative)
Not only do even the basement support plans include free support calls, you are never charged if it's a bug in their product. So either you're a very poor communicator, a liar, or what you were calling about wasn't a bug at all.
Re:My experience (Score:4, Insightful)
Oracle on the other hand request your support contract no (which they will actually look up for you) once you get past that really minor issue you never hear anything about money again. If you are unlucky enough to have a real bug that gets escalated you have the fun experience of hearing from someone from oracle every few hours - the calls seem to come from all over the world (based on accents etc)
More than once I have had a custom patch created for what to oracle must have seemed like a really minor bug.
Re: (Score:2)
But you have to hand over the credit card *first*, as the other poster said.
Re: (Score:2)
Every bug we reported got a patch very quickly.
Wait, this is the same Oracle that silently fixes bugs three years after they've been reported?!
This study doesn't make SQL Server look good. It's security record is pretty average over the last couple of years, since the SDL stuff Litchfield mentions. (A comparison of MSSS with MySQL and PostgreSQL... now, that would be interesting.) Oracle are without doubt the worst so-called "Enterprise Software" vendor going today; their attitude is notorious. The fact that they make MS SQL server look good by compar
Re: (Score:2)
Re: (Score:2)
I have personally stumbled across at least a dozen undocumented bugs in MS SQL Server and VB. Most of the VB ones (which I didn't report) turned up in the "Knowledge Base" eventually. Every initial call to Microsoft support required the submiss
Re: (Score:2)
Sounds more to me like it was the "highest possible contract" they could find on the web site, and that was a decade ago, or something along that line. I'd feel gipped if I was you
Re: (Score:2)
In Oracle's (Pseudo) Defence... (Score:4, Interesting)
As much as I dislike Microsoft products (Score:2)
I think this study might not be as much fud as some are making it to be. Oracle is the kitchen sink and has many components such as development tools an d apis that come with their product. Microsoft has them as well but bundles them with MSDN and VS.net. So if you compare the development tools that
Yes it is complex to count flaws (Score:2)
1) Locking down SQL Server is much harder. It is easier to run Oracle as a restricted user than SQL Server, reducing vulnerability. SQL Server, if you want to use SQL Agent, replication or other high end functions requires you to elevate the privileges under which you must run it.
2) SQL Server is *much* more reliant on the underlying OS. Which means you may want to count at least some of the OS
More Flaws (Score:2)
This just in (Score:4, Funny)
SQL Server (Score:2)
Not that im a MS fan, but i do give them credit when its due.
Where's the rest of the picture... (Score:2)
I realize they're only comparing the two, but why?
That's a bit like only comparing BMW and Lincoln when comparing car brands for safety. Sure, it's useful to see one relative to the other, but removed from the overall marketplace, it's not a particularly useful comparison.
Re:Features? -- defend your answer! (Score:2)
So for from what i've seen in SQL Server 2005, it doesn't seem that bad. At work, we're experimenting with the new mirroring feature on some test servers.
Re: (Score:2, Insightful)
My spidey senses tell me that you've never actually used SQL Server at all.
Re: (Score:2)
Seriously, I wish people could come up with cogent arguments instead of "sux, half-assed implementation, or crashes all the time"
My organization uses SQL SERVER 2005 and we have had nothing but great success. I especially love the XML data type with schema binding. In my recollection, the only failures we have had was either hardware-based or DBA-error.
Cheers!
Re: (Score:2)
Re: (Score:2)
Really, this post parses to: Product A is WAY better than brand X! Even product C is better than brand X!
I see claims like that in TV ads all the time; I'm not tempted to call them "informative."
Re: (Score:2)
Actually, the argument here is because a product has less bugs reported and fixed, it is therefore more secure than one with less bugs reported and fixed.
That this metric is clearly bogus is, well, pretty obvious, since with two initially identical products, with the same bugs reported, the product which has the fewest bugs fixed will be rated "more secure".
Re: (Score:2)
1. If you're buying software rather than developing it yourself, the first question isn't "is the database secure?", it's "does this software solve my problem?".
2. If you are developing software yourself and you're concerned about security, you should be putting a firewall between the database server and the app server, and setting various standards in your development processes which say things like "all data will be checked before being pass
Agreed! (Score:2)
Re: (Score:3, Interesting)
The "flaws" I've experienced with SQL Server either made my server crash or corrupted my databases to all hell. I've never had an Oracle server (or any other vendor's product) corrupt my tables, thank you very much. I think MS brought this "feature" over from their Jet / Access engine.
If you compare the severity of these fla
Re: (Score:3, Interesting)
There is cruft in Oracle that dates back to the mid '80s and it's showing.
Oracle needs a through refactoring. They'll either do it under their own steam or the market will do it for them.
Well, no not really. There is old code in there, but it is not cruft, but well functioning code.
I'm also concerned about Oracle's development practices.
What? Can you explain what you mean because I have no idea what you are talking about.
Quality is continues to be poor for the first few releases of any new feature. Witness 10g EM; there are .nohup files lurking in (*nix) log directories. I find that astonishing.
Huh? What exactly war you talking about? Oracle does not store any files in standard *NIX log directories.
ASM won't be suitable for widespread use for two or three releases, 11xR2 or something. That should have been right on try #1 six or seven years ago.
Completly wrong. Thousands of customers are using ASM today and with great success. Please explain what the heck you are talking about.
Re: (Score:2)
Microsoft and Sybase were not "working together" on anything. Microsoft bought the source code for the Sybase RDBMS engine core and a royalty-free license to do anything they wanted with it, including competing with Sybase.
Yes, it hasn't changed at all since version 6.5. Just