Is the Relational Database Doomed? 344
DB Guy writes "There's an article over on Read Write Web about what the future of relational databases looks like when faced with new challenges to its dominance from key/value stores, such as SimpleDB, CouchDB, Project Voldemort and BigTable. The conclusion suggests that relational databases and key value stores aren't really mutually exclusive and instead are different tools for different requirements."
new record (Score:5, Interesting)
that's efficient -a summary that refutes the inflammatory headline
I'm just sayin'
Re:new record (Score:4, Funny)
Yeaah. Only if you did not know the meaning of the '?' symbol.
Re:new record (Score:4, Insightful)
?'s meaning - literal and implied (Score:5, Insightful)
In headlines, "?" implies that something is a serious question, whose answer is likely to be yes. One that makes it worth spending the time to read the article.
Imagine the headline said "Does Obama Smoke Crack?" and the article had a bunch of stuff about the president, with a last paragraph saying: "There is absolutely no reason to thing that President Obama has ever smoked crack."
Re:?'s meaning - literal and implied (Score:5, Funny)
Re:?'s meaning - literal and implied (Score:5, Funny)
President Obama smokes crack?!!?!??!!?!
Dunno. Has he stopped beating his wife?
Re:?'s meaning - literal and implied (Score:5, Interesting)
Re:?'s meaning - literal and implied (Score:5, Insightful)
In headlines, "?" implies that something is a sensationalized question, whose answer is "almost certainly, no".
Fixed that for ya.
Re: (Score:3, Informative)
This is what linguists refer to the "tabloid headline question mark". Its use is to say something inflammatory and only tangentially related to the story in order to get readers.
Examples:
"Is Jennifer pregnant?"
"Steve Ballmer: Love child of Satan?"
Re:new record (Score:5, Funny)
Next Slashdot article: Is Jah-Wren Ryel a child molester?
There's no evidence Jah-Wren Ryel has ever molested children, and no reason to suspect he would ever do so. Bandying about accusations like that would likely ruin his life forever.
However, since child molestation is such a big political issue these days, as a responsible news site I believe we need to have equal representation from both sides of the argument and let our viewers decide.
Re:new record (Score:5, Funny)
that's efficient -a summary that refutes the inflammatory headline
I'm just sayin'
Nah. Efficient would be if the summary were "No."
Here's a match.. (Score:3, Interesting)
Relational databases need to die. I loved them and preached the goodness of them 10 years ago, but they are just too rigid for contemporary needs. I've learned better ways of organizing and filtering data.. but the old RDBMS school is too canonical (stubborn) and self-indulging to realize that needs are changing and their model doesn't fit.
We need efficient attribute/value models. We need to stop referencing data by where it is and start referencing it by what it is. There is too much data that needs to
Re: (Score:3, Insightful)
What do you mean by "informatin, not just data"? It seems like you have specific, personal definitions of those words that others might not share.
If you make sorting the responsibility of the client, what do you do with large result sets? You can't sort chunked data client-side, as you have to sort before chunking. There should be *some* answer for result sets that don't fit in memory (client or server). I'd be happy with only being able to get results in a certain order if I've already built an index a
Re:Here's a match.. (Score:5, Informative)
Wow, um where to being really....
So you realize that the structure you are suggesting can be easily built in a traditional RDB, using a star-schema or cluster design right?
Next you suggest doing the sorting on the client, and then say that if there is more data then a client can handle the server can be asked to send chunks according to the clients sort order. That means the server has to have all the sort logic the client has and probably in all but the most trival applications do all the sorting anyway... Seems to me a star schema and indexing the fact table on the attributes that are most comonly going to be used for sorting makes much more sense; because as I said the serve is going to be sorting anyway.
Now there are data sets that non relational structers do make some more sense, but we have hierarchy , and navigational designes for those, yours is not one of them.
Re:Here's a match.. (Score:4, Insightful)
We need to stop referencing data by where it is and start referencing it by what it is.
You say that without any explanation of your apparent position that the relational model requires you to reference data by "where it is".
You seem to think that the semantics of your system are somehow richer -- providing "information" rather than "data".
Do you even know what a relation is?
WTF? (Score:2)
Summary: "The conclusion being that relational databases and key value stores aren't really mutually exclusive and instead are different tools for different requirements."
WTF?
Re: (Score:3, Insightful)
If "key/value" databases do become more popular, they certainly might eat in to relational database mindshare. 90% of web applications use RDMSs merely as persistent data storage--the fact that they are "relational" doesn't matter at all; the fact that a separate SQL language is needed to get the data (rather than using language-native data structures as an interface) is even a negative for RDMs.
As a web app developer, I'm excited that something other than SQL is getting attention. RDMSs won't go away becau
Re: (Score:3, Insightful)
A "key/value" database is simply a relational database with a single table and two columns. It doesn't make any sense to build a separate server program for what current database servers can already easily do.
Uh-oh (Score:5, Funny)
Re: (Score:2)
Re: (Score:3, Funny)
That's okay! I'll just rollback the transaction.... oh shit, that was a MyISAM table...
Yes, but not soon. (Score:4, Interesting)
Re:Yes, but not soon. (Score:4, Interesting)
do you really think you can get people to give up MSSQL?
In favor of MySQL, PostgreSQL, SQLite, even Oracle, yes, I do.
corporations wont even consider it for a number of years.
You must have some specific corporations in mind, because I've known many corporations to use each of the above technologies. In fact, SQLite is one of the most popular databases ever.
No, the reason it's not soon is because these other ones (CouchDB) aren't mature, and the ones that are (BigTable) aren't available at any price.
Re:Yes, but not soon. (Score:4, Informative)
Suggesting that you could replace a MS-SQL server with SQLite basically forces anybody in the know to ignore every other point you make.
MySQL is good, unless you need a highly performent query analyzer.
Postgres is good, unless you need actual replication features.
SQLite is good, if your datastore is less than 1GB.
Oracle is no-doubt a valid replacement and improvement upon SQL Server. And I use MySQL more than any other DB. But you need to hire Percona to get the same performance out of MySQL that you get from SQL Server out of the box.
Re:Yes, but not soon. (Score:4, Informative)
Suggesting that you could replace a MS-SQL server with SQLite basically forces anybody in the know to ignore every other point you make.
You're assuming that the person using MS-SQL Server knows what they're doing. How do you know it's more than just a glorified Access database?
MySQL is good, unless you need a highly performent query analyzer.
In other words, the query analyzer is slow? Because the queries work well enough.
Postgres is good, unless you need actual replication features.
Like these [tinyurl.com]?
SQLite is good, if your datastore is less than 1GB.
Another quick Google, and we find these limits [sqlite.org] -- by default, the maximum database size is just under 32 terabytes.
Not that I'm suggesting it's a good choice at that point, especially with multiple processes. But it does make it kind of hard to take you seriously with that kind of imagined limit, unless you're suggesting there's a practical, performance wall after 1 gig.
Re: (Score:3, Interesting)
this has not been my experience. at least with version 8 (two back from current), performance was miserable compared to either mysql or postgresql of comparable vintage. this was my first serious experience using mssql, but with no tuning on either side, both mysql and postgresql outperformed mssql by a factor of about 2.
while we never got the database on the production system swapped out (devel
Re:Yes, but not soon. (Score:4, Insightful)
let me guess, you don't like mssql because it's microsoft? what a fucking sheep, mssql is a great database.
oh and i've used all the others and for you to suggest mysql over mssql tells a lot...
MSSQL? Isn't that the only database that isn't cross platform these days? Why would anybody want to use MSSQL outside of .Net developers? On a side note, why is it that only MSSQL appears to get crippled by worms and none of the others?
Phillip.
Re: (Score:3, Insightful)
First, all applications have bugs that open them up to security flaws. Picking on MSSQL in that area is a non-starter.
What you're missing are all of the tools that come with a MSSQL license. SISS and MSAS are two big ones that are hard to replace with open source tools (Pentaho is interesting). If all you're looking to replace is a pure data store then yeah, postgre is what I would move to. When you start replacing all functionality offered by MSSQL it gets a little more complicated.
Re: (Score:3, Interesting)
let me guess, you don't like mssql because it's microsoft?
And because it's proprietary, single-platform, and expensive for what is, at the end of the day, just a database.
And because I have seen new and interesting things built with MySQL, like NDB. What has MS SQL got on that?
what a fucking sheep
Look who's talking.
More seriously, while I have pretty much no MS SQL experience, I don't particularly want to. The only good experience I've ever had from a Microsoft product was Halo. Bungie was acquired, and has now been sold, making me wonder if Microsoft had the chance to screw them up
Re:Yes, but not soon. (Score:5, Informative)
Actually i read TFA, and I just couldnt make sense of the benefits offered by the key value thing. You basically should be able to get the same benefits with a relational database system with a query that does a lookup on a single column index. This would involve searching the b-tree for that column, which would yield a row data address of some sort, to either a linked list of cells or a list of addresses of those cells. Once the single b-tree is done it is then very fast to find the other column values in that row. The b-tree or other index lookup also has to be done with the key value pair, the relational is just a collection of multiple key value indexes.
There is the issue of having a variable number of pieces of data linked to a certain key. But you can do this in relational too. Just create a table with an id column, value type column and value column. A well designed relational, if you do a query on the id column, the b-tree will lead to data which has all of the row data addresses in the database that match the id. EAch of those rows will contain a different data type/data payload for the id. This is again pretty much as fast as a simple single index database.
Re:Yes, but not soon. (Score:5, Interesting)
Yes, these newer simple key/value databases like BigTable and CouchDB are effectively a subset of RDBMS functionality, so of course the same thing can be implemented relationally by just not using features.
The reason these projects have taken off is that the relational features being skipped comprise most of the complexity of an RDBMS. Without them, it's relatively trivial to write new database engines from scratch instead of re-using MySQL, PostgreSQL, and so-on. These new feature-poor rewrites can take on many challenges that are harder for the big relational guys, like stellar performance on huge datasets, and being truly distributed in nature.
Re: (Score:3, Insightful)
What worries me about these arguments, however, is that they're missing a point that's very similar to yours here: these high-performance key-value databases can be implemented as features in an RDBMS. Basically, if you have a technology that allows some limited type of database to be distributed across
No (Score:2)
Top 25 Reasons the Relational Database is Doomed (Score:5, Funny)
Someone type this up and submit it to Digg.
Hey! (Score:4, Insightful)
Hey, read my article! Just to make sure you do, I'll pull a Dvorak and put in some incredibly sensational headline about how RDBMs are dewmed!!!!!! BWAHAHA, feed my advertisers!!!!
(Tune in ext week, when I write about how C programming is going to become extinct in the light of fantastic new development tools like C# and Ruby on Rails!!!)
Re:Hey! (Score:5, Insightful)
Especially when the claim is as ridiculous as this one.
There's a reason relational databases took over the world of databases: They provide a good combination of flexibility and structure to efficiently represent data. Which is what databases are supposed to do.
Re:Hey! (Score:5, Insightful)
There's a reason relational databases took over the world of databases: They provide a good combination of flexibility and structure to efficiently represent data.
Especially since so many databases really are inherently relational. The textbook example of 1-customer:n-invoices, 1-invoice:n-items plays out quite a bit in the workplace.
Free Traffic (Score:2)
And people complain that i don't go read the articles and rely on summaries.
This is one of the reasons.
Voldemort! (Score:3, Funny)
There's a db called Project Voldemort? That's awesome! I'm switching to that just for the name! I think my manager is a Harry Potter fan so getting approval shouldn't be too hard.
Re:Voldemort! (Score:4, Funny)
Re:Voldemort! (Score:5, Funny)
**SPOILER ALERT**
In book 8, it turns out that good ol' Voldy is actually Harry's older brother. They had a tearful reunion, and Voldy now works for Harry.
Re: (Score:2)
Nah, in book 8, Voldemort returns, lops of Harry's hand in a big fight scene, then tells Harry that he's really his father. In book 9, Harry gets mad at Dumbledore's animated picture for deceiving him, to which Dumbledore admits "Tom Riddle was my friend, when I first knew him he was already a great Quidditch player, but I was amazed by how strong the magic was in him."
Re:Voldemort! (Score:5, Funny)
Re: (Score:2)
CREATE_TABLE customer_balance (
id INTEGER AUTO_INCREMENT,
balance WINGUARDIUM_LEVIOSA,
PRIMARY KEY (id)
);
Re: (Score:2)
Re:Voldemort! (Score:4, Funny)
It's already been done ...
HAI ;) "test.mdb"
CAN HAS DBASE?
I HAZ A VARIABLE1 IS NOTHING
IM IN YR DATA
CAN I PLZ GET column1 column2 column3
ALL UP IN table1
OMG column1 IZ BIGGER THAN 5
ALL UR BASE R BELONG 2 VARIABLE1
IM OUTTA YR DATA
VISIBLE VARIABLE1
KTHXBYE
Re:Voldemort! (Score:5, Funny)
The name might be cool; but the length of some of the commands will really get to you. How many times do you want to type AVADA_KEDAVRA TABLE?
Better than PokemonDB. Then you have to jump on top of your desk and shout "Customer Table, I select you!" every time you run a damn query.
Re:Voldemort! (Score:5, Funny)
*polite golf clap*
Re: (Score:2)
Re:Voldemort! (Score:5, Funny)
You're right, that is a bit cumbersome. Hopefully, they'll release a friendly GUI wizard to make working with it more efficient.
Re: (Score:2)
Well, considering that the database process dies as soon as you type it, you only have to type it once.
Re: (Score:2)
How many times do you want to type AVADA_KEDAVRA TABLE?
Just once, but that's all I'll need...
Enough with the death of the relational DB (Score:5, Interesting)
Re:Enough with the death of the relational DB (Score:5, Funny)
Re:Enough with the death of the relational DB (Score:4, Funny)
99.9% of databases... (Score:4, Interesting)
99.9% of database claim to follow the relational model.
The rest have scalability problems that 99.9% of developers will never see throughout their entire careers.
So the answer is a simple, emphatic, no.
Re: (Score:3, Interesting)
99.9% of database claim to follow the relational model.
The rest have scalability problems that 99.9% of developers will never see throughout their entire careers.
Uh, actually, relational databases are pretty damn hard to scale. That's basically the main problem with them. Why do you think relational databases are so often paired with a cache made from a hashtable-based database?
Re: (Score:3, Informative)
What you call a "hash table database" others might call an "indexed cursor".
Others would be wrong ;)
An indexed cursor only contains a reference to the original data. Memcached contains a duplicate of the original data, so I'd argue it was a database in its own right.
However, even if Memcached doesn't meet the criteria of a database, DBM [wikipedia.org]-based databases certain do. They operate on a similar principle; a unique key points to a specific piece of data. Unlike Memcached, they are persistent, but like Memcached they are very fast and easily scalable.
I was asking for an example of a data storage technique that scales better than RDB.
Well, consider a modern DBM-based data
Finally the OODB people will (Score:5, Insightful)
Leave us RDBMS dinosaurs alone. String Name/Value pairs, that is a great innovation. In other news, Sun will be dropping all types from the Java object system and rely on the VOID type. Idiots.
Yeah (Score:2)
The conclusion being that relational databases and key value stores aren't really mutually exclusive and instead are different tools for different requirements.
In related news, black is not white.
Re:Yeah (Score:4, Funny)
Is white the new black?
No, it isn't, black is the new black, and whiten and black are not really mutually exclusive. And.... I made you look. Thanks for the pageviews, suckers!
A great open source implementation (Score:5, Funny)
Map db = new HashMap();
beginTransaction(); // Synchronize on the map // Just serialize the fucker to a file. The idiots using this won't know the difference.
db.add("key", "value");
commitTransaction();
Re: (Score:2)
commitTransaction(); // Just serialize the fucker to a file. The idiots using this won't know the difference.
You've come across prevayler then?
ah, stupid. (Score:3)
The big dumb thing about key store values is that they are actually just a subset of relational algebra in theory and are thus readily implementable in a relational database in fact. If you really wanted to have a database just do key / store values, you could quite easily do that in any rdms.
Re:ah, stupid. (Score:4, Insightful)
If you really wanted to have a database just do key / store values, you could quite easily do that in any rdms.
Sure, but it's not likely that a key/value store implemented within a general-purpose RDBMS can achieve the same raw performance that a system designed to do nothing but implement a key/value store -- nor the distributability, for that matter.
In relation to what? (Score:5, Funny)
This is an old argument which will not fly (Score:5, Informative)
It has been suggested before that the life of the relational DB is coming to an end. I must say that while I agree with this statement: -
Relational databases scale well, but usually only when that scaling happens on a single server node. When the capacity of that single node is reached, you need to scale out and distribute that load across multiple server nodes. This is when the complexity of relational databases starts to rub against their potential to scale.
I disagree with the following statement: -
Try scaling to hundreds or thousands of nodes, rather than a few, and the complexities become overwhelming, and the characteristics that make RDBMS so appealing drastically reduce their viability as platforms for large distributed systems.
I submit that the complexity can be managed and that's why we have jobs.
I am an IT consultant at a major bank and we keep all kinds of data. Data that many find useless and is spread across 27 [major] nodes. Total records in our biggest table number about 57 million with 49 rows. I can tell you that data querying and integrity maintaining are a breeze if the schematic design is correct in the first place.
We are always designing and testing different scenarios. In cases where we have had to change the schema, it has been simple if one knows what to do.
I must say that Open Source DBs have worked for us though we rely on products from IBM and Oracle.
Our philosophy is: If it works in PostgreSQL, it will even do wonders on DB2 or Oracle. I do not see how we can do away with the relational DB. Whoever designed it in the beginning did a marvelous job.
Ridiculous (Score:4, Insightful)
Really rational is the best way to take a data set and be able to access it in various ways. Many of the other concepts are indeed regressions and reintroduce problems a relational database solves. Relational allows you to able to display and view data in various different ways and apply the dataset in new ways, ways that may not have originally been a part of the original design of the application. Every time we hear someone harp about some new database technology that reintroduces all of the problems of the past, but relational is still the best and most versatile way to store your data in a way that allows for query flexibility.
Re: (Score:3, Insightful)
Sure, relational is a good general fit databases, but it sounds like you are saying the fact that you can query and modify it using something like SQL in most implementations makes it great?
If you're a DBA, system administrator or tester - or if you simply have to do something ad-hoc and dodgy as a quick fix on a live system - then this makes it not so much great as absolutely fantastic. You can do things like:
Re: (Score:3, Interesting)
WITH RECURSIVE hierarchy AS (
SELECT * FROM employees WHERE name = 'personsname'
UNION ALL
SELECT sub.* FROM employees AS sub, employees AS super
WHERE super.id = sub.parent_department
)
SELECT * FROM hierarchy;
Is the automobile doomed? (Score:3, Insightful)
Turns out, there's something called a "skateboard." You can use it to travel as far as the Quickie Mart, with nothing but your feet to propel it.
In conclusion, skateboards and automobiles aren't the same thing, so probably not.
Project Voldemort? (Score:2)
Seriously? Get the Harry Potter out. Out now!
Supid people who don't understand data (Score:5, Informative)
The relational database is not going anywhere and nothing in that article is based on any firm understanding of managing data.
Is the notion of a "join" obsolete? No, but it is typically impractical in a high volume system. You would probably use denormalization as a strategy.
Scaling many nodes? OK, you still gotta put your data "in" something.
key/value indexing? yawn. select val from keyvalue_tab where key = foo;
The value can be basically anything, and most "relational" databases have good object support as well as XML, JSON, etc.
So we can establish that a SQL relational database can do *everything* a simpler system can do. Now, think about ALL the things you can do with your data in a real database.
What is the point of using a limited and less functional system? A good system, like Oracle, DB2, PostgreSQL, etc (!mysql of course) will do what you need AND allow you do do more should you be successful.
The problem with data is two fold: Managing read/write/deletes and finding what you are looking for. These problems have been solved. A good database will do this for you. Want to store object? XML, JSON, binary objects, or a specialized database extension works perfectly.
Re:Supid people who don't understand data (Score:5, Insightful)
no, the relational database is not going anywhere, you are correct. but, that does not mean that there aren't instances where a non-relational database, with the addition of map/reduce, aren't extremely useful.
non-relational databases have been around for decades, and are in use for quite a number of applications involving rapid development and storage of very large records. couple this with map/reduce, and you have the ability to scale quickly with very large datasets.
scaling quickly is a very difficult problem to solve with an RDBMS - you either need to continue to throw more hardware at the problem, to the point of diminishing returns, or re-architect your data at the cost of possible significant downtime, while still attempting to serve up the data in a timely manner. i've been deep in the bowels of oracle RAC, fighting to get just 5% more speed out of a query over a billion rows and realizing that i have to start over with a new schema, just to squeeze more data out. compare that to simply adding another machine and letting the map functionality run across one more cpu before returning it for the reduce.
once again, correct, but having to denormalize to a snowflake or a star isn't always the best solution. you're taking the best parts of the relational database model, and throwing them out - normalization, referential integrity, just to squeeze more out of something that may not be the best tool for the job.
do you hammer with a wrench? i have before, and i managed to hurt my thumb.
Re: (Score:3, Insightful)
Not usually, but I have done so before. If it hurts your thumb, you're holding it wrong.
Re:Supid people who don't understand data (Score:4, Interesting)
The difference is optimization vs generalization. Many problems can be handled using simple key/value pair relationships. You can model this in an RDBMS using two-column tables that you never join across, where all of your queries are SELECT val FROM tab WHERE key=? and INSERT INTO tab (key,val) VALUES (?,?). However, if you use the RDBMS this way, you're paying for the overhead of the SQL engine, (usually) a client/server connection, and your language's library for interacting with an RDBMS.
The alternative is a non-relational database like BerkeleyDB [wikipedia.org], which is optimized for key/value pair operations. All the fetch and store operations do is fetch and store the value for a given key, with a minimum of overhead. BerkeleyDB is also an in-process database, where your application is accessing the database files directly using the BerkeleyDB library code. (The library handles locking so that multiple processes can use the database files at the same time.) Again, the overhead is kept to a minimum.
BerkeleyDB is much less flexible than an RDBMS, but for the problem domains where that flexibility is not needed, BerkeleyDB is much more efficient. I've easily achieved over 6000 read/write transactions per second on modest hardware in a single-threaded process; a multi-threaded and/or multi-process application can achieve much higher rates. Compare that to a typical Oracle database connection, where you're lucky to get as many as a few hundred transactions per second, just because of the network round-trip.
Re:Supid people who don't understand data (Score:5, Informative)
Map/Reduce [wikipedia.org] was developed at Google. It's a bit tough to wrap your head around at first, and once you get it you wonder what the big deal is, until you realize how suitable it is for Google's datacenters.
Basically, you take a dataset (a bunch of key/value pairs) and a mapping function, and you run the mapping function over every item in the dataset. This gives you an intermediate dataset with different keys and values. You then run that through a reducing function, which produces your final dataset. This can be a single result, or a dataset that can then be processed with a different map/reduce pair of functions.
The big deal for Google is that many of their problems can be expressed in terms of map and reduce functions that can operate in parallel over their datasets, and that their datacenters can handle absolutely enourmous quantities of parallel operations. So, for the mapping operation, they take the original dataset and mapping function, subdivide the dataset over thousands of servers, and let them run the mapping function in parallel. When these servers return their results, it's common for many different servers to return the same or related keys in the intermediate set. These are collated, so that when the intermediate dataset is distributed with the reduce function, all of the values with the same keys go to the same servers. This helps the reduce function to be run in parallel; it's often counting the number of original items that were assigned to the same key in the intermediate set.
MapReduce is a bunch of hype (Score:4, Interesting)
The name of the MapReduce framework comes from the functional programming operations "map" and "reduce." Map takes as its input a collection of data, and a function that transforms data elements into other elements; it outputs a collection where each element of the input collection has been replaced by the result of applying that function to it. Reduce takes a collection of elements, an initial value of the same type as the elements, and a two-place, commutative, associative and symmetric operation; it produces as its output the value that results from applying the operation to the initial value and each element of the collection in turn, accumulating the partial results.
Map and reduce are operations that can be trivially parallelized. To parallelize map, you divide the collection into subcollections (in any arbitrary manner), and map over each of them in parallel. To parallelize reduce, you divide the collection into subcollections, also arbitrarily, reduce each subcollection independently, then apply the reduction operation to the partial results. (That works because the reduction operation is commutative, associative and symmetric.)
Well, guess what: this sort of technique is trivially applicable to relational database queries. A SQL query translates down to a combination of joins (the FROM clause), filters (the WHERE clause) and maps (the SELECT clause). Joins are trivially parallelizable; you give each execution unit a subset of the tuples of the driving relation. Filtering (the WHERE clause) is a kind of reduce operation. SELECT is a kind of map operation. This means that relational queries are not any less amenable to parallel execution than the stuff Google does.
But the killer thing here is that MapReduce says absolutely nothing about the updates problem. This is one of the big features of RDBMSs: the ability to handle concurrent query and modification. It also says nothing about the data integrity problem, which is also one of the big RDBMS features.
So, when you get down to it, there is a good argument to be made that many applications could make use of database technologies that support much faster querying, at the expense of very little updating. But there's no convincing argument that that technology isn't best implemented in the context of an RDBMS.
Re: (Score:3, Insightful)
In terms of expressive power, sure, but no one is arguing that distributed key/value stores are going to gain against RDBMS's because they have superior expressive power. What is being argued is that they will do so because they have superior scalability and distribution properties, and that in many real-world applications those are more important than the having the full expressive power of relational algebra. Pa
Re: (Score:3, Insightful)
The other solutions (see below) do not, in all cases, "get rid of ACID".
Scalaris, a distributed transactional key/value store that does not get rid of ACID, is one of the "other solutions" (and one that has been demonstrated, by repl
Some credibility... (Score:3, Insightful)
Re: (Score:2, Funny)
He can't even explain relations correctly... (Score:4, Informative)
He lost cred right then.
Not buying it. (Score:5, Interesting)
Not the only one thinking this is silly... (Score:2)
...or at least an attempt at bad advertising or pursuasive writing (cognitive justification.)
OODBMS have been pushing this, and many of them are pushed as light weight key-value stores.
http://en.wikipedia.org/wiki/ODBMS [wikipedia.org]
This isn't new, like OpenDoc's Bento
http://en.wikipedia.org/wiki/OpenDoc [wikipedia.org]
That became IronDoc
http://linuxfinances.info/info/oodbms.html [linuxfinances.info]
The problem with any of it is that relational databases rule the enterprise space. You cannot get away from them, and they are far from dead, because you will
hell no (Score:2)
There are still multi-billion dollar businesses operating the core of their business on COBOL systems, and they're decades older than relational database technology.
So don't bet on it.
Just to be pendactic (Score:4, Insightful)
There really isn't a true implementation of the relational model as per Codd and Date.
Also, SQL is a nightmare. A badly designed programming language which is not quite functional and not quite procedural and so needs a bunch of hacks to work properly. And then there is the issue of NULLS. And the fact that you can end up with ugly bag operations and path dependencies in SQL.
And just to start yet another flame war (Iknow, I just know some one is going to mod me as a troll today) key/value is just another way of saying "network database".
And another thing which I will probably get hammered for, if you normalize a DB properly you will get you objects almost for free. And vice versa. Where I see people having problems is that they either are :
1) lazy about defining and understanding their data
2) or likewise for their objects
3) or both.
If you do it properly will will get a nice set of multidimensional objects and fact/attribute tables which are orthogonal and lean. Easy to understand, search, join, build, compose, decompose, signal and track.
As opposed to a snarled up hacked together, overloaded, over inherited nightmare with hidden dependencies which I have seen too many times.
OK, you can slam me now.
SQL is the problem, not RDBMSs (Score:4, Interesting)
SQL and all its pointy-headed progeny are the real problem with databases, not the relational vs. newMarketingBuzzwordDuJour arguments.
Database operations do not need to look like code or algorithms, the only reason they do is to provide jobs for database programmers.
Over 15 years ago Paradox's query-by-example was light-years ahead of today's soul-killing SQL crap.
SQL is not going away, though, any more than its idiot older brother Mumps (M, Caché).
Re: (Score:3, Insightful)
Paradox's query-by-example
*looks up* GUI query builder? Highly appropriate for simple things (e.g. Crystal Reports), but absolutely terrible for more complex things.
Re:SQL is the problem, not RDBMSs (Score:5, Informative)
QBE grids are nothing more then a UI abstraction of the underlying SQL SELECT statement. In fact, in MS-Access (which has a QBE grid), you can flip between looking at the QBE and looking at the raw SQL SELECT statement.
Sometimes it's faster to do it in raw SQL, sometimes it's faster to setup the query in a QBE grid.
Re:SQL is the problem, not RDBMSs (Score:5, Insightful)
Database operations do not need to look like code or algorithms, the only reason they do is to provide jobs for database programmers.
From Wikipedia [wikipedia.org]:
SQL looks like SQL because it's based on set theory. As an exercise, invent your own language that's as powerful (read: also based on a strong theoretical basis) but simpler. See you in a couple of decades!
STILL "relational" - Dynamic Relational (Score:3, Interesting)
Some of those systems appear to more or less still be "relational". If each row is treated like a map (associative array) of strings, then the "schema" for a given table is the set union of all attributes used in the table, and non-existing columns for a given row can be treated as nulls.
As long as an asterisk is not used in a query (ex: "select * from tableX"), then it will pretty much act like existing RDBMS, and as long as the type-explicitness issues are resolved based on dynamic language conventions. (Asterisks can be implemented perhaps, but it could be computationally expensive.)
It's kind of like dynamic (AKA "scripting") languages versus static or type-heavy languages. The static kind of languages requires more up-front info that "protects" the integrity of the thing at the expense of flexibility and declaration volume. The same dichotomy can be applied to RDBMS also. We have RDBMS that like a lot of info up-front, and now those which accept incremental or ad-hoc insertions are starting to be common (but still less standardized).
And constraints can be incrementally added, such as later requiring that every new record in a "Cars" table have a value for "brand" or the like.
One possible exception is that there were some examples that violated "map-ness" of records, such as having two colors for a car. If they instead supplied "color_1" and "color_2", then map set rules would not be violated, keeping it closer to true relational.
In short: We don't have to abandon relational to get dynamism.
Yep, this will happen (Score:3, Funny)
I can see the meeting now.
Developer: "Hey boss, I found a better product for the transaction processing data! It might save us a bunch of money on Oracle licenses!"
Boss: "Great, what is it?"
Developer: "Project Voldemort!"
Boss: "..."
Developer: "No really, let me explain..."
Boss: "I have a meeting to get to, but hey, let me know if you have any other great ideas."
A SQL query walks into a bar... (Score:5, Funny)
A SQL query walks into a bar and sees two tables. He walks up to them and says 'Can I join you?'
From Tom Kyte's blog sql joke [blogspot.com]
Object class anyone? (Score:3, Insightful)
This is just the OOP crowd trying to not learn SQL and do things their way. It won't replace a full RDBMS. And an RDBMS can scale quite nicely if you know what the hell you're doing.
Re: (Score:2, Insightful)
This isn't digg. Posting that doesn't guarantee you +5
Re: (Score:2)
No, it's more like porn, except it doesn't have naked people doing things to themselves and each other.
Re: (Score:2)
"Enough with the bad blog posts already, it's like facebook, only less interesting."
No, it's more like porn, except it doesn't have naked people doing things to themselves and each other.
It's kind of like a car, if the car didn't have a fuel gauge or any springs inside the passenger seat...
Re:I see the problem! (Score:4, Insightful)
they think Nissan makes the Civic!
This lack of data integrity could have been prevented if they had used a relational database...
Re: (Score:3, Insightful)
Hardware makes just as big of a difference today, which is why distributed key/value stores are gaining currency at the moment. The hardware-related difference that was a big win for relational databases was their efficient use of disk space when normalized; the hardware-related difference that is a big win for distributed key/value stores now is their efficient scalability by distribution