Twitter To Open Source Streaming Data Analyzer

splitenz writes "Expanding the field of complex event process software with another offering, Twitter will release as open source its software for analysing live large-scale data streams, called Storm. Although the software has been compared to Hadoop, Storm is best suited for analysing live data streams, such as millions of Twitter feeds."

Why the link to secondary info?

[La Camiseta]

The original blog post is here [twitter.com].

Yes

[improfane]

Nobody really cares about Twitter. It's a fad.

You could code a crude Twitter in one night.

Re:

[fuzzytv]

Except that the post is not about Twitter. It's about a tool they use they developed and use to analyse the stream of data. And they're dealing with a lot of data, so the tool might be really interesting.

And yes, you could code a crude Twitter in one night, the only problem is it'd support about 3 users while Twitter is used by millions. So this goes to the same drawer like "I can run Google on a single LAMP box" and other similar ideas.

Yet nobody cares

[improfane]

Even so, it's still about Twitter and nobody actually cares. Have you noticed we're not really talking about it and having a metadiscussion?

Of course it would scale, my point is Twitter is such a trivial application of technology. The scaling technologies used for Twitter would work for other applications. Hence, Twitter is nothing special or significant.

Re:

[improfane]

would not scale*

Re:

[marmotte]

however trivial twitter may look, it's a perfect huge stream of data for the netflow software TFA is about. btw twitter is valued $7 Billion, are you coding something significant tonight ?

Re:

[improfane]

We are in a bubble. It's not actually worth that. Yes I am :-)