Slashdot Log In
Evolution and the 'Wisdom of Crowds'
Posted by
CowboyNeal
on Fri Oct 19, 2007 04:41 AM
from the better-and-better dept.
from the better-and-better dept.
An anonymous reader writes "An essay by a developer of recommendation systems makes a case for why so many people have trouble grasping Darwin's theory of evolution. Downplaying its conflict with religion, the essay suggests that evolution is in a specific class of "equilibrium seeking" concepts that tend to be extremely counterintuitive to most people. The hypothesis is supported by the observation that so many people reject the notion that evolution-like systems such as Wikipedia, prediction markets, and recommendation systems can actually be effective. Particularly fascinating is the description of his surprisingly simple algorithm for competing in the Netflix prize contest."
Related Stories
Submission: Evolution and the "Wisdom of Crowds" by Anonymous Coward
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
Eh. (Score:4, Insightful)
While there may be many that reject that these systems can be effective at all, I'd suggest that there's many more that would actual argue that while these systems do work, they aren't necessarily the best or only method that is effective.
He doesn't address the evolution of ideas (Score:5, Interesting)
Societies may have "invented" the notion of religion because religion led to ethics, which led to less killing of their neighbors. All of the sudden, it's survival of the fittest, as non-ethical tribes tended to be killed off, while religious tribes thrived.
An obvious second example is the notion of being against birth control (or for large families). Tribes that were for large families and passed those beliefs down to their children tended to grow.
So my question is: Even if there is no God, and you are an atheist, is it possible that a world containing religious people is actually a "better" society than a world full of atheists? The Earth's people evolved into a world of mixed beliefs (some religious, some not), which could be argued to be the survival of the fittest idea or world. The mixed-belief world appears to be the "fittest" world, as opposed to such less-fit worlds of all atheists or all Christians, as examples.
If we evolved to be a mixed world of beliefs, as the "fittest", perhaps we should accept that, and quit trying to convert people with arguments for our favorite religious/non-religious belief.
Parent
Re:He doesn't address the evolution of ideas (Score:5, Insightful)
Historically, some of the worst atrocities have been carried out in the name of God. While your idea has merit for a very young civilizations, religion as a means of social control became obsolete as soon as secular law was invented. Since then it's only been abused to manipulate and extort people, at least on a scale that has any impact on society as a whole. (Exceptions made for those small groups who actually practice what they preach.)
Evolution is a pretty slow process... I guess 3000 years or so isn't quite long enough to breed out the religious nutjobs.
=Smidge=
Parent
Re:He doesn't address the evolution of ideas (Score:4, Insightful)
Jerry Fallwell and Pat Robertson do not make up all of Christianity. Just like Pol Pot, Kim Jong Il and Stalin do not make up all of atheism. But if we were to play by your rules:
Just adding up the body count should convince anyone that religion is a bad idea for humanity.
I think that statement has just been shot to hell!
Parent
Re:He doesn't address the evolution of ideas (Score:4, Insightful)
2. The claim is not "some people who happened to be theists also did bad things", but rather that "people did bad things in the name of their religious belief". If you want to counter that, you need to show how someone's lack of belief caused them to do bad things.
Parent
Re:He doesn't address the evolution of ideas (Score:4, Informative)
Parent
Re:He doesn't address the evolution of ideas (Score:4, Informative)
Parent
Re:He doesn't address the evolution of ideas (Score:4, Informative)
Parent
Re:He doesn't address the evolution of ideas (Score:5, Insightful)
Parent
I suggest a new strategy, believe in the god. (Score:4, Funny)
Parent
actually... (Score:5, Interesting)
And in one way or another, we're all atheists. Is the world worse off because people don't believe in Thor anymore?
Parent
Re:actually... (Score:4, Interesting)
Parent
Re:He doesn't address the evolution of ideas (Score:4, Interesting)
I've wondered about that as well. I suspect that the "believe your parents" bit is partially the origin of religion. My reason is partially the fact my daugher (3.5 years) wants an explanation for everything. "Just because" does not satisfy her, but she isn't quite ready for the real explanation for a lot of things. I'm sure I could get to quit asking "Why?" with enough references to god. Humans seem to want to understand but frequently don't have the capacity or knowledge required, so left to them selves they abstract the problem away another step. ie. Saying god causes the rain isn't a explanation of how or why god would want rain, but it answers the immediate question of why it's raining.
I really don't want to read "The God Delusion" as you suggest. Why are you pushing your religion on me?
Just to be pedantic I did say, "if you read." I mentioned it more as a citation for an idea that wasn't really mine.
But in reality I do believe the world would be a better place if religion would go away.
Parent
"Wisdom Of Crowds" (Score:3, Insightful)
I can't wait for this meme to die. (Score:5, Insightful)
Who controls the content of Wikipedia articles? Is it a large crowd of seemingly random contributors each imparting their own bits of wisdom? Or is it a small set of contributors providing the base of an article with a few mostly minor revisions submitted by random people passing by? In my experience, it's the latter. Usually a small set of people, no more than 3 to 5 which make the core of a Wikipedia article.
These same people are also generally the ones that cultivate the article and keep it consistent and well editted. Occasionally these same few people come to disagreements and end up in "edit wars" in which they call in another set of few members interested in judging to judge the issue. There's no "crowd" at work here, it's a lot of small groups of vested individuals who have interest in a particular domain and an efficient way of contributing and collaborating in that domain.
There may be hundreds of such groups, but they typically stick to their domain or they become edit whores and stick to minor revisionary work on a large amount of articles. Either way, I don't see much of a "crowd" once I break it down and look close, much less a wise crowd. Have you ever noticed that different subsections of Wikipedia have their own "feel" or "identity"? Maybe the particular manner of phrasing or the type of consistency shown throughout that sub-section which differs somewhat from another unrelated domain. This is largely a result of edits by the aforementioned small group of vested individuals. Each group leaves their own tint which colors a section and gives it life.
Wisdom of Crowds? No. Small, intelligent groups of people focused on achieving a well defined goal? Yes. If you really want to test this "Wisdom of Crowds" concept, take a look at SomethingAwful.com or any of the various large web forums and learn of the "Wisdom of Crowds". Even there, it's generally a very few amount of people contributing intelligently with the rest just being meaningless drivel. This meme needs to die.
Parent
Re:"Wisdom Of Crowds" (Score:5, Insightful)
Actually in 2000 the "wisdom of the crowds" picked Al Gore. The electoral college and the Supreme Court put GW in the Whitehouse.
Parent
the wisdom of the crowds (Score:5, Insightful)
Crowds contain individuals ... (Score:4, Interesting)
Isn't that the obvious conclusion?
Bad analogy? (Score:3, Insightful)
> mutation, of course, is non-directed...that is, "random." It could be bad or good, but most of the time
> it is bad.
IMNSHO this is simply untrue. If this is true Wikipedia is dead for long: it never keeps a large, visible "pool" of "genes" (different version of the same article) that the "nature" (viewing public) can "select", and the "nature" simply is too busy to "select" them anyway. They have many version of the same article, but there are not many who will go into the version and select to revert to one of those. To me, the success of Wikipedia is that those who don't know much about a subject will normally refrain from editing the subject, so most edits are actually of a rather high quality. It is a social behavior, not an evolution behavior.
Re: (Score:3, Informative)
Two Ways of Summing it Up (Score:5, Interesting)
2. Most people can't see the forest for the trees. Everybody who is not as smart as the author needs to take remedial education and secular-deprogramming classes.
Now you don't have to read the article.
You're welcome.
Nothing new.. (Score:3, Interesting)
Just a n-dimensional random distribution, with small adjustment steps. The 'n' of the system being chosed by hand, not even automatically computed. It works for Netflix because the domain being modeled is not 'wild' statistically, and have a very simple topology.
The 'presumed' relation with a 'wisdom of the crowds' concept is just coincidence, try to apply such a simple system to a really complex domain (ie: natural language syntax) and it will fail.
On the other hand, it's true that simple statistics can be used for a lot of tasks (ie: language/topic detection), but nothing really new here.
Creationism and Evolution Artificially at Odds? (Score:5, Insightful)
Honestly, I find these kinds of statements to be a bit off-base. I really get the feeling that Creationism and Evolution/Darwinism are artificially pitted against each other as if one or the other has to "win."
The interesting thing is that there is absolutely nothing in either of the standpoints that cannot coexist with the other. I would say that the consistant framing of them being exclusive is what causes resistance (from both sides, most likey) when it isn't even needed.
If one wants to get anyone to believe in a scientific theory they are having difficulties with, framing it as, "you should believe this because what you believe is wrong and you are stupid," is not really going to win anyone over. Especially when one could easily take the stance of, "here's why this theory makes sense, and really it doesn't have anything to do with what you may or may not believe."
I've seen no strong theology that would rule out that evolution did not happen. Creationism is about a supernatural force overseeing things--it says nothing specific about how things actually happened. (And, I think, most theologists will agree that Genesis is highly metaphorical.)
So, bottom line is, if science-minded people want others to "see the light" on this one, stick to the facts and leave the religion-bashing alone. Making people defensive generally is not an effective way of getting an idea across.
Re:Creationism and Evolution Artificially at Odds? (Score:4, Informative)
Generally, the use of creationism references young Earth creationism... where part of the belief is that the Earth is only a couple of thousand years old. This flavor of creationism can't stand alongside evolution.
Nephilium
Parent
Re:Creationism and Evolution Artificially at Odds? (Score:4, Insightful)
Well, there's just the small, unimportant, inconsequential matter of intent.
Also, a total reversal of roles, look:
Evolution, on the other hand, claims that complexity emerges during the process of evolution, which starts with very simple things.
I really see no way for two theories to coexist if their claimed starting points are exact opposites. If you can't even agree on that, everything down from there is either dishonesty or an intentional scam of one theory to not have its core assumptions examined too closely.
Parent
Randomness (Score:5, Insightful)
I think the main problem with people's understanding of evolution is the fact that it is not taught very well in schools, and people get the strong idea that evolution is a random process. I also think it is a problem with the timescales involved, which are hard for the human mind to grasp.
What about the "madness of crowds"? (Score:4, Informative)
The book is frequently referenced in discussions of investment strategy, especially so-called "contrarian investing", which often makes money for its followers. The contrarian investing principle can be summarized as being that when the crowd overwhelmingly agrees on something, go the other way.
The book describes market behavior at least as well as Adam Smith's "unseen hand", and may also well describe other aspects of crowd behavior. I had never heard of the "wisdom of crowds" before this posting, but I have heard of the "madness of crowds" for many years.
Re: (Score:3, Insightful)
Every other developed country in the world has a significantly higher number of people who prefer the scientific version to the religious one when it comes to the origins of the species.
When it comes to evolution, the USA is closer to Turkey than the west-european nations. In fact, in a lot of Europe, Creationism/"Intelligent design" are almost unheard of. (AFAIK, and I just live there..)
Not only that, but the USA is the only country in the western world with a decli
Re:typo (Score:5, Insightful)
That's true of humans in general. Religions don't have a monopoly on arrogance.
Parent
Re:typo (Score:4, Insightful)
Welcome fellow Belgian. It's horrible to see how we've been conditioned in excusing ourselves for statements which "potentially could be read in a racist way" because of the constant idea we are "against multiculturism" and are overly sensitive to "cultural differences".
Parent
Re: (Score:3, Insightful)
EVERY muslim university preaches creationism (even more stupid than that : young-earth creationism)
Most Indian universities preach creationism
and most Chinese also believe in creationism
That's 50% of the world where there isn't any discussion
Re:typo (Score:4, Interesting)
Parent
Re:typo (Score:5, Insightful)
muslims inside england use terror to avoid evolution in biology lessons :
http://forums.muslimvillage.net/index.php?showtopic=37975 [muslimvillage.net]
in france:
http://islamineurope.blogspot.com/2007/02/france-muslim-anti-evolutionist.html [blogspot.com]
This is in Turkey, the most moderate muslim nation existing (where both islamists and atheists massacre eachother, creating a balance) :
http://www.nytimes.com/2007/07/17/science/17book.html?_r=1&oref=slogin [nytimes.com]
If you thought Christians are trouble when it concerns evolution, you're in for a rude awakening. Christians don't kill you. Don't threaten you. And they don't gang up on your family just because you don't "respect" creationism. Muslims do.
Parent
Re:typo (Score:5, Insightful)
There is a theatre production by the Reduced Shakespeare Company where they do the entire bible in 90 mins or somesuch. *Everytime* I have seen it there have been jossling, abusive Christians outside telling me I was going to hell for watching it. I've also numerous reports of people killing in the name of Christianity. I think we need to be clear on this, all religions, whether Muslim, Christian or whatever have extremist factions and that's where the problems are. the mainstream ones are generally fairly laid back.
Parent
Re:typo (Score:5, Informative)
Bush: No, I don't know that Atheists should be considered as citizens, nor should they be considered patriots. This is one nation under God.
Current stats:
85% of Americans self-identify as Christians. (2002)
7% of US adults classify as evangelicals (2004) (see Evangelical category for more information)
38% of US adults classify as born again, but not evangelical. (2004)
37% are self-described Christians but are neither evangelical nor born again
Atheists and agnostics comprise 12% of adults nationwide. (2004)
11% of the US population identify with a faith other than Christianity (2004)
s/Christian/Muslim/g
Nuff said... No further comment...
Parent
Re:typo (Score:5, Funny)
NAMBLA polls kids all the time.
*ducks*
Parent
Re:typo (Score:5, Informative)
I brought this subject up several times in a conversation with europeans. Those who don't follow slashdot and similar sites hadn't heard about the concept of "intelligent design" at all, and needed it explained. And all of them went "WTF?" at the explanation.
The vast majority of the population hasn't even heard of ID. All the religious arguments I participated in (and there were quite a few) always revolved around the existence/inexistence of a deity, evolution wasn't brought up even once.
Parent
Re:typo (Score:4, Informative)
So yeah, Europe is doing something to stop pseudoscience from finding its way into schools.
Parent
Re:typo (Score:4, Insightful)
Religion and science are not viewed as polar opposites. They do disagree on several points but that does not mean anyone with religion is against scientific teaching. Darwin himself was obsessed with the Bible.
Parent
Re:typo (Score:5, Informative)
Got any proof? Because I've got some that shows you're wrong. Link [nationalgeographic.com].
Parent
Religion vs Darwin vs Technology vs Society (Score:5, Insightful)
What is happening today to the common man is that he/she is getting immune to technology, which leads us to the possibly false premise that the lay person understands technology any better than say, evolution. Given this assault of seemingly illogical and complex information (which completely undermines a person's ego, mind you), religion provides a very convenient framework to make life simple, seemingly secure, and less fragile. Religion is hence, more of a survival tool for a society that shields away a person's insecurities. For that matter, that is the reason why societies and families formed in the first place, which is to increase the probability of our survival and proliferation. For the common man, religion and society practically mean the same thing, and hence interchangeably attribute the positive aspects of one with the other. This is also why they are willing to put up with the restrictions and rules of religion, just as we do for society's laws and restrictions!
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:5, Interesting)
Apart from the fear thing, I have exactly that reason to explain why I have always believed in evolution (since reading about it myself in a book at 7). Even then I was struck by the vastness of the universe, and the idea that some god person had made it all seemed a bit too simple. Even then I was utterly fascinated by astronomy, and looking at the night sky, especially in Australia, where we actually had a visible star scape, was an experience that filled me not with religious conviction, but with a determination to find explanations for what I saw. 'God did it' was never an option.
Having grown up now I realise why so many people need to believe in the biblical creation myth. Believe that and everything becomes easy, simple enough that you don't have to worry about it. Reject it and boy have you got a lot of work to do. For one thing you actually have to understand things, not pass it of as 'the work of god'.
I find it amusing that creationists/ID'ers seem to want a stupid god, incapable of anything but focusing on one planet in the vast universe, as interested in the fall of birds (why is it always bad stuff?) then the formation of galaxies. I prefer the idea that if god exists, he was smart enough to set things in motion at some point (at the start of this universe? a previous one, no idea), and it all works without intervention. Of course this implies that there is no god, since a system that does not require a god to run doesn't need one to exist at all.
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:5, Interesting)
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:5, Funny)
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:4, Insightful)
Understand? did I say that? Want to understand yes, but understand the reason for the existence of the universe? hah, as if I could. The best I can do is study and research using the scientific method.
What I do though is not put myself into a cushioned frame of mind that requires no conclusions beyond 'god did it'.
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:4, Interesting)
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:4, Funny)
2) market said gods
3) prophet
Fixed.
Parent
Re:Religion vs Darwin vs Technology vs Society (Score:4, Interesting)
I know for a fact that for many retailers this is not true - unless you have a source I call BS.
Your other examples are rather meaningless as because there is a demand for the bible and other books, and so people write and sell them. That's just economics. You'd be better off pointing out the amount of money Churches take in every year from donations and not paying taxes.
Parent
Darwin's theory of natural selection (Score:5, Insightful)
The mutation in Darwin's theory does NOT have to be random!
Although random mutation is perhaps the most effective way compared to its complexity. It surely is the most simple way for nature to "implement" it. And most of the time it results in very good "fuel". About your example: although the mutations are made by intelligent designers, some designs are rejected and some accepted (to be built further upon). The mutations are not random, but the selection is still in place. That's good enough.
So if you don't want to call Darwin's theory a theory of evolution, call it a THEORY OF NATURAL SELECTION instead.
Keep in mind: you do not need DNA, big gene pools, parallel mutations, sexual mutations,
Parent
Re:This is a stupid conclusion (Score:5, Insightful)
The notion of n monkeys typing randomly is used to illustrate the absurdity of evolution. It would be a great illustration if it were not intrinsically flawed from its very conception. A better analogy would be, again as Richard Dawkins again demonstrated in said documentary/book, that each change the monkeys made that took their current works of Shakespeare away from the actual works of Shakespeare were ignored, or favoured less, than changes which improved the similarity of the monkeys' work with that of Shakespeare.
So, in a nutshell, it's similar to evolution as you clearly don't understand evolution enough to ask that question
Parent