Wisdom of CrowdsThat crowds are dumb is a given — an immutable truth that’s not worth argu­ing about. Meet­ings are to be sneered at, group-think deserves con­tempt, com­mit­tee and pro­cras­ti­na­tion are syn­onyms. As Niet­zsche puts it, “Mad­ness is the excep­tion in indi­vi­u­dals but the rule in groups.” And Thoreau: “The mass never comes up to the stan­dard of its best mem­ber, but on the con­trary degrades itself to a level with the low­est.” (etcetera: We are good at googling).

The smartest (ok, ok, fun­ni­est) philoso­pher of them all, “Dave Barry sums up our col­lec­tive feel­ings in one (slightly long) line, “If you had to iden­tify, in one word, the rea­son why the human race has not achieved, and never will achieve, its full poten­tial, that word would be meet­ings. When on quotes, here’s another one: “Any­one taken as an indi­vid­ual is tol­er­a­bly sen­si­ble and rea­son­able – as a mem­ber of a crowd, he at once becomes a block­head.” — Friedrich Schiller, through Amit Varma.


New Yorker
colum­nist James Surowiecki wanted to prove Barry wrong, and wrote a whole book about the value of meet­ings. Ok, half a book maybe. Seri­ously though, Surowiecki’s eru­dite, well-researched, and inter­est­ing book provoca­tively takes on a widely held notion — that indi­vid­u­als are bet­ter deci­sion mak­ers than groups — and proves how wrong it is. Not con­clu­sively, but there’s enough empir­i­cal evi­dence in the book to force a rethink. The book was an instant best­seller and won a lot of acclaim — but most impor­tantly it is an enjoy­able read.

So, why are groups good? A long time back, somewere in Eng­land, a philoso­pher decided to run an exper­i­ment involv­ing a few hun­dred men and a dead ox. The philosoper strongly believed that most peo­ple were dorks, and that crowds of dorks were dorkier and this exper­i­ment was going to be con­clu­sive proof of his belief. The dead ox was placed in a shandy , and peo­ple were asked to guess the weight of the ox. At the end of the day, the esti­mates were col­lected and aver­aged. The expected out­come was that the mean guess would be far off, thus prov­ing that crowds were stupid.

Unfor­tu­nately for the philosoper though, the mean of all the guesses was almost exactly equal to the weight of the ox, and much bet­ter than most indi­vid­ual guesses. In addi­ton to thor­ougly con­fus­ing the philoso­pher, the exper­i­ment had a point to it: It was an early indi­ca­tor of the idea that forms the basis of Surowiecki’s book: A col­lec­tive deci­sion made by a group of peo­ple, each of whom thinks inde­pen­dently, will almost always be bet­ter than the best indi­vid­ual deci­sion. This is not the same as con­sen­sus, which is the dumb­ing down of indi­vid­ual opin­ion to sat­isfy the group. You can­not find a bet­ter exam­ple of the Wis­dom of Crowds than the Inter­net: Google, Linux, Fire­fox and Wikipedia are exam­ples of decen­tral­ized mech­a­nisms that have deliv­ered out­stand­ing results. The Blo­gos­phere, in con­junc­tion with Google’s Pager­ank is quite pos­si­bly the best exam­ple of a per­fect democ­racy: the more peo­ple that like a blog, the more links it gets, increas­ing its rel­a­tive impor­tance and readership.

Draw­ing on exam­ples from every­day life — stock mar­ket bub­bles and traf­fic jams; the Colom­bia crash and over­crowded bars — Surowiecki paints a com­pelling pic­ture of smart groups, and pro­vides sug­ges­tions for pos­si­ble ways to har­ness the poten­tial. One of the meth­ods dis­cussed is a “deci­sion mar­ket” like the Iowa Elec­tronic Mar­ket — a stock mar­ket like sys­tem where you bet on a cer­tain per­son win­ning an elec­tion. The accu­racy of the IEM’s pre­dic­tions are bet­ter than even polls — which is sur­pris­ing con­sid­er­ing the small num­ber of peo­ple that par­tic­i­pate in it. Fas­ci­nat­ing. By the way, what do you think was the most reli­able life­line on Who Wants to be a Millionaire?

Get a cou­ple of peo­ple in a room. Give one of them $10, and ask him to share it with the other guy. If the other guy accepts his offer, they both get to keep the money, oth­er­wise no money for either of them. Most of the time, the offer was $5 appar­ently, while peo­ple rejected low­ball offers (any­thing less than $2), even though it was free money. Surowiecki attrib­utes this to an innate sense of what con­sti­tutes fair that we all have — and uses it to explain why we vote in elec­tions and why we tip at restau­rants in dis­tant towns that we know we are not going to go back.

The book has been accused of not being rig­or­ous enough (as in pro­vid­ing sta­tis­tics for why crowds are smarter), and some­times you get the feel­ing that the author is hand wav­ing his way to a pre-determined con­clu­sion using anec­dotes, but you know what, if you judge a book by the amount of plea­sure you get from read­ing it, then this is a good book. I’ve not enjoyed non-fiction more (if you don’t count Starry Nights, that is). Plus I now know all about the virtues of a decen­tral­ized, diverse cor­po­rate power struc­ture and ways to run pro­duc­tive meetings.

Excerpts can be found here and here.

  4 Responses to “Intelligence In Numbers”

  1. this topic is inter­est­ing and only because every­time i read an arti­cle about it, it presents an oppos­ing view (almost a nat­ural “not gate”!)
    for exam­ple, the last time i read abou this, i was con­vinced by the author that crowds and aver­ages are sim­ply not the best thing. a sim­ple (though some may say, silly) exam­ple: if 5 peo­ple of vary­ing sizes were to vote on the right size for a shirt, the aver­age shirt pro­duced would fit no one!(hey i warned you abou thte silly fac­tor!) the author made a strong case for the indi­vid­ual — for exam­ple using your exam­ples above, don’t for­get that google, linux et all were all the concepts/ideas of one or atmost two peo­ple and it remained so for awhile. over time, many con­tributed and made it pop­u­lar, but they were still add-ons remem­ber? the core of what made it great never came from a meet­ing — and in my belief never would have. some­where inbe­tween the dis­cus­sion of whether linux should be a micro-kernel based archi­tec­ture, a homer-like char­ac­ter would have said they should break for dough­nuts and that would have been the end of that)
    i have seen this per­son­ally too: when i come across a com­put­ing prob­lem at work and think up a solu­tion, i am asked to sit in a meet­ing to see if it is the best choice — an hour later noth­ing hap­pens, actu­ally i am now more con­fused then ever given teh choices (which reminds me: you should read “The Para­dox Of Choice: Why More Is Less” by Barry Schwartz). then the next day, my friend, who was also at the meet­ing but drew a blank then, would have thought about it alone overnight and would present a rad­i­cal solu­tion to me.)
    as for your restau­rant exam­ple, i say tip most to the restau­rant out of town since you might never see the poor guy again. at a reg­u­lar place, reduce the tip since you are going to keep vis­it­ing him any­way :-)

  2. There are def­i­nitely two sides to the story. How does google think a search result is impor­tant — by deter­min­ing how many peo­ple link to tha site. That’s the “democ­racy” Surowiecki describes, but you have a great point — the idea behind google itself came from a cou­ple of individuals.

    Surowiecki argues that the meet­ings you describe here are badly run meet­ings — well run meet­ings with a diverse group (intel­lec­tu­ally diverse, peo­ple hold­ing dif­fer­ent opin­ions and no imped­i­ments to peo­ple express­ing their opin­ions) will always come up with bet­ter solu­tions most of the time.

    Of course, there are lim­its to what groups can do — writ­ing a good book, a paint­ing etc. are prob­a­bly things that only indi­vid­u­als can do (although edi­tors, review­ers might play a role).

    I will add The Para­dox of Choice to my grow­ing ‘to-read’ list…

  3. […] The arti­cle was received well — so well in fact that Ander­son is now turn­ing it into a book, fol­low­ing the lead of James Surowiecki whose book born out of a New Yorker arti­cle — Wis­dom of the Crowds — was an instant bestseller. […]

  4. […] mys­ter­ies of the world using cold, hard num­bers. And on a unre­lated note, here is James Surowiecki (whose book we loved!) on The Pirates’ […]

Sorry, the comment form is closed at this time.

   
© 2012 etcetera Suffusion theme by Sayontan Sinha

Switch to our mobile site