Does Social Media Accelerate the Spread of Dangerous Ideas?

Oct 15th 2009 View Comments




Is the social web becoming a dangerous platform for contagious, destructive ideas? As social media usage grows and becomes a hive mind of collective consciousness, it enables a number of positive things to happen, but it also presents a grave danger in the form of dangerous memes.

Dan Dennet gave a great TED talk that I’ve mentioned before where he explores dangerous memes. He defines these as parasitic ideas that subordinate genetic interests, in that they can flourish and spread even when they cause harm to the people who contract them. Examples of these are “ideas to die for” like communism, capitalism, religion, fascism and contagious suicide.

Memes are ideas that act as viruses and spread from person to person. In biological infection extreme dense populations often form worst breeding grounds. Many of history’s deadliest outbreaks started in the extremely dense populations of Asia. Cholera started in Bengal and spread across India in the early eighteen hundreds. The black death is widely believed to have begun in central Asia and the third bubonic plague pandemic began in the Yunnan province of China in 1855

If memes are idea viruses, population density can be compared to technologies that bring minds closer together. Social media not only does this, but it also increases the reach available to a single infected person and the frequency of contact that other minds have with new ideas.

The old, industrial media regime had several buffering factors that hindered the spread of contagious ideas. The gatekeepers of broadcast media companies often did extensive fact checking on new stories. The speed and frequency of idea transmission under the old media was also much less than that presented by social media.

We’ve already begun to see the beginnings of dangerous meme outbreaks in social media. Many are relatively benign like the celebrity death hoaxes of stars like Tila Tequila, Britney Spears and Zach Braff. We’ve all seen examples of incorrect “facts” spreading across Twitter at lightening speed through ReTweets and stock prices have felt the pain of a rumor posted to a social site.

More sinister variations on this theme have also begun to emerge including a suspected “web-based Suicide Cults” in England and Japan, a “flash mob riot” in Philadelphia, online gang recruitment, and racist and neo-Nazi social networking. The giant Unification Church “cult” also has strong presences on Facebook and Youtube.

These phenomenon are likely only the tip of the iceberg. How long will it be before a dangerous cult, racist faction or mass-panic inducing hoax emerges that has been specifically designed for social media contagiousness?

If you liked this post, don't forget to subscribe to my RSS feed or my email newsletter so you never miss the science.

Take this quick survey and tell me what social media data you'd like to see me analyze.

  • http://socialmediarockstar.com Brett Borders

    Dan, I think it is definitely a hotbed to spread dangerous memes that would never be allowed to flow freely in polite, face-to-face society. Once place where you can kind find unsavory + dangerous ideas is Reddit, which – if you dig deep enough – is hot bed of antisemitism, “The US Government Perpretrated 9/11,” radical Islamist propaganda, unfounded rumors, propaganda sites and conspiracy theories.

  • http://twitter.com/ericpursh ericpursh

    Great post, Dan.
    I agree with Brett, and would add that it has already lead to “public danger” in the instances of high-school level harassment. A lot of times what's needed is simply common sense, something we can all use a good dose of as we peruse the Internet.

    However, I'd also hasten to add that every technological leap has had the same “dangerous” potential and came with the same caveats — from the printing press to radio to television to the Internet, and now Web 2.0/3.0/mobile.

    Trouble now is, access is easier and cheaper, and news spreads even faster, in multiple media forms. We need more snopes.coms!

  • http://ikeif.net keif

    I don't consider this new – the idea of “the teeming masses are idiots” isn't new, and the internet being used to push political/social agendas has just made it easier, and now sites like Facebook/Myspace make it easier to create “groups” of people with similar ideologies (or easy to install forum software, blog platforms, etc. etc.)

    Conspiracy theories existed and propagated before – without the internet or social media, and remained because the only people finding that information were seeking that information out. Social Media and the Internet make it exponentially easier to stumble upon accidentally (or through unintended means) that also make it easier to *educate yourself* and also *prove wrong*. Saying it quickly perpetuates and gets out and is exploited is due to the idioicy of people letting it happen – much like the people that retweet links without reading them, or make comments based on headlines and not article content.

    Celebrity deaths? Stock prices drop because of a tweet? This just shows how much weight people put in rumors over facts – nothing has changed, much the same way propaganda spreads through feeding on paranoia and false information. The teeming masses as a whole are stupid mobs – it's up to the individuals to strike back and spread the truth to counter lies (or dig for facts – much like the “Michael Jackson is dead” before it was confirmed – people took a gossip hound's word as fact without waiting for verification, PEOPLE love gossip, as a person, I do not and I research anything I see as dubious).

    (btw – lose the overlay on page load, that's annoying as hell)

  • wordwrite

    Dan, great post. The examples you cite are indeed troubling. Another one of the most interesting (and unpredicted) areas of inquiry for Twitter use has been in public interaction with government and politics. I believe your readers will be interested in my blog on this topic which focuses on the Constitutional and free speech issues in the arrest of two anarchists charged with using Twitter to mobilize anti-police activity during the recent G-20 summit in Pittsburgh:
    http://www.wordwritepr.com/blogstorytelling/?p=41

    Paul Furiga, CEO WordWrite Communications

  • cocreatr

    Dan, it is easy to agree about social media accelerating the spread of dangerous ideas, and so I do. Yet, just the same social media do accelerate the spread of wholesome helpful ideas, too, would you agree?

    Somehow this article rings distant bells of a justification for propaganda or “some ideas are better suppressed, for the sake of society”. Who is to decide that, without being called a four letter word like [censored]?

    What if this article itself represents a dangerous idea?

    Books are not ideas. Words are not the things they label. http://bit.ly/NWIMsymbols (via @spinhead)

    BTW, this popup before I can read what you want to say is plain annoying:
    “Get the blog sent to your inbox by entering your email address. Enter your email address below: No Thanks”

    Disclosure: I grew up in post-Nazi Germany. I trust you cannot fool all the people all the time. I am convinced we get what we keep focusing our attention on.

  • jnewman1

    I like this blog! It stands out from all the others in this search criteria! I know a great blog when I see it. Thanks for the great information on the subject. The web needs more blogs like this one. Thanks again, and Happy Halloween!
    Tech Blog

  • http://edwardboches.com edwardboches

    Dan,
    Thoughtful post. A couple of reactions. One, on a positive note at least it's all public and there to be found, in many ways making alert sociologists, educators, sm aware able to call this stuff out, as you have. It's really no different than how any group wanting to build a following has used whatever media of the day was available. Let's face it, there were plenty of cults recruiting successfully long before all this stuff was mainstream. On the other hand, there seems to be more positive stuff going on. Look at the green avatar for example. Or Twestival. Or all the cancer fund raising. So sure, things are easier for the dangerous, as you call it, memes, but hopefully they're visible enough for thoughtful people to know what's going on. And at the same time, likely to be outnumbered by the good stuff.

  • danzarrella

    I believe the development of more and more contagious memes is a technological pursuit and it is that pursuit that will determine if more good or bad comes from social media. Which side develops the most infectious ideas.

  • lauraclarke

    Interesting post Dan. Sure, viruses and bad ideas/ memes start in dense populations… but so do the really good ideas!

    Silicon Valley was the place where silicon tech really happened. Was this a virus that needed containing??

    London, with its 8 million plus population, is a hub of activity for all kinds of technological advances, new ideas, cultural happenings and revolutions… as are many other big cities around the world.

    I guess I'm suggesting every yin has a yang, and vice versa… No?

  • http://www.mytwitterreport.com Laura Clarke

    Interesting post Dan. Sure, viruses and bad ideas/ memes start in dense populations… but so do the really good ideas!

    Silicon Valley was the place where silicon tech really happened. Was this a virus that needed containing??

    London, with its 8 million plus population, is a hub of activity for all kinds of technological advances, new ideas, cultural happenings and revolutions… as are many other big cities around the world.

    I guess I'm suggesting every yin has a yang, and vice versa… No?

  • Pingback: Everybody’s doing it: meme spreadage and social search | Erica Glasier: Oversocialized!

  • Pingback: Reading Assignment « Spring 2010 Graphic Design Seminar