« December 2010 | Main | February 2011 »

January 2011 Archives

January 9, 2011

The Spam Clock is Live

Most people see the web through a relatively small lens. They see the sites they regularly visit, the links in their Facebook and twitter streams, and the ones that show up for the searches they do. And that's about it.

When you work for a search engine, however, you get a different point of view. Because you are literally crawling and analyzing the entire internet constantly (well, most of it anyway), you get a unique top down view of what's out there. The good, the bad and the ugly. Unfortunately, the good seems to be getting crowded out by the bad and the ugly.

More specifically, we're seeing at blekko is a non-stop firehose of web spam. Millions of pages generated every day solely for the purpose of getting indexed by the major search engines and syphoning traffic from them. Of course the goal of this traffic is not to inform, but to monetize users through a variety of ad networks.

Unless you live this every day, its hard to communicate the size and breadth of this problem. In these instances, a graphic helpful. Thus, we created the spam clock. As you can see, based on our calculations we are showing spam growing at a rate of 1 million pages per hour.

Think about that 1 million pages an hour. Wikipedia is 3.5M articles. Every 3.5 hours a new volume of text the size of wikipedia is unleashed on the internet and unsuspecting users. Every 3.5 hours. 7 wikipedia size corpuses being created every day. Ugh.

Lest you think otherwise, the war on spam is far from over and the enemy is hardly backing down.

Rich's take here. Danny Sullivan's coverage is here.

About January 2011

This page contains all entries posted to Marksonland in January 2011. They are listed from oldest to newest.

December 2010 is the previous archive.

February 2011 is the next archive.

Many more can be found on the main index page or by looking through the archives.

Powered by
Movable Type 3.33