October 21, 2009

This blog has NOT been brought to you by an algorithm

Online content factory Demand Media has a new way to generate blogs and videos, using software and a network of human drones. Welcome to your Web nightmare

I read a chilling story by Wired Magazine's Dan Roth last night about the future of online media, and I'm still trying to keep my breakfast down. It's not pretty.

Roth's story is about a company called Demand Media, which has introduced factory farming to the blogosphere. The company churns out 4,000 articles and videos every single day based on ideas spit out by a computer algorithm. The algorithm analyzes the keyword frequency from major search engines and the ad revenue that each of those keywords returns.

[ Also not bringing you this blog: the FTC. Get the lowdown from Cringely on InfoWorld. | Stay up to date on Robert X. Cringely's musings and observations with InfoWorld's Notes from the Underground newsletter. ]

Its goal: to find the topics people search for most often that also provide the most pennies per click. The algorithm then spits out a series of keywords that are manipulated into a fortune cookie-style headline by a pair of humans (at 8 cents a pop). That headline gets tossed out to Demand's cadre of hungry freelance writers, who get paid $15 a post to generate a few hundred words of drivel. Demand runs the post through a plagiarism detector, pays $2.50 for it to be copyedited and (maybe) another buck for fact checking, and then voila -- instant content, delivered at a tidy profit.

This is similar to a tactic that has long been used by sleazy SEO companies. They commission bogus, link-rich articles about a product or Web site, then post them online hoping to fool Google into thinking the particular product or site is more popular than it actually is. The problem here is that Demand Media is being used with increasing frequency by legitimate sites, like eHow, LiveStrong, and Cracked.

Want to crank out a video on that topic? No problem. You can make a cool $20 for that. Doesn't have to be in focus or anything. According to Roth, YouTube loves Demand Media because -- unlike 90 percent of the stuff people post -- it produces videos that are easy to sell ads against.

Here's an obnoxious YouTube video describing their services, which appropriately enough comes with an ad for cheap car insurance attached to it.

And now the really chilling bit. Per Roth:

White Paper

D2D Virtual Tape Library Replication Primer

This whitepaper explains the terminology and concepts behind Data Replication technologies and establishes some sizing rules through worked examples. Learn the new paradigm in disaster tolerance—protect data anywhere.

Download now »

White Paper

An Alternative to Virtualization for Datacenter Cost Savings

Server virtualization is a popular option for dealing with mounting datacenter costs. Another equally promising approach is the use of an Application Delivery Controller. Citrix NetScaler provides a low-cost way for organizations to reduce their server count and accrue cost savings from a reduction in space, cooling, power and personnel.

Download now »

White Paper

Why Your Firewall, VPN, and IEEE 802.11i Aren't Enough to Protect Your Network

The emergence of WLANs has created a new breed of security threats to enterprise networks.

Included in HP ProCurve WLAN solutions is security technology that alleviates threats from WLANs through:
* Monitoring wireless activity inside and out of the enterprise
* Classifying WLAN transmissions into harmful and harmless
* Preventing transmissions that pose a security threat to the enterprise network
* Locating participating devices for physical remediation

Download now »

White Paper

Bringing the Edge to the Data Center

Effectively address data protection challenges, implementing solutions that help store and protect business–critical data while cutting costs and improving efficiency and reliability.

Download now »
bz8x8c 21-Oct-09 1:03pm
Not to fear, Cringemeister, Google is already on it for us. Keep in mind that the problem is not really the content (there's far enough drivel on the web to shake a stick at, as you pointed out); it's the search engines that play their hand by ranking sites based on link counts and pure word content. Now, with Google implementing a way for readers to rate the content they view, content farms will lose some of their relevance over more useful content if readers are actually able to recognize quality content over drivel (yeah, this is questionable). Now, if the content farms actually manage to produce quality content, then who are you to complain about how it's done, but Google will not rest on their laurels while coyotes feed at the hand of their ranking engine. Of course, Rosenbleat (sic) will have made his fortune (again) by the time Google gets around to shaping up the situation, but everybody has to eat, right?
Buckminster 21-Oct-09 1:33pm
1 reply

I think that first content was composed by a bot in a comment farm.

Buckminster 21-Oct-09 1:35pm

OK, I meant, "I think that first COMMENT was composed by a bot in a CONTENT farm." But I made the mistake intentionally so that you'd know MY comment was not generated by an algorithm.

John the Econ 22-Oct-09 3:45am
This is just another inning in the endless game of cat-n-mouse. If I am tired of anything, it's of clients asking me to help them implement the latest gimmick they've read about to fool the search engines to get them to the top. It's a complete waste of time, because the people at Google are not as stupid as these people seem to think they are. By the time you've heard about it, they've long since been on this, and will have a counter-algorithm in place by the end of the week. These people are wasting a lot of money.
BD Man 22-Oct-09 3:03pm
I am not sure you really understand their business model. They use a predictive technology platform to understand what people are searching for (interested in) and they pay professionals to create content based on demand. Don't all writers try to find an audience? If the content is of high quality, and Google tends to do a good job of determining that, then why shouldn't it show up in search results? SEO shops are known for writing keyword dense spammy articles. There is a big difference between manipulation and legitimate ranking.
Red T-Rex 22-Oct-09 5:10pm
I think we now know how Randall Kennedy's column gets created.
Charlotte 19-Nov-09 1:43pm
Well, well, well. It may be sound trite, but I sure wish I had a quarter for every blogster out there, like you, Mr.Tynan, who feels so threatened by Rosenblatt and Demand Media that you stoop to criticizing and ridiculing your fellow professional writers. It is so unattractive and just so wrong. First of all, the Demand Studio writers are held to obviously stricter standards than you, Mr. Tynan, employ. RESEARCH. Yup, we have to do a lot of it. Unlike you, who state the following: "The problem here is that Demand Media is being used with increasing frequency by legitimate sites, like eHow, LiveStrong, and Cracked." Now, had you done the "professional" writer's research you would not have made such a moronic statement. You see, eHow, LiveStrong and Cracked, all "legitimate sites," as you state, are also OWNED by Demand Media. Why shouldn't these sites use Demand Media content? See what a fool you are? All the content on those sites is produced by Demand writers. You express fear that if Demand's methods proliferate "professional writers" will go the way of the dinosaur. Who the hell do you think is writing Demand's content? Gee, could they be professional writers? Wow, what a concept. Another missed research opportunity for you that, again, makes you look like a fool. So, you are the dinosaur and Demand writers are the rodents? Well, look out, Tynansaurus, this IS the new wave of journalism. The rodents are taking over.

Sign up to receive InfoWorld Resource Alerts

Subscribe to the Robert X. Cringely: Notes from the Trenches Newsletter

The one-stop resource center for IT professionals.

©1994-2009 Infoworld, Inc.