Hadoop gets real

Here's how four IT leaders managed to bring Hadoop systems from the sandbox into production

Become An Insider

Sign up now and get FREE access to hundreds of Insider articles, guides, reviews, interviews, blogs, and other premium content. Learn more.

Technology professionals with strong skills in Apache Hadoop are among the hardest to find. In fact, demand for people with Hadoop expertise has skyrocketed 34% since last year, according to Wanted Analytics, a research firm specializing in the labor market.

But while competition for talent is fierce, the days of highly paid data science rock stars might be coming to an end. Hadoop is known for its robust data processing and storage power -- as well as its complexity. But businesses that need such functionality may no longer have to hunt far and wide for IT pros with Hadoop skills, because vendors are building Hadoop systems that are easier to use.

[ InfoWorld dishes on must-have iPad office apps, essential Android productivity apps, and road warrior standbys. Start downloading! | Get the latest insight on the tech news that matters from InfoWorld's Tech Watch blog. ]

Pivotal Software, Syncsort, MapR Technologies and Zettaset are just a few of the vendors creating business-friendly applications for crunching large data sets on Hadoop. The result is a burgeoning ecosystem of products that promise to help IT departments reduce their dependence on high-priced talent, increase security, cut costs and better align big data activities with business goals.

To continue reading this article register now