Hadoop - Infoworld http://www.infoworld.com/t/21604 en Hadoop gets real http://www.infoworld.com/d/business-intelligence/hadoop-gets-real-248591?source=rss_hadoop <p>Technology professionals with strong skills in Apache Hadoop are among the hardest to find. In fact, demand for people with Hadoop expertise has skyrocketed 34% since last year, according to Wanted Analytics, a research firm specializing in the labor market.</p> Business Intelligence Open Source Software Data Mining Hadoop Open Source Software IDG Insider Tue, 19 Aug 2014 10:00:00 +0000 admin 248591 at http://www.infoworld.com TPC takes the measure of big data systems http://www.infoworld.com/d/business-intelligence/tpc-takes-the-measure-of-big-data-systems-248611?source=rss_hadoop <p>Comparing commercial Hadoop big data-styled analysis systems might get a little easier, thanks to a new benchmark from the Transaction Processing Performance Council (TPC).</p> <p>The <a href="http://www.tpc.org/tpcx-hs/spec/tpcx-hs-specification-v1.1.pdf" target="_blank">TPCx-HS</a> benchmark, posted Monday, offers a performance assessment of Hadoop-based systems.</p> Business Intelligence Big Data Data Mining Hadoop Mon, 18 Aug 2014 15:24:36 +0000 admin 248611 at http://www.infoworld.com When to use Hadoop (and when not to) http://www.infoworld.com/d/business-intelligence/when-use-hadoop-and-when-not-248285?source=rss_hadoop <p>When enterprises interested in leveraging big data and analytics ask how to get started, they often are advised to begin with Hadoop, Apache Software's open source data storage and processing framework.</p> <p>There are a number of reasons why Hadoop is an attractive option. Not only does the platform offer both distributed computing and computational capabilities at a relatively low cost, it's able to scale to meet the anticipated exponential increase in data generated by mobile technology, social media, the Internet of Things, and other emerging digital technologies.</p> Business Intelligence Hadoop Predictive Analytics Fri, 15 Aug 2014 10:00:00 +0000 admin 248285 at http://www.infoworld.com Hadoop meets Google Docs: Analytics made easy http://www.infoworld.com/t/hadoop/hadoop-meets-google-docs-analytics-made-easy-247862?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hadoop.jpg" alt="Hadoop meets Google Docs: Analytics made easy" width="243" height="182" align="right" /><br /><em><p align="right">Credit: Wikimedia</p> Big Data Business Intelligence Data Visualization Hadoop Thu, 07 Aug 2014 14:00:00 +0000 InfoWorld Tech Watch 247862 at http://www.infoworld.com The right cloud for the job: Multicloud database processing is here http://www.infoworld.com/d/cloud-computing/the-right-cloud-the-job-multicloud-database-processing-here-247610?source=rss_hadoop <p>The idea is pretty simple and actually pretty old: Use a distributed architecture on large databases to quickly return the data requested. This approach runs the database query across many servers at the same time, then combines the results as they return from hundreds, perhaps thousands of servers in the cluster.</p> Cloud Computing Data Management DBMS Hadoop Cloud Computing Tue, 05 Aug 2014 10:00:00 +0000 David Linthicum 247610 at http://www.infoworld.com Team of rivals: Hortonworks, Pivotal join up for Hadoop project http://www.infoworld.com/t/hadoop/team-of-rivals-hortonworks-pivotal-join-hadoop-project-247138?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hadoop.jpg" alt="Hadoop rivals team up, give one of its underlying projects a boost" width="243" height="182" align="right" /><br /><em><p align="right">Credit: Wikimedia</p> Business Intelligence Hadoop Open Source Software Mon, 28 Jul 2014 18:49:56 +0000 InfoWorld Tech Watch 247138 at http://www.infoworld.com HP invests in Hortonworks' Hadoop http://www.infoworld.com/d/applications/hp-invests-in-hortonworks-hadoop-246969?source=rss_hadoop <p>Hewlett-Packard is betting $50 million that its customers will find value in the Hadoop data processing platform, by investing in Hadoop distributor Hortonworks.</p> <p>The two companies will also partner on sales calls and <a href="http://hortonworks.com/press-releases/hp-extends-strategic-partnership/" target="_blank">formulate</a> an architecture for incorporating the Hortonworks' Hadoop distribution into HP's data processing stack, called HAVEn.</p> Applications Hewlett-Packard (HP) Hadoop Applications Thu, 24 Jul 2014 18:03:41 +0000 admin 246969 at http://www.infoworld.com How to create a data lake for fun and profit http://www.infoworld.com/d/application-development/how-create-data-lake-fun-and-profit-246874?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/data_world.jpg" alt="How to create a data lake for fun and profit" width="243" height="182" align="right" /><br /><em><p align="right">Credit: iStockphoto</p></em></div> Application Development Big Data Big Data Database Design Application Development Hadoop Business Intelligence Data Management Thu, 24 Jul 2014 10:00:00 +0000 Andrew Oliver 246874 at http://www.infoworld.com The truth about big data: It's more than technology http://www.infoworld.com/t/big-data/the-truth-about-big-data-its-more-technology-246903?source=rss_hadoop <p>Hey, it must be hard to be the only person on the planet who doesn't understand big data.</p> <p>Actually, that's far from true: You're in good company. While Gartner finds that 64 percent of enterprises are investing in big data, a similar chunk (60 percent) don't have a clue as to what to do with their data.</p> <p>The real problem isn't one of technology, but of process. The key to succeeding with big data, as in all serious IT investments, is iteration. It's not about Hadoop, NoSQL, Splunk, or any particular vendor or technology. It's about iteration.</p> Big Data Big Data Hadoop Thu, 24 Jul 2014 10:00:00 +0000 InfoWorld Tech Watch 246903 at http://www.infoworld.com Review: Apache Hive brings real-time queries to Hadoop http://www.infoworld.com/d/big-data/review-apache-hive-brings-real-time-queries-hadoop-246607?source=rss_hadoop <p>Apache Hive is a tool built on top of Hadoop for analyzing large, unstructured data sets using a SQL-like syntax, thus making Hadoop accessible to legions of existing BI and corporate analytics researchers. Developed by Facebook engineers and contributed to the Apache Foundation as an open source project, Hive is now at the forefront of big data analysis in commercial environments.&nbsp;</p> Big Data Business Intelligence Open Source Software Big Data Data Warehousing Hadoop IDG Insider Wed, 23 Jul 2014 10:00:00 +0000 Doug Dineley 246607 at http://www.infoworld.com The 10 worst big data practices http://www.infoworld.com/d/application-development/the-10-worst-big-data-practices-246380?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 243px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hazbigdata.jpeg" alt="I can haz big data" width="243" height="243" align="right" /></div><p>Yes, you can haz big data. However, you can haz it the right way or the wrong way. Here are the top 10 worst practices to avoid.</p> Application Development Big Data Big Data Application Development Hadoop Thu, 17 Jul 2014 10:00:00 +0000 Andrew Oliver 246380 at http://www.infoworld.com Hadoop's success drives efforts to make it more secure http://www.infoworld.com/d/security/hadoops-success-drives-efforts-make-it-more-secure-245383?source=rss_hadoop <p>Talk about big data and it won't take long for Hadoop to appear in the conversation. The Apache open source software is used to orchestrate clusters of commodity computers to crunch information from mountains of data.</p> Security Hadoop Data Loss Prevention IDG Insider Tue, 08 Jul 2014 10:00:00 +0000 admin 245383 at http://www.infoworld.com How much is Hadoop worth? For Google, $80 million http://www.infoworld.com/t/hadoop/how-much-hadoop-worth-google-80-million-245233?source=rss_hadoop <div id="blog-edit" style="height: 192px; width: 243px; background: #ffffff no-repeat center top; position: relative; float: right; padding-bottom: 8px; padding-top: 8px; padding-left: 8px; padding-right: 8px"><img alt="How much is Hadoop worth? For Google, $80 million" src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hadoop.jpg" width="243" align="right" height="182" /> <br /><em> <p align="right">Credit: Wikimedia</p> Big Data Business Intelligence Data Explosion Google Hadoop Startups Open Source Software Mon, 30 Jun 2014 11:30:00 +0000 InfoWorld Tech Watch 245233 at http://www.infoworld.com Why Google Cloud Dataflow is no Hadoop killer http://www.infoworld.com/t/hadoop/why-google-cloud-dataflow-no-hadoop-killer-245212?source=rss_hadoop <div id="tw-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 182px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/Google_Cloud_hp.jpg" alt="Why Google Cloud Dataflow is no Hadoop killer" width="243" height="182" align="right" /></div><p>Unveiled earlier this week, <a href="http://www.infoworld.com/d/business-intelligence/google-service-analyzes-live-streaming-data-245079">Google's Cloud Dataflow service</a> clearly competes against Amazon's streaming-data processing service <a hr Big Data Cloud Computing Data Explosion Data Management Google Big Data Hadoop PaaS Fri, 27 Jun 2014 17:57:12 +0000 InfoWorld Tech Watch 245212 at http://www.infoworld.com Dell aims Cloudera-powered appliance at enterprise Hadoop users http://www.infoworld.com/t/hadoop/dell-aims-cloudera-powered-appliance-enterprise-hadoop-users-244954?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hadoop.jpg" alt="Dell aims Cloudera-powered appliance at enterprise Hadoop users " width="243" height="182" align="right" /><br /><em><p align="right">Credit: Wikimedia</p> Big Data Computer Hardware Dell Big Data Hadoop Servers Tue, 24 Jun 2014 17:18:08 +0000 InfoWorld Tech Watch 244954 at http://www.infoworld.com Hadoop analysis now tackling IoT to improve transit http://www.infoworld.com/d/business-intelligence/hadoop-analysis-now-tackling-iot-improve-transit-244919?source=rss_hadoop <p>For the Internet of Things, collecting data is only half the battle, and public transit agencies know that as well as anyone.</p> <p>Operators of bus, train, and trolley systems collect a wide range of data from ticket machines, fare validation devices, GPSes (Global Positioning Systems), and other sources, but typically that data stays in silos, according to Wade Rosado, director of analytics for Urban Insights, a consultancy launched on Monday to help make use of transit data.</p> Business Intelligence Internet of Things Hadoop Predictive Analytics Tue, 24 Jun 2014 11:26:24 +0000 admin 244919 at http://www.infoworld.com Moving a database to the cloud? Wrap it in a services layer http://www.infoworld.com/d/cloud-computing/moving-database-the-cloud-wrap-it-in-services-layer-244347?source=rss_hadoop <p>Most applications have some sort of database attached, and cloud-based applications are no different. In the world of cloud, you have many choices for database architecture, type of database, and number of databases to use. However, when it comes to database coupling, cloud developers often don't understand what the new rules are or how they apply.</p> Big Data Cloud Computing Data Management Database Design Cloud Storage Hadoop Fri, 20 Jun 2014 10:00:00 +0000 David Linthicum 244347 at http://www.infoworld.com Fast data: The next step after big data http://www.infoworld.com/t/big-data/fast-data-the-next-step-after-big-data-244102?source=rss_hadoop <p><em>The way that big data gets big is through a constant stream of incoming data. In high-volume environments, that data arrives at incredible rates, yet still needs to be analyzed and stored.</em></p> <p><em>John Hugg, software architect at VoltDB, proposes that instead of simply storing that data to be analyzed later, perhaps we've reached the point where it can be analyzed as it's ingested while still maintaining extremely high intake rates using tools such as Apache Kafka.</em></p> <p><em>-- Paul Venezia</em></p> Big Data Business Intelligence Data Management Open Source Software Big Data DBMS Hadoop OLAP SQL Open Source Software Data Management Wed, 11 Jun 2014 10:00:00 +0000 New Tech Forum 244102 at http://www.infoworld.com Facebook HydraBase adds reliability to Hadoop's HBase http://www.infoworld.com/t/hadoop/facebook-hydrabase-adds-reliability-hadoops-hbase-243901?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/hadoop.jpg" alt="Facebook HydraBase adds reliability to Hadoop's HBase" width="243" height="182" align="right" /><br /><em><p align="right">Credit: Wikimedia</p> Big Data Open Source Software Facebook Hadoop Open Source Software Fri, 06 Jun 2014 15:48:09 +0000 InfoWorld Tech Watch 243901 at http://www.infoworld.com Straight talk on Apache Spark -- and why you should care http://www.infoworld.com/d/application-development/straight-talk-apache-spark-and-why-you-should-care-243737?source=rss_hadoop <div id="blog-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 192px;"><img src="http://www.infoworld.com/sites/infoworld.com/files/media/image/all-in-one-knife.jpg" alt="Straight talk on Apache Spark -- and why you should care" width="243" height="182" align="right" /><br /><em><p align="right">Credit: Aldo Ottaviani</p> Application Development Data Explosion Data Management Big Data Database Design Application Development Hadoop Thu, 05 Jun 2014 10:00:00 +0000 Andrew Oliver 243737 at http://www.infoworld.com