Data Mining - Infoworld en Microsoft's new toolset brings analytics to 'ambient intelligence' <p>Microsoft is targeting the growing volume of data being generated by both machines and humans. CEO Satya Nadella on Tuesday showed off tools that could help organizations better understand -- and profit from -- this trove of information.</p> <p>One new hosted service, called the Azure ISS (Intelligent Systems Service), promises to ease the process of managing machine data from sensors and devices connected in the so-called Internet of Things. ISS is now available as a limited public preview.</p> Business Intelligence Microsoft Big Data Data Mining Hadoop Predictive Analytics Tue, 15 Apr 2014 20:57:51 +0000 admin 240576 at 10 big data startups to watch <p>The Big Data space is heating up to the point that many pundits already see it as the over-hyped heir to "cloud." The hype may be a bit much, but Big Data is already living up to its potential, transforming entire business lines, such as marketing, pharmaceutical research, and cyber-security.</p> <p>While the space is still fairly new, IDC, for one, sees big things ahead. The research firm predicts that the market for Big Data technologies will reach $32.4 billion by 2017, or about six times the growth rate of the overall information and communication technology market.</p> Big Data Business Intelligence Big Data Data Mining Startups Mon, 14 Apr 2014 14:46:47 +0000 admin 240414 at LucidWorks preps Solr stack as Splunk killer <p>Enterprise search software provider LucidWorks has introduced a package based on its open-source Apache Solr search engine that will allow administrators and business analysts to extract more information from IT system logs.</p> <p>SiLK "is a solution that relies on open core components that organizations can use to manage log data at scale," said Will Hayes, LucidWorks chief product officer.</p> Applications Business Intelligence Data Management Open Source Software Data Mining Open Source Software Search Engines Data Management Wed, 02 Apr 2014 13:01:24 +0000 admin 239627 at Government open data proves a treasure trove for savvy businesses <p>When President Barack Obama signed the Open Data Executive Order last May, many IT leaders applauded the White House's decision to release treasure troves of public data as part of an important government initiative for greater transparency.</p> <p>However, what many didn't bargain for was the state in which they'd find these once-buried data sets. "A dog's breakfast," "a train wreck," "a massive hairball" -- those are a few of the terms IT leaders have used to describe the vast volumes of public data now being made available to the general public.</p> Business Intelligence Data Mining Business Intelligence Government Mon, 24 Mar 2014 12:08:53 +0000 admin 238937 at Logstash steps up as Splunk's latest challenger <div id="tw-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 182px;"><img src="" alt="Logstash steps up as Splunk's latest challenger" width="243" height="182" align="right" /></div> <p>The popular log analysis system <a href="">Splunk </a>has been facing more and tougher competition with each passing month. Application Development Big Data Business Intelligence Data Mining Development Tools Open Source Software Search Engines Thu, 20 Mar 2014 16:43:28 +0000 InfoWorld Tech Watch 238800 at New Relic debuts Splunk-style analytics for software <div id="tw-edit" style="padding: 8px; background: none no-repeat scroll center top #ffffff; position: relative; float: right; width: 243px; height: 182px;"><img src="" alt="New Relic debuts Splunk-style analytics for software" width="243" height="182" align="right" /></div><p>Big data provides insight into items with many moving parts, and few objects have more moving parts than the applications used in any given enterprise. Application Development Business Intelligence Big Data Data Mining Development Tools Wed, 19 Mar 2014 15:19:50 +0000 InfoWorld Tech Watch 238693 at Internet of things presents both technical and ethical questions <p>Chamberlain Group CIO Bill Radon met with a team of engineers and IT managers in 2012, asking what was next for the company, a leading maker of residential and commercial garage door openers.</p> <p>Earlier, the team had delivered an Internet of Things device called MyQ Gateway to connect customers' smartphones to a narrow set of garage door products. Now Chamberlain wanted to build a device to connect with most garage door openers, even those from competitors. The result: MyQ Garage, which lets users monitor and control their garage doors with an Android or iOS smartphone.</p> Business Intelligence Mobile Technology Security Internet of things Data Mining Mobile Apps Internet Privacy IDG Insider Tue, 18 Mar 2014 14:33:28 +0000 admin 238587 at California fights drought with big data, cloud computing <p>California is facing its worst drought <a href="" target="_blank">in more than 100 years</a>, and one with no end in sight. Conserving water has never been more important, and Silicon Valley has an opportunity to offer technological solutions to the problem.</p> <p>Consider, for example, the approach the East Bay Municipal Utility District took to encouraging customers to reduce water consumption.</p> Business Intelligence Cloud Computing Networking Internet of things Big Data Data Mining SaaS Wed, 19 Feb 2014 13:16:27 +0000 admin 236633 at Intel wants to be the 'operating system' for big data <p>Intel is continuing to build out its array of software tools for the Hadoop open-source big data processing framework, with an emphasis on the security and reliability features demanded by large enterprises.</p> <p>A Data Platform tools suite will become available in the next quarter as a free-of-charge but self-supported Enterprise Edition, as well as a subscription Premium Edition that provides features such as proactive security fixes, regular enhancements and live support.</p> Business Intelligence Data Management Big Data Database Administration Data Mining Data Warehousing Open Source Software Thu, 13 Feb 2014 19:07:14 +0000 admin 236327 at Amazon Web Service now offers R on demand <p>Amazon Web Services now offers a hosted version of the R programming language, providing an easy way for individuals and organizations to start and test their big-data-styled analysis projects.</p> <p>The cloud service is offering a copy of Revolution R Enterprise 7 on the <a href="" target="_blank">AWS Marketplace</a>, an online store for different packages that can be run on AWS.</p> Application Development Business Intelligence Cloud Computing Amazon Web Services Data Mining Development Environments Tue, 11 Feb 2014 12:31:44 +0000 admin 236079 at ThoughtSpot promises Google-like BI experience <p>Two items on BI (business intelligence) customers' wish lists have long been ease of use and a lower burden on IT. A startup called ThoughtSpot says its new BI appliance can tackle both.</p> <p>ThoughtSpot has developed an in-memory database for the appliance. This allows information to be held in RAM for faster processing of queries, which users enter in natural language through a Google-like form.</p> Business Intelligence Data Mining Startups Applications Business Intelligence Wed, 05 Feb 2014 12:33:41 +0000 admin 235753 at Cloudera launches in-memory analyzer for Hadoop <p>Hadoop distributor Cloudera has released a commercial edition of the Apache Spark program, which analyzes data in real time from within Cloudera's Hadoop environments.</p> <p>The release has the potential to expand Hadoop's use for stream processing and faster machine learning.</p> Business Intelligence Data Mining Hadoop Tue, 04 Feb 2014 20:47:50 +0000 admin 235708 at 10 big myths about big data <p>Big Data has dominated tech news of late. It has been touted as a possible solution for everything from intrusion detection to fraud prevention to curing cancer and setting optimal product prices.</p> <p>But Big Data, which we're defining as data collected in large volumes, at high velocity and in a variety of formats, isn't a cure-all for every problem. In fact, if companies that believe in some of the myths surrounding Big Data, could head off in the wrong direction, waste a lot of time and money, cost a company its competitive position in the market, or damage a company's reputation.</p> Business Intelligence Big Data Data Mining IDG Insider Mon, 27 Jan 2014 15:18:56 +0000 admin 235044 at Hortonworks brings Hadoop 2.0 to Windows <p>Hadoop specialist <a href="" target="_blank">Hortonworks</a> today <a href="" target="_blank">announced the public availability</a> of Hortonworks Data Platform 2.0 for Windows, for the first time giving <a href="" target="_blank">Microsoft</a> Windows shops access to a distribution of Apache Hadoop 2.0 certified for production usage on Windows Server 2008 R2 and Windows Server 2012.</p> Business Intelligence Data Mining Microsoft Windows Hadoop Tue, 21 Jan 2014 18:49:33 +0000 admin 234656 at Hadoop gets native R programming for big data analysis <p>Sensing a growing interest in big data-style analysis, software provider Revolution Analytics has updated its flagship package of R statistical functions so it can be run with the Hadoop data processing platform.</p> <p>Revolution R Enterprise 7 (RRE 7), <a href="" target="_blank">to be made available on Monday</a>, also features the ability to run R within Teradata databases as well.</p> Business Intelligence Data Mining Hadoop Mon, 16 Dec 2013 17:49:59 +0000 admin 232716 at Big data's biggest challenges <p>"Puppies are free, but you still have to feed them."</p> <p>Virendra Vase jokingly likened this truism to Klout's experience with big data. Vase is CTO at Klout, which uses analytics to measure people's influence across social networks. "We basically sit above the social networks, gathering all the signals, helping folks to understand and be recognized for their influence," he said.</p> Business Intelligence Big Data Data Mining IDG Insider Wed, 20 Nov 2013 17:56:41 +0000 admin 231309 at Flame graph shows system performance in a new light <p>The person who became known on the Internet for yelling at servers is now becoming famous for another, somewhat related, feat, creating a new type of data visualization for characterizing system performance.</p> <p>Brendan Gregg, lead performance engineer at cloud provider Joyent, has developed a visualization technique called a flame graph that can be effective for charting how system resources such as CPUs and memory are used. It has subsequently been picked up by a number of engineers who have used it to enhance popular diagnostic tools such as DTrace and Windows XPerf.</p> Business Intelligence Data Mining Free Tools Data Management Fri, 08 Nov 2013 19:44:14 +0000 admin 230520 at Big data blues: The dangers of data mining <p>More than simply bits and bytes, big data is now a multibillion-dollar business opportunity. Savvy organizations, from retailers to manufacturers, are fast discovering the power of turning consumers' ZIP codes and buying histories into bottom-line-enhancing insights.</p> Business Intelligence Big Data Data Mining Mon, 04 Nov 2013 15:38:25 +0000 admin 230107 at Hadoop is not enough for big data, says Facebook analytics chief <p>The Hadoop programming framework may be synonymous with the "big data" movement but it's not the only tool companies need to derive insights from massive stores of unstructured information, according to Facebook analytics chief Ken Rudin.</p> Business Intelligence Facebook Big Data Data Mining Hadoop Data Management Tue, 29 Oct 2013 16:43:13 +0000 admin 229727 at Splunk launches Hunk for Hadoop <p>Analytics software provider, Splunk, has released a new platform which allows anyone to explore, analyze and visualize data in Hadoop.</p> <p>Hunk, the next generation of big data analytics, is built on patent pending virtual index technology that delivers self-serve analytics without the need for specialized programming skill sets, fixed schemas or costly integrations.</p> Business Intelligence Data Mining Hadoop Predictive Analytics Tue, 29 Oct 2013 11:44:14 +0000 admin 229696 at