Big Data

Big Data news, analysis, research, how-to, opinion, and video.

DNA fingerprint
Spark Java microframework

fingers keyboard code hands programming

New functional programming language can generate C, Python code for apps

The open source Futhark makes it easier to program for GPUs that speed up machine learning and other math-intensive apps

house displayed on a hand 000005812122

Hot property: How Zillow became the real estate data hub

The R language, open source analytics software, and a migration to AWS are helping Zillow cement its position as the leading real estate data provider


How do you stop patent trolls? This algorithm just might do the trick

With 4.2 million listings so far, All Prior Art aims to 'democratize ideas'

Data lakes 101: Come on in, the water's fine

How to plan for and build a central hub for data analytics with the ever-evolving Hadoop ecosystem

Chair race    187891029

Look out, Spark and Storm, here comes Apache Apex

A new open source streaming analytics solution derived from DataTorrent's RTS platform, Apex offers blazing speed and simplified programmability. Let's give it a spin

machine learning

Why machine learning is the new BI

Get ready for artificial intelligence and automation that helps you make business decisions rather than just understanding what happened in the past

Abstract background texture with bright clouds in windows

Cloud review: Amazon, Microsoft, Google, IBM, and Joyent

The top five public clouds pile on the services and options, while adding unique twists


NoSQL chips away at Oracle, IBM, and Microsoft dominance

MongoDB, Cassandra, Basho, Couchbase, and MarkLogic are quietly insinuating themselves into enterprise data centers and cloud deployments

analytics big data stats statistics charts

Apache Beam wants to be uber-API for big data

New, useful Apache big data projects seem to arrive daily. Rather than relearn your way every time, what if you could go through a unified API?

5 steps to a modern data architecture

Becoming a true data-driven organization requires adopting a more centralized approach to data architecture and analysis

global network

Review: Amazon Web Services is eating the world

Amazon continues to define the cloud with an unrivaled set of services for developers, IT, and data crunchers

death match 6 battle fight contest boxing punch fist challenge

Apache Storm 1.0 packs a punch

Apache's streaming data processing system takes on Spark with better performance and more convenient debugging features

tampere by kari savolainen1

Finland, the land of vertical search engines

There are some underlying reasons behind the high number of search engine startups in Finland

machine learning

Machine learning's biggest job

Search gives people the superpower to find an answer to almost any question. Machine learning is about to give that same capability to machines

streaming river water creek flow

What Spark's Structured Streaming really means

Thanks to an impressive grab bag of improvements in version 2.0, Spark's quasi-streaming solution has become more powerful and easier to manage

Get started with Apache Spark

Reap the performance and developer productivity advantages of Spark for batch processing, streaming analysis, machine learning, and structured queries

ibm watson

Review: IBM Watson strikes again

Built on Watson and SPSS predictive analytics, IBM's cloud machine learning services meet the needs of developers, data scientists, and businesses

metamind richard socher salesforce

Salesforce buys AI specialist MetaMind to avoid being 'flanked' by rivals

The purchase will extend Salesforce's data science capabilities by embedding deep learning within the Salesforce platform.

Load More