Big Data

Big Data | News, how-tos, features, reviews, and videos

A human profile containing digital wireframe of technology connections.
Clash of fists in silhouette

abstract binary vortex matrix motion digtial transformation disruption  by simon carter peter crowt

TensorFlow 2 review: Easier machine learning

Now more platform than toolkit, TensorFlow has made strides in everything from ease of use to distributed training and deployment

Evolution of Lighting 166160844

The data lake is becoming the new data warehouse

Platforms like AWS Lake Formation and Delta Lake point toward a central hub for decision support and AI-driven decision automation

money time clock numbers abstract

Time series analysis with KNIME and Spark

Train and evaluate a simple time series model using a random forest of regression trees and the NYC Yellow taxi data set

blank tag isolated on white 95754104

Supervised learning explained

Supervised learning turns labeled training data into a tuned predictive model

blockchain network machine learning neural network

What is TensorFlow? The machine learning library explained

TensorFlow is a Python-friendly open source library for numerical computation that makes machine learning faster and easier

broken down red mustang in trouble roadside hopeless

Hadoop runs out of gas

As big data customers flee complexity and embrace the cloud, the Hadoop vendors are sputtering

Dial allowing selection by flags of the world.

Natural language processing explained

Deep learning has improved machine translation and other NLP tasks by leaps and bounds

abstract data

Deep learning explained

Deep neural networks can solve the most challenging problems, but require abundant computing power and massive amounts of data

man on mountain top winner leader alone

4 reasons big data projects fail—and 4 ways to succeed

Nearly all big data projects end up in failure, despite all the mature technology available. Here's how to make big data efforts actually succeed

machine learning

Machine learning explained

Able to learn from data, machine learning algorithms can solve problems that are too complex to solve with conventional programming

Exploding binary numbers

Machine learning algorithms explained

Machine learning uses algorithms to turn a data set into a model. Which algorithm works best depends on the problem

Sparks

Delta Lake gives Apache Spark data sets new powers

A new open source project from Databricks adds ACID transactions, versioning, and schema enforcement to Spark data sources that don't have them

big data blue

Pub/sub messaging: Apache Kafka vs. Apache Pulsar

Apache Kafka set the bar for large-scale distributed messaging, but Apache Pulsar has some neat tricks of its own

container ship storage transport colorful containers diversity outsourcing

IBM preps Watson AI services to run on Kubernetes

IBM Watson services arrive in versions that can run on the public cloud or on privately hosted container infrastructure

cloud connect comput woman carry lights

How to use Azure Data Explorer for large-scale data analysis

Microsoft’s tool for querying terabytes of data finally arrives for everyone to use

sparkler / firework / sparks / celebration / hands

Tutorial: Spark application architecture and clusters

Learn how Spark components work together and how Spark applications run on standalone and YARN clusters

bullseye target with 3 arrows

Why you should use Gandiva for Apache Arrow

An execution engine for Arrow-based in-memory processing, Gandiva brings dramatic performance improvements to analytical workloads

Artificial intelligence computer brain circuits electronics grid

Review: MXNet deep learning shines with Gluon

With the addition of the high-level Gluon API, Apache MXNet rivals TensorFlow and PyTorch for developing deep learning models

Load More