Big Data
Big Data | News, how-tos, features, reviews, and videos
Machine learning algorithms explained
Machine learning uses algorithms to turn a data set into a model. Which algorithm works best depends on the problem
Delta Lake gives Apache Spark data sets new powers
A new open source project from Databricks adds ACID transactions, versioning, and schema enforcement to Spark data sources that don't have them
Pub/sub messaging: Apache Kafka vs. Apache Pulsar
Apache Kafka set the bar for large-scale distributed messaging, but Apache Pulsar has some neat tricks of its own
Apache Kafka vs. Apache Pulsar: How to choose
Apache Kafka set the bar for large-scale distributed messaging, but Apache Pulsar has some neat tricks of its own
IBM preps Watson AI services to run on Kubernetes
IBM Watson services arrive in versions that can run on the public cloud or on privately hosted container infrastructure
How to use Azure Data Explorer for large-scale data analysis
Microsoft’s tool for querying terabytes of data finally arrives for everyone to use
Tutorial: Spark application architecture and clusters
Learn how Spark components work together and how Spark applications run on standalone and YARN clusters
Tutorial: Spark application architecture and clusters
Learn how Spark components work together and how Spark applications run on standalone and YARN clusters
Why you should use Gandiva for Apache Arrow
An execution engine for Arrow-based in-memory processing, Gandiva brings dramatic performance improvements to analytical workloads
Review: MXNet deep learning shines with Gluon
With the addition of the high-level Gluon API, Apache MXNet rivals TensorFlow and PyTorch for developing deep learning models
Microsoft revamps machine learning tools for Apache Spark
The new open source release integrates Spark with Cognitive Toolkit and other Microsoft machine learning offerings
The future is cloudy, with a chance of success
True cloud computing metaphors: not every cloud is a rain cloud, and too much rain is disastrous for the unprepared
Built for realtime: Big data messaging with Apache Kafka, Part 2
Learn how to use Apache Kafka's partitions, message offsets, and consumer groups to distribute load and scale your applications horizontally, handling up to millions of messages per day
Built for realtime: Big data messaging with Apache Kafka, Part 1
Apache Kafka scales horizontally and offers much higher throughput than some traditional messaging systems. Get started with installation, then build your first Kafka messaging system
Real-time data processing with data streaming: new tools for a new era
Real-time data streaming is still early in its adoption, but over the next few years organizations with successful rollouts will gain a competitive advantage
Real-time data processing with data streaming: new tools for a new era
Real-time data streaming is still early in its adoption, but over the next few years organizations with successful rollouts will gain a competitive advantage
Bossies 2018: The Best of Open Source Software Awards
InfoWorld recognizes the leading open source projects for software development, cloud computing, big data, and machine learning
The best open source software for data storage and analytics
InfoWorld’s 2018 Best of Open Source Software Award winners in databases and data analytics
What is a data lake? Flexible big data management explained
A data lake can be a much more flexible repository than a data warehouse. Or it can be a trash dump that grows and grows
LinkedIn open-sources a tool to run TensorFlow on Hadoop
The Tony project uses Hadoop's native scheduler to run TensorFlow jobs, making fault tolerance and GPU usage easier
Popular on InfoWorld
