Spark

Spark | News, how-tos, features, reviews, and videos

sparkler / firework / sparks / celebration / hands
sparkler / firework / sparks / celebration / hands

one yellow arrow moving opposite a stream of white arrows

Real-time data processing with data streaming: new tools for a new era

Real-time data streaming is still early in its adoption, but over the next few years organizations with successful rollouts will gain a competitive advantage

True Technologist video series [teaser]

Interview: Matei Zaharia on Spark and machine learning

Zaharia expounds on the reasons Spark has become the big data framework of choice and why he thinks his company’s melding of Spark and machine learning delivers unique value

template c100.00 01 15 18.still001
video

Matei Zaharia, creator of the Apache Spark project, on the big data framework | True Technologist Ep 2

In this episode of True Technologist, host Eric Knorr talks with Matei Zaharia, chief technologist at Databricks and an assistant professor of computer science at Stanford, about the Apache Spark and Apache Mesos projects

2 hadoop and spark

What’s new in Apache Spark? Low-latency streaming and Kubernetes

Continuous processing and native Kubernetes support in Apache Spark 2.3 spell the end for micro-batching and Hadoop

wireless network - industrial internet of things edge [IoT] - edge computing

Azure Databricks: Fast analytics in the cloud with Apache Spark

Microsoft’s partnership with Databricks adds new analytics tools to Azure’s data platform

abstract fire rays 100152558

Spark tutorial: Get started with Apache Spark

A step by step guide to loading a dataset, applying a schema, writing simple queries, and querying real-time data with Structured Streaming

cloud computing - binary - data center - network server - storage

Microsoft brings Apache Spark, Cassandra, MariaDB to its Azure cloud

Beta tools extend Azure to popular analytics and NoSQL platforms, as well as add devops pipeline support in Git

artificial intelligence / machine learning / network

Apache PredictionIO: Easier machine learning with Spark

An open source project now under Apache’s guidance uses a template system for easy training and deployment of Spark-powered machine learning models

apache spark 900x600

The rise and predominance of Apache Spark

Recent surveys and forecasts of technology adoption have consistently suggested that Apache Spark is being embraced at a rate that outperforms other big data frameworks

Navigating a field of uncertainty and doubt questions

Which Spark machine learning API should you use?

A brief introduction to Spark MLlib's APIs for basic statistics, classification, clustering, and collaborative filtering, and what they can do for you

Load More