Spark

Spark | News, how-tos, features, reviews, and videos

sparking jumper cables 94261543
data lake

fire flames

How Qubole addresses Apache Spark challenges

The Qubole Data Platform brings streamlined configuration, auto-scaling, cost management, and performance optimizations to Spark-as-a-service

analytics statistics stats big data

How to do real-time analytics across historical and live data

5 in-memory computing platform capabilities that support analytical processing of both data lake data and operational streams

money time clock numbers abstract

Time series analysis with KNIME and Spark

Train and evaluate a simple time series model using a random forest of regression trees and the NYC Yellow taxi data set

Sparks

Delta Lake gives Apache Spark data sets new powers

A new open source project from Databricks adds ACID transactions, versioning, and schema enforcement to Spark data sources that don't have them

head / face / radiating lines / radial waves / artificial intelligence / projection / connection

AI, machine learning, and deep learning deep dive

Download this 26-page in-depth guide to AI, machine learning, and deep learning for easy reading at your convenience

sparkler / firework / sparks / celebration / hands

Tutorial: Spark application architecture and clusters

Learn how Spark components work together and how Spark applications run on standalone and YARN clusters

sparkler / firework / sparks / celebration / hands

Microsoft revamps machine learning tools for Apache Spark

The new open source release integrates Spark with Cognitive Toolkit and other Microsoft machine learning offerings

one yellow arrow moving opposite a stream of white arrows

Real-time data processing with data streaming: new tools for a new era

Real-time data streaming is still early in its adoption, but over the next few years organizations with successful rollouts will gain a competitive advantage

True Technologist video series [teaser]

Interview: Matei Zaharia on Spark and machine learning

Zaharia expounds on the reasons Spark has become the big data framework of choice and why he thinks his company’s melding of Spark and machine learning delivers unique value

template c100.00 01 15 18.still001
video

Matei Zaharia, creator of the Apache Spark project, on the big data framework | True Technologist Ep 2

In this episode of True Technologist, host Eric Knorr talks with Matei Zaharia, chief technologist at Databricks and an assistant professor of computer science at Stanford, about the Apache Spark and Apache Mesos projects

Get started with Angular

A step-by-step guide to installing the tools, creating an application, and getting up to speed with Angular components, directives, services, and routers

Python megaguide: The best frameworks and IDEs

Only on InfoWorld: A hands-on, in-depth look at 13 Python web frameworks and six Python development toolkits

Quick guide: Digital transformation and the agile enterprise

Enterprise transformation is hard. But when you build a platform for continuous change, putting new ideas into production becomes a lot easier

Career hacks: Professional do’s and don’ts for developers

The hot skills to master, the secrets to breaking into management, the career mistakes to avoid -- here's how to refactor yourself as the developer every organization wants

ifw dd office 365

Deep Dive how-to: Office 365 document sharing

Office 2016, OneDrive, and Office 365 together offer powerful document collaboration capabilities across Windows, MacOS, iOS, Android, and the web -- but only if you set them up and manage them properly. This how-to guide walks you...

Machine learning megaguide: Amazon, Microsoft, Databricks, Google, HPE, IBM

Download InfoWorld's massive roundup of Amazon, Microsoft, Databricks, Google, HPE, and IBM machine learning toolkits

The Essential Guide to Microservices

How to create modern Web and mobile applications that scale.

The essential guide to PowerShell for Windows, Windows Server, and Exchange

Make the most of Microsoft’s command line by mastering the nuances of the PowerShell language

Load More