In this webcast, Patrick Wendell from Databricks will be speaking about Apache Spark's new 1.5 release.

Spark 1.5 ships Spark's Project Tungsten initiative, a cross-cutting performance update that uses binary memory management and code generation to dramatically improve latency of most Spark jobs. This release also includes several updates to Spark's DataFrame API and SQL optimizer, along with new Machine Learning algorithms and feature transformers, and several new features in Spark's native streaming engine.

Presenters

Patrick Wendell

Patrick Wendell

Co-Founder, Databricks

Patrick Wendell is a co-founder and engineer at Databricks as well as a founding Committer and PMC member of Apache Spark. In the Spark project, Patrick has acted as release manager for several Spark releases, including Spark’s previous 1.4 release. Patrick also maintains several subsystems of Spark’s core engine. Before helping start Databricks, Patrick obtained an M.S. in Computer Science at UC Berkeley. His research focused on low latency scheduling for large-scale analytics workloads. He holds a B.S.E in Computer Science from Princeton University.