Your privacy matters: This site uses cookies to analyze site usage and provide social media features. Learn More.

Introduction to Apache Spark 2 Programming

SPRK-100 (3 Days)
4.4 out of 5 (38 reviews)  

Request Pricing

Apache Spark 2 Training Overview

Accelebrate's Introduction to Apache Spark 2 training provides students with a solid technical introduction to the Spark architecture and how Spark works. Attendees learn the basic building blocks of Spark, including RDDs and the distributed compute engine, as well as higher-level constructs that provide a simpler and more capable interface, including Spark SQL and DataFrames.

This course also covers more advanced capabilities such as the use of Spark Streaming to process streaming data, and provides an overview of Spark Graph Processing (GraphX and GraphFrames) and Spark Machine Learning (SparkML Pipelines). Finally, the class explores possible performance issues, troubleshooting, cluster deployment techniques, and strategies for optimization.

Location and Pricing

Most Accelebrate courses are delivered as private, customized, on-site training at our clients' locations worldwide for groups of 3 or more attendees and are custom tailored to their specific needs. Please visit our client list to see organizations for whom we have delivered private in-house training. These courses can also be delivered as live, private online classes for groups that are geographically dispersed or wish to save on the instructor's or students' travel expenses. To receive a customized proposal and price quote for private training at your site or online, please contact us.

Apache Spark 2 Training Objectives

All students will:

  • Understand the need for Spark in data processing
  • Understand the Spark architecture and how it distributes computations to cluster nodes
  • Be familiar with basic installation / setup / layout of Spark
  • Use the Spark for interactive and ad-hoc operations
  • Use Dataset/DataFrame/Spark SQL to efficiently process structured data
  • Understand basics of RDDs (Resilient Distributed Datasets), and data partitioning, pipelining, and computations
  • Understand Spark's data caching and its usage
  • Understand performance implications and optimizations when using Spark
  • Be familiar with Spark Graph Processing and SparkML machine learning

Apache Spark 2 Training Outline

Expand All | Collapse All | Printer-Friendly

Scala Ramp Up (Optional)
  • Scala Introduction, Variables, Data Types, Control Flow
  • The Scala Interpreter
  • Collections and their Standard Methods (e.g. map())
  • Functions, Methods, Function Literals
  • Class, Object, Trait
Introduction to Spark
  • Overview, Motivations, Spark Systems
  • Spark Ecosystem
  • Spark vs. Hadoop
  • Typical Spark Deployment and Usage Environments
RDDs and Spark Architecture
  • RDD Concepts, Partitions, Lifecycle, Lazy Evaluation
  • Working with RDDs - Creating and Transforming (map, filter, etc.)
  • Caching - Concepts, Storage Type, Guidelines
DataSets/DataFrames and Spark SQL
  • Introduction and Usage
  • Creating and Using a DataSet
  • Working with JSON
  • Using the DataSet DSL
  • Using SQL with Spark
  • Data Formats
  • Optimizations: Catalyst and Tungsten
  • DataSets vs. DataFrames vs. RDDs
Creating Spark Applications
  • Overview, Basic Driver Code, SparkConf
  • Creating and Using a SparkContext/SparkSession
  • Building and Running Applications
  • Application Lifecycle
  • Cluster Managers
  • Logging and Debugging
Spark Streaming
  • Overview and Streaming Basics
  • Structured Streaming
  • DStreams (Discretized Steams),
  • Architecture, Stateless, Stateful, and Windowed Transformations
  • Spark Streaming API
  • Programming and Transformations
Performance Characteristics and Tuning
  • The Spark UI
  • Narrow vs. Wide Dependencies
  • Minimizing Data Processing and Shuffling
  • Caching - Concepts, Storage Type, Guidelines
  • Using Caching
  • Using Broadcast Variables and Accumulators
(Optional): Spark GraphX Overview
  • Introduction
  • Constructing Simple Graphs
  • GraphX API
  • Shortest Path Example
(Optional): MLLib Overview
  • Introduction
  • Feature Vectors
  • Clustering / Grouping, K-Means
  • Recommendations
  • Classifications
Conclusion
Request Pricing

Lecture percentage

40%

Lecture/Demo

Lab percentage

60%

Lab

Course Number:

SPRK-100

Duration:

3 Days

Prerequisites:

Students should have an introductory knowledge of Python or Scala. An overview of Scala is provided if needed. (Class can be customized for SQL data analysts, emphasizing SQL techniques and minimizing procedural coding.)

Training Materials:

All Spark training students receive comprehensive courseware.

Software Requirements:

  • Windows, Mac, or Linux PCs with the current Chrome or Firefox browser.
    • Most class activities will create Spark code and visualizations in a browser-based notebook environment, the class also details how these notebooks can be exported, and how to run Spark code outside of this environment.
  • Internet access

Contact Us:

Accelebrate’s training classes are available for private groups of 3 or more people at your site or online anywhere worldwide.

Don't settle for a "one size fits all" public class! Have Accelebrate deliver exactly the training you want, privately at your site or online, for less than the cost of a public class.

For pricing and to learn more, please contact us.

Contact Us Train For Us

Toll-free in US/Canada:
877 849 1850
International:
+1 678 648 3113

Toll-free in US/Canada:
866 566 1228
International:
+1 404 420 2491

925B Peachtree Street, NE
PMB 378
Atlanta, GA 30309-3918
USA

Subscribe to our Newsletter:

Never miss the latest news and information from Accelebrate:

Microsoft Gold Partner

Please see our complete list of
Microsoft Official Courses

Recent Training Locations

Alabama

Huntsville

Montgomery

Birmingham

Alaska

Anchorage

Arizona

Phoenix

Tucson

Arkansas

Fayetteville

Little Rock

California

San Francisco

Oakland

San Jose

Orange County

Los Angeles

Sacramento

San Diego

Colorado

Denver

Boulder

Colorado Springs

Connecticut

Hartford

DC

Washington

Florida

Fort Lauderdale

Miami

Jacksonville

Orlando

Saint Petersburg

Tampa

Georgia

Atlanta

Augusta

Savannah

Idaho

Boise

Illinois

Chicago

Indiana

Indianapolis

Iowa

Ceder Rapids

Des Moines

Kansas

Wichita

Kentucky

Lexington

Louisville

Louisiana

Banton Rouge

New Orleans

Maine

Portland

Maryland

Annapolis

Baltimore

Hagerstown

Frederick

Massachusetts

Springfield

Boston

Cambridge

Michigan

Ann Arbor

Detroit

Grand Rapids

Minnesota

Saint Paul

Minneapolis

Mississippi

Jackson

Missouri

Kansas City

St. Louis

Nebraska

Lincoln

Omaha

Nevada

Reno

Las Vegas

New Jersey

Princeton

New Mexico

Albuquerque

New York

Buffalo

Albany

White Plains

New York City

North Carolina

Charlotte

Durham

Raleigh

Ohio

Canton

Akron

Cincinnati

Cleveland

Columbus

Dayton

Oklahoma

Tulsa

Oklahoma City

Oregon

Portland

Pennsylvania

Pittsburgh

Philadelphia

Rhode Island

Providence

South Carolina

Columbia

Charleston

Spartanburg

Greenville

Tennessee

Memphis

Nashville

Knoxville

Texas

Dallas

El Paso

Houston

San Antonio

Austin

Utah

Salt Lake City

Virginia

Richmond

Alexandria

Arlington

Washington

Tacoma

Seattle

West Virginia

Charleston

Wisconsin

Madison

Milwaukee

Alberta

Edmonton

Calgary

British Columbia

Vancouver

Nova Scotia

Halifax

Ontario

Ottawa

Toronto

Quebec

Montreal

Puerto Rico

San Juan

© 2013-2019 Accelebrate, Inc. All Rights Reserved. All trademarks are owned by their respective owners.