Data Engineering on Google Cloud Platform


Course Number: GCP-126

Duration: 4 days (26 hours)

Format: Live, hands-on

Data Engineering on GCP Training Overview

This Data Engineering on Google Cloud Platform training course teaches attendees how to design data processing systems, build end-to-end data pipelines, analyze data, and carry out machine learning. This GCP course covers structured, unstructured, and streaming data.

Location and Pricing

This course is taught as a private, live online class for teams of 3 or more. All our courses are hands-on, instructor-led, and tailored to fit your group’s goals and needs. Most Accelebrate classes can be flexibly scheduled for your group, including delivery in half-day segments across a week or set of weeks. To receive a customized proposal and price quote for online corporate training, please contact us.

Objectives

  • Design and build data processing systems on Google Cloud
  • Process batch and streaming data by implementing autoscaling data pipelines on Cloud Dataflow
  • Derive business insights from extremely large datasets using Google BigQuery
  • Train, evaluate, and predict using machine learning models using Tensorflow and Cloud ML
  • Leverage unstructured data using Spark and ML APIs on Cloud Dataproc
  • Enable instant insights from streaming data

Prerequisites

  • Completed the Google Cloud Big Data and Machine Learning Fundamentals course or have equivalent experience
  • Basic proficiency with common query language such as SQL
  • Experience with data modeling, extract, transform, load activities
  • Experience developing applications using a common programming language such as Python
  • Familiarity with Machine Learning and/or statistics

Outline

Expand All | Collapse All

Introduction
Google Cloud Dataproc Overview
  • Creating and managing clusters.
  • Leveraging custom machine types and preemptible worker nodes.
  • Scaling and deleting Clusters.
Running Dataproc Jobs
  • Running Pig and Hive jobs.
  • Separation of storage and compute.
Integrating Dataproc with Google Cloud Platform
  • Customize cluster with initialization actions.
  • BigQuery Support.
Making Sense of Unstructured Data with Google’s Machine Learning APIs
  • Google’s Machine Learning APIs
  • Common ML Use Cases
  • Invoking ML APIs
  • Serverless Data Analysis with Google BigQuery and Cloud Dataflow
Serverless Data Analysis with BigQuery
  • What is BigQuery
  • Queries and Functions
  • Loading data into BigQuery
  • Exporting data from BigQuery
  • Nested and repeated fields
  • Querying multiple tables
  • Performance and pricing
Serverless, Autoscaling Data Pipelines with Dataflow
  • The Beam programming model
  • Data pipelines in Beam Python
  • Data pipelines in Beam Java
  • Scalable Big Data processing using Beam
  • Incorporating additional data
  • Handling stream data
  • GCP Reference architecture
  • Serverless Machine Learning with TensorFlow on Google Cloud Platform
Getting Started with Machine Learning
  • What is machine learning (ML)
  • Effective ML: concepts, types
  • ML datasets: generalization
Building ML Models with Tensorflow
  • Getting started with TensorFlow
  • TensorFlow graphs and loops + lab
  • Monitoring ML training
Scaling ML Models with CloudML
  • Why Cloud ML?
  • Packaging up a TensorFlow model
  • End-to-end training
Feature Engineering
  • Creating good features
  • Transforming inputs
  • Synthetic features
  • Preprocessing with Cloud ML
  • Building Resilient Streaming Systems on Google Cloud Platform
Architecture of Streaming Analytics Pipelines
  • Stream data processing: Challenges
  • Handling variable data volumes
  • Dealing with unordered/late data
Ingesting Variable Volumes
  • What is Cloud Pub/Sub?
  • How it works: Topics and Subscriptions
Implementing Streaming Pipelines
  • Challenges in stream processing.
  • Handle late data: watermarks, triggers, accumulation.
Streaming Analytics and Dashboards
  • Streaming analytics: from data to decisions
  • Querying streaming data with BigQuery
  • What is Google Data Studio?
High Throughput and Low-Latency with Bigtable
  • What is Cloud Spanner?
  • Designing Bigtable schema
  • Ingesting into Bigtable
Conclusion

Training Materials:

All GCP training students receive comprehensive courseware.

Software Requirements:

Students must have the Google Chrome web browser and Internet access.



Learn faster

Our live, instructor-led lectures are far more effective than pre-recorded classes

Satisfaction guarantee

If your team is not 100% satisfied with your training, we do what's necessary to make it right

Learn online from anywhere

Whether you are at home or in the office, we make learning interactive and engaging

Multiple Payment Options

We accept check, ACH/EFT, major credit cards, and most purchase orders



Recent Training Locations

Alabama

Birmingham

Huntsville

Montgomery

Alaska

Anchorage

Arizona

Phoenix

Tucson

Arkansas

Fayetteville

Little Rock

California

Los Angeles

Oakland

Orange County

Sacramento

San Diego

San Francisco

San Jose

Colorado

Boulder

Colorado Springs

Denver

Connecticut

Hartford

DC

Washington

Florida

Fort Lauderdale

Jacksonville

Miami

Orlando

Tampa

Georgia

Atlanta

Augusta

Savannah

Hawaii

Honolulu

Idaho

Boise

Illinois

Chicago

Indiana

Indianapolis

Iowa

Cedar Rapids

Des Moines

Kansas

Wichita

Kentucky

Lexington

Louisville

Louisiana

New Orleans

Maine

Portland

Maryland

Annapolis

Baltimore

Frederick

Hagerstown

Massachusetts

Boston

Cambridge

Springfield

Michigan

Ann Arbor

Detroit

Grand Rapids

Minnesota

Minneapolis

Saint Paul

Mississippi

Jackson

Missouri

Kansas City

St. Louis

Nebraska

Lincoln

Omaha

Nevada

Las Vegas

Reno

New Jersey

Princeton

New Mexico

Albuquerque

New York

Albany

Buffalo

New York City

White Plains

North Carolina

Charlotte

Durham

Raleigh

Ohio

Akron

Canton

Cincinnati

Cleveland

Columbus

Dayton

Oklahoma

Oklahoma City

Tulsa

Oregon

Portland

Pennsylvania

Philadelphia

Pittsburgh

Rhode Island

Providence

South Carolina

Charleston

Columbia

Greenville

Tennessee

Knoxville

Memphis

Nashville

Texas

Austin

Dallas

El Paso

Houston

San Antonio

Utah

Salt Lake City

Virginia

Alexandria

Arlington

Norfolk

Richmond

Washington

Seattle

Tacoma

West Virginia

Charleston

Wisconsin

Madison

Milwaukee

Alberta

Calgary

Edmonton

British Columbia

Vancouver

Manitoba

Winnipeg

Nova Scotia

Halifax

Ontario

Ottawa

Toronto

Quebec

Montreal

Puerto Rico

San Juan