Google Cloud ETL Training Overview
This private, customizable ETL Processing on Google Cloud Using Dataflow and BigQuery training course teaches attendees how to design data processing systems and build end-to-end GCP data pipelines for extracting, transforming, and loading data.
Location and Pricing
This course is taught as a private, live online class for teams of 3 or more. All our courses are hands-on, instructor-led, and tailored to fit your group’s goals and needs. Most Accelebrate classes can be flexibly scheduled for your group, including delivery in half-day segments across a week or set of weeks. To receive a customized proposal and price quote for online corporate training, please contact us.
In addition, we offer some courses as live, instructor-led online classes for individuals.
Objectives
- Understand the approaches to ETL
- Use BigQuery to load and transform the data to perform a one-time load of a small amount of data into BigQuery for analysis
- Use Dataflow to load, transform, and cleanse the data
Prerequisites
- Completed Google Cloud Fundamentals Big Data and Machine Learning course or have equivalent experience
- Basic proficiency with SQL, as well as with data modeling, extraction, transformation, and loading
- Prior experience with Python, ideally in the context of statistics and/or analytics
Outline
Expand All | Collapse All
Introduction to Data Engineering
- Explore the role of a data engineer
- Analyze data engineering challenges
- Intro to BigQuery
- Data Lakes and Data Warehouses
- Federated Queries with BigQuery
Building a Data Warehouse
- The modern data warehouse
- Introduction to BigQuery
- Query TB+ of data in seconds
- Getting Started
- Loading Data
- Querying Cloud SQL from BigQuery
- Loading Data into BigQuery
Introduction to Building Batch Data Pipelines
- EL, ELT, ETL
- Quality considerations
- How to carry out operations in BigQuery
Serverless Data Processing with Cloud Dataflow
- Cloud Dataflow
- Why customers value Dataflow
- Dataflow Pipelines
- A Simple Dataflow Pipeline (Python/Java)
- MapReduce in Dataflow (Python/Java)
- Side Inputs (Python/Java)
- Dataflow Templates
- Dataflow SQL
Conclusion
Training Materials
All Dataflow And BigQuery training students receive comprehensive courseware.
Software Requirements
Students must have the Google Chrome web browser and Internet access.
