Course Outline

Introduction

  • Overview of AWS Glue and its components for government use
  • Understanding the AWS Glue components and architecture for government operations
  • AWS Glue benefits and limitations in a public sector context

Working with Data Catalog

  • Understanding AWS Glue crawlers and data catalog for government datasets
  • Creating a database for government records
  • Creating a table for government data
  • Working with crawlers to automate data discovery for government
  • Building custom classifiers for government-specific data types

AWS Glue Development Endpoint

  • Using a development notebook for government projects
  • Understanding Glue context and dynamic frames in a public sector environment
  • Creating a dynamic frame to handle government data efficiently

AWS Glue Transformation

  • Applying transformation techniques for government data processing
  • Resolving choices in government datasets
  • Selecting and renaming fields for government records
  • Dropping unnecessary fields to streamline government data
  • Using filters to refine government data queries
  • Applying maps to transform government data structures
  • Joining tables for comprehensive government data analysis
  • Utilizing the spigot operation for efficient data flow in government applications
  • Flattening JSON structures for easier government data management

Understanding the Glue Workflow

  • Working with Glue jobs to automate government data processing tasks
  • Configuring triggers to initiate government workflows automatically

Debugging

  • Fixing script retrieval errors for government applications
  • Resolving launch errors in government environments
  • Addressing Glue argument errors for government scripts
  • Correcting policy errors to ensure compliance with government regulations

Summary and Next Steps

Requirements

  • Comprehension of ETL (Extract, Transform, Load) concepts
  • Fundamental knowledge of Python programming

Audience

  • Data engineers for government
  • Data analysts for government
 14 Hours

Number of participants


Price per participant

Testimonials (3)

Upcoming Courses

Related Categories