Course Outline

Module 1: Streaming Overview for Government

  • Key differences between batch and streaming processing
  • Use cases for Streaming Data Management in government operations
  • Streaming architecture fundamentals
  • Kappa architecture principles
  • End-to-end Streaming Data Management strategies for government
  • Types of Streaming data relevant to public sector applications
  • Benefits of implementing Streaming solutions for government agencies

Module 2: Edge Data Streaming (EDS) Overview for Government

  • EDS architecture and its alignment with government workflows
  • Key features of EDS tailored for government use
  • Data flow process in EDS for efficient government operations
  • User interface design considerations for government users
  • Steps to create an EDS Service for government applications
  • Creating a data flow within the context of government projects
  • Deploying a data flow to support government initiatives
  • Monitoring data flows to ensure compliance and performance in government operations
  • Lab1: Create an Edge Data Streaming Service for government use
  • Lab2: Create and Deploy a Data Flow for government projects

Module 3: Big Data Streaming Overview for Government

  • Overview of Big Data Streaming in the context of government operations
  • Stream Data Processing with Spark streaming for enhanced government data management
  • BDS component architecture and its relevance to government systems
  • Key features of BDS designed to meet government requirements

Module 4: Kafka Overview for Government

  • Kafka Concepts and their application in government data management
  • Kafka core APIs for secure and efficient government data processing
  • Topics in Kafka and their role in government data streams
  • Kafka models and their use cases in government operations
  • Lab: Create a Kafka connection for government applications

Module 5: Streaming Mappings for Government

  • Sources in a Streaming Mapping for government data flows
  • Targets in Streaming Mappings to support government operations
  • Lookup sources and their importance in government data management
  • Kafka Data Object Properties relevant to government applications
  • Lab: Create a Mapping with Kafka Source and HDFS Target for government use
  • Lab: Create a Mapping with Kafka Source and Kafka Target for government projects
  • BDS Transformations tailored for government data processing
  • Lab: Enhance Mapping Using Filter and Expression Transformations in government contexts
  • Lab: Enhance Mapping Using Window and Aggregator Transformations for government applications
  • Lab: Enhance Mapping Using Sorter and Rank Transformations to meet government needs

Module 6: Monitoring Logs and Troubleshooting for Government

  • Spark Monitoring techniques for government data streams
  • Viewing logs to ensure transparency and accountability in government operations
  • Troubleshooting strategies to maintain reliability in government data management
  • Lab: Monitor an EDS Data Flow for government compliance
  • Lab: Monitor a BDS Mapping to support government initiatives

Module 7: Performance Tuning and Best Practices for Government

  • Tuning performance of Spark jobs in government data processing environments
  • List of best practices while working with streaming data in government contexts

Module 8: End-to-End Use Case for Government

  • Use Case scenarios for government applications
  • Final Goal of integrating EDS and BDS for government operations
  • Lab: Convert Unstructured Streaming Data into Structured Data for government use
  • Lab: Ingest Data from EDS to BDS and Execute a Mapping in BDS for government projects

Requirements

None for government

 14 Hours

Number of participants


Price per participant

Testimonials (5)

Upcoming Courses

Related Categories