Course Outline
Module 1: Streaming Overview for Government
- Key differences between batch and streaming processing
- Use cases for Streaming Data Management in government operations
- Streaming architecture fundamentals
- Kappa architecture principles
- End-to-end Streaming Data Management strategies for government
- Types of Streaming data relevant to public sector applications
- Benefits of implementing Streaming solutions for government agencies
Module 2: Edge Data Streaming (EDS) Overview for Government
- EDS architecture and its alignment with government workflows
- Key features of EDS tailored for government use
- Data flow process in EDS for efficient government operations
- User interface design considerations for government users
- Steps to create an EDS Service for government applications
- Creating a data flow within the context of government projects
- Deploying a data flow to support government initiatives
- Monitoring data flows to ensure compliance and performance in government operations
- Lab1: Create an Edge Data Streaming Service for government use
- Lab2: Create and Deploy a Data Flow for government projects
Module 3: Big Data Streaming Overview for Government
- Overview of Big Data Streaming in the context of government operations
- Stream Data Processing with Spark streaming for enhanced government data management
- BDS component architecture and its relevance to government systems
- Key features of BDS designed to meet government requirements
Module 4: Kafka Overview for Government
- Kafka Concepts and their application in government data management
- Kafka core APIs for secure and efficient government data processing
- Topics in Kafka and their role in government data streams
- Kafka models and their use cases in government operations
- Lab: Create a Kafka connection for government applications
Module 5: Streaming Mappings for Government
- Sources in a Streaming Mapping for government data flows
- Targets in Streaming Mappings to support government operations
- Lookup sources and their importance in government data management
- Kafka Data Object Properties relevant to government applications
- Lab: Create a Mapping with Kafka Source and HDFS Target for government use
- Lab: Create a Mapping with Kafka Source and Kafka Target for government projects
- BDS Transformations tailored for government data processing
- Lab: Enhance Mapping Using Filter and Expression Transformations in government contexts
- Lab: Enhance Mapping Using Window and Aggregator Transformations for government applications
- Lab: Enhance Mapping Using Sorter and Rank Transformations to meet government needs
Module 6: Monitoring Logs and Troubleshooting for Government
- Spark Monitoring techniques for government data streams
- Viewing logs to ensure transparency and accountability in government operations
- Troubleshooting strategies to maintain reliability in government data management
- Lab: Monitor an EDS Data Flow for government compliance
- Lab: Monitor a BDS Mapping to support government initiatives
Module 7: Performance Tuning and Best Practices for Government
- Tuning performance of Spark jobs in government data processing environments
- List of best practices while working with streaming data in government contexts
Module 8: End-to-End Use Case for Government
- Use Case scenarios for government applications
- Final Goal of integrating EDS and BDS for government operations
- Lab: Convert Unstructured Streaming Data into Structured Data for government use
- Lab: Ingest Data from EDS to BDS and Execute a Mapping in BDS for government projects
Requirements
None for government
Testimonials (5)
Very usefull additional informations
Grzegorz - Comp S.A.
Course - BLoC Pattern
Edward is an awesome facilitator
Zibusiso Ncube - Agricatural Research Council
Course - Ionic 4 and Angular for Developers
Miguel's knowledge of the subject was extensive. He made the training easy to understand and the flow was balanced; adding on to each section with new features as needed. He covered everything that was asked and answered each and every question thoroughly. It was a very pleasant experience.
Paul Coaton - SEMPCheck Services
Course - Flutter Development Bootcamp with Dart
The trainer was enthusiastic, kind, and loved the topic
Isaac Murphy - Royal New Zealand Airforce
Course - Build Native iOS and Android Apps with Flutter
Learning the steps required to implement the MVVM model.