Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Module 1: Streaming Overview
- Distinguishing between batch and streaming processes
- Use cases for Streaming Data Management in government operations
- Overview of streaming architecture for government applications
- Kappa architecture for efficient data processing
- Comprehensive End-to-End Streaming Data Management solutions for government
- Types of streaming data relevant to public sector operations
- Advantages of implementing streaming technologies for government
Module 2: Edge Data Streaming (EDS) Overview
- Architecture of Edge Data Streaming (EDS)
- Key features of EDS for enhancing data management in government
- Data flow process within the EDS framework
- User interface design for EDS
- Steps to create an EDS service for government use
- Creating a data flow within EDS for government applications
- Deploying a data flow in EDS for government operations
- Monitoring the performance of data flows in EDS for government
- Lab1: Creating an Edge Data Streaming Service for government use
- Lab2: Creating and deploying a data flow within EDS for government applications
Module 3: Big Data Streaming Overview
- Overview of Big Data Streaming in the context of government operations
- Stream data processing using Spark streaming for government
- Component architecture of Big Data Streaming (BDS) for government applications
- Key features of BDS to support government data management needs
Module 4: Kafka Overview
- Fundamental concepts of Apache Kafka for government use
- Kafka core APIs and their application in government data streams
- Understanding topics in Kafka for efficient data distribution in government
- Kafka models and their relevance to government data processing
- Use cases of Kafka in government operations
- Lab: Creating a Kafka connection for government applications
Module 5: Streaming Mappings
- Sources used in streaming mappings for government data streams
- Targets in streaming mappings for government data processing
- Lookup sources for enhancing data integrity in government streams
- Kafka Data Object Properties for optimizing government data flows
- Lab: Creating a mapping with Kafka source and HDFS target for government
- Lab: Creating a mapping with Kafka source and Kafka target for government applications
- BDS transformations to enhance data processing in government streams
- Lab: Enhancing mappings using filter and expression transformations for government use
- Lab: Enhancing mappings using window and aggregator transformations for government applications
- Lab: Enhancing mappings using sorter and rank transformations for government operations
Module 6: Monitoring Logs and Troubleshooting
- Monitoring Spark jobs for performance in government data streams
- Viewing logs to ensure data integrity in government applications
- Troubleshooting common issues in government data streaming operations
- Lab: Monitoring an EDS data flow for government use
- Lab: Monitoring a BDS mapping for government applications
Module 7: Performance Tuning and Best Practices
- Tuning the performance of Spark jobs in government data streams
- Best practices for working with streaming data in government operations
Module 8: End-to-End Use Case
- Detailed use case for implementing streaming data solutions in government
- Final goals of integrating EDS and BDS in government applications
- Lab: Converting unstructured streaming data into structured data for government use
- Lab: Ingesting data from EDS to BDS and executing a mapping in BDS for government operations
Requirements
The provided content does not contain any text to rewrite. Please provide specific text for government use so that it can be revised accordingly.
14 Hours
Testimonials (5)
Very usefull additional informations
Grzegorz - Comp S.A.
Course - BLoC Pattern
Edward is an awesome facilitator
Zibusiso Ncube - Agricatural Research Council
Course - Ionic 4 and Angular for Developers
Maybe more exercises could be better for lerning but the time was to little
Gianpiero Arico' - Urmet Spa
Course - Embedded Linux Systems Architecture
Miguel's knowledge of the subject was extensive. He made the training easy to understand and the flow was balanced; adding on to each section with new features as needed. He covered everything that was asked and answered each and every question thoroughly. It was a very pleasant experience.
Paul Coaton - SEMPCheck Services
Course - Flutter Development Bootcamp with Dart
The trainer was enthusiastic, kind, and loved the topic
