Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Configuration
- Overview of Apache Kafka and the Confluent Platform for government data infrastructure
- Fundamentals of Kafka brokers, producers, consumers, and topics
- Kafka’s function within federal data streaming and messaging pipelines
- Confluent platform extensions: REST Proxy, Schema Registry, and Control Center
- Kafka cluster architecture components: brokers, partitions, and replication mechanisms
Module 2: Zookeeper Quorum Configuration
- Definition and purpose of Zookeeper in federal IT environments
- Zookeeper’s role in maintaining Kafka cluster stability
- Determining appropriate Zookeeper quorum sizes
- Zookeeper configuration parameters
- Implementation of SSH protocols on server infrastructure
- Practical Exercise: Zookeeper configuration (collaborative and service-level)
- Navigating the Zookeeper Command Line Interface (CLI)
- Practical Exercise: Establishing a Zookeeper quorum
- Zookeeper’s internal hierarchical file system structure
- Performance variables impacting Zookeeper operations
- Demonstration: Zookeeper management utilities and Zoonavigator interface
Module 3: Kafka Cluster Configuration
- Kafka core principles
- Kafka configuration standards
- Practical Exercise: Configuring a single Kafka broker
- Practical Exercise: Executing standard Kafka commands
- Practical Exercise: Establishing a multi-broker Kafka cluster
- Practical Exercise: Validating Kafka cluster functionality
- Access protocols for Kafka clusters
- Advertised.listeners configuration: critical network settings
- Topic configuration standards
- Implementing message ingestion and delivery workflows in topics
- Practical Exercise: Demonstrating Kafka resilience capabilities
- Kafka performance metrics: I/O, network bandwidth, RAM, CPU, and OS compatibility
- Additional factors influencing Kafka performance
- Practical Exercise: Modifying broker configurations for optimization
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka Topics UI, Confluent REST Proxy, and Schema Registry
- Message transmission and reception via CLI, Java, and Spring Framework
- Metrics and monitoring solutions (Confluent Control Center, Elasticsearch, etc.)
- Management of log files and message offsets
- High availability architectures and disaster recovery planning
- Achieving high availability through data replication
- Producer and consumer performance tuning
- Comprehensive disaster recovery strategies
- Failing over controls and executing data recovery procedures
- Configuration of Kafka Connectors
- Implementation of Kafka Connect frameworks
- Security features within the Kafka ecosystem for government use
Summary and Next Steps
Requirements
- Demonstrated proficiency in operating Linux environments and utilizing command-line utilities
- Knowledge of distributed systems principles and architectures
- Competence in fundamental networking protocols and system configuration management
Audience
- DevOps and Site Reliability Engineering (SRE) personnel responsible for overseeing Kafka infrastructure
- System administrators managing Confluent platforms and ZooKeeper services
- Kafka developers and solution architects tasked with designing scalable enterprise solutions for government operations
16 Hours
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
