Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Module 1: Overview of Confluent Apache Kafka Cluster Architecture and Configuration
- The role of Kafka in contemporary data pipeline infrastructure
- Key distinctions between Apache Kafka and Confluent Platform
- Essential components: producers, consumers, brokers, topics, and partitions
- Deployment models for Kafka clusters and associated scaling considerations
Module 2: Zookeeper Quorum Configuration
- Overview of Zookeeper functionality
- Zookeeper’s function within the Kafka ecosystem
- Determining appropriate Zookeeper Quorum size
- Zookeeper configuration parameters
- Implementation of SSH protocols on designated servers
- Practical exercise: Configuring Zookeeper (team-based and service-oriented approaches)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical exercise: Establishing Zookeeper Quorum settings
- Structure of the Zookeeper internal file system
- Performance factors influencing Zookeeper operations
- Demonstration of management utilities for Zookeeper and Zoonavigator
Module 3: Kafka Cluster Configuration
- Fundamental Kafka concepts
- Kafka configuration guidelines
- Practical exercise: Configuring Kafka brokers
- Practical exercise: Executing Kafka command-line operations
- Practical exercise: Establishing a multi-broker Kafka cluster
- Practical exercise: Conducting Kafka cluster validation tests
- Methods for establishing connectivity to the Kafka cluster
- Configuring Advertised.listeners: A critical setting
- Topic-specific configuration parameters
- Settings for message ingestion and retrieval within topics
- Practical exercise: Demonstrating Kafka resilience capabilities
- Kafka performance optimization: Input/Output (I/O)
- Kafka performance optimization: Network throughput
- Kafka performance optimization: Memory allocation
- Kafka performance optimization: CPU utilization
- Kafka performance optimization: Operating System (OS) adjustments
- Additional Kafka performance considerations
- Practical exercise: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configuration
- Configuration of Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception via CLI, Java, and Spring framework
- Monitoring metrics and associated tools (e.g., Confluent Control Center, Elasticsearch)
- Management of log files and offsets
- High availability and disaster recovery frameworks
- Achieving high availability through data replication
- Tuning producer and consumer performance metrics
- Comprehensive disaster recovery strategies
- Failover control and data restoration procedures
- Connector configuration protocols
- Implementation of Kafka Connect
- Kafka security feature deployment for government
Summary and Next Steps
Requirements
- Competence in distributed architectures and message transmission protocols
- Proficiency in utilizing the Linux operating system command interface
- Foundational knowledge of network protocols and systems management
Target Audience
- Systems administrators
- DevOps engineers
- Platform and infrastructure teams involved in for government initiatives
21 Hours
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
