Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Module 1: Foundational Overview of Confluent Apache Kafka Cluster Architecture and Configuration
- The function of Apache Kafka within contemporary data pipeline infrastructure
- Distinguishing characteristics between Apache Kafka and the Confluent distribution
- Essential architectural elements: producers, consumers, brokers, topics, and partitions
- Deployment strategies and scaling parameters for enterprise-grade Kafka clusters
Module 2: Configuration of the Zookeeper Quorum
- Definition and purpose of Zookeeper in a distributed environment
- The operational role of Zookeeper in coordinating the Kafka cluster
- Determining the appropriate Zookeeper Quorum size
- Best practices for Zookeeper configuration
- Implementation of Secure Shell (SSH) protocols on target servers
- Practical application: Configuring Zookeeper as a team and as a service
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical application: Setting up the Zookeeper Quorum
- Structure of the Zookeeper internal file system
- Performance factors influencing Zookeeper efficiency
- Demonstration of Zookeeper management tools and Zoonavigator
Module 3: Configuration of the Kafka Cluster
- Fundamental concepts of Apache Kafka
- Standard Kafka configuration parameters
- Practical application: Configuring Kafka brokers
- Practical application: Executing essential Kafka commands
- Practical application: Configuring a Multi-Broker Kafka Cluster
- Practical application: Testing the stability of the Kafka cluster
- Verifying connectivity to the Kafka cluster
- Advertised.listeners configuration: Critical settings for network addressing
- Optimization of topic-level settings
- Configuration requirements for message ingestion and download
- Practical application: Demonstrating Kafka resilience mechanisms
- Kafka performance: Input/Output (I/O) optimization
- Kafka performance: Network considerations (RED model)
- Kafka performance: Memory (RAM) management
- Kafka performance: Central Processing Unit (CPU) utilization
- Kafka performance: Operating System (OS) tuning
- Kafka performance: Additional efficiency factors
- Practical application: Modifying Kafka broker configurations
Module 4: Advanced Configuration and Management of Kafka
- Configuration of the Landoop Kafka topic interface, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception methods via CLI, Java, and the Spring framework
- Implementation of monitoring metrics and tools (e.g., Confluent Control Center, Elasticsearch)
- Management of log files and consumer offsets
- Strategies for high availability and disaster recovery
- Maintaining high availability through data replication
- Performance tuning for producers and consumers
- Formulation of disaster recovery strategies
- Control of failover processes and data recovery procedures
- Configuration of Kafka Connect connectors
- Implementation details for Kafka Connect
- Integration of Kafka security features
Summary and Recommended Next Steps
Requirements
- Working knowledge of distributed systems and messaging concepts
- Proficiency with the Linux command line interface
- Foundational understanding of networking protocols and system administration
Target Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
