Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 16 hours
Course Outline
Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Setup
- Foundations of Apache Kafka and the Confluent Platform
- Core components: brokers, producers, consumers, and topics
- The function of Kafka in data streaming and messaging workflows
- Confluent-specific tools: REST Proxy, Schema Registry, and Control Center
- Cluster architecture details: brokers, partitioning, and replication
Module 2: Zookeeper Quorum Setup and Management
- Introduction to Zookeeper
- The function of Zookeeper within a Kafka cluster environment
- Determining the appropriate Zookeeper quorum size
- Configuring Zookeeper parameters
- Establishing SSH access on server infrastructure
- Practical Exercise: Configuring Zookeeper as both a team and a service
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical Exercise: Establishing the Zookeeper quorum
- Overview of Zookeeper’s internal file system structure
- Performance considerations influencing Zookeeper operations
- Demonstration: Reviewing Zookeeper management utilities and Zoonavigator
Module 3: Kafka Cluster Configuration and Operation
- Basic principles of Kafka
- Core configuration settings for Kafka
- Practical Exercise: Setting up Kafka on a single broker
- Practical Exercise: Running essential Kafka commands
- Practical Exercise: Deploying a multi-broker Kafka cluster
- Practical Exercise: Testing the Kafka cluster
- Verifying connectivity to the Kafka cluster
- Configuring advertised.listeners: A critical setting
- Defining topic-level configurations
- Setting up message ingestion and delivery within topics
- Practical Exercise: Demonstrating Kafka fault tolerance
- Kafka performance considerations: I/O, network, RAM, CPU, and OS
- Kafka performance: Additional influencing factors
- Practical Exercise: Modifying broker configurations
Module 4: Advanced Kafka Configuration and Management
- Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
- Message production and consumption methods (CLI, Java, Spring Framework)
- Monitoring and metrics tools (Confluent Control Center, Elasticsearch, etc.)
- Managing log files and consumer offsets
- Implementing high availability and disaster recovery
- Achieving high availability through replication
- Performance optimization for producers and consumers
- Developing disaster recovery strategies
- Controlling failover and managing data recovery
- Setting up Kafka Connectors
- Implementing Kafka Connect
- Applying Kafka security features
Summary and Recommendations for Next Steps
Requirements
- Proficiency with Linux-based operating systems and command-line interfaces
- Understanding of distributed systems principles and architectures
- Knowledge of fundamental networking protocols and system configuration
Target Audience
- DevOps and Site Reliability Engineering (SRE) teams responsible for managing Kafka deployments
- System administrators overseeing Confluent and Zookeeper infrastructure
- Kafka developers and architects tasked with designing scalable systems for government and enterprise use
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
