Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Fundamentals of Kafka Administration
- Positioning Kafka within modern data infrastructure and defining operational duties in production environments
- Essential technical concepts for operators, including brokers, topics, partitions, offsets, and consumer groups
- Replication mechanisms: leader and follower dynamics, in-sync replicas, and balancing availability requirements
- Key operational procedures and standard terminology utilized in administrative runbooks
KRaft Mode Architecture and Cluster Design
- Overview of KRaft mode: controller functions, metadata quorum requirements, election processes, and operational significance
- Deployment strategies: sizing parameters for throughput, partition management, data retention, and scalability
- Node architecture: combined versus dedicated controller roles and fault domain segregation strategies
- Practical exercise: examine KRaft metadata, assess quorum stability, and analyze controller logging data
Installation, Configuration, and Routine Operations
- Deployment methodologies (package managers, tarball extraction, containerization) and establishing standards for enterprise environments
- Critical broker configurations affecting reliability: listener settings, replication settings, log storage paths, and retention policies
- Safe service management: proper startup sequencing, controlled shutdown procedures, and verification protocols
- Practical exercise: provision a multi-node cluster, confirm broker registration, and validate baseline data production and consumption
Topic, Partition, and Data Placement Management
- Topic lifecycle management via Kafka CLI: creation, inspection, configuration adjustment, and deletion
- Determining optimal partition counts and replication factors for specific workloads, including identification of common design flaws
- Partition reassignment and load balancing: criteria for moving partitions and methods for monitoring progress safely
- Practical exercise: instantiate topics, initiate partition reassignment, simulate broker failure, and verify system recovery
Securing Kafka for Production Environments
- Implementing TLS for client and inter-broker communication: certificate management, trust chain validation, and verification steps
- Authentication via SASL: selecting appropriate mechanisms and preventing configuration errors
- Authorization using ACLs: enforcing least-privilege access for administrative, producer, and consumer roles
- Practical exercise: activate TLS and SASL, verify client connectivity, and implement ACLs for application-specific roles
Observability, Reliability, and Troubleshooting
- Core monitoring metrics: controller status, under-replicated partitions, request latency, and resource saturation
- Log analysis and metrics exposure: interpreting broker logs and integrating metrics with standard observability platforms via JMX
- Operational playbooks: executing rolling restarts, applying configuration changes safely, and resolving disk capacity and ISR issues
- Practical exercise: establish a foundational alerting rule set, diagnose a degraded cluster state, and restore healthy replication
Upgrades and Disaster Recovery Preparedness
- Kafka upgrade planning: compatibility verification, staging environment testing, and rollback strategies
- Backup and recovery capabilities: identifying recoverable data components, non-recoverable elements, and restoring configurations
- Cross-cluster replication concepts and the application of MirrorMaker 2 for disaster recovery and migration tasks
- Summary: operational compliance checklist, documentation handover, and roadmap for production deployment
Requirements
- Proficiency in fundamental Linux administration (user management, services, file systems, permissions)
- Familiarity with TCP/IP networking concepts (DNS, ports, firewall rules, load balancing)
- Basic scripting proficiency (Bash, PowerShell, or equivalent) for executing routine operational tasks
Target Audience
- Kafka administrators and platform engineers accountable for the operation of Kafka clusters
- Site reliability engineers and DevOps engineers supporting streaming data platforms
- Infrastructure and operations teams implementing new KRaft-based Kafka clusters or migrating from ZooKeeper
Testimonials (5)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
To the point, proper pace (bash basics required though)
Krzysztof - Agora SA
Course - Kafka for Administrators
Trainer accepts questions at any time of the session, even if the subject was taught few days past.
GOODLUCK MASHIMBA - Tanzania Revenue Authority
Course - Kafka for Administrators
Nice presentation skill
Md Maruf Hossain - ATOS PGS sp. z o.o.
Course - Kafka for Administrators
Grate skills, examples, very good exercises
