Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Kafka Administration Fundamentals
- The role of Kafka within modern data architectures and standard production duties
- Key operational concepts: brokers, topics, partitions, offsets, and consumer groups
- Replication mechanisms: leader-follower dynamics, in-sync replicas (ISR), and availability trade-offs
- Operational priorities and standard terminology for Kafka runbooks
KRaft Architecture and Cluster Design
- KRaft fundamentals: controllers, metadata quorum, election processes, and operational significance
- Deployment strategies: capacity planning for throughput, partition counts, retention policies, and scalability
- Node roles and topology: combined versus dedicated controllers, and fault domain design
- Exercise: inspect KRaft metadata, validate quorum health, and analyze controller logs
Installation, Configuration, and Routine Operations
- Deployment methods (packages, archives, containers) and standardization practices for enterprise environments
- Essential broker settings affecting reliability: listeners, replication settings, log directories, and retention policies
- Service lifecycle management: startup sequences, graceful shutdowns, and validation procedures
- Exercise: deploy a multi-node cluster, verify broker registration, and confirm basic produce/consume functionality
Topic Management, Partitioning, and Data Placement
- Topic lifecycle management via Kafka CLI: creation, description, configuration updates, and deletion
- Selecting partition counts and replication factors for production workloads, including common anti-patterns to avoid
- Partition reassignment and load balancing: identifying triggers, executing moves, and verifying progress safely
- Exercise: create topics, initiate a partition reassignment, simulate broker failure, and verify recovery
Production Security for Kafka
- TLS implementation for client and inter-broker communication: certificate management, trust chains, and validation
- SASL authentication: selecting appropriate mechanisms and preventing configuration errors
- Authorization via ACLs: implementing least-privilege models for administrators, producers, and consumers
- Exercise: enable TLS and SASL, validate client connectivity, and apply ACLs for application roles
Observability, Reliability, and Troubleshooting
- Monitoring priorities: controller status, under-replicated partitions, request latency, and resource saturation
- Logs and metrics: interpreting broker logs and exporting metrics via JMX to observability platforms
- Operational procedures: rolling restarts, safe configuration changes, and resolving disk or ISR issues
- Exercise: establish a baseline alerting system, diagnose cluster degradation, and restore healthy replication
System Upgrades and Disaster Recovery Preparedness
- Upgrade planning for Kafka: compatibility assessments, staged deployments, and rollback strategies
- Backup and recovery expectations: data preservation limits and configuration restoration basics
- Cross-cluster replication overview and utilizing MirrorMaker 2 for disaster recovery and migration tasks
- Conclusion: operational checklist, handover documentation, and next steps for production deployment
Requirements
- Proficiency in foundational Linux system administration, including user management, service control, file systems, and access permissions.
- Familiarity with TCP/IP networking principles, encompassing DNS resolution, port configuration, firewall policies, and load balancing mechanisms.
- Competency in scripting languages such as Bash or PowerShell to automate routine operational procedures.
Audience
- Kafka administrators and platform engineers tasked with the management and maintenance of Kafka clusters.
- Site reliability engineers and DevOps professionals responsible for supporting data streaming infrastructure.
- Infrastructure and operations groups deploying KRaft-mode Kafka clusters or executing migrations from ZooKeeper-based architectures.
21 Hours
Testimonials (5)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
To the point, proper pace (bash basics required though)
Krzysztof - Agora SA
Course - Kafka for Administrators
Trainer accepts questions at any time of the session, even if the subject was taught few days past.
GOODLUCK MASHIMBA - Tanzania Revenue Authority
Course - Kafka for Administrators
Nice presentation skill
Md Maruf Hossain - ATOS PGS sp. z o.o.
Course - Kafka for Administrators
Grate skills, examples, very good exercises
