Course Outline
Module 1: Introduction to the Architecture and Configuration of the Confluent Apache Kafka Cluster for Government
- The Role of Kafka in Modern Data Pipelines for Government
- Differences Between Apache Kafka and Confluent Kafka for Government
- Core Components: Producers, Consumers, Brokers, Topics, Partitions
- Kafka Cluster Deployment Models and Scaling Considerations for Government Operations
Module 2: Zookeeper Quorum Configuration for Government
- What is Zookeeper?
- Zookeeper’s Role in a Kafka Cluster for Government
- Zookeeper Quorum Size for Government Applications
- Zookeeper Configuration for Government Systems
- Implementing SSH on Servers for Government Security
- Practical: Zookeeper Configuration (as a Team and as a Service) for Government
- Using the Zookeeper Command Line Interface (CLI) for Government Operations
- Practical: Zookeeper Quorum Configuration for Government Environments
- Zookeeper Internal File System for Government Data Management
- Performance Factors Affecting Zookeeper in Government Systems
- Demonstration of Management Tools for Zookeeper and Zoonavigator for Government Use
Module 3: Kafka Cluster Configuration for Government
- Basic Kafka Concepts for Government Applications
- Kafka Configuration for Government Systems
- Practical: Kafka Broker Configuration for Government Operations
- Practical: Executing Kafka Commands for Government Tasks
- Practical: Kafka Multi-Broker Cluster Configuration for Government Scalability
- Practical: Kafka Cluster Testing for Government Assurance
- Can I Connect to My Kafka Cluster in a Government Environment?
- Advertised.Listeners Configuration: Most Important Setting for Government Networks
- Topic Configuration for Government Data Streams
- Configuration for Downloading and Ingesting Messages in Topics for Government Use
- Practical: Demonstrating Kafka Resilience for Government Operations
- Kafka Performance: I/O Considerations for Government Systems
- Kafka Performance: Network (RED) for Government Networks
- Kafka Performance: RAM Optimization for Government Applications
- Kafka Performance: CPU Efficiency for Government Operations
- Kafka Performance: Operating System (OS) Tuning for Government Systems
- Kafka Performance: Other Factors for Government Performance
- Practical: How to Change Kafka Broker Configuration in a Government Setting
Module 4: Advanced Kafka Configuration for Government
- Landoop Kafka Topic User Interface, Confluent REST Proxy, and Confluent Schema Registry Configuration for Government Systems
- Sending and Receiving Messages (CLI, Java, and Spring Framework) for Government Applications
- Monitoring Metrics and Tools (Confluent Control Center, Elasticsearch, etc.) for Government Operations
- Log Files and Offset Management for Government Data Integrity
- High Availability and Disaster Recovery for Government Systems
- Ensuring High Availability Through Replication in Government Environments
- Tuning Producer and Consumer Performance for Government Efficiency
- Disaster Recovery Strategies for Government Continuity
- Failover Control and Data Recovery for Government Resilience
- Connector Configuration for Government Integration
- Kafka Connect Implementation for Government Applications
- Kafka Security Features for Government Compliance
Summary and Next Steps for Government Operations
Requirements
- Familiarity with distributed systems and messaging concepts for government applications
- Experience with the Linux command line in a public sector environment
- Basic understanding of networking and system administration principles
Audience
- System administrators for government agencies
- DevOps engineers in the public sector
- Platform and infrastructure teams supporting government operations
Testimonials (5)
the deploy of Kafka and zookeeper was very useful to understand the problem perhaps to check the config files would be also useful for next trainings
Bolivar Alvarez - SICPA SA
Course - Administration of Kafka Message Queue
The labs and the slides combine well with Jorge's knowledge and love for Kafka.
Willem - BMW SA
Course - Apache Kafka for Developers
Sufficient hands on, trainer is knowledgable
Chris Tan
Course - A Practical Introduction to Stream Processing
Grate skills, examples, very good exercises
Marek Konieczny - G2A.COM Limited
Course - Kafka for Administrators
Recalling/reviewing keypoints of the topics discussed.