Course Outline
Module 1: Introduction to the Architecture and Configuration of the Confluent Apache Kafka Cluster for Government
- The Role of Kafka in Modern Data Pipelines for Government
- Differences Between Apache Kafka and Confluent Kafka for Government
- Core Components: Producers, Consumers, Brokers, Topics, Partitions
- Kafka Cluster Deployment Models and Scaling Considerations for Government Operations
Module 2: Zookeeper Quorum Configuration for Government
- What is Zookeeper?
- Zookeeper’s Role in a Kafka Cluster for Government
- Zookeeper Quorum Size for Government Applications
- Zookeeper Configuration for Government Systems
- Implementing SSH on Servers for Government Security
- Practical: Zookeeper Configuration (as a Team and as a Service) for Government
- Using the Zookeeper Command Line Interface (CLI) for Government Operations
- Practical: Zookeeper Quorum Configuration for Government Environments
- Zookeeper Internal File System for Government Data Management
- Performance Factors Affecting Zookeeper in Government Systems
- Demonstration of Management Tools for Zookeeper and Zoonavigator for Government Use
Module 3: Kafka Cluster Configuration for Government
- Basic Kafka Concepts for Government Applications
- Kafka Configuration for Government Systems
- Practical: Kafka Broker Configuration for Government Operations
- Practical: Executing Kafka Commands for Government Tasks
- Practical: Kafka Multi-Broker Cluster Configuration for Government Scalability
- Practical: Kafka Cluster Testing for Government Assurance
- Can I Connect to My Kafka Cluster in a Government Environment?
- Advertised.Listeners Configuration: Most Important Setting for Government Networks
- Topic Configuration for Government Data Streams
- Configuration for Downloading and Ingesting Messages in Topics for Government Use
- Practical: Demonstrating Kafka Resilience for Government Operations
- Kafka Performance: I/O Considerations for Government Systems
- Kafka Performance: Network (RED) for Government Networks
- Kafka Performance: RAM Optimization for Government Applications
- Kafka Performance: CPU Efficiency for Government Operations
- Kafka Performance: Operating System (OS) Tuning for Government Systems
- Kafka Performance: Other Factors for Government Performance
- Practical: How to Change Kafka Broker Configuration in a Government Setting
Module 4: Advanced Kafka Configuration for Government
- Landoop Kafka Topic User Interface, Confluent REST Proxy, and Confluent Schema Registry Configuration for Government Systems
- Sending and Receiving Messages (CLI, Java, and Spring Framework) for Government Applications
- Monitoring Metrics and Tools (Confluent Control Center, Elasticsearch, etc.) for Government Operations
- Log Files and Offset Management for Government Data Integrity
- High Availability and Disaster Recovery for Government Systems
- Ensuring High Availability Through Replication in Government Environments
- Tuning Producer and Consumer Performance for Government Efficiency
- Disaster Recovery Strategies for Government Continuity
- Failover Control and Data Recovery for Government Resilience
- Connector Configuration for Government Integration
- Kafka Connect Implementation for Government Applications
- Kafka Security Features for Government Compliance
Summary and Next Steps for Government Operations
Requirements
- Familiarity with distributed systems and messaging concepts for government applications
- Experience with the Linux command line in a public sector environment
- Basic understanding of networking and system administration principles
Audience
- System administrators for government agencies
- DevOps engineers in the public sector
- Platform and infrastructure teams supporting government operations
Testimonials (5)
interactive approach of the teacher, not a straight story but acting on the questions from the audience.
Rens - Canon Medical Informatics Europe B.V.
Course - Administration of Kafka Topic
The labs and the slides combine well with Jorge's knowledge and love for Kafka.
Willem - BMW SA
Course - Apache Kafka for Developers
very interactive...
Richard Langford
Course - SMACK Stack for Data Science
Sufficient hands on, trainer is knowledgable
Chris Tan
Course - A Practical Introduction to Stream Processing
Grate skills, examples, very good exercises