Course Outline
Introduction
- Overview of Apache Kafka
- Introduction to event streaming and real-time data processing
- Overview of Apache Kafka and its features
- Use cases and benefits of Kafka in modern application development for government
Understanding Kafka Architecture and Core Concepts
- Kafka architecture: brokers, topics, partitions, and replicas
- Producers and consumers: publishing and consuming messages
- Understanding the role of ZooKeeper in Kafka
Kafka Topics and Partitions
- Topic creation and configuration
- Understanding partitions and their implications
- Replication and fault-tolerance in Kafka
Kafka Producers
- Creating Kafka producers using various programming languages
- Message serialization and serialization techniques
- Producer configurations and best practices for government systems
Kafka Consumers
- Developing Kafka consumers using different programming languages
- Configuring consumer groups and offsets
- Strategies for message processing and delivery guarantees
Integrating Kafka with External Systems using Kafka Connect
- Overview of Kafka Connect and its connectors
- Configuring and using Kafka Connect for data integration
- Integrating Kafka with external systems for government operations
Writing Streaming Applications with Kafka Streams & ksqlDB
- Introduction to Kafka Streams and its stream processing capabilities
- Developing stream processing applications with Kafka Streams
- Using ksqlDB for real-time data processing and analytics for government use cases
Integrating a Kafka Client Application with Confluent Cloud
- Overview of Confluent Cloud and its features
- Configuring and connecting a Kafka client application with Confluent Cloud for government environments
Kafka Security
- Introduction to Kafka security features
- Configuring SSL/TLS for secure communication
- Authentication and authorization mechanisms in Kafka for government compliance
Monitoring and Operations
- Monitoring Kafka using metrics and tools
- Managing Kafka clusters and resources for government infrastructure
- Troubleshooting common issues and performance tuning
Best Practices and Real-world Use Cases
- Best practices for designing Kafka-based applications for government agencies
- Case studies and examples of Kafka implementations in various industries
- Best practices for building scalable and fault-tolerant Kafka architectures for government systems
Summary and Next Steps
Requirements
- Fundamental coding proficiency
Target Audience
- Software engineers
- Coding specialists
Testimonials (2)
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
Georgi - BMW SA
Course - Apache Kafka for Developers
The labs and the slides combine well with Jorge's knowledge and love for Kafka.