Course Outline
Introduction
- Fundamental overview of the Apache Kafka platform
- Foundations of event streaming and real-time data processing workflows
- Core capabilities and architectural features of Apache Kafka
- Strategic applications and operational benefits of Kafka in modern software development
Kafka Architecture and Core Concepts
- Architectural components: brokers, topics, partitions, and replication mechanisms
- Roles of producers and consumers in message publishing and ingestion
- The operational function of ZooKeeper within the Kafka ecosystem
Topics and Partition Management
- Procedures for topic creation and parameter configuration
- Implications of partitioning strategies on system performance and distribution
- Mechanisms for data replication and ensuring fault tolerance
Producer Implementation
- Implementation of Kafka producers across diverse programming environments
- Message serialization standards and encoding techniques
- Optimal configuration parameters and operational best practices for producers
Consumer Implementation
- Development of Kafka consumers utilizing various programming languages
- Configuration of consumer groups and offset management
- Strategies for message processing efficiency and delivery guarantee enforcement
External System Integration via Kafka Connect
- Overview of the Kafka Connect framework and its connector architecture
- Configuration and deployment of Kafka Connect for robust data integration
- Techniques for integrating Kafka with third-party external systems
Streaming Application Development with Kafka Streams & ksqlDB
- Introduction to Kafka Streams and its stream processing functionalities
- Building stream processing applications using the Kafka Streams library
- Utilizing ksqlDB for real-time data analytics and processing tasks
Confluent Cloud Integration
- Overview of Confluent Cloud services and feature sets
- Configuration and connection of Kafka client applications to Confluent Cloud environments
Security Protocols
- Overview of built-in Kafka security features and controls
- Implementation of SSL/TLS encryption for secure data transmission
- Authentication protocols and authorization mechanisms within Kafka
Monitoring and Operations
- Kafka monitoring strategies utilizing performance metrics and diagnostic tools
- Management of Kafka cluster resources and capacity planning
- Troubleshooting common operational issues and performance optimization
Best Practices and Operational Use Cases
- Best practices for the architectural design of Kafka-based applications
- Case studies illustrating Kafka implementations in public and private sector contexts
- Guidelines for constructing scalable and highly available Kafka architectures
Summary and Path Forward
Requirements
- Familiarity with fundamental programming concepts
Target Audience
- Software developers
- Programming specialists
Testimonials (2)
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
Georgi - BMW SA
Course - Apache Kafka for Developers
The labs and the slides combine well with Jorge's knowledge and love for Kafka.
