دوره آموزشی KAFKA

معـرفی خدمـات آموزشـی

KAFKA

مدت دوره : 32 ساعت

سرفصل دوره :

1. Introduction to Apache Kafka

• What is Kafka?
• Kafka Features
• Kafka Concepts
• Kafka Architecture
• Kafka Components
• ZooKeeper
• Where is Kafka Used?
• Kafka Installation
• Kafka Cluster
• Types of Kafka Clusters
• Configuring Single Node Single Broker Cluster
Hands on:
• Kafka Installation
• Implementing Single Node-Single Broker Cluster

2. Kafka Producer

• Configuring Single Node Multi Broker Cluster
• Constructing a Kafka Producer
• Sending a Message to Kafka
• Producing Keyed and Non-Keyed Messages
• Sending a Message Synchronously & Asynchronously
• Configuring Producers
IntroBrocher-DouranGroup-Edu .V1
• Serializers
• Serializing Using Apache Avro
• Partitions
Hands On:
• Working with Single Node Multi Broker Cluster
• Creating a Kafka Producer
• Configuring a Kafka Producer
• Sending a Message Synchronously & Asynchronously

3. Kafka Consumer

• Consumers and Consumer Groups
• Standalone Consumer
• Consumer Groups and Partition Rebalance
• Creating a Kafka Consumer
• Subscribing to Topics
• The Poll Loop
• Configuring Consumers
• Commits and Offsets
• Rebalance Listeners
• Consuming Records with Specific Offsets
• Deserializers
Hands On:
• Creating a Kafka Consumer
• Configuring a Kafka Consumer
• Working with Offsets

4. Kafka Internals

• Cluster Membership
• The Controller
• Replication
• Request Processing
• Physical Storage
• Reliability
• Broker Configuration
• Using Producers in a Reliable System
• Using Consumers in a Reliable System
• Validating System Reliability
• Performance Tuning in Kafka
Hands On:
• Create topic with partition & replication factor 3 and execute it on multi-broker
cluster
• Show fault tolerance by shutting down 1 Broker and serving its partition from another
broker

5. Kafka Cluster Architectures & Administering Kafka

• Use Cases – Cross-Cluster Mirroring
• Multi-Cluster Architectures
• Apache Kafka’s MirrorMaker
• Other Cross-Cluster Mirroring Solutions
• Topic Operations
• Consumer Groups
• Dynamic Configuration Changes
• Partition Management
• Consuming and Producing
• Unsafe Operations
Hands on:
• Topic Operations
• Consumer Group Operations
• Partition Operations
• Consumer and Producer Operations

6. Kafka Monitoring and Kafka Connect

• Considerations When Building Data Pipelines
• Metric Basics
• Kafka Broker Metrics
• Client Monitoring
• Lag Monitoring
• End-to-End Monitoring
• Kafka Connect
• When to Use Kafka Connect?
• Kafka Connect Properties
Hands on:
• Kafka Connect

7. Kafka Stream Processing

• Stream Processing
• Stream-Processing Concepts
• Stream-Processing Design Patterns
• Kafka Streams by Example
• Kafka Streams: Architecture Overview
Hands on:
• Kafka Streams
• Word Count Stream Processing

8. Kafka Administration

• Setting up and Configuring Multi Node and Zookeeper Multi Node Multi Broker
Cluster
• Configuring Apache Kafka Security
• Configuring High Availability and Consistency for Apache Kafka
• Configuring Apache Kafka for Performance and Resource Management
• Viewing Apache Kafka Metrics
• Working with Apache Kafka Logs