Pre-requisites:
- Good knowledge on Linux Operating system
- Basic knowledge on how a messaging product works
- People who are working professional and looking for a change to boost career with bigdata injection tools
- What is Apache Kafka
- Kafka Features and terminologies
- High-level kafka architecture
- Real-life Kafka Case Studies
- Broker
- Zookeeper
- Topics
- Partition
- Replication factor
- Producer
- Consumer
- Pre-requisites and Environment setup
- Code download
- Single broker installation
- Zookeeper configuration and setup
- Kafka server configuration and setup
- Topics
- Replication factor
- Partitions
- Console Producer
- Console Consumer
- Console Consumer Groups
- Changing a topic configuration
- Segment and Indexes
- Log Cleanup policies
- Log Cleanup Delete
- Log compaction
- min.insync.replicas
- Unclean leader Election
- Part 1: Zookeeper Quorum setup
- What is a zookeeper ?
- Zookeeper role in kafka cluster
- Zookeeper Quorum sizing
- Zookeeper configuration
- Part 2: Broker Clustersetup
- Introduction and Architecture
- Kafka cluster size discussion
- Kafka Configuration
- Kafka Multi-broker setup
- Disk (I/O)
- Network
- RAM
- CPU
- OS (Operating System)
- What is a Kafka Manager
- Managing Kafka with Kafka Manager
- Advantages of Kafka Manager
- Zero copy
- Up / Down conversions in Kafka
- Kafka Upgrade from 1.x to 2.x
- Kafka Broker vs Kafka Client
- Need of security encryption in Kafka
- SSL/TLS– setup
- Broker side setup
- Client-side setup
- Enabling Data encryption in between Kafka client and Broker
