Get in Touch
 Duration 16 hours

Course Outline

Module 1: Introduction to Confluent Apache Kafka Architecture and Cluster Setup

  • Overview of Apache Kafka and the Confluent Platform
  • Core concepts: Kafka brokers, producers, consumers, and topics
  • The role of Kafka in data streaming and messaging pipelines
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center
  • Kafka cluster architecture: brokers, partitions, and replication mechanisms

Module 2: Configuring Zookeeper Quorums

  • Introduction to Zookeeper
  • The function of Zookeeper within a Kafka cluster
  • Determining appropriate Zookeeper quorum sizes
  • Zookeeper configuration parameters
  • Implementing SSH on server infrastructure
  • Hands-on: Configuring Zookeeper as a team and as a service
  • Utilizing the Zookeeper Command Line Interface (CLI)
  • Hands-on: Establishing a Zookeeper quorum
  • Overview of the Zookeeper internal file system
  • Performance factors impacting Zookeeper
  • Demo: Exploring Zookeeper management tools and Zoonavigator

Module 3: Configuring the Kafka Cluster

  • Foundational Kafka concepts
  • Essential Kafka configuration settings
  • Hands-on: Configuring Kafka on a single broker
  • Hands-on: Executing standard Kafka commands
  • Hands-on: Setting up a multi-broker Kafka cluster
  • Hands-on: Testing the Kafka cluster environment
  • Verifying connectivity to the Kafka cluster
  • Configuring Advertised.listeners: a critical setting
  • Topic configuration options
  • Setting up message ingestion and delivery within topics
  • Hands-on: Demonstrating Kafka resilience under load
  • Kafka performance metrics: I/O, network, RAM, CPU, and OS impact
  • Additional factors influencing Kafka performance
  • Hands-on: Modifying broker configurations

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry
  • Sending and receiving messages via CLI, Java, and Spring Framework
  • Metrics and monitoring tools (e.g., Confluent Control Center, Elasticsearch)
  • Log file management and offset tracking
  • High availability and disaster recovery planning
  • Ensuring high availability through replication
  • Performance tuning for producers and consumers
  • Disaster recovery strategies
  • Failover control and data recovery procedures
  • Connector setup and configuration
  • Implementing Kafka Connect
  • Kafka security features and best practices

Summary and Recommended Next Steps

Requirements

  • Proficiency with Linux-based systems and command-line utilities
  • Working knowledge of distributed system concepts
  • Grasp of fundamental networking and system configuration principles

Target Audience

  • DevOps and SRE teams responsible for managing Kafka deployments
  • System administrators working with Confluent and Zookeeper
  • Kafka developers and architects focused on building scalable systems

Testimonials (2)

Upcoming Courses

Related Categories