Get in Touch
 Duration 16 hours

Course Outline

Module 1: Overview of Confluent Apache Kafka Architecture and Cluster Configuration

  • Understanding Apache Kafka and the added value of the Confluent Platform.
  • Core components: Brokers, producers, consumers, and topics.
  • The strategic role of Kafka in data streaming and messaging workflows.
  • Confluent extensions: REST Proxy, Schema Registry, and Control Center.
  • Cluster architecture deep-dive: Brokers, partitions, and replication mechanisms.

Module 2: Configuring the Zookeeper Quorum

  • Introduction to Zookeeper and its functionality.
  • Zookeeper’s critical role within a Kafka cluster.
  • Determining the appropriate Zookeeper quorum size.
  • Essential Zookeeper configuration parameters.
  • Implementing SSH connectivity on server infrastructure.
  • Hands-on: Configuring Zookeeper both as a team and as a service.
  • Utilizing the Zookeeper Command Line Interface (CLI).
  • Hands-on: Establishing a Zookeeper quorum setup.
  • Exploring Zookeeper’s internal file system structure.
  • Key performance factors influencing Zookeeper efficiency.
  • Demo: Utilizing Zookeeper management tools and Zoonavigator.

Module 3: Configuring the Kafka Cluster

  • Fundamental concepts of Kafka.
  • Core configuration settings for Kafka.
  • Hands-on: Configuring Kafka on a single broker instance.
  • Hands-on: Executing essential Kafka commands.
  • Hands-on: Deploying a multi-broker Kafka cluster.
  • Hands-on: Conducting cluster integrity tests.
  • Verifying cluster connectivity.
  • Critical configuration of Advertised.listeners.
  • Topic-level configuration strategies.
  • Setting up message ingestion and delivery mechanisms within topics.
  • Hands-on: Demonstrating Kafka’s resilience to failures.
  • Performance analysis: I/O, network, RAM, CPU, and OS considerations.
  • Additional factors influencing Kafka performance.
  • Hands-on: Adjusting broker configurations for optimal results.

Module 4: Advanced Kafka Configuration

  • Configuring Landoop Kafka Topics UI, Confluent REST Proxy, and Confluent Schema Registry.
  • Message transmission and reception using CLI, Java, and Spring Framework.
  • Leveraging metrics and monitoring tools such as Confluent Control Center and Elasticsearch.
  • Managing log files and consumer offsets.
  • Strategies for High Availability (HA) and disaster recovery.
  • Achieving HA through effective replication.
  • Performance tuning for both producer and consumer components.
  • Developing robust disaster recovery plans.
  • Controlling failover processes and ensuring data recovery.
  • Setting up Kafka Connectors.
  • Implementing the Kafka Connect framework.
  • Securing Kafka environments using built-in security features.

Summary and Recommended Next Steps

Requirements

  • Working experience with Linux-based operating systems and command-line interfaces.
  • A solid grasp of distributed systems principles and architectures.
  • Foundational knowledge of networking protocols and system configuration.

Target Audience

  • DevOps and SRE teams responsible for the lifecycle of Kafka deployments.
  • System administrators managing infrastructure involving Confluent and Zookeeper.
  • Kafka developers and architects tasked with building scalable, resilient systems.

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories