Apache Kafka Fundamentals

Expand all

Course Description

About Apache Kafka

Apache Kafka is a high-performance distributed and scalable messaging system and streaming platform. Originally created at LinkedIn to process large amounts of data, Kafka is now used by more and more companies as their central nervous system for data.

Kafkas focus on performance and persistence enables companies to rethink their IT architecture. This introduces new challenges for architects and operators.

In this instructor-led course you will not only experience what makes Kafka such a successful streaming platform but also how to identify challenges and obstacles and how to resolve them as easily as possible.

 

Course Objectives

• Learn, how to successfully design and operate your Kafka-centered IT projects
• Enjoy the hands-on experiences in the labs and have fun during our highly interactive course.
• Enable your team and yourself to operate Kafka in production and explore how to improve your Kafka setup right after the course.
• Learn the industry best practices on how to run and operate Kafka in Production.

Course Outline

 

Day 1: Hello Kafka

 

We discover Apache Kafka and learn how to use it successfully. We cover the basics so that every participant can start using it successfully immediately after the training.

 

The following topics are in focus:

 

• Why Kafka? - Motivation for Kafka and common uses
• What do we transport with Kafka? - Message types and topics
• What is Kafka? - Kafka as a distributed log: logs, distributed systems, Kafka components, Kafka as a streaming platform
• How does Kafka achieve its performance? - Partitions and consumer groups
• How does Kafka achieve its reliability? - Replication, ACKs and Exactly Once

 

Day 2: Understanding and successfully using Kafka

 

Building on what we learned on the first day, we deepen our knowledge and experience with Kafka. We learn how Kafka really achieves reliability and scalability and how to optimize our Kafka cluster.

 

The following topics are in focus:

 

• Production and consumption: What's really happening in clients and on brokers?
• Persisting messages: Data and file structures - how does replication really work?
• Cleaning up messages: how can we delete data we no longer need and free up storage space? - Log Retention and Compaction
• Insights into the Kafka ecosystem: how do we connect Kafka to other systems like databases and external systems with Kafka Connect?

Exam

N/A

Learning Path

Please contact us for more suggestions.

• Apache Kafka for Developers
• Apache Kafka for Operators

Ways to Attend

• Attend a public course, if there is one available. Please check our schedule, or register your interest in joining a course in your area.
• Private onsite Team training also available, please contact us to discuss. We can customise this course to suit your business requirements.