Apache Kafka Tutorial For Beginners

Explore the principles of Kafka installation, operations, Zookeeper concepts and deployment of Kafka servers.

Last updated 2022-01-10 | 3.8

- Master in Apache Kafka Server concepts
- Able to decide where and when to use Kafka
- Able to Install and setup Kafka servers from start to end

What you'll learn

Master in Apache Kafka Server concepts
Able to decide where and when to use Kafka
Able to Install and setup Kafka servers from start to end
Can work on Kafka cluster/ multi node instances
Produce and receive messages to/from Kafka and related servers
Will be comfortable with real-time applications and integration with Big Data Technologies.

* Requirements

* Nothing about Kafka
* we will start for scratch.
* Basic knowledge of Computers

Description

This course will explore the basic concepts of messaging systems, introduction to point to point messaging, publish - subscribe messaging, principles of Apache Kafka Server installation, operations and then it will walk you through the deployment of Kafka cluster in single node and multi node mode. Finally, we will conclude with producer application and consumer application and later I add real-time applications and integration with Big Data Technologies.

The target audience would be the people who are willing to know about Apache Kafka, Zookeeper, Queues, Topics, Client - Server communication, Messaging system (Point to Point & Pub - Sub), Single node server, Multi node servers or Kafka cluster, command line producer and consumer, Producer application using Java API's and Consumer application using Java API's.

All the material which is used in this course is attached, Java code for both Producer and Consumer, External Documentation which is helpful further.

You can complete this course in 3hours and please don't ignore any Quiz.

We made this course such a way that everyone can understand easily, we added the basic concepts in the beginning lectures , then added advanced topics and finally taught how to use the Kafka server in real time with an example.

Apache Kafka is creating a lot of buzz these days. While LinkedIn, where Kafka was founded, is the most well known user, there are many companies successfully using this technology. So now that the word is out, it seems the world wants to know: What does it do? Why does everyone want to use it? How is it better than existing solutions? Do the benefits justify replacing existing systems and infrastructure?

Who this course is for:

  • Anyone can learn it as this course starts from scratch
  • This course is developed for all the Developers and Administrators who want to learn about Kafka servers.
  • Who want to learn more about client - server communication
  • Students who wants to do a job in middleware

Course content

15 sections • 56 lectures

Important message to students Preview 00:43

Apache Kafka Introduction (slides) Preview 00:00

What is a Messaging System Preview 03:57

Why Apache Kafka Preview 02:45

Introduction to Apache Kafka (slides) Preview 00:00

Quiz - 1

Apache Kafka Basics Preview 01:47

Fundamentals and Terminology - 1 Preview 03:40

Architecture and Terminology - 2 Preview 05:18

Apache Kafka - Fundamentals & Architecture (slides) Preview 00:00

Quiz - 2

Work Flow in Kafka Preview 05:35

Apache Kafka - Work Flow (slides) Preview 00:00

Quiz - 3

Java or JDK Installation Preview 03:10

Zookeeper Installation Preview 05:32

Starting & Stopping Zookeeper Preview 00:22

Installation and running of a kafka server (Single Node) Preview 08:16

Apache Kafka - Installation (Help) Preview 00:11

Quiz - 4

Role of Zookeeper Preview 01:29

Zookeeper Basic Operations Preview 03:52

Apache Kafka - Zookeeper Role (slides) Preview 00:00

Ways to Start Zookeeper Preview 00:32

Quiz - 5

Kafka server Basic Operations and commands Preview 09:40

Modifying an existing topic Preview 06:00

Quiz - 6

Kafka Console Producer & Consumer Usage Preview 07:35

Console Producer & Consumer (Help) Preview 00:03

Configuring Multi node Kafka Preview 06:15

Apache Kafka - Multi Node Cluster Configuration (Help) Preview 00:25

Starting Multi Node Kafka Server Preview 02:52

Basic operations on multi node kafka Preview 08:07

Quiz - 7

What is an API Preview 00:02

Producer API's Preview 06:04

Consumer API's Preview 01:27

Apache Kafka - API's Preview 00:01

Quiz - 8

Introduction to SimpleProducer Preview 03:43

Adding the JARS to the project Preview 03:55

Import Kafka Libraries using Maven Project (Optional) Preview 00:24

Simple Producer Application Preview 16:33

Apache Kafka - Simple Producer (code) Preview 00:16

Quiz - 9

Simple Consumer Application Preview 19:14

Quiz - 10

Apache Kafka - Simple Consumer code Preview 00:18

Apache Kafka vs JMS Preview 00:51

Migrating to new Apache Kafka 0.10 Ebook Preview 00:08

Building large scale infrastructure across the data centers using Apache Kafka Preview 00:08

Apache Kafka 0.10.1.0 New Features Preview 00:13

Apache Kafka: FAQ Preview 10:05

Bonus Lecture: Awesome Resources Preview 00:28