Kafka Ksql

Use SQL on Apache Kafka with Confluent ksqlDB! Build an entire taxi booking application based on KSQL stream processing

Last updated 2022-01-10 | 4.6

- Learn all the fundamentals of KSQL & ksqlDB
- Create a taxi booking application
- Create Streams
- Tables
- Generate Data with ksql-datagen

What you'll learn

Learn all the fundamentals of KSQL & ksqlDB
Create a taxi booking application
Create Streams
Tables
Generate Data with ksql-datagen
Advanced Operations: Joins
Windowing
Aggregations
Geospatial
Deal with all kind of data formats: CSV
JSON & Avro
Create and use UDF
use UDAF
Moving KSQL to production with tips

* Requirements

* Fundamental understanding of Kafka (see beginners course)
* Kafka Streams knowledge is a plus (but not a requirement)

Description

The latest release in the Apache Kafka Series!

Confluent ksqlDB has become an increasingly popular stream processing framework built upon Kafka Streams. It enables developers to write real-time stream processing applications with the ease of SQL. No Kafka Streams knowledge required!

For this course, I have partnered with KSQL expert Simon Aubury to bring you the ultimate KSQL course.

We'll take a project based approach for this course. You'll learn all the most important KSQL features by gradually building a KSQL taxi booking application!

  • KSQL Setup

  • KSQL Command Line

  • Streams with CSV, JSON, and AVRO

  • Use the KSQL-Datagen utility

  • Manipulate streams

  • Create Tables

  • Perform Joins

  • Advanced KSQL: Rekeying, Merging Streams, Windowing, Geospatial

  • Extending KSQL: UDF & UDAF

  • Moving to Production

  • KSQL Operations

Note: To best enjoy this course, a Mac or Linux machine is preferred. Windows users will have special instructions and would be better by leveraging a Linux VM.


===============================

Instructor

My name is Stephane Maarek, and I'll be your instructor in this course. I teach about Apache Kafka, the Kafka ecosystem and Kafka Certifications with my focus always on helping my students improve their professional proficiencies. I am also the co-founder of Conduktor: an enterprise Apache Kafka platform & UI to help everyone use Kafka.

Throughout my career in designing and delivering these certifications and courses, I have already taught 1,000,000+ students and gotten 350,000+ reviews!

Simon Aubury is the lead instructor of this course. He is a KSQL expert, authored many blogs on the Confluent Blog, and wrote cool KSQL POCs on Medium such as detecting in real-time when the heater of his house is left on, or when planes go over his house! He'll be leading you through this course and make sure that everything is properly explained.

With Apache Kafka becoming much more than a buzzword out there, I've decided it's time for students to properly learn how to be a Kafka professional. So, let’s kick start the course! You are in good hands!

===============================

This Course Also Comes With:

  • Lifetime Access to All Future Updates

  • A responsive instructor in the Q&A Section

  • Links to interesting articles, and lots of good code to base your next applications onto

  • Udemy Certificate of Completion Ready for Download

This is the course that could improve your career!

Apache Kafka is a skill in high demand and there are not enough people to fulfill all the open positions. You can boost your income, take on new roles and fun challenges. Many of my students are now the Kafka experts of their companies! You can be the next!

I hope to see you inside the course!

=======================

Note: Looking for more advanced Kafka concepts? There are many volumes in the Apache Kafka Series:

  • Learn Kafka for Beginners v2 (great to start)

  • Kafka Connect Hands On Learning

  • Kafka Streams for Data Processing

  • KSQL on ksqlDB - Hands On!

  • Kafka Cluster Setup & Administration

  • Confluent Schema Registry & Kafka REST Proxy

  • Kafka Security (SSL SASL ACL)

  • Kafka Monitoring and Operations

Happy learning!

Who this course is for:

  • Developers who want to learn and write their first KSQL applications
  • Architects who want to understand how KSQL fits into their solution architecture
  • Anyone looking to learn more about KSQL

Course content

8 sections • 38 lectures

ksqlDB and KSQL Course Introduction Preview 05:48

Project Overview Preview 01:23

Code Download Preview 00:14

Prepare the ksqlDB project files Preview 01:43

KSQL Setup - Mac / Linux / Windows Preview 10:27

Important - Windows Users Preview 07:41

KSQL Command Line Preview 08:42

Our first KSQL Stream Preview 10:32

Create a Stream with JSON Preview 05:22

KSQL Datagen - Generating Streams Preview 03:57

Manipulate a Stream Preview 05:41

Streams from streams and functions Preview 08:44

ksqlDB Tables Preview 08:41

KSQL Joins Preview 07:02

Pull Queries Preview 05:29

Kafka Connect with ksqlDB Preview 09:18

Data Encodings Preview 05:55

CSV Delimited Data Preview 04:58

JSON Data Preview 04:28

Avro Data Preview 07:48

Avro Schema Evolution Preview 13:26

Nested JSON Preview 04:55

Build a rekeyed table Preview 07:22

Repartition a Stream Preview 07:05

Merging Streams Preview 07:33

Windowing Preview 09:59

Geospatial Preview 07:22

Moving to Productions-Headless for KSQL Preview 08:00

Explain Plan Preview 04:27

Scaling and Load Balancing Preview 11:11

Configuration Settings Preview 05:53

State Stores Preview 04:45

Testing ksqlDB applications Preview 08:44

Next Steps & Congratulations Preview 02:20

THANK YOU! Preview 01:32

Bonus Lecture: Special discounts for our other courses Preview 01:04