Войти
  • 14318Просмотров
  • 10 месяцев назадОпубликованоAWS Made Easy

Real-Time Data Pipeline with Apache Kafka and AWS | AWS MSK | Hands-on Data Engineering Project

This is a hands-on end to end data engineering project on AWS. In this project we have demonstrated how you can build real time data streaming pipeline on AWS using Apache Kafka. Learn how to leverage the power of Kafka and AWS to build powerful real-time data pipelines. We have leveraged AWS services like RDS, MSK, S3 to build this pipeline. The following topics are covered in this video: 1. Pipeline architecture overview 2. Explanation of Kafka Connect 3. How to create MSK cluster 4. How to create Kafka Connect source and sink connectors This can be a very good project for people who want to build something using Apache Kafka and understand the basics of Data Engineering and Data Ingestion Pipelines. GitHub Repo Link : #apachekafka #dataengineering #awsprojects