Войти
  • 17553Просмотров
  • 5 месяцев назадОпубликованоShubham Wadekar

End-To-End Azure Data Engineering Project | Retail Data Pipeline | Databricks | ADF

Get End to End Data Engineering Project here: 𝗜 𝗵𝗮𝘃𝗲 𝗽𝗿𝗲𝗽𝗮𝗿𝗲𝗱 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲 𝗜𝗻𝘁𝗲𝗿𝘃𝗶𝗲𝘄 𝗣𝗿𝗲𝗽𝗮𝗿𝗮𝘁𝗶𝗼𝗻 𝗚𝘂𝗶𝗱𝗲 𝗳𝗼𝗿 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗻𝗲𝗿𝘀. 𝗚𝗲𝘁 𝘁𝗵𝗲 𝗚𝘂𝗶𝗱𝗲 𝗵𝗲𝗿𝗲 - 𝗖𝗼𝘂𝗽𝗼𝗻 𝗰𝗼𝗱𝗲 - AZURE20 / AWS20 / GCP20 to get discounts for next 10 users. Connect with me: Instagram: LinkedIn: Data Engineers - Interview Prep : Whatsapp community: Interviewer: Ganesh Kudale - Interviewee: Satyam Meena - CHAPTERS: 00:00 – Introduction of the Project Series 01:04 – Introduction of Interviewer 02:08 – Introduction of Candidate 03:09 – Project Explanation with Architecture Diagram 05:03 – Get End-to-End Data Engineering Project 06:04 – Project Explanation with Architecture Diagram 08:59 – Roles and Responsibilities of Candidate 10:59 – Team Size and Stakeholders 11:59 – How Do You Get Requirements to Work on Project 14:44 – Agile/Scrum Ceremonies Followed in Project 16:44 – Scenario-Based Question 1: Have You Faced Sudden Spike in Data? 18:17 – Optimizing the Code 19:04 – File Format You Have Worked On? 22:34 – Scenario-Based Question 2: Have You Ever Faced Any Changes in Schema? 24:14 – How You Were Checking Data Accuracy? 24:39 – How Does Unit Testing Work in Your Project? 26:59 – Scenario-Based Question 3: Have You Encountered Pipeline Failure in Production? 29:39 – Default Shuffle Partitions in Spark 30:19 – How Were You Monitoring This Pipeline? 31:59 – Deployment Process 33:19 – Frequency of the Pipeline Running 33:59 – Optimization Techniques Used 39:38 Anything you would like to change in the current pipeline? 42:02 Feedback 44:40 Question from candidate and Final Feedback. ✨ Tags ✨ Mock Data Engineer Interview, Data Engineer Interview Questions, Data Engineering Mock Interview, Data Engineer Interview Preparation, Azure Data Engineer Interview, Cloud Data Engineering, ETL Interview Questions, SQL Interview for Data Engineer, PySpark Interview Questions, Big Data Interview Mock, Real Interview Data Engineer, Data Engineer Scenario Based Questions, Data Engineer Technical Interview, Mock Interview Full Length, AWS Data Engineer Mock, Data Engineering Projects, Data Engineer Career Switch, Entry Level Data Engineer, Data Engineering Roadmap, Data Modeling, Data warehousing, delta lake, glue, athena, stock market, real time data, Data Engineering project, Data Engineering projects, End to end data engineering project, GCP services ✨ HashTags ✨ #mockinterview #dataengineering #data #dataengineer #sql #python #pyspark #jobs #interview #bigdata #azure #cloud #gcp #aws #databricks #adf #azuredatafactory #synapse #dataflow #dataproc #project #end_to_end_data_engineering_project #ETL#DataPipeline #DataOps #PySpark #ApacheKafka #AWSGlue #Airflow #Snowflake #SQL #Python #CloudComputing #DataProcessing #BatchProcessing #StreamProcessing #DataTransformation #GoogleCloud #GCP #GoogleCloudPlatform #GCPProjects #CloudComputing #BigQuery #Dataflow #PubSub #Dataproc #CloudComposer #DataEngineeringOnGCP #GCPDataServices #StreamingWithGCP #CloudEngineer #GCPTraining #GCPforDataEngineers