Войти
  • 24756Просмотров
  • 1 год назадОпубликованоData with Marc

How to run PySpark with Apache Airflow: The new way!

How to run PySpark with Apache Airflow: The NEW way! In this video, you will learn: ✅ How to set up Apache Airflow with Apache Spark in local ✅ How to run a PySpark script with the SparkSubmitOperator ✅ How to run code on Spark with the new Spark decorator and more! CODE: 🏆 BECOME A PRO: 👍 Smash the like button to become an Airflow Super Hero! ❤️ Subscribe to my channel to become a master of Airflow