Master Airflow - Beginner to Advance with Project

A Comprehensive Guide to Apache Airflow: Learn Workflow Management from Beginner to Expert
Free Download What you'll learn
Learn Orchestration and Workflow Management
How to create Data Pipelines
Cloud Integrations and Data Migration
End to End Data Pipeline with real use case
Requirements
Basic Python Knowledge
Description
Apache Airflow is an open-source platform used for workflow automation, scheduling, and orchestration of complex data pipelines. As data volumes and complexity continue to grow, the need for efficient and scalable data processing and management is critical. In this comprehensive course, you will learn how to master Apache Airflow, starting from the basics and progressing to advanced concepts.The course is designed for data engineers, data scientists, python developers, software engineers, and anyone interested in learning how to automate and manage data workflows. You will learn how to use Apache Airflow to build and manage data pipelines, schedule, and trigger tasks, monitor and troubleshoot workflows, and integrate with various data sources and services.The course will cover the following topics:Introduction to Apache Airflow and workflow managementIntroduction to Docker and Docker CommandsInstallation and configuration of Apache AirflowBuilding and managing workflows with Apache AirflowScheduling and triggering tasks in Apache AirflowOperators in Apache AirflowFetching data from Web APIs or HTTPFile Sensors in Apache AirflowConnecting with Azure or AWSUsing AWS S3 Bucket and Azure Blob Storage to store and retrieve dataCreating custom operators and sensorsHandling dependencies and task retriesMonitoring and troubleshooting workflowsIntegrating with data sources and servicesScaling and optimizing Apache Airflow for large-scale data processing using Celery ExecutorsSecuring Dags Connections using Fernet KeysThroughout the course, you will work on practical exercises and projects to apply the concepts you learn. By the end of the course, you will have a strong understanding of Apache Airflow and the skills to build and manage complex data workflows.
Who this course is for
Data Engineers
Python Developers interested in Data Engineering
Data Scientist
DevOps Engineer
MLOps Engineer
Software Developers
Homepage

https://www.udemy.com/course/master-airflow-beginner-to-advance-with-project/

Links are Interchangeable - Single Extraction

Вернуться назад

Навигация

Рекомендуем

Статистика

Master Airflow - Beginner to Advance with Project

Коментарии

Рекомендуем

Популярное