Join for free and connect with our local tech scene

Stay on top of the latest companies and upcoming events with our weekly newsletter, and be counted among the people building the future of your local tech community.

Phoenix, AZ /

Apache Airflow in Production

The University of Advancing Technology 2625 W. BASELINE RD. , Tempe, AZ 85283 (map)

Details

Title: Apache Airflow in Production

Abstract:

In this talk will introduce Airflow, an Apache Project for scheduling and workflow orchestration. We will discuss use cases, applicability and how best to use Airflow, mainly in the context of building data engineering pipelines. We have been running Airflow in production for about 4 years and will also go over some learnings, best practices and some tools we have built around it.

Speaker Bio: Robert Sanders, Director of Big Data Engineering

Robert Sanders is the Director of Big Data Engineering, Engineer, and Architect at Clairvoyant Insight. He primarily works with clients to Architect and Build Big Data solutions on the Hadoop Ecosystem. Robert has a deep background in enterprise systems, working on full-stack implementations and then focusing on Data management platforms.

Comments

Sign in to comment.