BROADCASTS.com

b'

Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today\\u2019s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.

In this episode we discuss:

\\n
• Solving the \\u201cnegative engineering problem\\u201d
\\n
• Learning from the complaints of data engineers at Apache Airflow
\\n
• The difficulty of having a product that serves two masters
\\n
• How COVID changed the direction of Prefect
\\n

Links:

\\n
• Prefect
\\n
• Apache Airflow
\\n
• Why Not Airflow?
\\n

People mentioned:

\\n
• Jim O\'Shaughnessy (@jposhaughnessy)
\\n
• Patrick O\\u2019Shaughnessy (@patrick_oshag)
  \\n
\\n