![Contributor artwork](https://is1-ssl.mzstatic.com/image/thumb/Podcasts113/v4/ed/22/f5/ed22f5a7-2e54-8817-b3a2-faa82934bbd3/mza_8244403555972519111.jpg/100x100bb.jpg)
Prefect with Jeremiah Lowin
Contributor
English - October 21, 2020 09:00 - 48 minutes - 44.9 MB - ★★★★★ - 11 ratingsTechnology Homepage Download Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.
In this episode we discuss:
Solving the “negative engineering problem”
Learning from the complaints of data engineers at Apache Airflow
The difficulty of having a product that serves two masters
How COVID changed the direction of Prefect
Links:
Prefect
Apache Airflow
Why Not Airflow?
People mentioned:
Jim O'Shaughnessy (@jposhaughnessy)
Patrick O’Shaughnessy (@patrick_oshag)