If you’ve worked on data problems, you probably have heard of Airflow and Superset, two powerful tools that have cemented their place in the data ecosystem. Building successful open-source software is no easy feat, and even fewer engineers have done this back to back. In Part 1 of this conversation, we chat about how to adapt to the LLM-age as engineers.

 

Segments:

(00:01:59) The Rise and Fall of the Data Engineer
(00:11:13) The Importance of Executive Skill in the Era of AI
(00:13:53) Developing the first reflex to use AI
(00:17:47) What are LLMs good at?
(00:25:33) Text to SQL
(00:28:19) Promptimize
(00:32:16) Using tools LangChain
(00:35:02) Writing better prompts

 

Show Notes:

- Max on Linkedin: https://www.linkedin.com/in/maximebeauchemin/
- Rise of the Data Engineer: https://medium.com/free-code-camp/the-rise-of-the-data-engineer-91be18f1e603
- Downfall of the Data Engineer: https://maximebeauchemin.medium.com/the-downfall-of-the-data-engineer-5bfb701e5d6b
- Promptimize: https://github.com/preset-io/promptimize

 

Stay in touch:

👋 Make Ronak’s day by leaving us a review and let us know who we should talk to next! [email protected]