Coffee Sessions #136

Systems Engineer Navigating the World of ML

We don't hear that much about working at a very low level on this podcast but they are still very valid. Andrew is able to give us his take on why and what you need to keep in mind when you are working at these low levels and why it is very important when you are a Machine Learning Engineer and how the two can play together nicely. Most MLOps teams are formed using existing people and exitsing engineers. More often than not you have to blend these various disciplines and it works well when there's a common goal.

Take-aways

Outline - Personal journey from low level systems engineer to ML, and from big tech to Union. - Challenges encountered in ML and big tech - many "classic" distributed systems problems, complicated by fast paced ML environment and simple but highly flexible abstractions. Tons of tech/product opportunities here. - How Union and Flyte are accelerating the work of data scientists and ML engineers by handling the complexity of workflow orchestration, and ensuring these workloads are production ready from day one. - Early learnings from my journey into open source and the Flyte ecosystem. Plus lessons to bring from big tech.

In this episode

Andrew Dye

Andrew Dye

Software Engineer, Union

Andrew is a software engineer at Union and contributor to Flyte, a production grade data and ML orchestration platform. Prior to that he was a tech lead for ML Infrastructure at Meta, where he focused on ML training reliability.

Twitter

LinkedIn

Demetrios Brinkmann

Demetrios Brinkmann

Host

Demetrios is one of the main organizers of the MLOps community and currently resides in a small town outside Frankfurt, Germany. He is an avid traveller who taught English as a second language to see the world and learn about new cultures. Demetrios fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and ML. Since diving into the nitty-gritty of Machine Learning Operations he felt a strong calling to explore the ethical issues surrounding ML. When he is not conducting interviews you can find him making stone stacking with his daughter in the woods or playing the ukulele by the campfire.

David Aponte

David Aponte

Host

David is one of the organizers of the MLOps Community. He is an engineer, teacher, and lifelong student. He loves to build solutions to tough problems and share his learnings with others. He works out of NYC and loves to hike and box for fun. He enjoys meeting new people so feel free to reach out to him!