Coffee Sessions #40

Scaling AI in Production

This Coffee Session is a Collaboration with @AIEngineering. Srivatsan Srinivasan, the founder of the popular AI Engineering channel on YouTube and a senior partner at a major technology consultancy. Sri has a true passion for building ML systems and his channel engages in some of the most detailed, thorough, and complete treatments of the MLOps topics we often discuss in the community. It's no surprise then, that his coffee session with us went similarly! This conversation became pretty technical. We delved into details of how to set up CI/CD, how to set up the right kinds of tests, which cloud tools stand out to us on GCP, AWS, etc., and many other topics. Sri was a wealth of knowledge on all these fronts! Some tidbits: 1. Fail smart, not just fast. 2. Deploy a useless model over waiting to deploy the perfect model 3. Understand that much of DevOps/Kubernetes/CI/CD is YAML proficiency, which can be intimidating, but not impossibly by any means. 4. AutoML has a ton of potential that all of us are eagerly watching out for. 5. Avoid overengineering ML systems by doing things as simply as possible. We know many of you have been waiting for a more technical approach to some coffee sessions, and I think this is what you want! Let us know your thoughts on some of the practical tips we discussed (especially about CI/CD and testing).

In this episode

Srivatsan Srinivasan

Srivatsan Srinivasan

Chief Data Scientist , AIEngineering

20+ years of intense passion for building data-driven applications and products for top financial customers. Srivatsan has been a trusted advisor to a senior-level executive from business and technology, helping them with complex transformation in the data and analytics space. Srivatsan also run a YouTube Channel (AIEngineering) where he talks about data, AI and MLOps.

LinkedIn

Demetrios Brinkmann

Demetrios Brinkmann

Host

Demetrios is one of the main organizers of the MLOps community and currently resides in a small town outside Frankfurt, Germany. He is an avid traveller who taught English as a second language to see the world and learn about new cultures. Demetrios fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and ML. Since diving into the nitty-gritty of Machine Learning Operations he felt a strong calling to explore the ethical issues surrounding ML. When he is not conducting interviews you can find him making stone stacking with his daughter in the woods or playing the ukulele by the campfire.

Vishnu Rachakonda

Vishnu Rachakonda

Host

Vishnu Rachakonda is the operations lead for the MLOps Community and co-hosts the MLOps Coffee Sessions podcast. He is a machine learning engineer at Tesseract Health, a 4Catalyzer company focused on retinal imaging. In this role, he builds machine learning models for clinical workflow augmentation and diagnostics in on-device and cloud use cases. Since studying bioengineering at Penn, Vishnu has been actively working in the fields of computational biomedicine and MLOps. In his spare time, Vishnu enjoys suspending all logic to watch Indian action movies, playing chess, and writing.