Posts by: Jess Leung

June 3, 2024

The MLOps Behind Recursion’s Foundation Model Phenom-1

Recursion's development of their Phenom-1 foundation model showcases the importance of MLOps practices throughout the machine learning lifecycle. To train this large model on massive image datasets, they implemented solutions for experiment tracking, resource allocation, and data management. This included using tools like PyTorch Lightning and Hydra for better control and efficiency. They also optimized data transfer speeds and storage formats to handle the workload. Furthermore, Recursion highlights the crucial role of MLOps culture, emphasizing collaboration across diverse teams and utilizing infrastructure like their BioHive-1 supercomputer effectively.