LLM Avalanche
At the end of June, I flew out to San Francisco to do three things: I want to break down LLM Avalanche. Aside from being basically a mini-conference that we called a meetup, there were incredible learnings. It would be... View article
Tag Archive: LLMs
MLOps: More Oops than Ops
As model complexity increases exponentially, so too does the need for effective MLOps practices. This post acts as a transparent write-up of all the MLOps frustrations I’ve experienced in the last few days. By sharing my challenges and insights, I... View article
Building the Future with LLMOps: The Main Challenges
The following is an extract from Andrew McMahon’s book, Machine Learning Engineering withPython, Second Edition. Available on Amazon at https://packt.link/w3JKL. Given the rise in interest in LLMs recently, there has been no shortage of people expressing the desire to integrate... View article
Empowering Language Model Applications: Understanding and Evaluating Vector Databases in Production
Language models are powerful artificial intelligence algorithms that have the ability to generate human-like text based on the input they receive. They are general-purpose neural networks pre-trained on vast amounts of textual data and learn the statistical patterns and relationships... View article
Concepts for Reliability of LLMs in Production
Traditional NLP models are trainable, deterministic, and for some of them, explainable. When we encounter an erroneous prediction that affects downstream tasks, we can trace it back to the model, rerun the inference step, and reproduce the same result. We... View article
Driving Business Innovation with NLP and LLMs – Part 1 – QA Models
In this series of articles, we’re going to explore the powerful business benefits that come from leveraging large language models (LLMs) and natural language processing (NLP). We won’t be having a deep dive into super technical details like how BERT,... View article
Fixing the MLOps Survey on LLMs with ChatGPT API: Lessons Learned
Large Language Model (LLM) is such an existing topic. Since the release of ChatGPT, we saw a surge of innovation ranging from education mentorship to finance advisory. Each week is a new opportunity for addressing new kinds of problems, increasing human productivity, or improving existing solutions. Yet, we may wonder... View article
“It worked when I prompted it” or the challenges of building an LLM Product
How do we serve a response with confidence, if we don’t know how confident we should be about the response? Author: Soham Chatterjee Over the last few weeks, we have been trying to build an LLM product ourselves, a Chrome extension... View article