Ask HN: How do you upgrade the models you run in production?
Hi! I'm an AI engineer at a Series D company. We use LLMs for basically everything: customer responses, classification, routing, clustering, etc. While most of my focus is on developing new features, writing evals for them and monitoring quality in production, I can't help but look for opportunities to improve our current ways of doing things. One of these is model upgrades. It seems that we...