Ask HN: Fine tuning a 65B LLM vs. fine tuning task specific million size models
Hi HN,Ex-ML Engineer to feel free to dive deep in the answersEverywhere I look today (medium, reddit, twitter) everyone is talking about fine-tuning LLMs. How the future is taking billion size models and fine-tuning then distilling them to specialised LLMs that perform specific tasks (i.e: sentiment analysis, Q&A, summarisation).1/When people speak about fine-tuning are they actually fully...