News for hackers. Stuff that matters.
Re:How has DeepSeek improved the Transformer architecture? by HarHarVeryFunny on Tuesday January 28, 2025 @04:46PM (#42858481)
I'm sure that a smaller generalist model with RAG would work for many cases, especially where the RAG is just looking up some facts or technique, but would you really want a smart high school kid who's googled brain surgery to be operating on your brain? Books are useful for looking up facts, but there's no substitute for experience/training in actually getting good at something.

There are no comments on this comment yet.