Re:Ask HN: What do data scientists need to know about LLMs t...
by m_kos on Friday March 22, 2024 @04:32PM
(#39794517)
Thank you for the advice! Regarding building a RAG, do mean making one based on, e.g., the this example? https://python.langchain.com/docs/expression_language/cookbo...
Re:Ask HN: What do data scientists need to know about LLMs t...
by p1esk on Friday March 22, 2024 @07:39PM
(#39795990)
I wouldn’t waste my time learning about RAG. It’s quite likely GPT5 will make all current methods obsolete.
Re:Ask HN: What do data scientists need to know about LLMs t...
by m_kos on Friday March 22, 2024 @11:40PM
(#39797210)
What would you recommend learning instead?
Re:Ask HN: What do data scientists need to know about LLMs t...
by p1esk on Saturday March 23, 2024 @12:40AM
(#39797508)
Learn whatever interests you the most.
Re:Ask HN: What do data scientists need to know about LLMs t...
by BOOSTERHIDROGEN on Sunday March 24, 2024 @06:55PM
(#39811272)
What it is considered not to be a waste of time?
Re:Ask HN: What do data scientists need to know about LLMs t...
by nborwankar on Saturday March 23, 2024 @05:37PM
(#39803267)
That’s not quite correct.
Private data especially in the enterprise cannot use public LLM’s like GPT-4 or 5 or N. Use cases needing data privacy have to use an internally implemented LLM application. In Currently, RAG is a concrete and pragmatic enterprise use of LLM’s aside from summarization, which is not amenable to using GPT-4.
GPT-5 may very well be amazing. But unless it runs on-prem it can’t be used in many scenarios because of data privacy.
To the OP - learning how to run LLM’s locally via say Ollama (see ollama.ai) will get you started in a hands on manner. See the /r/LocaLlama subreddit for a very active community around running LLM’s locally.
Re:Ask HN: What do data scientists need to know about LLMs t...
by p1esk on Saturday March 23, 2024 @05:44PM
(#39803303)
I think you’re missing my point. RAG is something that you currently implement yourself, or pay someone else who already implemented it. With GPT5 (or GPT6 at the latest), you just give it the same access you would give to a RAG system, and describe what you want it to do. It will do the rest.
Edit: I’m assuming the scenario where you do want to use the best model.
To improve your chops in this field, (a) learn the basics of NLP, (b) build yourself a RAG using llamaindex or langchain (or other but build it).
As for fine tuning and deep learning, without experience in that field it's tough. It's like any complex thing (fine tuning not so much but deep learning), knowledge comes with time and exposure. So go find a reason to fine tune or build and train a neural network and go friggin do it.