Re:Ask HN: How complex is it to train your own (tiny) LLM?
by dxsh on Wednesday November 15, 2023 @04:17AM
(#38274793)
Thank you! I checked out Langchain last night and wow I am super impressed by how accessible it is.
Do you have any good resources on cleaning up / structuring of data? The 5000 articles I have span multiple years which which means contextual information may be "spread out". The data I have contains dates of when the article was written, I'm pondering how to ensure the LLM doesn't talk about a fact in 2015 like it's still true in the present day.
Do you have any good resources on cleaning up / structuring of data? The 5000 articles I have span multiple years which which means contextual information may be "spread out". The data I have contains dates of when the article was written, I'm pondering how to ensure the LLM doesn't talk about a fact in 2015 like it's still true in the present day.