News for hackers. Stuff that matters.
Re:GPU-Accelerated LLM on a $100 Orange Pi by regularfry on Tuesday August 15, 2023 @08:47AM (#37133313)
https://arxiv.org/pdf/2308.04430.pdf is interesting from that point of view. They've tackled it from the perspective of avoiding copyright content in training, but including it in inference but I think it ought to mean less hallucination because they also (claim to) solve the attribution problem.
Re:GPU-Accelerated LLM on a $100 Orange Pi by jacquesm on Tuesday August 15, 2023 @08:52AM (#37133349)
Nice one, thank you. Added to my 'read later today' list, the abstract looks very interesting.