News for hackers. Stuff that matters.
Re:AlphaCode Attention Visualization by lossolo on Thursday December 08, 2022 @08:57PM (#33916428)
> if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?

I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.

Re:AlphaCode Attention Visualization by astrange on Thursday December 08, 2022 @10:23PM (#33917031)
Apparently you can avoid hallucination by basically reading the model’s mind instead of asking it questions.

https://arxiv.org/abs/2212.03827

Raises some ethical issues…