News for hackers. Stuff that matters.
Re:The Coming of Local LLMs by agumonkey on Tuesday April 11, 2023 @01:39PM (#35528432)
Were transformers used in other contexts ? biochemistry ? geometry .. whatever.
Re:The Coming of Local LLMs by skinner_ on Thursday April 13, 2023 @03:01AM (#35552036)
Alphafold uses something they call Evoformer, it is an attention mechanism. Our group has tried, and so far failed to utilize transformers for a very very specific search problem in geometry (https://bit.ly/unit-distances).
Re:The Coming of Local LLMs by agumonkey on Saturday April 15, 2023 @02:11PM (#35583050)
thanks a lot man, very nice