Re:The Coming of Local LLMs
by agumonkey on Tuesday April 11, 2023 @01:39PM
(#35528432)
Were transformers used in other contexts ? biochemistry ? geometry .. whatever.
[ Parent
| on HN ]
Alphafold uses something they call Evoformer, it is an attention mechanism. Our group has tried, and so far failed to utilize transformers for a very very specific search problem in geometry (https://bit.ly/unit-distances).