Re:Meta AI Unleashes Megabyte, a Revolutionary Scalable Mode...
by beefield on Wednesday May 24, 2023 @05:10AM
(#36055644)
> seems perfectly possible that a model like GPT-4 is just a hair's breadth away from vastly superhuman performance
Sorry, can't help commenting the weirdness of high dimensional spaces. If you take an cube of a size of a hair breadth (100um) in a space of hindreds of billions of dimensions like gpt4, distances between random points in that cube are in the order of tens of meters...
Sorry, can't help commenting the weirdness of high dimensional spaces. If you take an cube of a size of a hair breadth (100um) in a space of hindreds of billions of dimensions like gpt4, distances between random points in that cube are in the order of tens of meters...