Re:33TB of text data for a 1T-parameter model
by flashgordon on Saturday April 15, 2023 @08:27PM
(#35586039)
No totally. Not an ml guy by long shot. My understanding is llms are foundational models which iiuc are "base" models representing all human knowledge until some point in time. Now I'd argue that you don't have to count all of evolution but just the point from when you were born. I'd say the all the sensory experiences + knowledge input from the day a brain is activated (DOB) would be in the order of PBytes if not more?
[ Parent
| on HN ]
There are no comments on this comment yet.