News for hackers. Stuff that matters.
Re:33TB of text data for a 1T-parameter model by sgu999 on Saturday April 15, 2023 @07:57PM (#35585870)
If we are going in that direction, I guess the few million years of evolution should also count
Re:33TB of text data for a 1T-parameter model by flashgordon on Saturday April 15, 2023 @08:27PM (#35586039)
No totally. Not an ml guy by long shot. My understanding is llms are foundational models which iiuc are "base" models representing all human knowledge until some point in time. Now I'd argue that you don't have to count all of evolution but just the point from when you were born. I'd say the all the sensory experiences + knowledge input from the day a brain is activated (DOB) would be in the order of PBytes if not more?