News for hackers. Stuff that matters.
Re:We collected 10k hours of neuro-language data in our base... by g413n on Monday December 08, 2025 @12:49PM (#46195352)
what's the basis for conversion between hours of neural data to number of tokens? is that counting the paired text tokens?
Re:We collected 10k hours of neuro-language data in our base... by rio-popper on Monday December 08, 2025 @12:53PM (#46195395)
edit: oops sorry misread - the neural data is tokenised by our embedding model. the number of tokens per second of neural data varies and depends on the information content.