News for hackers. Stuff that matters.
Re:Open Source AI Is the Path Forward by tintor on Tuesday July 23, 2024 @01:53PM (#41048882)
> they have brought the cost of pretraining a frontier 400B+ parameter model to ZERO

It is still far from zero.

Re:Open Source AI Is the Path Forward by cs702 on Tuesday July 23, 2024 @02:20PM (#41049146)
If the model is already pretrained, there's no need to pretrain it, so the cost of pretraining is zero.
Re:Open Source AI Is the Path Forward by moffkalast on Tuesday July 23, 2024 @03:29PM (#41049825)
Yeah but you only have the one model, and so far it seems to be only good on paper.