News for hackers. Stuff that matters.
Re:GPT-4o mini: advancing cost-efficient intelligence by yawnxyz on Thursday July 18, 2024 @01:14PM (#40997729)
I think it's heavily quantized, so it doesn't cost them (too much). But I think it's still at cost...
Re:GPT-4o mini: advancing cost-efficient intelligence by saiansh2525 on Thursday July 18, 2024 @08:53PM (#41001162)
Judging from the perplexity scores, the model doesn't seem to be quantized, it seems to simply be a scaled down version of the original GPT-4O or something similar.