mosshammer
Re:Intel Neural-Chat-7B Model Achieves Top Ranking on LLM Leaderboard
on Sunday December 03, 2023 @11:11AM (#38508086)
This is outdated information as the ranking has been heavily influenced by (wrong) DROP benchmark results. The current leaderboard thus has that particular benchmark not listed anymore, see the Huggingface blog for more details: https://huggingface.co/blog/leaderboard-drop-dive
Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM
on Tuesday June 06, 2023 @11:44AM (#36214607)
The RTX 4090 has 330.3 TOPS with INT8 precision, so for inference workloads it is still a magnitude faster