News for hackers. Stuff that matters.
Re:Pythia: A Suite for Analyzing Large Language Models Acros... by maxnoe on Wednesday April 05, 2023 @04:46AM (#35451171)
Also pythia: https://www.pythia.org/

A high energy physics simulation library

Re:Pythia: A Suite for Analyzing Large Language Models Acros... by cozzyd on Wednesday April 05, 2023 @05:26AM (#35451471)
I asked ChatGPT what a top quark can decay into. Among other things it suggested a top quark could decay into a photon. ChatGPT seems not to have learned about baryon number conservation...

On a more serious note, Pythia has been around for 40 years... surely they could have picked a better name...

Re:Pythia: A Suite for Analyzing Large Language Models Acros... by elashri on Wednesday April 05, 2023 @11:13AM (#35455601)
I asked ChatGPT (GPT-4) model about the top quark decay channels and it was mostly correct about top decay to W and b quark. It then started listing possibilities of further W decays which were mostly correct.

On your same serious note, particle physicists are the worst in naming things, let's not forget that people came up with a very unique name of "ROOT".

Re:Pythia: A Suite for Analyzing Large Language Models Acros... by zetalyrae on Wednesday April 05, 2023 @04:59AM (#35451265)
I'm ok with this as long as it's not the n-th software project called Spark.
Re:Pythia: A Suite for Analyzing Large Language Models Acros... by ALLTaken on Wednesday April 05, 2023 @07:40AM (#35452414)
Re:Pythia: A Suite for Analyzing Large Language Models Acros... by jerrygenser on Wednesday April 05, 2023 @07:42AM (#35452430)
No, the title is linked. The title refers to Pythia by EleutherAI for evaluating LLMs.

You linked something that is a framework for multimodal models by facebook.

Re:Pythia: A Suite for Analyzing Large Language Models Acros... by dwrensha on Wednesday April 05, 2023 @08:28AM (#35452962)
I've been happily using Pythia in Acronymy Assistant: https://github.com/dwrensha/acronymy-assistant

It's quite convenient to have a continuous range of model sizes. Usually I want "the largest model that fits on my GPU", but sometimes I want to trade between quality and performance, and Pythia makes that easy.