News for hackers. Stuff that matters.

A comment on Show HN: Beating GPT-4 on HumanEval with a fine-tuned CodeLlama-34B. Parent comment

Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by krasin on Friday August 25, 2023 @07:16PM (#37268216)
One possible explanation is to make PyTorch victory over TensorFlow/JAX even more apparent: with Google ceasing to release interesting open-source models, and Facebook / Meta continuing doing so (even if under a less permissive license than usual), it means that there's nothing interesting in the TensorFlow/JAX ecosystem, and a lot in the PyTorch one.

(context: I work for Google DeepMind, opinions are my own)

[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by iudqnolq on Friday August 25, 2023 @11:05PM (#37269598)
Another possible reason might be to attract and retain talent? Speculating wildly but I'd guess some top researchers would value having their work be the industry standard rather than internal.
[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by desperate on Friday August 25, 2023 @11:57PM (#37269821)
Your speculation is pretty accurate afaik. Mark commented that releasing open source models is what is needed to retain the best so it is what they will do (paraphrasing) on his interview with Lex Friedman.
[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by whimsicalism on Friday August 25, 2023 @11:18PM (#37269657)
Hmm, but I feel like Jax/Pytorch interop is only getting better. Tensorflow abstraction has already firmly lost.
[ Parent | on HN ]
Re:Show HN: Beating GPT-4 on HumanEval with a fine-tuned Cod... by krasin on Saturday August 26, 2023 @02:28AM (#37270348)
> Hmm, but I feel like Jax/Pytorch interop is only getting better

There's definitely some convergence. It's good. It still stands for a fact that most people do/think about PyTorch nowadays, not JAX (speaking as someone who likes JAX).

[ Parent | on HN ]