News for hackers. Stuff that matters.

A comment on OPT: Open Pre-trained Transformer Language Models. Parent comment

Re:OPT: Open Pre-trained Transformer Language Models by metadat on Monday May 02, 2022 @10:47PM (#31243889)
Ending up in the wild is an eventuality, whether FB creates it or someone else, why draw it out?

Bandwidth concerns is nonsensical these days, fb has nearly unlimited resources in that department.

Set it free! It wants to be free.

[ Parent | on HN ]
Re:OPT: Open Pre-trained Transformer Language Models by sanxiyn on Monday May 02, 2022 @11:47PM (#31244338)
"It wants to be free" is a ridiculous statement, considering that after full two years (GPT-3 was published in May 2020), there is no public release of anything comparable.

In May 2020, was your estimate of time to public release of anything comparable shorter or longer than two years? I bet it was shorter.

[ Parent | on HN ]
Re:OPT: Open Pre-trained Transformer Language Models by HWR_14 on Tuesday May 03, 2022 @01:13AM (#31244905)
> "It wants to be free" is a ridiculous statement

"It wants to be free" is based on the standard line "code/data wants to be free". It doesn't mean this cost nothing to produce or isn't valuable.

[ Parent | on HN ]
Re:OPT: Open Pre-trained Transformer Language Models by jquery on Monday May 02, 2022 @11:14PM (#31244099)
This is an ideal use case for a torrent.
[ Parent | on HN ]
Re:OPT: Open Pre-trained Transformer Language Models by londons_explore on Tuesday May 03, 2022 @12:17AM (#31244556)
In big companies, something as simple as "host it on facebook.com/model.tar.gz" can be mountains of approval and paperwork.
[ Parent | on HN ]