Run 100B+ language models at home, BitTorrent‑style

Re:Run 100B+ language models at home, BitTorrent‑style by visarga on Tuesday March 21, 2023 @03:00AM (#35243257)

Yes, this is a growing stage. In one or two years LLMs will have Wikipedia quality or even research paper quality. The spam they will produce might be better than most human written stuff.

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by ithkuil on Tuesday March 21, 2023 @03:31AM (#35243417)

At which point does high quality spam cease to be spam?

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by amelius on Tuesday March 21, 2023 @04:50AM (#35243883)

The point where it is just misinformation?

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by Yajirobe on Tuesday March 21, 2023 @05:42AM (#35244198)

Misinformation is false information. Spam can be facts.

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by amelius on Tuesday March 21, 2023 @06:30AM (#35244462)

Theoretically, yes. But better treat it as misinformation.

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by zamnos on Tuesday March 21, 2023 @04:57AM (#35243929)

Might refer you to XKCD 810.

https://xkcd.com/810/

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by ithkuil on Tuesday March 21, 2023 @09:52AM (#35246088)

There is a XKCD for everything.

hmm, is there XKCD for "might refer you to XKCD $number" ?

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by bugcheck7b on Tuesday March 21, 2023 @03:31AM (#35243416)

If the spam is better quality than the human written stuff, who's to say we aren't better off?

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by lanternfish on Tuesday March 21, 2023 @03:40AM (#35243457)

Quality in this case doesn't necessarily mean ground truth accuracy - it just means ability to look accurate to humans.

[ Parent | on HN ]

Re:Run 100B+ language models at home, BitTorrent‑style by fauigerzigerk on Tuesday March 21, 2023 @05:04AM (#35243975)

I agree, that's the problem, but I think it's still somewhat complicated.

Imagine someone posting an extremely well written and insightful postmortem of an outage. It would show advanced and accurate usage of all kinds of tools to get to the bottom of the outage. It would be extremely useful reading for anyone investigating a similar outage, but the outage never actually occurred.

Now you have both ground truth accuracy and misleading fiction at the same time. Whether or not that makes the post useful depends entirely on the conclusions you're drawing from it.

[ Parent | on HN ]