News for hackers. Stuff that matters.
Re:Ask HN: Is it just me or GPT-4's quality has significantl... by znagengast on Wednesday May 31, 2023 @12:34PM (#36140321)
What if you split up the training down to the literal vector math, and treated every macbook like a thread in a gpu, with just one big computer acting as the orchestrator?
Re:Ask HN: Is it just me or GPT-4's quality has significantl... by Filligree on Wednesday May 31, 2023 @12:38PM (#36140357)
You would need each MacBook to have an internet connection capable of multiple terabytes per second, with sub millisecond latency to every other MacBook.