News for hackers. Stuff that matters.

A comment on The Coming of Local LLMs. Parent comment

Re:The Coming of Local LLMs by zamalek on Tuesday April 11, 2023 @12:46PM (#35527693)
There are those Google accelerators that plug into an M.2 slot. You could plausibly do this today, although I am not sure what sort of memory constraints those accelerators have.
[ Parent | on HN ]
Re:The Coming of Local LLMs by BrutalCoding on Tuesday April 11, 2023 @01:37PM (#35528407)
These ones can be plugged in with USB type-c, see: https://coral.ai/products/accelerator/

It’s used for boosting interference (offline) on Linux, Mac and Windows.

Haven’t bought or used them but I’ve had my eyes on these for a little while!

[ Parent | on HN ]
Re:The Coming of Local LLMs by beauzero on Tuesday April 11, 2023 @01:47PM (#35528558)
https://www.electronicsweekly.com/blogs/gadget-master/boards...
[ Parent | on HN ]