News for hackers. Stuff that matters.

A comment on Performance of llama.cpp on Apple Silicon A-series. Parent comment

Re:Performance of llama.cpp on Apple Silicon A-series by runjake on Tuesday December 19, 2023 @09:20PM (#38704729) 

  > how about a co-op neighborhood LLM rack?
It'll work about as well as those "wire your neighborhood for Internet as a collective" movements of the 1990s.

In fact, you'll need those to deal with latency issues, if my experience with consumer ISP quality is any indication.

[ Parent | on HN ]
Re:Performance of llama.cpp on Apple Silicon A-series by dharmab on Tuesday December 19, 2023 @10:39PM (#38705182)
Funny enough, I know two separate groups of people doing that. One in an apartment in SF running a shared Wi-Fi network with VLANs so they don't step on each other's frequencies, and another group sharing WISP infrastructure in semi-rural Utah where they can't convince ISPs to lay fiber. (Although I think the second group now uses that as a backup for Starlink.)
[ Parent | on HN ]
Re:Performance of llama.cpp on Apple Silicon A-series by runjake on Wednesday December 20, 2023 @06:40PM (#38715134)
Yes, UBNT nanobeam 5ac AC wireless[1] is pretty dirt cheap. Can get a pair for about $199 for a wireless P2P link that can work over several kilometers. I have deployed a number of these myself, along with more high bandwidth airFiber stuff.

1. https://store.ui.com/us/en/pro/category/all-wireless/product...

[ Parent | on HN ]