News for hackers. Stuff that matters.

ptitlaby

Ask HN: Did you buy hardware for Local AI?

With the release of some new platforms having 128GB or more of unified memories, I am wondering if I should spend some money on those.I am looking for feedback and stories of people who bought hardware for local-first AI.- Did you identify a sweet spot in model size, and therefore hardware sizing?- Did you continue to use cloud / frontier models?

( Read More... | 1 comment | on HN )