News for hackers. Stuff that matters.
Re:Ask HN: Affordable hardware for running local large langu... by lemonlime0x3C33 on Sunday May 05, 2024 @06:33AM (#40263737)
I have used a raspberry pi for running image classification CNN’s, it really depends on the model you are using. Edge IoT AI is making a lot of progress targeting running AI on resource constrained devices.

If you have access to the dataset you want you could train one yourself to fit on your target hardware. You could also look at FPGA solutions if you are comfortable working with those. Training locally might take some time but you could use google Codelab to train it.

There are no comments on this comment yet.