News for hackers. Stuff that matters.
Re:Stanford Alpaca web demo suspended “until further notice” by tarruda on Saturday March 18, 2023 @09:13AM (#35208828)
I did not dislike your comment.

The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a machine learning model on my computer.

I could not do it with the unmodified pytorch model (my GPU is not powerful enough to run even the 7B model), but I was surprised on how easy it was running with llama.cpp. I literally just followed the steps in the github page.

But I was biased in saying it was easy, since I do have other knowledge (such as C development on Linux) which helped me.

There are no comments on this comment yet.