Re:Stanford Alpaca web demo suspended “until further notice”
by tarruda on Saturday March 18, 2023 @09:13AM
(#35208828)
I did not dislike your comment.
The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a machine learning model on my computer.
I could not do it with the unmodified pytorch model (my GPU is not powerful enough to run even the 7B model), but I was surprised on how easy it was running with llama.cpp. I literally just followed the steps in the github page.
But I was biased in saying it was easy, since I do have other knowledge (such as C development on Linux) which helped me.
The reason I considered easy was because I have very little knowledge in this area, in fact this is the first time I ever ran a machine learning model on my computer.
I could not do it with the unmodified pytorch model (my GPU is not powerful enough to run even the 7B model), but I was surprised on how easy it was running with llama.cpp. I literally just followed the steps in the github page.
But I was biased in saying it was easy, since I do have other knowledge (such as C development on Linux) which helped me.