dalai does a lot of magic in the background. I had to run the package from source to debug the error messages. When run in on a Mac with zsh, it still runs bash under the hood to setup the python venv. Took me an hour to debug that as bash did not have poetry and pyenv configured to use <3.11 python since I never use bash. Yet, sentencepiece does not have a 3.11 wheel available, thus running dalai fails.
Today, just 2d after running dalai successfully, it refuses to start and just hangs in there. Unclear why.
llama.cpp and alpaca.cpp both ship binary releases. Dalai does not seem to.
Re:Run LLaMA and Alpaca on your computer
by vorticalbox on Thursday April 06, 2023 @06:38AM
(#35466570)
for one the script after cloning llama.cpp repo then calls `exit()` which then drops me out of my fish shell.
The first version won't work on my linux distribution (nixos). The second one also won't work, but I know how to make it work (C++ and Python without any additional abstraction layers are easy).
how is this:
harder than: