Re:Llamafile lets you distribute and run LLMs with a single ...
by verdverm on Wednesday November 29, 2023 @10:06PM
(#38468972)
Not sure, I use cloud VMs for ML stuff
We definitely prefer to use the same tech stack for dev and production, we already have docker (mostly migrated to nerdctl actually)
Can this project do production deploys to the cloud? Is it worth adding more tech to the stack for this use-case? I often wonder how much devops gets reimplemented in more specialized fields
Is there an easy way to run a Docker container on macOS such that it can access the GPU?