News for hackers. Stuff that matters.
[dead]
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by osmarks on Sunday September 12, 2021 @01:06PM (#28502861)
GNU/Linux requires basically the same hardware as the usual alternative (Windows). If you switch from hosted GPT-3 to selfhosted GPT-J you start needing to get and manage all the hardware, which might go underutilized most of the time depending on what your demand looks like, and which requires lots of software optimizations to use maximally effectively. You can use hosted GPT-J, though, a few companies offer that.
Re:OpenAI Shuts Down Chatbot Project by Indie Developer by bluesnowmonkey on Sunday September 12, 2021 @12:42PM (#28502666)
The comment to which you replied is making a useful point actually. Self hosting is not free in the relevant sense when comparing cost vs a third party API.