Re:I Self-Hosted Llama 3.2 with Coolify on My Home Server
by archerx on Wednesday October 16, 2024 @06:11AM
(#41857395)
For me at least the biggest feature of some self hosted LLMs is that you can get it then to be “uncensored”, you can get them to tell you dirty jokes or have the bias removed with controversial and politically incorrect subjects. Basically you have a freedom you won’t get from most of the main providers.
[ Parent
| on HN ]
Re:I Self-Hosted Llama 3.2 with Coolify on My Home Server
by ndheebebe on Wednesday October 16, 2024 @06:57AM
(#41857684)
And reliability. When Azure sends you the "censored output" status code it had basically failed and no retry is gonna help. And unless you are some corp you wont get approved for lifting the censoring.