News for hackers. Stuff that matters.
Re:Cost Per 1M tokens Of Self Hosting Llama-3 by elorant on Friday June 14, 2024 @04:27PM (#40684773)
Is there any resource that goes into more detail about how to setup all this?
Re:Cost Per 1M tokens Of Self Hosting Llama-3 by sneak on Friday June 14, 2024 @04:37PM (#40684853)
https://github.com/slackhq/nebula

the docs are good. when creating the initial CA make absolutely sure you set the CA expiration to 10-30 years, the default is 1 which means your whole setup explodes in a year without warning.