Re:Cost Per 1M tokens Of Self Hosting Llama-3
by hammyhavoc on Sunday June 16, 2024 @01:01PM
(#40698493)
Are the keys not already kept on their own infra?
[ Parent
| on HN ]
Re:Cost Per 1M tokens Of Self Hosting Llama-3
by aborsy on Monday June 17, 2024 @11:16AM
(#40706461)
No, private keys don’t leave user’s devices. This is the case in all such products.
But with a malicious update, they could ship them to their infra, targeting some users. The product then becomes malware!