Re:Show HN: Desktop Devin
by printvoid on Sunday July 28, 2024 @03:23AM
(#41091769)
Does it always need an API key to work with any models, why can't you provide GPT3.5 which is free or any other models available that work without an API key.
Re:Show HN: Desktop Devin
by elco_us on Sunday July 28, 2024 @01:44PM
(#41094684)
As @meiraleal pointed out, there is no free API
And the only model I would recommend to use is Sonnet 3.5
I would still recommend adding OpenAI API key - for embeddings so code search and google search work
Re:Show HN: Desktop Devin
by navjack27 on Sunday July 28, 2024 @08:25AM
(#41092767)
Yeah I'm not sure how this is privacy focused if it's still using API. I have local models that could run on my CPU that have pretty big context windows that would be pretty cool if this could just plug into and keep everything local.
And the only model I would recommend to use is Sonnet 3.5 I would still recommend adding OpenAI API key - for embeddings so code search and google search work
By privacy focused - I mean there is no backend servers that log chat or store embeddings. All data is stored locally.
And OpenAI API, doesn't use data from API for training.
Local models are on the roadmap. So far they just don't perform good enough to get anything meaningful done. Highly recommend Sonnet 3.5!