News for hackers. Stuff that matters.
Re:GitHub Copilot loses an average of $20 a month per user by iterateAutomate on Monday October 09, 2023 @01:32PM (#37822932)
The speed at which the models are progressing and new optimizations for reducing hardware requirements makes $20/mo per user not too bad. They'll be able to reduce those costs pretty soon in my opinion, and the users will continue to use the service for years to come.
Re:GitHub Copilot loses an average of $20 a month per user by matteoraso on Monday October 09, 2023 @01:42PM (#37823075)
The flip side to that is it's going to be easier to self-host a coding LLM. That's free for the user (if they already have a good enough GPU) and it gives much better flexibility.
Re:GitHub Copilot loses an average of $20 a month per user by iterateAutomate on Monday October 09, 2023 @02:33PM (#37823609)
That's a good point, the large corporation model vs smaller specialized finetuned models are vying for dominance right now, I'm interested to see which paradigm we end up with.
Re:GitHub Copilot loses an average of $20 a month per user by BackBlast on Tuesday October 10, 2023 @09:51AM (#37832099)
Won't be winner takes all. The people who use local models will have requirements or desires that lean them that way. The rest will use the easier to stand up large corp offerings.

Only way this changes is if there is a very large performance gap between the two. Small ones just won't matter.