News for hackers. Stuff that matters.
Re:GitHub Copilot code review will start consuming GitHub Ac... by datsci_est_2015 on Wednesday April 29, 2026 @07:19AM (#47946761)
At what point will local inference catch up to today’s cloud inference? Will it ever? If it doesn’t, does that imply a certain dead-end for the LLM inference industry?
Re:GitHub Copilot code review will start consuming GitHub Ac... by lukaslalinsky on Thursday April 30, 2026 @03:56AM (#47959547)
I don't think at any point in foreseeable future we will have terabytes of RAM for dedicated LLM chips at home.