News for hackers. Stuff that matters.
Re:Wavecoder – a CodeLLM with 6.7B params scoring just behin... by lxe on Wednesday January 17, 2024 @04:07PM (#39033453)
While I lack specific data, my intuition is based on observed trends in AI model development. I believe some other models that claimed such numbers excelled in benchmarks but fell short in real-world applications. Further research can validate this claim, and I welcome a balanced discussion.
Re:Wavecoder – a CodeLLM with 6.7B params scoring just behin... by travisporter on Wednesday January 17, 2024 @04:10PM (#39033494)
It does seem incredible that chatgpt has so much expertise in literally everything. Does this mean you can beat chatgpt by creating smaller "experts" and directing questions to each?
Re:Wavecoder – a CodeLLM with 6.7B params scoring just behin... by great_psy on Thursday January 18, 2024 @04:10PM (#39047787)
See mixture of experts. It’s likely what chatGPT does in the backend.