News for hackers. Stuff that matters.

A comment on Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size. Parent comment

Re:Refact LLM: New 1.6B code model reaches 32% HumanEval and... by brucethemoose2 on Monday September 04, 2023 @06:32PM (#37385764)
This can be addressed with token streaming and input caching.

Would that be enough? shrug

[ Parent | on HN ]

There are no comments on this comment yet.