News for hackers. Stuff that matters.
Re:Reflection 70B, the top open-source model by moralestapia on Thursday September 05, 2024 @04:57PM (#41460355)
>A friend who developed NoCha [1] is running the model on that benchmark [...]

Please do update us on the result.

Re:Reflection 70B, the top open-source model by nsagent on Friday September 06, 2024 @04:11PM (#41469353)
Not looking good. Apparently the model was broken when they released it yesterday. The version they uploaded 8hrs ago only has an 8k context length, so we can't test it on the novels.

Here's the updates to the model config on huggingface:

https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B/c...