Show HN: How I Topped the HuggingFace Open LLM Leaderboard on Two Gaming GPUs

Re:Show HN: How I Topped the HuggingFace Open LLM Leaderboar... by BloodAndCode on Tuesday March 10, 2026 @03:18PM (#47327655)

Did you try repeating the same mid-layer block more than once?

If the gain comes from giving the model another pass over its internal representation, I'd expect some sort of diminishing-returns curve as you add more repeats. But if those layers form a spevific circuit, running it multiple times might actually break the computation.

It would be really interesting to see which of those regims the model falls into.

[ Parent | on HN ]

Re:Show HN: How I Topped the HuggingFace Open LLM Leaderboar... by dnhkng on Tuesday March 10, 2026 @03:22PM (#47327702)

Yes!

I tried that pretty early on, the its basically never good. Its described in the the section: https://dnhkng.github.io/posts/rys/#the-beginning-of-llm-neu...

[ Parent | on HN ]

Re:Show HN: How I Topped the HuggingFace Open LLM Leaderboar... by efromvt on Tuesday March 10, 2026 @03:32PM (#47327803)

If you found two disjoint sections that seemed positive on their own, did you try looping both separately in the same model? Wondering how localized the structures are.

[ Parent | on HN ]

Re:Show HN: How I Topped the HuggingFace Open LLM Leaderboar... by fennecfoxy on Thursday March 12, 2026 @11:37AM (#47352344)

How about, as you found repeating x-y was useful for locating the block of 7 layers in the first place; I'd be incredibly curious if, knowing that block of 7, if you then iterated from repeating x-y in that block z times.

Like for those 7 layers 1,2,3,4,5,6,7 does efficiency increase if you run 1,2,3,3,4,4,4,5,6,7 or perhaps 1,2,3,3,4,5,6,6,7 etc. If only GPUs grew on trees

[ Parent | on HN ]

Re:Show HN: How I Topped the HuggingFace Open LLM Leaderboar... by dnhkng on Friday March 13, 2026 @11:00AM (#47365405)

Yes, I have done these thype of experiments; thats for the next post

[ Parent | on HN ]