Can I Run AI locally?

Re:Can I Run AI locally? by threecheese on Friday March 13, 2026 @06:24PM (#47370779)

You can really see the limitations of qwen3.5:9b in reasoning traces- it’s fascinating. When a question “goes bad”, sometimes the thinking tokens are WILD - it’s like watching the Poirot after a head injury.

Example: “what is the air speed velocity of a swallow?” - qwen knew it was a Monty Python gag, but couldnt and didnt figure out which one.

[ Parent | on HN ]

Re:Can I Run AI locally? by scottmf on Friday March 13, 2026 @09:23PM (#47372318)

As a person who also knows there's a connection between that phrase and Monty Python and not much more information beyond that, I'm not sure how to feel.

[ Parent | on HN ]

Re:Can I Run AI locally? by cassianoleal on Friday March 13, 2026 @11:11PM (#47372938)

African or European?

[ Parent | on HN ]

Re:Can I Run AI locally? by plank on Saturday March 14, 2026 @05:48AM (#47374974)

My favourite colour is blue. Oh, no, it is...

[ Parent | on HN ]

Re:Can I Run AI locally? by 8note on Saturday March 14, 2026 @03:21PM (#47380152)

could that be some of the RL trying to get it to not regurgitate?

the gag is giving in detail which one

[ Parent | on HN ]

Re:Can I Run AI locally? by threecheese on Saturday March 14, 2026 @06:14PM (#47381838)

https://gist.github.com/mikewaters/7ebfbc73eb8624f917c5b4167...

It thinks like it’s memory is broken and it’s unaware of it; over 100 lines like this:

    - Wait, no, that's not right either.
    - Let's recall the specific line. It goes like this:
        - Knight A: "How can you have a swallow?"
        - Knight B: "It is the air speed velocity of a swallow."
        - Actually, the most common citation is from the movie where they ask an expert on swallows? No.

[ Parent | on HN ]