News for hackers. Stuff that matters.

A comment on Decorator JITs: Python as a DSL. Parent comment

Re:Decorator JITs: Python as a DSL by dleeftink on Monday February 03, 2025 @11:12AM (#42919681)
> random issues like the bias term

I'd like to know more about this!

[ Parent | on HN ]
Re:Decorator JITs: Python as a DSL by Scene_Cast2 on Monday February 03, 2025 @02:45PM (#42922016)
Basically this style of code - https://github.com/pytorch-labs/attention-gym/pull/84/files - has issues like this - https://github.com/pytorch/pytorch/pull/137452 https://github.com/pytorch/pytorch/issues/144511 https://github.com/pytorch/pytorch/issues/145869

For some higher level context, see https://pytorch.org/blog/flexattention/

[ Parent | on HN ]