News for hackers. Stuff that matters.
Re:Transformer Attention is off by one by RationPhantoms on Monday July 24, 2023 @09:18PM (#36856573)
I've long wanted an informational slider to bits of text. Something where you can zoom in and out to the level of desired complexity. LLM's might be able to fill in some of those gaps. You could turn any paper into a introduction of the subject it's a part of.
Re:Transformer Attention is off by one by tonypace on Monday July 24, 2023 @11:31PM (#36857528)
This sounds like a good use case for local llm models. Browser plugin, precooked prompts for different levels of detail, maybe a lora to give the model some idea of expected output. I bet some of the 13b models could do a useful job on this even if they were imperfect.
Re:Transformer Attention is off by one by jdougan on Tuesday July 25, 2023 @07:55PM (#36871346)
Look for "stretchtext"