Also, even before reading the comments, I was pleasantly surprised that everything on that page worked and nothing bothered me. There is a good amount of attention to detail (switching of the rounding on codeblocks when switching to light mode for example, avoiding a weird corner on mobile). Nothing moves around on load etc. I know this is a low bar, but it's gotten pretty rare, even for pages linked on here.
I'm trying to say that his 100k lines might actually be spent on attention to detail and aren't just slop.
PTQ1_0 has no optimized MMQ-Path in their llama-cpp fork, try running PTQ2_0 (needs a bit more vram, but is about 2x faster on my 6700 XT)
https://gist.github.com/nilsherzig/b8266d001c5c01bdb3d81d209...
Here is a detailed explanation from Pangram how their scoring works https://www.pangram.com/research/how-it-works
as an extension so you can continue to comment and use hn as usual
https://hnslop.nilsherzig.com/
Firefox Extension/Userscript and API to get Pangram scores for all articles on the hackernews frontpage. The extension allows you to hide articles with a high score.This is about detecting posts written by LLMs, not posts about AI.Feel free to use the API to build your own tooling/readers.Big thanks to https://news.ycombinator.com/user?id=salahadawi for providing the data :).
Im trying to get something cheaper to work, Pangram has some nice docs on how to build something like their service https://github.com/pangramlabs/EditLens, they even have training data online.
The harm a missclassification carries is much lower for a hn post than a masters thesis, so we might be fine with a worse model.
OPs solution does more than keyword filtering. But its still about filtering out "content about ai" not filtering out "ai written content".
Instead of filtering keywords this ranks the content using Pangram. But it's also pretty effective at filtering content about AI. Turns out that a lot of LLM tooling projects have LLM written project descriptions/blog posts.
It's amazing to see how many of the "AI hurts my brain" posts are apparently written by an LLM.
https://www.pangram.com/history/5a4b90c6-0123-4f97-b50e-9c90...
Don't get me wrong I love factorio like the next guy and understand the idea behind your thinking, but there should be limits to that thinking in the real world. And if that doesn't convince you consider the efficiency loss of a depressed worker with a urinary tract infection.
Honestly - and I don't mean that as an insult - I hope for you to experience (just once) the loss of dignity that not being able to visit the restroom on your own decision will give you. Might make you realize the hell this kind of thinking leads to.
But even in this hypothetical world I would still have a hard time teaching an LLM what I find important in a product. Not everything can be captured in easy to compare numbers. "Does the device creak under pressure?", "What's the one weirdly unergonomic thing about it you only notice after weeks of using?"... Stuff like that. Things which are easy to miss even if the model ingests all relevant reviews about the product, because it might not stand out, but might be important for me.
I tried searching for good opensource / reasonably priced alternatives, pangram themselves even have some of their older architecture and training data on github/hugging face, but i never got that working reliably enough.
> In 2006, SoftwareOnline was sued by The Washington State Attorney General's Office for alleged violations of the Consumer Protection Act after complaints were made about two products called "Registry Cleaner" and "InternetShield".
https://en.wikipedia.org/wiki/Dave_Plummer#:~:text=16%5D-,In...
Asking an LLM to remove an Idea from a Document often times results in an edit which explicitly states that this Idea is not relevant, instead of just removing all references to that Idea.
That might be useful for some form of "evolving" Documentation (so future readers know that this part of the search space was covered and deemed irrelevant) but is just overly verbose and confusing to read in most situations.
Still missing the human connection of cause, so im not sure if this is a technical / skill issue in the first place.
After using Claude (paid by work) for a couple of months, I was amazed how well instruction following works in other setups.
