Re:Ask HN: What are you working on? (July 2025)
by lobsterthief on Sunday July 27, 2025 @08:07PM
(#44705893)
Interesting idea! Could someone use the software to train an LLM prompt that will get around it? By learning what passes and what doesn’t and then having the LLM train on that
Re:Ask HN: What are you working on? (July 2025)
by enjeyw on Sunday July 27, 2025 @10:55PM
(#44706787)
Yeah this is something I'm a little worried about - right now it's not extremely difficult to just take an AI generated essay and then just tweak the essay until it passes.
My first pass approximation is to make the assessment of whether the essay is AI generated or not accessible only to teachers. I may need to also rate-limit the checks, so people can't brute force it to gather data on what passess.
Re:Ask HN: What are you working on? (July 2025)
by Footprint0521 on Sunday July 27, 2025 @09:53PM
(#44706466)
I got burned by software like this, when I pasted in a essay I transcribed while driving through Whisper, and software like this thought I had pasted AI content lol
For both a keystroke based AI detector, and software designed to mimic human keystroke patterns, performance will be determined by the size of the dataset they have of genuine human keystroke patterns. The detector has an inherent leg-up in this, because it's constantly collecting more data through the use of the tool, whereas the mimic software doesn't have any built in loop to collect those inputs.