News for hackers. Stuff that matters.

white_viel

Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Thursday February 26, 2026 @02:45AM (#47163124)
but i am impressed that gpt was able to decipher the worke.dev url on its own and access it.
Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Thursday February 26, 2026 @02:44AM (#47163109)
>> interesting. workers.dev domains can be a liability sometimes -- if you've mapped the worker to a real zone, then you probably don't want the workers.dev zone anymore.

maybe that is a good idea, prompt a user to disable the worker.dev domain. however, having the worker.dev domain open for me is more of a backup way to access the worker as the mapped domain is more for a hobby project.

> Interesting. workers.dev domains can be a liability sometimes

what about allowing the specific worker.dev to serve a robots.txt on its own that can be used to disable the AI bots?

i.e https://XXXXXXXXXXX.username.workers.dev/robots.txt should be allowed to be configure on a worker level. not sure how that affects the design of the infra, but it would be a good idea

Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Wednesday February 25, 2026 @01:54PM (#47156027)
Finally managed to kill the traffic: 1. renamed the worker - the bot was bypassing the route on the domain and using the worker.dev domain 2. add WAF rules to block gptbot in user agent 3. serve zip bomb on request from GPT.

interesting that GPT was accessing the worker directly to bypass the WAF rule son Cloudflare

Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Wednesday February 25, 2026 @01:32PM (#47155667)
update: the bot is back now with a vengeance, sending request at about 1 request per second. ignoring robots.txt and the status code 403
Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Wednesday February 25, 2026 @01:09PM (#47155262)
serving a zip bomb and after 10 minutes, the traffic from the gpt bot disappeared..
Re:GPT Bot Ignoring Robots.txt on my cloudflare worker on Wednesday February 25, 2026 @12:08PM (#47154320)
will be serving a zip bomb to the bot to see if they stay away from my proxy

GPT Bot Ignoring Robots.txt on my cloudflare worker

TLDR: GPT Bot is systematically accessing my private ubuntu mirror, ignoring the robots.txtToday in the morning I woke up to the following message from Cloudflare about my quota usage on Cloudflare workers>> Your account has reached 75% of its daily requests limit for Cloudflare Workers and/or Pages FunctionsThis is unusual as only have one worker on my Cloudflare account that proxies my...

( Read More... | 9 comments | 3 points | on HN )
Re:Plex Update: Notice of a potential security incident on Monday September 08, 2025 @06:27PM (#45174893)
Jellyfin - an almost direct replacement of plex Emby - IMOO the best replacement if Plex is not viable

Plex Update: Notice of a potential security incident

Dear Plex User, We have recently experienced a security incident that may potentially involve your Plex account information. We believe the actual impact of this incident is limited; however, action is required from you to ensure your account remains secure.What happened An unauthorized third party accessed a limited subset of customer data from one of our databases. While we quickly contained...

( Read More... | 12 comments | 20 points | on HN )
Re:Why's that company so big? I could do that in a weekend on Monday October 03, 2016 @08:27AM (#12626879)
what about the bus stop broadcasting a signal with the id, name etc? the system is activated by the proximity..so you can have smthing like approaching station A, leaving station A.

it is scalable because the bus-stop transmitters are added , moved, removed as needed.

updating the data can also be done remotely