oowa
Re:Creepy Crawlies
on Sunday August 30, 2026 @07:02PM (#49503688)
TLDR basically old tech is not optimized for scrapers / slurpers / etc. to the point it would take 42^n to solve all possible combinations. Why? Murphy's law. Solution for OP is to ignore for now. Otherwise Use or invent something else. Easy enough. other notes... Anubis and other gatekeepers dont work perfectly, but ok for now.
Re:Creepy Crawlies
on Sunday August 30, 2026 @06:58PM (#49503666)
remember, its only difficult for you. at the end of the day its just 7gb of data...
Re:Creepy Crawlies
on Sunday August 30, 2026 @04:06PM (#49502261)
it can be solved in a few days, just the OP said its ok for now
Re:Creepy Crawlies
on Sunday August 30, 2026 @04:03PM (#49502245)
no its only difficult for you. and only at this moment... any minute now you will see the way. btw, the OP is just saying "its OK for now". And the OP is just telling us: this is what has been happening... maybe its difficult for OP also, but they didnt say that. they just said their current setup cant handle it. old tech...
Re:Creepy Crawlies
on Sunday August 30, 2026 @04:02PM (#49502239)
using the current solution and a cache pattern doesnt solve it, but it is an "affordable" solvable problem. but first we need to ignore OP said its ok for now...
Re:Creepy Crawlies
on Sunday August 30, 2026 @04:00PM (#49502219)
anyway, I have solved this exact scenario many times in the last 30 years... thanks for the dv
Re:Creepy Crawlies
on Sunday August 30, 2026 @03:56PM (#49502180)
what a beehive of activity here. he said its ok for now. he said its not exactly his responsibility. and almost all the comments well..
Re:Creepy Crawlies
on Sunday August 30, 2026 @11:38AM (#49499648)
i think its only 7gb of data total, therefore there should be a strategy to fully optimize for this deterministic scenario, but instead of caching instead with maybe compiled streaming renderer(s)... but he said its ok for now.. and anyway why should they need to fix anything, the slurp is what sucks. pun intended
Re:Creepy Crawlies
on Sunday August 30, 2026 @11:33AM (#49499595)
he said its fast enough for now actually...
Re:Amazon Is Awash with AI-Written Guideslop for Games That Aren't Eve...
on Monday June 29, 2026 @01:52PM (#48722613)
thanks, Kotaku is dogshhhhh
Re:German ruling declares Google liable for false answers in AI Overviews
on Tuesday June 09, 2026 @11:00PM (#48470854)
that would be hela curryketchup nice