News for hackers. Stuff that matters.
Re:Creepy Crawlies by teo_zero on Sunday August 30, 2026 @10:43AM (#49499104)
But there are "cubic bazillions" of possible URLs that are being requested. Even if they boil down to "only" some millions actual commits, their rendered HTMLs are all different.
Re:Creepy Crawlies by kijin on Sunday August 30, 2026 @11:10AM (#49499351)
Yes, this is very difficult to solve for sites with many URL variations, like git repos and heavily threaded forums. Your cache is always full, but the hit ratio is abysmal.
Re:Creepy Crawlies by oowa on Sunday August 30, 2026 @04:03PM (#49502245)
no its only difficult for you. and only at this moment... any minute now you will see the way. btw, the OP is just saying "its OK for now". And the OP is just telling us: this is what has been happening... maybe its difficult for OP also, but they didnt say that. they just said their current setup cant handle it. old tech...
Re:Creepy Crawlies by oowa on Sunday August 30, 2026 @06:58PM (#49503666)
remember, its only difficult for you. at the end of the day its just 7gb of data...
Re:Creepy Crawlies by oowa on Sunday August 30, 2026 @04:06PM (#49502261)
it can be solved in a few days, just the OP said its ok for now