News for hackers. Stuff that matters.
Re:Terence Tao on GPT-4 by patates on Wednesday April 12, 2023 @09:50AM (#35539643)
I thought what and when to cache was one of the hardest problems in computer science.
Re:Terence Tao on GPT-4 by endisneigh on Wednesday April 12, 2023 @09:51AM (#35539654)
Something like Mastodon is likely 90% reads, or even more. How often is the OP editing their post? When they post, cache it. Kind of like what I did by including it in my original post. Caching is a hard problem because sometimes invalidation results in serious consequences, therefore knowing when to invalidate becomes potentially intractable. In this case there would be few, if any.
Re:Terence Tao on GPT-4 by jibe on Wednesday April 12, 2023 @09:57AM (#35539749)
it was cache invalidation, and naming things. Just throwing stuff in cache is easy.
Re:Terence Tao on GPT-4 by CyberDildonics on Wednesday April 12, 2023 @10:52AM (#35540734)
Why would it be difficult to cache static text?