Re:Terence Tao on GPT-4
by patates on Wednesday April 12, 2023 @09:50AM
(#35539643)
I thought what and when to cache was one of the hardest problems in computer science.
[ Parent
| on HN ]
Re:Terence Tao on GPT-4
by endisneigh on Wednesday April 12, 2023 @09:51AM
(#35539654)
Something like Mastodon is likely 90% reads, or even more. How often is the OP editing their post? When they post, cache it. Kind of like what I did by including it in my original post. Caching is a hard problem because sometimes invalidation results in serious consequences, therefore knowing when to invalidate becomes potentially intractable. In this case there would be few, if any.
it was cache invalidation, and naming things. Just throwing stuff in cache is easy.
Re:Terence Tao on GPT-4
by CyberDildonics on Wednesday April 12, 2023 @10:52AM
(#35540734)
Why would it be difficult to cache static text?