Regarding the lifetime of a site, it might be possible to submit requests to the Internet Archive or similar service whenever a site is added to a directory or a new post is found on it. That way too, it would be easier to see when a site is no longer active or when it turned into something else. Then, when it's deactivated, the web directory could just point to the archive first