That’s correct. If the post is not hot anymore, continue monitoring new votes wouldn’t have much impact on the sorting, at least not the top ones. And because for sites like HackerNews and Reddit, once it’s not trending enough, it’s rare the upvotes continue to increase a lot. So this is a trade off I think makes sense considering the nature of RSS feed.
Obviously this is something you have thought through, so I assume you just treat item disappearing from the feed as some form of indication it's not "trending" enough from the source point of view. Am I right?