Re:Ask YC: How to Build an RSS Aggregator?
by rgrieselhuber on Thursday October 30, 2008 @09:58PM
(#349535)
I've used SimplePie to parse over 20,000 feeds an hour on very modest resources, but there are memory leak issues (in PHP, not SimplePie) that aren't easily resolved in all PHP installations (even with the recommended fix).
You will probably end up having to spawn separate PHP processes to get the throughput if you ever need to parse that amount of feeds (or higher - easy to do once you've solved this problem of course). An upcoming release of PHP is supposed to fix this problem but we'll see.
You will probably end up having to spawn separate PHP processes to get the throughput if you ever need to parse that amount of feeds (or higher - easy to do once you've solved this problem of course). An upcoming release of PHP is supposed to fix this problem but we'll see.