News for hackers. Stuff that matters.
Re:I have 6.000.000 RSS articles in a DB. What can I do? by gbog on Thursday June 21, 2012 @06:39AM (#4141289)
> the db is getting large and difficult to handle.

Did your store the raw content in the database? If so, you might consider writing files instead. These blobs, like pictures, are better stored as files. In your database, you should keep relational data: url, time, adder, etc, properly indexed (probably by adder, time and maybe keywords). Then a 6M rows table is quite a small thing for any RDBMS (if your SELECTs are filtering on indexed columns).

Re:I have 6.000.000 RSS articles in a DB. What can I do? by robertpohl on Thursday June 21, 2012 @06:46AM (#4141306)
Good idea! When i'm importing the raw data I add it to lucene to make similar-articles-matching, but after that it could be dumped to text.