Whatever your issue was, it most likely has to do with our query planning or lack of indexes. I've used sqlite with success on many gigabyte datasets.