News for hackers. Stuff that matters.
Re:Recutils – Tools and libraries to access plain text datab... by rwmj on Thursday September 21, 2017 @10:15AM (#15303616)
I guess these are quite slow (because no indexing) once you have a serious number of records? That in itself isn't a problem as long as you understand the scope of the project. I wonder why they didn't use (a well-defined subset of) CSV as the format however.
Re:Recutils – Tools and libraries to access plain text datab... by jdemler on Thursday September 21, 2017 @10:20AM (#15303658)
CSV is neither human-readable nor -writable.

And I don't think the performance issue exists. Computers are fast nowadays. Parsing recfiles is straightforward. Also you could easily archive historic/old/probably irrelevant records.

Re:Recutils – Tools and libraries to access plain text datab... by rwmj on Thursday September 21, 2017 @10:24AM (#15303691)
This is why I was very careful to say "well-defined subset". I wrote a full CSV library[1], and so I'm well aware of how deceptively difficult CSV is to deal with. However with a well-defined subset (and perhaps not using "," as a separator as well) it should be editable for at least simple changes.

[1] https://github.com/Chris00/ocaml-csv

Re:Recutils – Tools and libraries to access plain text datab... by zbuf on Friday September 22, 2017 @04:29PM (#15315517)
CSV locks you to the same fields per data entry, that makes it a little less flexible. Plus one of the appeals for me is readability of the raw data; CSV gets long and thin very quickly. Granted each will best suit a certain type of data.
Re:Recutils – Tools and libraries to access plain text datab... by ComodoHacker on Thursday September 21, 2017 @11:49AM (#15304642)
No built-in indexing, but no one forbids you from indexing text files if you need it.
Re:Recutils – Tools and libraries to access plain text datab... by neuland on Thursday September 21, 2017 @11:51AM (#15304667)
But, any indexing system you create won't work with the rec* tools. For example, `recsel` will not be any faster on large files.

Not sure if they have indexing on the roadmap, but it does make sense to me for people that have adopted it and are starting to get bigger databases.

Of course, you could argue that when the files get too big, it's time to switch to a different solution.

It seems that's kind of a natural tension in projects. Do you grow the scope to accommodate existing users with growing use cases? Or, do you draw the line in the sand and have people move on to a different solution?