Re:Useful Unix commands for exploring data
by barrkel on Wednesday August 27, 2014 @01:03PM
(#8233227)
The problem is that the most obvious way of doing it - File.readlines('foo.txt').map { ... }.select { ... } etc. - is not stream-oriented.
Re:Useful Unix commands for exploring data
by riffraff on Wednesday August 27, 2014 @04:59PM
(#8234684)
arguably, it's trivial to make that stream oriented
open('tmp.rb').each_line.lazy.map {...}.select {...}
the problem with processing big files with ruby (in my humble experience) is usually that it's still slow enough that "preprocessing with grep&uniq" is worthwhile.
Re:Useful Unix commands for exploring data
by barrkel on Thursday August 28, 2014 @05:19AM
(#8236493)
> open('tmp.rb').each_line.lazy
NoMethodError: undefined method `lazy' for #<Enumerator: #<File:Procfile>:each_line>
Not everybody is using Ruby 2.0.
check out yield and blocks