Gonix – Unix tools written in Go

Re:Gonix – Unix tools written in Go by danieldk on Saturday May 09, 2015 @02:38AM (#9515729)

You mean bufio.ReadLine? As the documentation says, it's low-level, since you have to do the buffer allocation yourself. ReadBytes/ReadString are nicer interface-wise, but it allocates new buffers on every call.

I like Scanner because it provides a nice high-level interface, but still maintains an internal buffer, reducing GC pressure. Of course, it's not one size fits all.

[ Parent | on HN ]

Re:Gonix – Unix tools written in Go by polegone on Saturday May 09, 2015 @03:06AM (#9515760)

I tested it by on a several megabyte text file (not that large) and I can see a huge improvement in speed when I use a reader vs. loading the whole thing into memory as I did at first.

I can see now how much of a difference it can make on a really large file, like in the gigabyte range.

BTW, I deleted my earlier comment because the problem I had wasn't anything to do with bufio. I had just made an obvious mistake elsewhere in my code, which I've fixed now.

[ Parent | on HN ]