How fast are Linux pipes anyway?

Re:How fast are Linux pipes anyway? by mg on Thursday June 02, 2022 @08:54AM (#31594213)

Your node version indeed did not crash. Tried for 2 minutes.

But using a longer string crashed after 23s here:

    node -e 'function write() {process.stdout.write("1111111111222222222233333333334444444444555555555566666666667777777777888888888899999999990000000000"); process.nextTick(write)} write()' | pv > /dev/null

[ Parent | on HN ]

Re:How fast are Linux pipes anyway? by capableweb on Thursday June 02, 2022 @08:59AM (#31594266)

Hm, strange. With the same out of memory error as before or a different one? Tried running that one for 2 minutes, no errors here, and memory stays constant.

Also, what NodeJS version are you on?

[ Parent | on HN ]

Re:How fast are Linux pipes anyway? by mg on Thursday June 02, 2022 @09:03AM (#31594316)

Yes, same error as before. Memory usage stays the same for a while, then starts to skyrocket shortly before it crashes.

node is v10.24.0. (Default from the Debian 10 repo)

[ Parent | on HN ]

Re:How fast are Linux pipes anyway? by capableweb on Thursday June 02, 2022 @09:17AM (#31594478)

Huh yeah, seems to be a old memory leak. Running it on v10.24.0 crashes for me too.

After some quick testing in a couple of versions, it seems like it got fixed in v11 at least (didn't test any minor/patch versions).

By the way, all versions up to NodeJS 12 (LTS) are "end of life", and should probably not be used if you're downloading 3rd party dependencies, as there are bunch of security fixes since then, that are not being backported.

[ Parent | on HN ]

Re:How fast are Linux pipes anyway? by captn3m0 on Thursday June 02, 2022 @10:29AM (#31595336)

I used this exact issue today while pointing out how Debian support dates can be misleading as packages themselves aren’t always getting fixes: https://github.com/endoflife-date/endoflife.date/issues/763#...

[ Parent | on HN ]