News for hackers. Stuff that matters.
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by amckinlay on Sunday July 15, 2018 @03:14PM (#17536545)
Still wish the Linux kernel had zero-copy IPC with pipes. vmsplice(1) can zero-copy data into the pipe, but the destination process cannot vmsplice(1) the data out of the pipe without incurring a copy.
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by en4bz on Sunday July 15, 2018 @05:13PM (#17537111)
Modifying virtual mappings tends to be just as expensive as copying.
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by voidlogic on Monday July 16, 2018 @01:43AM (#17539022)
I'd be curious to see if this is still true with large page sizes and to see on current processors where the cross over point is.
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by gpderetta on Sunday July 15, 2018 @09:01PM (#17538027)
I've never tried it, but shouldn't you be able to vmsplice into the pipe, splice from pipe to an actual file and mmap the file? Probably the cost of the additional splice call offsets the saved copy.

It is possible to implement a simple shared memory queue which does not requires syscalls unless empty or full, and the time saved avoiding system calls (and expensive VM manipulation) might be more than the cost of copying data in and out for many applications.

Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by LukeShu on Sunday July 15, 2018 @04:16PM (#17536829)
The paper mentions that the source code is available at netstreamline.net, which is now a spam domain. Here's the most recent IA link:

https://web.archive.org/web/20130624173559/http://netstreaml...

If the topic of the paper is interesting to you, you will likely be interested in other parts of the Streamline project.

Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by justinjlynn on Monday July 16, 2018 @02:46AM (#17539245)
Looks like it's been re-hosted to university services:

https://www.cs.vu.nl/~herbertb/projects/streamline/index.htm...

Unfortunately, it appears that the institution's internal project hosting system (that would hold the source code I'm after) is down -- I suppose an e-mail to the department would be in order.

Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by navaati on Sunday July 15, 2018 @12:46PM (#17535967)
This is probably very interesting but I would need to pay for access to the article...
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by jbapple on Sunday July 15, 2018 @12:57PM (#17536004)
Second Google hit when searching for the paper title:

https://www.cs.vu.nl/~herbertb/papers/osreview2008-2.pdf

Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by navaati on Sunday July 15, 2018 @04:22PM (#17536862)
Oh thanks !
Re:PipesFS: Fast Linux I/O in the Unix Tradition (2008) by htor on Sunday July 15, 2018 @01:59PM (#17536246)
ooh, this sounds wicked cool! unix pipelines and unix tools is what made me like computers.