News for hackers. Stuff that matters.
Re:How are Unix pipes implemented? by all2 on Friday March 27, 2020 @04:27PM (#22706538)
Does anyone know how the pipe idea compares to Erlang messaging?

As far as I can tell the implementation of each might look like the other in some ways (a queue of some kind with MutEx guaranteed somehow).

Does anyone have the knowledge to write a little on this? Or maybe point to a similar article for that style of messaging?

Re:How are Unix pipes implemented? by Matthias247 on Friday March 27, 2020 @04:46PM (#22706710)
Pipes are bytes Streams. Communication between actors as well as CSP channels are object streams.

Pipes exercise backpressure on the writer - if the pipe is full the writer is blocked. Actor systems mostly use seemingly unbounded queues. The sender will not get blocked.

Re:How are Unix pipes implemented? by toast0 on Friday March 27, 2020 @09:05PM (#22708330)
> Pipes exercise backpressure on the writer - if the pipe is full the writer is blocked. Actor systems mostly use seemingly unbounded queues. The sender will not get blocked.

Erlang does suspend (block) processes that send to ports or nodes when the buffers for that get full; but not when sending to local processes. There used to be an optional reduction count punishment for senders when sending to messages with larger mailboxes, but it seems that may have been removed. I don't think it would be too hard to add a feature where sending to a local mailbox over a specified size caused the sender to be suspended, but tracking it might be a little difficult.

Re:How are Unix pipes implemented? by wahern on Friday March 27, 2020 @05:03PM (#22706876)
Here's a short 2014 paper from McIlroy himself discussing his early thinking back then: https://www.cs.dartmouth.edu/~doug/sieve/sieve.pdf

TL;DR: McIlroy was applying the concept of coroutines, which was described by Melvin Conway in 1963. Two processes communicating over a pipe are basically coroutines, except instead of passing structured data they're just passing bytes.

A Unix pipeline is a set of multiple coroutines. In fact, Tony Hoare's 1978 Communicating Sequential Processes paper cites the UNIX shell[1] for the concept of coroutines, and discussion of coroutines figures prominently in that paper. See https://www.cs.cmu.edu/~crary/819-f09/Hoare78.pdf CSP basically models the behavior of a large set of coroutines.

AFAIU, Erlang was partly inspired by CSP. You can draw a straight line from coroutines, through Unix pipelines and CSP, to Erlang's processes.

[1] Specifically, Ken Thompson's 1976 paper, "The UNIX command language." See https://archive.org/details/theunixcommandlanguage

Re:How are Unix pipes implemented? by TheGrassyKnoll on Saturday March 28, 2020 @04:54AM (#22710013)
"...a practical exploration of using Python coroutines..."

  http://www.dabeaz.com/coroutines/index.html