News for hackers. Stuff that matters.
Re:GNU Shepherd 1.0.0 Released by danudey on Tuesday January 14, 2025 @12:48PM (#42700874)
Taking a quick look at this, the first thing I notice is that the configuration file syntax is obtuse and nigh-illegible unless you already know what things are, and even then it's cumbersome and looks frustrating to write.

e.g. instead of systemd's simple:

    Exec=/path/to/ntpd -n -c /etc/ntpd.conf -u ntpd -g
We have this mess:

    #:start (make-forkexec-constructor
           (list "…/bin/ntpd"
                 "-n" "-c" "/…/…-ntpd.conf" "-u" "ntpd" "-g")
           #:log-file "/var/log/ntpd.log")
They say you don't need to be an expert on guile scheme to build a service file, but it does seem as though you need to know things like what `'(ntpd)` means, which I assumed was some kind of identifier literal, and it seems to be what's called a 'data literal' in scheme, but I had to google to discover that since the actual guile scheme documentation didn't seem to explain that syntax at all.

I get that there are benefits to being able to do more advanced scripting in a service file, but this seems like a classic example of programmers writing things for programmers and not for users (or at least, not for users who don't 'get it').

Going to chalk this up as another 'GNU reimplemented something badly because of NIH syndrome' incident and move on.

Re:GNU Shepherd 1.0.0 Released by uludag on Tuesday January 14, 2025 @01:28PM (#42701572)
I think this may be just due to unfamiliarity. Like, if that mess you shared was written as follows:

  {
    start: makeForkexecConstructor(["…/bin/ntpd", "-n", "-c", "/…/…-ntpd.conf", "-u", "ntpd", "-g"]),
    logFile: "/var/log/ntpd.log"
  }
this wouldn't bat an eye. Even though I've never used Guile, just familiarity with Elisp makes that example pretty straightforward. Lisp-adjacent people would all pretty quickly grok this I presume.

And I think it's also hard to claim that one is better than the other. I personally have gotten my feet wet with Guix and I would love the time to become more familiar it.

Re:GNU Shepherd 1.0.0 Released by packetlost on Tuesday January 14, 2025 @03:11PM (#42703147)
Eh, I'm a Schemer (not Guile though) but the above is dramatically less readable and, at a glance, understandable than the equivalent systemd .target file. The problem with Lisps (but especially Schemes) is there's magic everywhere that makes no sense without having a sizeable context of the program you're working in.
Re:GNU Shepherd 1.0.0 Released by Bootvis on Tuesday January 14, 2025 @03:52PM (#42703678)
IMO in this example there seems too be to little magic.
Re:GNU Shepherd 1.0.0 Released by yencabulator on Tuesday January 14, 2025 @04:39PM (#42704259)
I would definitely bat an eye at "make fork exec constructor", regardless of what syntax sugar you sprinkle on that abomination.
Re:GNU Shepherd 1.0.0 Released by ebilgenius on Tuesday January 14, 2025 @06:32PM (#42705418)
While I agree it's hard to claim one is outright better than the other and there are a lot of factors that go into it, I do feel it's important to toss my chip in as someone who's not familiar with Lisp, Scheme, or any other functional language that I find it's syntax and layout particularly difficult to parse, let alone get started with compared to say, the INI-inspired systemd conf files. I can detail why but the mere fact that I'd have to learn an entire functional programming language (no matter how "easy/simple" it's claimed to be) to be able to competently edit a service file is a huge immediate turn-off for me.
Re:GNU Shepherd 1.0.0 Released by Pay08 on Wednesday January 15, 2025 @03:35PM (#42716567)
This is very basic Scheme syntax (plus Guile's keyword argument extension), nothing advanced and definitely not all of Scheme.
Re:GNU Shepherd 1.0.0 Released by rmgk on Wednesday January 15, 2025 @05:37AM (#42709444)
I don’t think this is about lisp syntax.

The systemd variant uses one of the universal DSLs for key-value pairs (key=value) and the universal DSL for calling programs (program name, space separated list of arguments).

The latter is even the same syntax that lisp uses for functions calls – thus I would argue the systemd config file looks more like a lisp program than the Guix version does.

As a person that has seen a reasonable amount of sexpression, this is what I would not bat an eye at:

(start /path/to/ntpd -n -c /etc/ntpd.conf -u ntpd -g)

Re:GNU Shepherd 1.0.0 Released by Pay08 on Wednesday January 15, 2025 @03:34PM (#42716545)
It is also strictly less powerful because of that, often needing to launch bash scripts instead of the programs directly.
Re:GNU Shepherd 1.0.0 Released by rmgk on Thursday January 16, 2025 @11:50AM (#42727707)
I understand this as systemds config being less powerful than using Guile?

If so, I fully agree, on the config being less powerful.

Maybe let me add to my original argument, because it does not seem to make it’s point well.

I think that it would be feasible (and worthwhile) to simplify the configuration structure while keeping Guile syntax, and have the complaint be a non issue. As opposed to keeping the semantic structure and just changing the syntax as the comment I replied to proposed.

Re:GNU Shepherd 1.0.0 Released by bmacho on Wednesday January 15, 2025 @07:11PM (#42719147)
> and the universal DSL for calling programs (program name, space separated list of arguments).

Yeah, don't do that. Both the program name, and the arguments can and do contain spaces. Do instead what every other languages do, that is, use a list of strings to invoke programs.

> The latter is even the same syntax that lisp uses for functions calls

No it's not.

Re:GNU Shepherd 1.0.0 Released by rmgk on Thursday January 16, 2025 @12:49PM (#42728449)
The way that this syntax (see bash, zsh, fish, etc) usually work is that these lists are separated by spaces. You can still quote arguments if they contain spaces (or escape the spaces).

Choosing space for a very common thing in your language often makes sense, as you reduce the amount of visual elements. Thus space is often used to apply arguments to functions. Lisp and Haskell are common examples Though, you could argue that in Lisp it only is an application if it is within parenthesis.

Re:GNU Shepherd 1.0.0 Released by kazinator on Thursday January 16, 2025 @04:31PM (#42731155)
Lisp looks like it uses spaces, but that's only when we look at certain kinds of tokens that are terminated by whitespace, like numbers and symbols.

So (ls -l .foo) is a three element list of symbols in Common Lisp or Scheme, sure.

Symbols are not strings though; we don't necessarily want to use symbols this way. For one thing, they get interned. That means they stick around forever, or until explicitly uninterned. The symbols are memorized so that the next time they appear, the same object is returned (almost always implemented as a pointer to the same symbol).

String tokens use mandatory double quotes: ("ls" "-l" ".foo")

Re:GNU Shepherd 1.0.0 Released by bmacho on Friday January 17, 2025 @03:29AM (#42735275)
> The way that this syntax (see bash, zsh, fish, etc) usually work is that these lists are separated by spaces.

And programming languages that have variables, string type, and function calls do the opposite. In C, Python, JavaScript etc, in order to start a program you make a function call with a list of strings.

> Choosing space for a very common thing in your language often makes sense,

Not interpreting space separated things as strings but as keywords (built ins, variable names, literals) makes more sense for bigger programs.

Re:GNU Shepherd 1.0.0 Released by blueflow on Tuesday January 14, 2025 @01:17PM (#42701404)
I vaguely learned lisp years ago and i already prefer the guile scheme over systemd - guile correctly takes an argument vector instead of a command string which needs to be split using some obtuse shell quoting rules.

Having the shell taken out of the equation is what Lennart promised but never delivered.

Re:GNU Shepherd 1.0.0 Released by n8henrie on Tuesday January 14, 2025 @02:32PM (#42702547)
Interesting take. As a hobbyist, I get special characters and escapes wrong in systemd all the time, because they try to look like regular shell but aren't. And systemd-escape (or whatever it's called) just makes an ugly mess that makes it hard for me to read.

I don't know lisp, but the idea of having each argument be part of a list (kind of like launchd's xml format) resonates with me.

Re:GNU Shepherd 1.0.0 Released by vvillena on Tuesday January 14, 2025 @01:29PM (#42701599)
You don't have to be an expert, but knowing the basics of Lisp helps. The full definition of the example "ntpd" service is clear to read.

> the actual guile scheme documentation didn't seem to explain that syntax at all

It does, here: https://www.gnu.org/software/guile/manual/html_node/Expressi...

It's a basic concept of Lisp. Everything is evaluated, unless quoted. Code is data is code!

Re:GNU Shepherd 1.0.0 Released by baq on Tuesday January 14, 2025 @01:30PM (#42701621)
> Code is data is code!

Which nowadays is 'yaml is code is yaml is code is yaml' in the devops world. The wheel turns.

Re:GNU Shepherd 1.0.0 Released by davexunit on Tuesday January 14, 2025 @02:26PM (#42702447)
I tell ya, it was sometimes difficult to be a lisp guy doing devops full-time.
Re:GNU Shepherd 1.0.0 Released by nine_k on Tuesday January 14, 2025 @02:16PM (#42702305)
...only with more parsing gotchas :(
Re:GNU Shepherd 1.0.0 Released by teddyh on Tuesday January 14, 2025 @01:14PM (#42701365)
> the actual guile scheme documentation didn't seem to explain that syntax at all.

  (quote data)
  'data
Quoting is used to obtain a literal symbol (instead of a variable reference), a literal list (instead of a function call), or a literal vector. ' is simply a shorthand for a quote form. For example,

  'x                   ⇒ x
  '(1 2 3)             ⇒ (1 2 3)
  '#(1 (2 3) 4)        ⇒ #(1 (2 3) 4)
  (quote x)            ⇒ x
  (quote (1 2 3))      ⇒ (1 2 3)
  (quote #(1 (2 3) 4)) ⇒ #(1 (2 3) 4)
Note that an application must not attempt to modify literal lists or vectors obtained from a quote form, since they may be in read-only memory.

— <https://www.gnu.org/software/guile/manual/html_node/Expressi...>

Re:GNU Shepherd 1.0.0 Released by f1shy on Tuesday January 14, 2025 @01:18PM (#42701429)
The system is integrated into Guix, so makes sense to use s-exp for the configuration.

Systemd has done things that previously were trivial very difficult. I would like to know how it fares in that arena. The syntax can just be learned.

Re:GNU Shepherd 1.0.0 Released by baq on Tuesday January 14, 2025 @01:29PM (#42701602)
Guile has been the scripting language of choice for GNU before the Internet was called Internet. It hasn't even been disliked, it's been simply ignored, for the most part.
Re:GNU Shepherd 1.0.0 Released by kstrauser on Tuesday January 14, 2025 @01:43PM (#42701838)
I know that's true, having heard it talked about a lot over the years. But why, though? What is it about Guile that made GNU pick it over CL or Scheme (or TCL or Lua or...)?

NM, answered my own question. It’s literally Scheme.

Re:GNU Shepherd 1.0.0 Released by pkkm on Tuesday January 14, 2025 @06:38PM (#42705475)
> TCL

I actually know the answer to that one!

> The principal lesson of Emacs is that a language for extensions should not be a mere "extension language". It should be a real programming language, designed for writing and maintaining substantial programs. Because people will want to do that!

> Another lesson from Emacs is that the way to make sure an extension facility is really flexible is to use it to write a large portion of the ordinary released system. If you try to do that with Tcl, you will encounter its limitations.

> Tcl was not designed to be a serious programming language. It was designed to be a "scripting language", on the assumption that a "scripting language" need not try to be a real programming language. So Tcl doesn't have the capabilities of one. It lacks arrays; it lacks structures from which you can make linked lists. It fakes having numbers, which works, but has to be slow.

From Why you should not use Tcl by Richard Stallman [1].

[1] https://vanderburg.org/old_pages/Tcl/war/0000.html

Re:GNU Shepherd 1.0.0 Released by kstrauser on Tuesday January 14, 2025 @07:56PM (#42706067)
Brilliant. That's exactly the kind of information I was missing. I don't know enough about Tcl to opine on whether he was right, but if that's what RMS thought about it, I can see why he'd push back hard against it..
Re:GNU Shepherd 1.0.0 Released by Pay08 on Wednesday January 15, 2025 @03:41PM (#42716630)
Guile is an implementation of Scheme. As for why not CL, Stallman has expressed his dislike for CL, especially as a scripting language a lot of times over the years. Which is pretty funny because a lot of the criticisms he has about it (like the namespace system and keyword arguments) are in Guile now.
Re:GNU Shepherd 1.0.0 Released by IshKebab on Tuesday January 14, 2025 @02:38PM (#42702640)
To be fair the Guile one is properly quoted and specifies the log file. make-forkexec-constructor is a really terrible name though, and Guile is a poor choice.
Re:GNU Shepherd 1.0.0 Released by NeutralForest on Tuesday January 14, 2025 @01:31PM (#42701627)
I mean, they're pretty much the same right? You can't abstract away the services and you need to pass arguments to the executable (ntpd in this case).

I don't see more or fewer issues, but I also don't see the value to using Scheme instead of a conf. file like format.

At the end, there's talk about adding the possibility to live reconfigure services, which is pretty cool but I don't really see what kind of users are targeted by that use-case, at least not regular users like me who's running Linux on a single laptop.

The link at the end (https://spritely.institute/news/spritely-nlnet-grants-decemb...) is IMO much more interesting since it would make it possible to orchestrate several machines and their services as well. If you have live reloading as well, I think it would make for good developer experience.

My main gripe with Guile is its ergonomics and tooling: no LSP, no linter, no step-debugger that I know of and the docs are often unhelpful imo.

Maybe I'm not Scheme brained enough but I think it's a shame because there are some really cool projects out there (anything https://spritely.institute/ really).

P.S: I know that some people will tell me to get used to REPL based development which I think is fine for small-ish projects but I can't understand the flow one uses for larger projects where many components might need to talk to each other.

Re:GNU Shepherd 1.0.0 Released by choobacker on Tuesday January 14, 2025 @04:46PM (#42704343)
I agree systemd's is easier to understand, and I'm a happy systemd user.

But some of Shepherd's strengths are in other examples, and it makes sense to evaluate the whole.

A few examples:

* if we want multiple similar services, I'd prefer writing a Guile function than using systemd templates.

* the above Shepherd guile code lives lexically alongside your wider Guix guile code. AST-aware syntax highlighting and refactoring tools would treat them the same. That's pretty neat and beats having two different languages. Guix calls this g-expressions.

This "one language for all your system" is pretty compelling, but Guix's feature set is a bit too far behind NixOS at the moment for me.

Re:GNU Shepherd 1.0.0 Released by zamalek on Tuesday January 14, 2025 @06:22PM (#42705318)
> NIH syndrome

I would be using nonGuix if it booted on my machine (libre seemingly has its claws too deep), instead of Nix, precisely because Guix has far less NIH: Nix is homegrown everything. Guile was a pre-existing project (for both Guix and The Shepherd), for a pre-existing language family.

Re:GNU Shepherd 1.0.0 Released by Pay08 on Wednesday January 15, 2025 @03:39PM (#42716610)
If you ever want to return to it, the nonguix ISO can be notoriously buggy. A better approach is to use the normal Guix ISO with an ethernet cable during installation and while setting up nonguix and your drivers.
Re:GNU Shepherd 1.0.0 Released by atlintots on Thursday January 16, 2025 @10:15PM (#42733719)
i don't have access to an ethernet cable
Re:GNU Shepherd 1.0.0 Released by kazinator on Thursday January 16, 2025 @03:27AM (#42722832)
Why do we use the list function, when all the arguments are literal string objects? That wants to be a quoted literal list like this:

  '("…/bin/ntpd"
    "-n" "-c" "/…/…-ntpd.conf"
    "-u" "ntpd" "-g")
Why isn't the configuration language mainly declarative, with executable Scheme only available other escape hatch to use as an exception rather than the rule?

I don't want to worry about list versus quote in a configuration language, because they shouldn't be evaluation going on, or not by default.