News for hackers. Stuff that matters.
Re:A CSS-Inspired Syntax for Flowcharts by catapart on Monday August 29, 2022 @11:39AM (#32639545)
Oh! Sorry! "Token" is an intermediary object that acts as a sorting category.

So if your markup was:

```

#parentA Start 'Welcome Node'

  #childA /1 "this node has a 
line break, so its content is in quotes"

```

That could be "tokened" as

[

{

tokenType: "ID"

value: "parentA"

decorators: [{ "character": "#", indexes: [0]}]

},

{

tokenType: "CONTENT"

value: "Start"

decorators: null

},

{

tokenType: "TITLE"

value: "Welcome Node"

decorators: [{character: "'", indexes: [0, 13]}]

},

...

]

So it could be that you can read multiple different syntaxes into the same tokenizations.

Like

```

#parentKey parent

#childKey child

#childKey -> #parentKey /north

```

could be equivalent to

```

#parentKey parent

  #childKey child /north
```
Re:A CSS-Inspired Syntax for Flowcharts by tonerow on Monday August 29, 2022 @12:04PM (#32639832)
I see. That's an interesting idea! I can definitely see how tokenization makes filtering parts of the graph easier.