News for hackers. Stuff that matters.
Re:Show HN: Benthos Studio – A modern take on Yahoo Pipes by dchuk on Wednesday November 23, 2022 @03:44PM (#33724298)
I like the playful vibe of the site, but it’s incredibly unclear what this actually is. Needs more specific description of the problems being solved.
Re:Show HN: Benthos Studio – A modern take on Yahoo Pipes by mihaitodor on Wednesday November 23, 2022 @04:06PM (#33724528)
Benthos Studio is an application that provides visual editing capabilities to the Benthos (https://www.benthos.dev) stream processor, which lets you craft and test yaml-based configurations that you can then run using Benthos.

Benthos itself is a stateless command line (CLI) app written in Go. It supports quite a few types of "macro" building blocks (aka components) which are various flavours of inputs, outputs, processors, caches, rate limits, buffers, metrics, tracers and loggers. The most important processor is the `mapping` one which lets you execute Bloblang code against each message which passes through it. Bloblang is a functional programming language embedded in Benthos as a DSL for manipulating structured data. You can read more about it over here: https://www.benthos.dev/docs/guides/bloblang/about Also, if you'd like to use it outside of Benthos, you can import it as a library: https://pkg.go.dev/github.com/benthosdev/benthos/[email protected]/...

Since I mentioned importing Bloblang as a library, you can import the entire Benthos framework as a library and inject your own custom plugins to create a custom Benthos build with whatever components and extra functionality you need. It's also a great way to slim down the existing distribution and only import the components that you require. See some examples here: https://github.com/benthosdev/benthos-plugin-example

Re:Show HN: Benthos Studio – A modern take on Yahoo Pipes by bunkertor on Wednesday November 23, 2022 @07:14PM (#33726239)
why is Pulsar disabled?
Re:Show HN: Benthos Studio – A modern take on Yahoo Pipes by mihaitodor on Wednesday November 23, 2022 @07:22PM (#33726300)
Some history here https://github.com/benthosdev/benthos/issues/1184#issuecomme... but the TL; DR version is that the client library has caused a bit of friction in the past. They had several releases where one of its dependencies produced various compiler warnings and there was this dbus zombie processes issue which caused some concern... However, if you wish to run this at scale in production, you might want to look at https://github.com/benthosdev/benthos-plugin-example and craft your own custom Benthos build, where you import just the components you need, such as the Pulsar ones.
Re:Show HN: Benthos Studio – A modern take on Yahoo Pipes by jeffail on Wednesday November 23, 2022 @03:54PM (#33724397)
Yeah that's my bad, the site assumes you already know what benthos is as it's an early stages UI for it. The best place to start is https://www.benthos.dev, or if you like dumb videos: https://youtu.be/88DSzCFV4Ng