Show HN: Crul || Query Any Webpage or API

Re:Show HN: Crul || Query Any Webpage or API by dan_rock_wilson on Tuesday February 28, 2023 @08:29PM (#34977582)

How did you integrate with all those services (the third party service APIs, not asking about the DBs)? I've seen a bunch of sites do this and I'm curious if there's some open source library I should be using, so that I don't need to write from scratch each time I'd like to integrate with another service.

Edit: just saw "airbyte" in a bunch of places, which I assume answers my question. So updated question: airbyte works well for ya?

[ Parent | on HN ]

Re:Show HN: Crul || Query Any Webpage or API by portInit on Tuesday February 28, 2023 @08:47PM (#34977713)

We hand wrote a number of integrations, sometimes it was a simple as reusing a schema with slightly different values, we are also using the awesome https://www.benthos.dev/!

[ Parent | on HN ]

Re:Show HN: Crul || Query Any Webpage or API by dan_rock_wilson on Tuesday February 28, 2023 @09:04PM (#34977828)

Thanks for the info, Benthos has not been on my radar, will check it out.

[ Parent | on HN ]