News for hackers. Stuff that matters.
Re:Show HN: Flyscrape – A standalone and scriptable web scra... by mikercampbell on Saturday November 11, 2023 @12:10PM (#38232152)
Have you seen Crul??

I love the JS flow, but I thought crul was an interesting newer tool!!

But I agree, you gotta get in there and it’s easier with JS

Re:Show HN: Flyscrape – A standalone and scriptable web scra... by sunshadow on Saturday November 11, 2023 @12:41PM (#38232489)
Crul looks nice, though, you cannot imagine how many startups that I've seen failed doing a very similar thing as Crul. Wouldn't rely on it.
Re:Show HN: Flyscrape – A standalone and scriptable web scra... by docyes on Wednesday November 15, 2023 @11:43AM (#38278748)
Thank you for the positive acknowledgment and insightful observation. As one of the creators of Crul, I fully understand the challenges inherent in this intricate business and software domain. Our initial emphasis on the browser abstraction layer, predating APIs such as SOAP, REST, GraphQL, etc., serves as a data driver and stateless cluster for interpreting DOM nodes. While we initially lacked programmatic extensibility for custom browser control, as you rightly pointed out, addressing complex edge cases often requires such a feature. Looking ahead, we are exploring the possibility of opening up the core, starting with "Krull," the browser cluster. We welcome feedback to gauge interest in this development.
Re:Show HN: Flyscrape – A standalone and scriptable web scra... by reyostallenberg on Saturday November 11, 2023 @12:36PM (#38232425)
Can you add a link to it?
Re:Show HN: Flyscrape – A standalone and scriptable web scra... by mdaniel on Saturday November 11, 2023 @02:40PM (#38233755)
I'm sorry to hear that your searches for that very specific name didn't provide the information you were looking for

its show hn: https://news.ycombinator.com/item?id=34970917

tfl: https://www.crul.com/