News for hackers. Stuff that matters.

A comment on Show HN: Extract Markdown, HTML or text from content-heavy websites. Parent comment

Re:Show HN: Extract Markdown, HTML or text from content-heav... by masukomi on Saturday September 10, 2022 @08:03PM (#32795602)
Can you expand on this statement "It costs me only several cents to parse an entire page"? That sounds like quite a lot to me. We're talking _maybe_ a few seconds of compute time (if things are really slow) + a trivial amount of bandwidth.

Are you dividing the monthly hosting costs for a server by total seconds spent actually running this tool? I'm thinking if you did this with an AWS lambda it'd be free (maybe bandwidth cost, but again, trivial) unless you had way, _way_ more use than a single person could reasonably generate. Also, free if you used any of the free hosting services and were just doing it for a small number of users.

[ Parent | on HN ]
Re:Show HN: Extract Markdown, HTML or text from content-heav... by franciscop on Sunday September 11, 2022 @01:11AM (#32797018)
OP here, I've added server timing headers to https://content-parser.com/, the total fetch+parse is taking me around 0.6-1.2s. The local parsing as a separated step is sync, so I expected it to be negligible but it actually takes a good chunk, often 500-700ms! A lot more than I thought/expected here, I haven't seen any backend error yet but at some point might have to move this to a different thread or similar.
[ Parent | on HN ]