Re:Show HN: Percollate – a command-line tool to grab web pag...
by danburzo on Friday October 12, 2018 @08:33AM
(#18200958)
Roger that! I'll be adding examples to the README. The main enhancement right now is running the article through Readability, the others are just trying to fetch the best-quality image, and removing some things from Wikipedia articles — so, more of a placeholder for future enhancements :)
[ Parent
| on HN ]
Re:Show HN: Percollate – a command-line tool to grab web pag...
by Ninjaneered on Friday October 12, 2018 @03:20PM
(#18203971)
Speaking of Wikipedia articles, have you checked out their "book creator" [0], it's a link on the left of every page? It has some significant issues [1] and as of now can't be used to download pdfs, it seemed to use an "Offline Content Generator" [2] that became unrepairable. I wonder if something like Percollate could be used as the backend generator for Wikipedia's book creator?
[0] https://en.wikipedia.org/w/index.php?title=Special:Book&book...
[1] https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality
[2] https://www.mediawiki.org/wiki/Offline_content_generator
Re:Show HN: Percollate – a command-line tool to grab web pag...
by danburzo on Friday October 12, 2018 @03:29PM
(#18204038)
I think they're already looking into something similar, either through Electron, or their own wrapper over Chromium. I understand from skimming the resources your linked to that they had reliability issues with Electron, and I can confirm from a separate project that Electron and Puppeteer can become a little slow / unwieldy for a large-scale project. So I'm not sure :/