News for hackers. Stuff that matters.
Re:Monolith – CLI tool for saving complete web pages as a si... by darkteflon on Sunday March 24, 2024 @07:51PM (#39811601)
SingleFile is amazing - use it tens of times every day across desktop and mobile. Can’t recall a single instance of it breaking. Thank you sincerely for your excellent work.
Re:Monolith – CLI tool for saving complete web pages as a si... by gildas on Sunday March 24, 2024 @08:03PM (#39811672)
Thanks a lot! Believe me, there have been a lot of bugs (+900 issues closed today) because it's hard to save a web page actually. You were lucky not to suffer ;)
Re:Monolith – CLI tool for saving complete web pages as a si... by darkteflon on Sunday March 24, 2024 @10:15PM (#39812313)
I bet! The proof of that must surely be in how poor a job formats like .webarchive do of it.

SingleFile just makes this one really complex, really important thing trivially easy, and in a portable format. For anyone curating a knowledge base it’s an absolute godsend.

I didn’t see any donation instructions on your GitHub - I for one would certainly love to chip in if you could point me in the right direction?

Re:Monolith – CLI tool for saving complete web pages as a si... by gildas on Monday March 25, 2024 @07:23AM (#39814871)
You can find links to sponsor the project here [1] in the section "Sponsor this project" at the bottom right of the page.

[1] https://github.com/gildas-lormeau/SingleFile

Re:Monolith – CLI tool for saving complete web pages as a si... by samstave on Sunday March 24, 2024 @08:37PM (#39811849)
May you please share what workflow is having you do this so much each day?

What do?

Re:Monolith – CLI tool for saving complete web pages as a si... by darkteflon on Sunday March 24, 2024 @10:10PM (#39812296)
Sure!

I use SingleFile to save a copy of every article / post / SO & forum discussion I find interesting or useful. I sort them into two buckets: work, and not-work.

I’ve been doing this for 10+ years (before SingleFile I used things like .pdf, plain .html, .webarchive files - although these all have drawbacks).

In the pre-LLM era, I would then interface with these almost exclusively through a search front-end. I use Houdahspot on Mac and easySearch on iOS. That lets me see everything interesting I’ve read on a particular subject just by typing it in (with the usual caveats that apply to basic keyword search - although in practice that alone has proven very effective). Because it’s just a folder of essentially zipped .html files, there’s no lock-in.

Now that we’ve got LLMs, I plug those 10+ years of files straight into my RAG pipeline using llama-index. It’s quite nice :)

Re:Monolith – CLI tool for saving complete web pages as a si... by felipefar on Sunday March 24, 2024 @10:43PM (#39812439)
Sorry for the ignorance, but if the forum posts require login to access then you won't be able to use SingleFile, right?

Also, how is the quality of the output generated compared to a .pdf? I'm used to print PDFs from chrome for articles that I want to save, but the layout can become awkward sometimes, and navigation bars can appear several times and hide portions of the text.

I like this feature from chrome, but it's not consistently reliable.

Re:Monolith – CLI tool for saving complete web pages as a si... by freedomben on Monday March 25, 2024 @12:25AM (#39812852)
If you use the browser extension, then pages requiring login are no problem because you are already logged in.

The output compared to PDF is like night and day. It is high Fidelity versus low Fidelity. At this point now, I only use PDF if for some reason I need it

Re:Monolith – CLI tool for saving complete web pages as a si... by tfsh on Monday March 25, 2024 @07:51AM (#39815121)
SingleFile operates in the context of your browser, so it scrapes files with your cookie jar meaning you will be authenticated and specifically it'll scrape files as you see them.

In most cases SingleFile outputs looks identical to the real thing. Though I generally only use it on simpler sites such as recipes and technical blogs.

Re:Monolith – CLI tool for saving complete web pages as a si... by profsummergig on Sunday March 24, 2024 @09:00PM (#39811972)
How do you use it on mobile? Is there an app for it? I don't see it on the Google Play store.
Re:Monolith – CLI tool for saving complete web pages as a si... by gildas on Sunday March 24, 2024 @09:11PM (#39812036)
It's officially available on Firefox for Android [1] and Safari [2] on mobile. You might also be able to use it with Kiwi Browser [3] on Android.

[1] https://addons.mozilla.org/android/addon/single-file/

[2] https://apps.apple.com/app/singlefile-for-safari/id644432254...

[3] https://play.google.com/store/apps/details?id=com.kiwibrowse...

Re:Monolith – CLI tool for saving complete web pages as a si... by alpacca-farm on Sunday March 24, 2024 @09:32PM (#39812147)
Just stumbled across Monolith and SingleFile recently and it's fascinating to see how these tools approach the challenge of web archiving in different ways. SingleFile seems to be a powerhouse, especially for those who rely heavily on JavaScript-laden pages. The ability to produce smaller pages and even generate ZIP files is pretty handy for content archiving and sharing.

That said, Monolith's approach of not requiring a web browser could be a game changer for simpler projects or where installing a Chromium-based browser isn't viable. It strikes me as a more straightforward, lightweight solution, albeit with the clear trade-off of not supporting JavaScript.

Has anyone run into situations where one tool clearly outperformed the other in real-world usage? I'm particularly curious about the impact on performance and convenience when choosing between these two, especially for mobile use. Also, kudos to the authors and contributors of these tools. The tech community benefits greatly from such innovations that help preserve and share knowledge.

Re:Monolith – CLI tool for saving complete web pages as a si... by supriyo-biswas on Monday March 25, 2024 @12:42AM (#39812924)
Is this a LLM generated comment? The structure of this response seems to be too close to the “while X, it’s also important to Y” construction that LLMs like to use.

Anyway, to answer your question, lots of pages need JS to work correctly, so using Singlefile is the better option.

Re:Monolith – CLI tool for saving complete web pages as a si... by alpacca-farm on Tuesday March 26, 2024 @08:12PM (#39834333)
Haha, ouch. Sadly not, but I'll have to work on how I come across in the future. Thanks for the answer!
Re:Monolith – CLI tool for saving complete web pages as a si... by voltaireodactyl on Monday March 25, 2024 @02:50AM (#39813352)
Anybox (on Mac and ios) also supports SingleFile, presenting as a WebDAV server for archives to be saved. It’s flawless and hugely convenient in my experience.