Show HN: Transform any web page into a document

Re:Show HN: Transform any web page into a document by dredmorbius on Thursday September 01, 2016 @10:45AM (#12405578)

Food for thought:

1. Externally-provided content is dangerous. You might use a hash of the domain name, but I'd avoid files named after the sources.

2. Metadata such as a date would be useful.

3. Despite 1, a highly-sanitised hostname could be informative. An iconv to 8-bit ASCII [-a-zA-Z0-9_], and not allowing the first character to be '-' might be a start. Put a length limit on that as well.

[ Parent | on HN ]

Re:Show HN: Transform any web page into a document by apancyborg on Thursday September 01, 2016 @11:53AM (#12406308)

Thanks, for 1) this is based on extraction not source so very easy to mitigate, 2)right we can include it in the filename.3)we have include most of it in the new updated version online. Thank you very much for your report.

[ Parent | on HN ]