Re:Show HN: Transform any web page into a document
by dredmorbius on Thursday September 01, 2016 @10:45AM
(#12405578)
Food for thought:
1. Externally-provided content is dangerous. You might use a hash of the domain name, but I'd avoid files named after the sources.
2. Metadata such as a date would be useful.
3. Despite 1, a highly-sanitised hostname could be informative. An iconv to 8-bit ASCII [-a-zA-Z0-9_], and not allowing the first character to be '-' might be a start. Put a length limit on that as well.
Re:Show HN: Transform any web page into a document
by apancyborg on Thursday September 01, 2016 @11:53AM
(#12406308)
Thanks, for 1) this is based on extraction not source so very easy to mitigate, 2)right we can include it in the filename.3)we have include most of it in the new updated version online. Thank you very much for your report.
For the Instataper pages that fail if you could send us some domain name you wish : hn at documentcyborg.com and we will test the parser against it to make sure it works.