News for hackers. Stuff that matters.

A comment on Show HN: Mapping almost every law, regulation and case in Australia. Parent comment

Re:Show HN: Mapping almost every law, regulation and case in... by snats on Friday March 22, 2024 @09:12AM (#39790363)
I built a map of all the PDF urls on the internet recently.

I used a tiny embeddings model and PCA for dimensionality reduction.

https://weblog.snats.xyz/posts/2024/03/20/

[ Parent | on HN ]
Re:Show HN: Mapping almost every law, regulation and case in... by ubutler on Friday March 22, 2024 @09:46AM (#39790717)
Interesting, did you try also using PaCMAP or UMAP for dimensionality reduction? It might result in a more meaningful representation of their underlying semantic structure: see the 'mammoth' example in my article.
[ Parent | on HN ]
Re:Show HN: Mapping almost every law, regulation and case in... by snats on Friday March 22, 2024 @12:19PM (#39792171)
No! I only tried PCA, but I still have the embeddings.

I'll try later and post results.

[ Parent | on HN ]
Re:Show HN: Mapping almost every law, regulation and case in... by ProllyInfamous on Saturday March 23, 2024 @10:27AM (#39800167)
Just a UI/UX comment: I cannot read the tiny text on your website's main graphic, on a 43" 4K display.
[ Parent | on HN ]