News for hackers. Stuff that matters.
Re:Show HN: Mapping almost every law, regulation and case in... by mg on Friday March 22, 2024 @04:30AM (#39788517)
This is great. This sentence struck a chord with me in particular:

    Imagine applying these techniques on the Common Crawl
    You would be able to produce a ... map of the internet.
Making maps of things not usually on maps has been my passion for years. And I made many of them. One of the more popular ones that some of you might know is the Music-Map:

https://www.music-map.com

I have had the urge to make a map of the web for quite a while. Already registered the web-map.com domain for it. I did some experiments, built a custom crawler and an algorithm which finds related websites fast. It showed that the project would be feasible.

But I hold back on doing it, because I already run multiple experimental maps and have yet to come up with a business model for "making maps of everything".

Re:Show HN: Mapping almost every law, regulation and case in... by vsnf on Friday March 22, 2024 @05:19AM (#39788793)
I had something similar once - it was a graph of connections between all the artists in my Spotify library to see who had collab'd with who. It was a lot of fun to see just how distantly connected two artists were through a long chain of collabs and collabs. Of course, like most human connection maps, it mostly came down to a handful of super-connectors who collaborate with hundreds of people, who in turn collaborate with their own niche groups. But there were some interesting groups revealed by it.
Re:Show HN: Mapping almost every law, regulation and case in... by dylan604 on Friday March 22, 2024 @04:04PM (#39794269)
I was halfway expecting a 6-degree to Kevin Bacon reference here. Disregarding the actual Bacon, I was almost hoping a similar effect from any 2 artists can be connected in 1 Bacon or less
Re:Show HN: Mapping almost every law, regulation and case in... by vsnf on Saturday March 23, 2024 @05:23AM (#39798572)
Some artists had very long chains, n >= 8 between them. But a lot of artists either never collaborate at all, or only collaborate with a specific group of people. Usually that group of people is a very niche sub-sub-genre of music, like bubblegum phonk.

That being said, this was an analysis of my own library, and I didn't grab the entire discography of every artist.

Re:Show HN: Mapping almost every law, regulation and case in... by ubutler on Friday March 22, 2024 @05:44AM (#39788912)
Thanks for sharing that map, I’m going to start using it to discover new artists :)

I’d love to see a semantic map of the internet, I’m considering having a crack it as well, but it’d be a monumental task. There is this cool map but it’s quite dated: http://internet-map.net/

Re:Show HN: Mapping almost every law, regulation and case in... by alwyn on Friday March 22, 2024 @06:28AM (#39789201)
You are the creator? Thank you for what you do! I've used it with pleasure for many years.
Re:Show HN: Mapping almost every law, regulation and case in... by mg on Friday March 22, 2024 @06:34AM (#39789236)
Yes. Happy you like it!
Re:Show HN: Mapping almost every law, regulation and case in... by rmnclmnt on Friday March 22, 2024 @06:21AM (#39789150)
So cool, thanks for sharing! I see you've also done it for movies, which is pretty cool and useful.

I could not find any technical details on the input data / feature extraction / clustering method used in these tool. Do you mind sharing what you have used so far?

Re:Show HN: Mapping almost every law, regulation and case in... by mg on Friday March 22, 2024 @06:38AM (#39789265)
The Music-Map and the Movie-Map are based on user preferences. The Music-Map is based on https://www.gnoosic.com and the Movie-Map on https://www.gnovies.com, two AI projects I started before the maps.

The AI and the mapping algorithm are my own developments. I was mostly inspired by thinkers like Douglas Hofstadter and John R. Koza.

Re:Show HN: Mapping almost every law, regulation and case in... by tomthe on Friday March 22, 2024 @09:04AM (#39790308)
It is really cool and useful. Interesting that you were able to gather enough data from users to make it work. I guess it was much less useful in the beginning?

I thought of making something similar with data from https://musicbrainz.org/

Re:Show HN: Mapping almost every law, regulation and case in... by mg on Friday March 22, 2024 @10:01AM (#39790855)
Yes, in the beginning pretty much everybody hated it and thought the project was nuts. I got pretty much no positive feedback but lots of negative. I was like "But it's learning! It's learning!" :) Strangely, that convinced almost nobody, even among my friends.

Now that many millions of people have used it, I get a lot of great, often enthusiastic feedback on how Gnod makes the best recommendations.

That teached me that you can't convince people with just an idea. For most people, you have to deliver something which is already useful to them.

Re:Show HN: Mapping almost every law, regulation and case in... by Citizen_Lame on Friday March 22, 2024 @11:48AM (#39791866)
Your effort is appreciated, but recommendations miss the mark by a considerable margin, to say at least.
Re:Show HN: Mapping almost every law, regulation and case in... by mg on Saturday March 23, 2024 @01:37AM (#39797735)
But it's learning!
Re:Show HN: Mapping almost every law, regulation and case in... by jcul on Friday March 22, 2024 @06:56AM (#39789376)
Very cool. I've immediately found some music I really like that I've never heard before.
Re:Show HN: Mapping almost every law, regulation and case in... by snats on Friday March 22, 2024 @09:12AM (#39790363)
I built a map of all the PDF urls on the internet recently.

I used a tiny embeddings model and PCA for dimensionality reduction.

https://weblog.snats.xyz/posts/2024/03/20/

Re:Show HN: Mapping almost every law, regulation and case in... by ubutler on Friday March 22, 2024 @09:46AM (#39790717)
Interesting, did you try also using PaCMAP or UMAP for dimensionality reduction? It might result in a more meaningful representation of their underlying semantic structure: see the 'mammoth' example in my article.
Re:Show HN: Mapping almost every law, regulation and case in... by snats on Friday March 22, 2024 @12:19PM (#39792171)
No! I only tried PCA, but I still have the embeddings.

I'll try later and post results.

Re:Show HN: Mapping almost every law, regulation and case in... by ProllyInfamous on Saturday March 23, 2024 @10:27AM (#39800167)
Just a UI/UX comment: I cannot read the tiny text on your website's main graphic, on a 43" 4K display.
Re:Show HN: Mapping almost every law, regulation and case in... by Groxx on Friday March 22, 2024 @09:19AM (#39790432)
You might also like: https://everynoise.com/
Re:Show HN: Mapping almost every law, regulation and case in... by quenix on Friday March 22, 2024 @03:00PM (#39793701)
This one is mesmerizing. Highly recommend checking it out.
Re:Show HN: Mapping almost every law, regulation and case in... by mbo on Friday March 22, 2024 @10:24AM (#39791045)
I did something similar for fragrances a little while ago: https://observablehq.com/@55th/every-fragrance-at-once
Re:Show HN: Mapping almost every law, regulation and case in... by itshossein on Friday March 22, 2024 @11:37AM (#39791749)
Great job! There is a form to report typos. Anywhere for duplicates and more complicated errors?
Re:Show HN: Mapping almost every law, regulation and case in... by mg on Friday March 22, 2024 @11:49AM (#39791876)
What is the difference between a typo and a duplicate? If you mean that two ways of writing the same name are both legit, then you have to decide on one being the more "correct" one. After a while Gnod will figure out which one is the more common name.

And "complicated errors"?