News for hackers. Stuff that matters.
Re:Why Is the Web So Monotonous? Google by onlyrealcuzzo on Thursday August 04, 2022 @06:14PM (#32348994)
> Well, I built sort of exactly this: https://search.marginalia.nu/

What's the elevator pitch? What do you actually do that is special?

From the about section:

> This is an independent DIY search engine that focuses on non-commercial content, and attempts to show you sites you perhaps weren't aware of in favor of the sort of sites you probably already knew existed.

> The software for this search engine is all custom-built, and all crawling and indexing is done in-house. The project is open source. Feel free to poke about in the source code or contribute to the development!

But that doesn't really give me much info.

Re:Why Is the Web So Monotonous? Google by marginalia_nu on Thursday August 04, 2022 @06:25PM (#32349094)
The point is to surface human websites and discriminate against content mills, click funnels and e-commerce.

For one I have a sort of budget for how much javascript I will tolerate. Some is fine, like your standard wordpress config probably will fly, but not much more. I also do a personalized pagerank biased toward the blogosphere. The likelihood your website shows up in the results is directly determined by whether real humans link to the website.

It's not a Google replacement by any measure, it's meant as a complement, but if you are looking for more in-depth content on a topic than you can find elsewhere, it's often a good starting point.

Re:Why Is the Web So Monotonous? Google by spacemadness on Thursday August 04, 2022 @08:40PM (#32350143)
I like the idea of a search engine that acts as a sort of filter for known dark patterns along with returning useful results. Limiting on javascript quantity seems like a sledgehammer approach, but I like the spirit of it all the same.
Re:Why Is the Web So Monotonous? Google by droidist2 on Thursday August 04, 2022 @09:03PM (#32350262)
> For one I have a sort of budget for how much javascript I will tolerate. Some is fine, like your standard wordpress config probably will fly, but not much more.

What about sites built with React, etc? Like would you be filtering out cool things like Ableton's "Learning Synths"[1] or do you mostly mean third party scripts?

[1] https://learningsynths.ableton.com

Re:Why Is the Web So Monotonous? Google by marginalia_nu on Thursday August 04, 2022 @10:10PM (#32350689)
Yeah, those sited go out the window entirely. It's a search engine for documents, not applications.
Re:Why Is the Web So Monotonous? Google by iakh on Thursday August 04, 2022 @10:35PM (#32350878)
Why should it matter if a website is marked up on the server side or client side to a search engine?
Re:Why Is the Web So Monotonous? Google by marginalia_nu on Friday August 05, 2022 @06:13AM (#32354012)
I don't know why it matters, but enforcing a JS budget turns out to rather effectively reduce the amount of problem websites down to nearly none.

Do babies go out with the bathwater? Almost certainly. But when you're running a small scale search engine, you're never going to index everything anyway, so that's entirely fine.

Re:Why Is the Web So Monotonous? Google by spc476 on Friday August 05, 2022 @03:59AM (#32353054)
Why should I download 50M of Javascript implementing a buggy, bespoke browsing engine to render perhaps 1k of text when I'm using a browser that is already capable of rendering 1k of text? For example, I used to enjoy browsing the C2 wiki, but recently they decided they needed to experiment with their own Javascript based browser, thus rendering their site unreadable unless you are using the very latest web browser (that needs to be updated every 20 minutes mind you).
Re:Why Is the Web So Monotonous? Google by joshlemer on Friday August 05, 2022 @12:58AM (#32351894)
Thanks for the link! I’ve tried it on a few queries and I really really like the results so far! Cheers!
Re:Why Is the Web So Monotonous? Google by tigerlily on Thursday August 04, 2022 @06:26PM (#32349106)
I know it’s of low value to ask, but who really gives a shit?
Re:Why Is the Web So Monotonous? Google by tigerlily on Thursday August 04, 2022 @11:19PM (#32351142)
Sigh, I guess I should’ve clarified I meant “who cares whether or not there’s an elevator pitch, this is just something that someone thought we all needed and would be cool to build”.

FWIW I think it is cool and much needed.

Re:Why Is the Web So Monotonous? Google by interroboink on Thursday August 04, 2022 @07:01PM (#32349397)
I do!

(also low value, perhaps :)