News for hackers. Stuff that matters.
Re:Absurd Success by bomewish on Wednesday August 30, 2023 @11:28PM (#37332117)
I enjoyed reading this but I also fundamentally don't get it at a basic level like... why re-implement stuff that has already been done by entire teams? There are so many bigger and productionised search and retrieval systems. Why invest the human capital in doing it all again yourself? I just don't get it.
Re:Absurd Success by BLKNSLVR on Wednesday August 30, 2023 @11:40PM (#37332193)
I want to do my own version of something like this to have a personally curated search function. The "it's mine" factor is enticing, if it does something unexpected, then I know all the dependent, interacting parts so I can trace the problem and fix it.

But I'm a privacy and self-hosting nut, which is probably just another way of saying the same thing.

(I will probably never actually do it, but that doesn't stop it being on the list).

Re:Absurd Success by lbotos on Wednesday August 30, 2023 @11:35PM (#37332162)
How does one learn new things if not first by understanding them, and then looking to evolve them?

Sure, we can shell out to libraries and to other people's work, but at some point, you will have to understand the thing that you've abstracted away if you want to evolve it.

Or as the kids say, let him cook: https://knowyourmeme.com/memes/let-him-cook-let-that-boy-coo...

Re:Absurd Success by ZephyrBlu on Thursday August 31, 2023 @09:20AM (#37336738)
FYI "let him cook" is usually used in a derogatory way.
Re:Absurd Success by tanjtanjtanj on Thursday August 31, 2023 @10:25AM (#37337645)
Not really. The original usage of it was completely positive and it has evolved into something more ironic but not necessarily negative. I think the person you were replying to used it absolutely the way most people use the phrase.

It can be more or less translated to "I want to see the outcome of what they're doing" usually used after the person who is "cooking" is criticized for their methods.

Re:Absurd Success by catchnear4321 on Wednesday August 30, 2023 @11:36PM (#37332171)
someone climbed everest. others tried and didn’t make it. some didn’t make it back. people keep doing it.

plenty of folks dabble in art, many of which quite poorly, when good and even great artwork can be purchased for not all that much.

some paint the walls of their house rather than call a professional painter.

there are countless reasons, including but not limited to the easiest, most flippant, and possibly the most human response to your question.

why not?

Re:Absurd Success by ftxbro on Wednesday August 30, 2023 @11:31PM (#37332140)
a lot of 'productionised' things keep getting enshittified and ruined so i don't blame anyone for remaking a wheel
Re:Absurd Success by fjfuvucucuc on Thursday August 31, 2023 @12:04AM (#37332322)
Fun? Takes like two weekends to build the whitepaper version of google.
Re:Absurd Success by EdwardDiego on Thursday August 31, 2023 @12:06AM (#37332336)
Because you enjoy it.

Because you're able to offer a product with differences in the market.

Because you can.

It's not like they're implementing their own DB to get to a MVP of their product "Tinder, but like for dogs".

Re:Absurd Success by marginalia_nu on Thursday August 31, 2023 @03:23AM (#37333625)
> It's not like they're implementing their own DB to get to a MVP of their product "Tinder, but like for dogs".

Well as it happens, https://explore.marginalia.nu/init

Re:Absurd Success by fouc on Thursday August 31, 2023 @12:22AM (#37332437)
why is bigger better? why assume that a team made something better?

anybody or any team that sets out to build something will prioritize different things and end up with radically divergent implementations.

Re:Absurd Success by yjftsjthsd-h on Thursday August 31, 2023 @12:34AM (#37332501)
> why re-implement stuff that has already been done by entire teams

Because by not being a huge team you can do it better.

Re:Absurd Success by jterrys on Thursday August 31, 2023 @01:22AM (#37332789)
It's kind of funny really, many good projects are actually maintained by a small group of people. You genuinely cannot throw more people at a project and make it faster and better. A lot of cool infra and protocol concepts stuff that we use day to day is made by a handful of people at best
Re:Absurd Success by foul on Thursday August 31, 2023 @04:00AM (#37333887)
Quality is an opinion. Big teams are oftentimes there to improve flawlessness and appeal.
Re:Absurd Success by MrVandemar on Thursday August 31, 2023 @01:02AM (#37332659)
Independant efforts are as important, if not more important, than larger corporate efforts. Because independants have different priorities, and are often not as tied to satisfying curiosity instead of some bottom-line.

Read any articles about how amazing Google's search is lately? Me neither.

Re:Absurd Success by mrkeen on Thursday August 31, 2023 @02:36AM (#37333287)
This opinion has already been expressed plenty of times.
Re:Absurd Success by namaria on Thursday August 31, 2023 @05:18AM (#37334477)
Funnily enough this repetitions encapsulates what is wrong with this reasoning. If you don't put time into learning the fundamentals, telling yourself there's not need to re-invent the wheel, you end up repeating old mistakes. Turns out computer systems are not as transparently obvious as a wheel...
Re:Absurd Success by marginalia_nu on Thursday August 31, 2023 @03:22AM (#37333616)
Most of what exists doesn't work for my application. It either assumes an unbounded resource budget, or makes different priorities that don't scale by e.g. permitting arbitrary realtime updates.

I'm building stuff myself because it's the only way I'm aware of to run a search engine capable of indexing quarter of a billion documents on a PC.