News for hackers. Stuff that matters.
Re:Show HN: Indexing Discord content into the web – Answer O... by apignotti on Sunday June 18, 2023 @05:32PM (#36384730)
Genuine question: I love Discord, but how on earth is it possible that such functionality was not built-in to begin with?

I really don't understand how the need for indexing and search was overlooked.

Re:Show HN: Indexing Discord content into the web – Answer O... by rhyssullivan1 on Sunday June 18, 2023 @05:36PM (#36384759)
I think it's due to how Discord evolved as a platform

Discord start as "your private place for your friends to talk" during a time where there were a lot of privacy issues with other communication methods.

Then as it grew beyond this scope of being a private place for friends, it would have been good for indexing to be added but indexing a normal text channel is really hard since you don't know where the conversation starts / stops to submit to a sitemap.

Now we've got large public communities and forum channels so it's possible they roll out their own version soon, but it does still slightly go against how their product was originally created so there may be some hesitation with adding it due to not knowing what the community reaction will be like.

Re:Show HN: Indexing Discord content into the web – Answer O... by dancemethis on Sunday June 18, 2023 @07:57PM (#36385762)
It's beyond ironic that Discord called itself that, being the successor to OpenFeint and its privacy lawsuit scandal, and being proprietary.

Now it is one of the most privacy-hostile AND preservation-hostile platforms around.

Re:Show HN: Indexing Discord content into the web – Answer O... by datenyan on Sunday June 18, 2023 @08:14PM (#36385872)
Unfortunately, it's a natural result of Discord moving from being a useful little service to a "platform" with investors and needing to constantly be updated with useless nonsense to keep the "value" of the product alive.

Realistically, once everything was up and running, and they had moved their DB over to their current platform [1], someone should have taken the keys away from them and just said "Discord is done, it's complete". We likely wouldn't be having this much of a problem with useful information being hidden away behind Discord server invite URLs.

[1] https://discord.com/blog/how-discord-stores-trillions-of-mes...

Re:Show HN: Indexing Discord content into the web – Answer O... by esafak on Monday June 19, 2023 @12:46AM (#36387405)
The solution to the growth problem is incubating complementary products.
Re:Show HN: Indexing Discord content into the web – Answer O... by TeMPOraL on Monday June 19, 2023 @06:06AM (#36389279)
For regular growth, maybe, but not for investment-fueled hyper-growth.
Re:Show HN: Indexing Discord content into the web – Answer O... by esafak on Monday June 19, 2023 @01:20PM (#36393787)
Every big, lasting company has a product portfolio: Google, Amazon, Meta, Microsoft... A single product will leave you vulnerable to disruption.
Re:Show HN: Indexing Discord content into the web – Answer O... by TeMPOraL on Monday June 19, 2023 @02:30PM (#36394847)
Correct. However, I feel the specific companies you mention didn't aim for hyper-growth, and had space to diversify their product portfolio. Discord, much like Reddit, is a one-trick pony. The weird thing to me is, Reddit feels like it should've been in the Google/Amazon/Meta/Microsoft bucket - yet somehow, through all these years, it failed to diversify.
Re:Show HN: Indexing Discord content into the web – Answer O... by jrockway on Sunday June 18, 2023 @08:51PM (#36386050)
I'm not sure Discord knew what it wanted to be. Private for your friends, but not end-to-end encrypted. Chat for streamers with rooms, but not a streaming platform. (They tried. Twitch also tried to make a Discord-like desktop app.)

Now they seem to be leaning into being Slack (notice that you can switch accounts, so your coworkers don't know you're xXxedgygamer69xXx or whatever.)

My takeaway is to always be a little scared about accepting investments. Your investors will make you hire people, who will want to work on something. The end result is a Frankenstein's Monster of a product.

Re:Show HN: Indexing Discord content into the web – Answer O... by omeze on Sunday June 18, 2023 @10:47PM (#36386792)
It wasn't meant to be "private" in the e2e sense. It was just meant to be a modern reimagining of Ventrilo/TeamSpeak, which were group chat programs for gamers. The video call stuff came after (since it was strange to not have video if you were already voice chatting in the year 201X). They want to branch outside of servicing online gaming communities but that was their origin, and you can still see how that culture affects their product design today. A good way of understanding the product is to just ask "would online gaming communities use this?".
Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @01:51AM (#36387728)
Not everything should be preserved forever. It's actually really nice to be able to talk online and not have it form a permanent record that can be instantly referenced by anyone.
Re:Show HN: Indexing Discord content into the web – Answer O... by TeMPOraL on Monday June 19, 2023 @06:11AM (#36389324)
Correct. However, some things should be preserved forever and accessible. It's really nice to be able to put a piece of scientific jargon, or a text of an error message, into a search box, and get back links and references to material you can peruse at your own pace and discretion - as opposed to having to join a closed community and keep asking people, hoping someone who knows the answer and is willing to help spots the message before it disappears in the flood of ongoing conversations, and monitoring said flood so that you catch the answer in time to ask follow-up questions, etc.

Point being: different needs require different tools. Current trend is doing everything in closed, ephemeral groups.

Re:Show HN: Indexing Discord content into the web – Answer O... by Geezus_42 on Monday June 19, 2023 @10:47AM (#36391669)
Also, there's the perpetual issue of people who just want to be assholes to other people on line and not actually help. This has existed in internet based chat platforms and is why they will never be better than documentation.
Re:Show HN: Indexing Discord content into the web – Answer O... by Geezus_42 on Monday June 19, 2023 @10:48AM (#36391681)
> Also, there's the perpetual issue of people who just want to be assholes to other people on line and not actually help. This has [always] existed in internet based chat platforms and is why they will never be better than documentation.
Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @09:30PM (#36398657)
docs/man pages should still be made, and people who are assholes should be banned.
Re:Show HN: Indexing Discord content into the web – Answer O... by haupt on Monday June 19, 2023 @05:20AM (#36388982)
>Discord start as "your private place for your friends to talk" during a time where there were a lot of privacy issues with other communication methods.

Discord started as a way for gamers to chat with one another. Initially the developers even wanted to sell games directly from the platform [1].

I think it would be incorrect to position Discord as a privacy-oriented platform when the desktop client needs to be run in a sandbox because there's no real way to disable data collection.

1. https://www.pcgamer.com/the-discord-game-store-is-now-open/

Re:Show HN: Indexing Discord content into the web – Answer O... by Dalewyn on Monday June 19, 2023 @05:33AM (#36389066)
This.

Discord came about because all the instant messaging services (eg: AIM, MSN) had recently died, Skype was hot flaming gasoline garbage, Teamspeak and Ventrilo were tedious and expensive (for gamers), and otherwise there were no other means of reliable, easy, free, convenient means of voice communications.

Re:Show HN: Indexing Discord content into the web – Answer O... by barrysteve on Monday June 19, 2023 @07:09AM (#36389677)
Mumble was the best free voice communications app and briefly took over after Teamspeak fell out of popularity.

Discord was really the best place to hang out with your friends outside of games. Social media was too distant and Steam friends didnt do enough. The old IRC chatroom / Discord format with voice comms and screen sharing is THE way to relate to friends online now.

Re:Show HN: Indexing Discord content into the web – Answer O... by Kiro on Sunday June 18, 2023 @06:09PM (#36385043)
It makes no sense to index the vast majority of content. You would need to cherry pick really hard among all the noise to find the stuff worth putting online.
Re:Show HN: Indexing Discord content into the web – Answer O... by jasonjmcghee on Sunday June 18, 2023 @06:16PM (#36385106)
Interesting comment. I would think Reddit is similar in terms of content, yet “site:reddit.com <query>” is common as a general search pattern (pre-blackout)
Re:Show HN: Indexing Discord content into the web – Answer O... by IceSentry on Sunday June 18, 2023 @11:41PM (#36387065)
Discord is made for realtime chat and instant messaging. People don't put a lot of thought process in the vast majority of what they write. The format of ressit encourages a bit of a slower conversation and therefore more thought through comments. You barely even have time to edit a message before it's already irrelevant in discord.
Re:Show HN: Indexing Discord content into the web – Answer O... by jlokier on Monday June 19, 2023 @06:00AM (#36389237)
That depends a lot on the channel. Some channels are exclusively monthly public announcements, of new version of software, or bugs, or announcements of conferences for example. Or job opportunities with instructions on how to apply.

Some channels contain a high level of knowledge in the same way as a forum, knowledge you won't find posted again, perhaps because the person who posted it no longer works at the company. Some channels are used for work purposes, similar to Slack and MS Teams, and contain async information across timezones about product development, or bug-investigations updates, or design discussions, which are more real-time but valuable to be able to find again. Some channels contain the information needed to enter and participate in multi-month long competitions. The information is not posted anywhere else, even though that would be useful and well suited to a blog or issue tracker.

Some places are using Discord not because it's their favourite thing, but because many other companies and projects in the same field are now using Discord, so it's become expected by users (like Twitter). After all nobody wants to install yet another application, but if everyone in a field already uses Discord for work, then that's what you have to use as well.

My first year of Discord was entirely because it was required by my job, as it was the way everyone communicated at that company.

The point is it was the only way everyone communicated at that company aside from a negligible number of emails (maybe 10 emails in a year), and some Telegram channels with outside parties. So nearly every formal announcement and work-related message, as well as real-time chat went through the company's internal Discord server. When I occasionally searched the company dev channels I found a treasure trove of relevant technical knowledge I couldn't find anywhere else. Knowledge I couldn't get in a reasonable time by asking current people. But being Discord search rather than a web page, it was really hard to keep track of things found, and that knowledge was effectively lost.

At my current job we use Teams the same was as the last company used Discord. Teams is worse.

Re:Show HN: Indexing Discord content into the web – Answer O... by michaelmior on Sunday June 18, 2023 @06:54PM (#36385378)
I would argue it makes no sense to index the vast majority of content without good search. If your search is good enough, you can index everything and then surface only the good stuff at query time.
Re:Show HN: Indexing Discord content into the web – Answer O... by lohnjemon on Monday June 19, 2023 @12:45AM (#36387396)
Indexing trillions of messages is outrageous.
Re:Show HN: Indexing Discord content into the web – Answer O... by andybak on Monday June 19, 2023 @07:29AM (#36389793)
That's why "archive to the web and let Google handle it" is a good solution.
Re:Show HN: Indexing Discord content into the web – Answer O... by esafak on Sunday June 18, 2023 @06:32PM (#36385213)
It's not made for knowledge discovery; it's for gamers. Just look at that busy UI! The content is assumed to have no historical value.
Re:Show HN: Indexing Discord content into the web – Answer O... by mavhc on Monday June 19, 2023 @02:58AM (#36388100)
But because it's free, and forums suck, people are using it for knowledge
Re:Show HN: Indexing Discord content into the web – Answer O... by Zetobal on Tuesday June 20, 2023 @02:58AM (#36400613)
Forums don't suck it's accessibility the biggest strength of discord is probably that they let you discover the communities and even take part in the conversation without signing up. It's just like IRC back in the day choose a username and of you go and if you like it converting the temp account to a normal one is just 2 clicks.
Re:Show HN: Indexing Discord content into the web – Answer O... by mavhc on Tuesday June 20, 2023 @04:32AM (#36401209)
Forums are terrible compared to Usenet, multiple clicks to see new posts, at least Discord has alt-shift-up/down
Re:Show HN: Indexing Discord content into the web – Answer O... by thrashh on Sunday June 18, 2023 @06:35PM (#36385237)
Discord is a chatroom first. What non-enterprise chat comes with archives?

A forum is totally different.

And even then, forums weren’t designed to be archived from the start. People just wrote web crawlers and search engines.

(I know Discord has some forum-like functionality now but the point stands.)

Re:Show HN: Indexing Discord content into the web – Answer O... by madeofpalk on Sunday June 18, 2023 @06:41PM (#36385276)
Discord has 'indexing' and search, just like how Slack does. It's just not on the public & open web - only searchable inside of Discord.
Re:Show HN: Indexing Discord content into the web – Answer O... by Nuzzerino on Sunday June 18, 2023 @08:34PM (#36385966)
Pretty sure that wasn't the spirit of what GP was asking
Re:Show HN: Indexing Discord content into the web – Answer O... by thunky on Sunday June 18, 2023 @06:54PM (#36385377)
What I wonder is why would anyone that cares about archiving/search would choose to use Discord?
Re:Show HN: Indexing Discord content into the web – Answer O... by hutzlibu on Sunday June 18, 2023 @07:20PM (#36385557)
Apparently because it is very easy to setup and offer a place where people can join.

More and more open source projects are using it and I don't really like it, but what easy alternatives can you recommend to them?

Genuine question, as it is an open issue for me. I want to focus on my project, not setting up and maintain a forum, mailing lists, etc. on top of that.

Re:Show HN: Indexing Discord content into the web – Answer O... by jacooper on Sunday June 18, 2023 @07:38PM (#36385666)
Matrix, but that doesnt really fix the searchability problem
Re:Show HN: Indexing Discord content into the web – Answer O... by thunky on Sunday June 18, 2023 @09:07PM (#36386150)
I don't know either, but I'm not the Discord target audience. I've tried but it gives me a headache like a Vegas casino.

I'd rather see something simple and plain (and functional) like phpbb.

Re:Show HN: Indexing Discord content into the web – Answer O... by waboremo on Sunday June 18, 2023 @09:41PM (#36386368)
Those are the biggest aspects, but the private aspect is actually an important part of why many open source projects are using it. They don't really want to be having those sort of conversations in github issues or the discussions page or anywhere indexable.

Like getting on a call with a coworker or a collaborator on the project. You can technically record it or leave it open to the public, but most people do not because they just see it as not "informing the public" worthy.

Re:Show HN: Indexing Discord content into the web – Answer O... by Grimburger on Sunday June 18, 2023 @10:43PM (#36386765)
> what easy alternatives can you recommend to them

Github discussions.

A project I follow moved all their Q&A from discord and it's a joy to both search and ask now.

Discord is actively hostile to anyone simply wanting to browse.

Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @02:00AM (#36387773)
I would much rather engage with a community on Discord than on Github discussions/Reddit/a forum. The inability to easily browse historical posts is a feature to me that makes it much less risky to ask questions and join a community. I don't have to spend a lot of time searching and effort to phrase my questions just right to avoid getting yelled at by someone that I should have used the search instead of posting.
Re:Show HN: Indexing Discord content into the web – Answer O... by TeMPOraL on Monday June 19, 2023 @06:16AM (#36389363)
But then instead of putting X amount of effort up-front to do search, you have to put in 10X amount of effort to join a community and ask someone about the thing. It's not a good trade, IMHO.
Re:Show HN: Indexing Discord content into the web – Answer O... by throwaway675309 on Monday June 19, 2023 @06:24PM (#36397203)
In my experience, most people on GitHub discussions seem to be more than happy to help out, and over time it also builds up a reservoir of information that anyone else can tap into. GitHub discussions search is relatively good.

Whereas on discord, you might get a great answer which helps you and anyone who is immediately following that conversation but that's it.

Re:Show HN: Indexing Discord content into the web – Answer O... by fomine3 on Tuesday June 20, 2023 @01:14AM (#36400007)
Gitter is an ignored solution.
Re:Show HN: Indexing Discord content into the web – Answer O... by starlevel003 on Sunday June 18, 2023 @10:14PM (#36386593)
> I really don't understand how the need for indexing and search was overlooked.

It wasn't overlooked. The point is to make it difficult for outside users to access information unless they sign up.

Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @01:48AM (#36387719)
Discord does have search, but I really hope they do not improve it.

The lack of good search really prevents the hostility towards new users that you often see on Reddit/forums where every question is instantly answered by a one liner "use the search" reply.

Discord communities are some of the most friendly and welcoming communities I have ever encountered on the internet. I think a large part of it is the chat nature and inability to easily pull up old comments.

Re:Show HN: Indexing Discord content into the web – Answer O... by teolandon on Monday June 19, 2023 @02:21AM (#36387883)
I'd rather have the tools to find things without having to interact with humans.
Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @02:33AM (#36387959)
No one are automatically entitled to get the output of a community while sitting on the sideline, although a community may chose to make it available.

Perhaps you should consider getting your answers from ChatGPT in the cases where a community has decided to be for themselves instead of the greater internet.

Re:Show HN: Indexing Discord content into the web – Answer O... by TeMPOraL on Monday June 19, 2023 @06:30AM (#36389437)
> No one are automatically entitled to get the output of a community while sitting on the sideline, although a community may chose to make it available.

That's the difference between the "cozy web" and the web 10-15 years ago. The communities used to grant everyone the right "to get the output of a community while sitting on the sideline" by default; in fact it was weird to gatekeep things that could be useful to others - the only thing that was gatekept was "write access", and it was done based on attitude, not on someone's ability to do networking and invest large amount of time on an ongoing basis.

Of all groups, it's both ironic and sad to see this happening to open source projects in particular. Those projects owe their very existence - and people participating in them owe their skills - to that open, indexed, no-strings-attached knowledge-sharing culture.

Re:Show HN: Indexing Discord content into the web – Answer O... by captaincrisp on Tuesday June 20, 2023 @10:35AM (#36404653)
The alternative here is that people are more of a burden on the community, not less. It's more disruptive to have noobs asking the same questions and having to be answered by community members every time. At least from where I sit.

I don't think asking noob questions makes you part of the community in the way it matters here - actually contributing.

Re:Show HN: Indexing Discord content into the web – Answer O... by mavhc on Monday June 19, 2023 @02:59AM (#36388106)
I always use discord search to find answers, but a lot of people don't bother. I'm not sure answering the same noob questions over and over is fun for anyone
Re:Show HN: Indexing Discord content into the web – Answer O... by chillfox on Monday June 19, 2023 @03:12AM (#36388186)
Maybe not, but it makes a community feel very welcoming