News for hackers. Stuff that matters.
Re:Jeff Atwood on growing Discourse by gue5t on Tuesday May 02, 2017 @01:22PM (#14248405)
For anyone who has to deal with the pain of reading Discourse message threads, you can append ?_escaped_fragment_ to the URI to get a JS-free page that loads completely immediately and doesn't unload when you scroll.

I have no idea why this user-hostile functionality is present by default. It breaks ctrl+F, ctrl+S, the scrollbar, and loads of other browser functionality.

Re:Jeff Atwood on growing Discourse by dfabulich on Tuesday May 02, 2017 @01:56PM (#14248785)
All forums with large threads have to paginate for performance, including HN. Discourse's infini-scroll feature is best understood as "automatic page turning."

In a paginated thread, you can only Ctrl-F for stuff on the current page, and Discourse is no different; it's no more "broken" than a traditional paginated forum with manual page turning. Similarly, you can only Ctrl-S to save the current page, not the whole thread.

Many forums have a "search in this thread" feature, and Discourse does, too. In fact, if you click in the page and press Ctrl-F, it intercepts the keystroke and shows Discourse's "search in thread" search box; some forums with manual page turning do the same thing.

Some people seem to get really pissed off at automatic page turning; I kinda understand why, but there are clear arguments for automatic page turning. Why make the user click "Next Page" when the software could do it for you? You'll notice that all of the most popular feed-based sites (Facebook, Twitter, Pinterest, Instagram) use automatic page turning, too, and that's because experiments show that people engage more when automatic page turning is enabled.

None of this will make you any happier with APT, but hopefully it will annoy you slightly less to know that this is a data-driven decision and not done specifically to annoy you.

Re:Jeff Atwood on growing Discourse by gabemart on Tuesday May 02, 2017 @04:47PM (#14250413)
> All forums with large threads have to paginate for performance, including HN.

I can read "War and Peace" [1] as an HTML document on my 7 year old cheapo Android phone. The browser even "streams" the data, displaying each chunk as it loads over a slow connection.

As far as I know, you're correct that all forum software I've used paginates large threads, but I'm curious if they "have" to - as in, I think a team could probably build forum software that didn't paginate large threads (for reasonable definitions of "large") and still have good performance on a wide range of devices, if they were willing to make the necessary trade-offs. Whether those trade-offs are worth making, I don't know.

[1] http://www.gutenberg.org/files/2600/2600-h/2600-h.htm

Re:Jeff Atwood on growing Discourse by emodendroket on Tuesday May 02, 2017 @04:57PM (#14250506)
Well, for one thing, there is nothing relational about a giant HTML document. But for another, is a page that long really the ideal experience for a discussion forum?
Re:Jeff Atwood on growing Discourse by dredmorbius on Tuesday May 02, 2017 @09:45PM (#14252392)
Why not allow the user or client define the pagination experience?

You can get and read War and Peace (or other similarly large books -- I frequently reference Adam Smith's Wealth of Nations) at Project Gutenberg. As a single HTML file.

The ability to search for any particular text instance within that document through browser capabilities is useful.

As is, I agree at times, the ability to present the information as some sort of consistently paginated context.

I'm thinking that somewhere between the 21st and 42nd centuries, computers might advance to a state where this is in fact possible.

Re:Jeff Atwood on growing Discourse by emodendroket on Tuesday May 02, 2017 @10:25PM (#14252548)
If I wanted to search a discussion thread I'd rather use a search function.
Re:Jeff Atwood on growing Discourse by dredmorbius on Wednesday May 03, 2017 @06:11PM (#14260679)
Why?

I suppose you're going to respond with something along the lines of "because it's better than the browser's search function".

But again: why is that?

Why do the built-in browser tools suck as badly as they do?

Example, outside of search: I realised some months back that a chief reason we have browser Reader Mode features, to uncrappify crappy site CSS, is because browser default styling ... is so horrible.

And again: why is that?

Why do we have craptastic CSS entity defaults when, with a very little work, every page could look, without any styling at all, pretty damned readable:

http://codepen.io/dredmorbius/full/KpMqqB/

(And if that's not your cuppa, then themes such that you get what you want -- Night Mode, or whateves.)

Whatever browsers are being built for, it's not the people actually using them.

/me looks suspiciously at Chrome => Google => Advertising....

Gee... I wonder why that might possibly be.

Re:Jeff Atwood on growing Discourse by emodendroket on Thursday May 04, 2017 @07:34AM (#14264068)
Well for one thing a browser search function can't distinguish between post content and the rest of the page. Also just one endless stream for a thread is practically unreadable.
Re:Jeff Atwood on growing Discourse by dredmorbius on Thursday May 04, 2017 @01:24PM (#14266781)
And you realise that the browser has literally parsed the entier document object mode. If there's a semantic structure to be found, the browser knows what it is.

Again: why is cabapility-in-the-browser so impossible to provide?

Why isn't "search post" vs. "search comments" something scoped into a browser? If comments are a ... not entirely novel or unknown concept within Web design and activity, why are the abilities, say, to have browser-generated lists of authors, or search by author, or post/comment distinctions, or persistent reputations of commentators so that I can tell if @[email protected] is just an asshat or a space alien cat who really knows where his towel is (and independent of whether or not dredmorbius maps to any particular known "real name")?

It's not like the question's just come up within the past 5 hours.

Really: Why is the browser so fucking limited in this regard?

https://www.w3.org/TR/annotation-model/

Re:Jeff Atwood on growing Discourse by mnutt on Tuesday May 02, 2017 @11:16PM (#14252743)
War and Peace in HTML on Gutenberg is 12,000 paragraph tags, which is a lot but it's very easy to find forum threads with more than 12,000 posts. And each post is more than a paragraph tag, it's probably more like a dozen: the author name, an icon, the date, controls, etc.

Even Chrome on my i7 doesn't instantly respond when loading those Gutenburg URLs.

Re:Jeff Atwood on growing Discourse by infogulch on Wednesday May 03, 2017 @09:54AM (#14255615)
The linked book is 3.9 MB. That you would have to reload every time a new post was appended to the end. This is a terrible counterexample.
Re:Jeff Atwood on growing Discourse by mnutt on Wednesday May 03, 2017 @12:23PM (#14257227)
I'm not sure I understand the connection? My argument was that War and Peace sounds like an incredibly big thing to load because it took people a long time to read it in high school, but it's actually pretty simple, structure-wise, when compared to a discussion forum.
Re:Jeff Atwood on growing Discourse by infogulch on Wednesday May 03, 2017 @12:27PM (#14257285)
I may have replied to the wrong parent. We are in agreement. :)
Re:Jeff Atwood on growing Discourse by mattmanser on Tuesday May 02, 2017 @02:11PM (#14248958)
HN doesn't paginate comments any more.

Here's a thread with 970 comments for example:

https://news.ycombinator.com/item?id=14023198

Re:Jeff Atwood on growing Discourse by 1wd on Tuesday May 02, 2017 @03:59PM (#14250010)
And the comments on that page (840kB) are smaller than the Javascript on a discourse site (4MB).
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @04:07PM (#14250091)
yes, but the minute you click a _second_ page, the Javascript app is already loaded, and we request only JSON for the new data.

Also this 4MB number isn't correct; I count 700kb. Feel free to double check my work:

http://imgur.com/a/gPiEb

Re:Jeff Atwood on growing Discourse by aleyan on Tuesday May 02, 2017 @04:31PM (#14250291)
Are you really arguing that Discourse's superior linear complexity outweighs the huge constant cost in any meaningfull scenario? At 4mb/840kb * 970 comments, disregarding any additional JSON data that Discourse loads, a Discourse thread would need to have 4974 comments before its strategy is more efficient than Hackernews.

Jeff, I respect you, but I don't understand where you are going with that comeback.

Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @05:49PM (#14250956)
Think of Discourse as a JavaScript app you load on your phone. Yes there is that unavoidable first time install on first page load, but once the app is installed, all it needs to render the page is the JSON data that makes up the comments -- which is very efficient, far more efficient than a full HTML page load of a traditional website.

So how you feel about this depends on "how often you use the app". If you only plan to visit that one page, ever, then it's not a great tradeoff (though 700kb -- no idea where you are getting 4MB from -- of images is basically nothing on a webpage these days). If you visit many discussions and many pages, it's a win.

In other words a single discussion doesn't need 4000 comments, you just need to read 4000 comments across all discussions all time. I'm not sure your math is correct here, either: I just visited meta.discourse.org in incognito mode and I see about.. 700kb of javascript?

http://imgur.com/a/gPiEb

I'm sorry but I don't know where you are getting 4 megabytes out of 700kb. See above screenshot.

Answering Macha, below:

- Your chosen example is missing http/2 so requests aren't batched

- Discourse homepage by default shows user avatars for each participant, up to 5 in each topic, so there will be "more images"

I suggest testing with meta.discourse.org (hosted) or discourse.codinghorror.com (self-hosted) to make sure you're looking at apples to apples, and properly configured sites.

Re:Jeff Atwood on growing Discourse by Macha on Tuesday May 02, 2017 @06:23PM (#14251169)
Not the parent poster, but going to the first Discourse forum in my history:

http://imgur.com/BoPPL0i

72 requests, 50s load time, 3.5mb data. It would have been smaller if you'd served the screenshot of the page.

HN for comparison:

http://imgur.com/a/8qaIN

6 requests, 50kb, 0.72s

Now how about your contemporary forum competition.

Here's a Xenforo forum:

http://i.imgur.com/tlzZ5WN.png

19 requests, 2mb, 5s

And that's with the massive background image you can see, which is 1mb in size by itself.

EDIT:

Since Jeff stated the comparisons weren't apples to apples, xenforo.com/community vs meta.discourse.org . Both boards running in basically stock configuration from their own sites:

* Xenforo.com: 43 requests, 1.4mb, 4s

* meta.discourse.org: 73 requests: 3.2mb, 4.5s

http://imgur.com/a/SihGh

Definitely a better showing than the ACEO forums, but still loses the comparison.

Too lazy to take more screenshots, but reddit is 50 requests, 1.3mb, 3s for comparison.

Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @07:03PM (#14251485)
This isn't remotely apples to apples; for example, HN has zero avatars, Xenforo has zero avatars, whereas Discourse shows up to five avatars per topic, of which there are many on the homepage.

I'm unclear where you are getting 3.2MB from, since sorting by filesize, here are the largest network requests at meta.discourse.org:

http://imgur.com/8v4Fp4L

As you can see, starting at 11.5kb and below it's all images (avatars).

I suppose you could try with images disabled. If you want to make a case that 'not showing avatars by default uses less bandwidth', then I guess I can agree with that. But these images won't affect actual load time, as images rez in later, and all the dimensions are set on the page.

Re:Jeff Atwood on growing Discourse by aleyan on Tuesday May 02, 2017 @06:38PM (#14251295)
Thanks for the reply. You have me convinced with amortizing the cost of js over multiple visits rather than a single thread.

Regarding the 4mb thing, I pulled it out of 1wd's comment. It would be best if 1wd came back and explained. That said, I believe the discrepancy is probably between the size of compressed javascript in the network and it's uncompressed size. Firefox dev tools show 3.1mb for meta.discourse.org. I don't know how to view the total size in Chrome's dev tools, but if you click the "use large request rows" in the Network tab you will see that application.js by itself takes up 1.5mb.

Re:Jeff Atwood on growing Discourse by accountyaccount on Tuesday May 02, 2017 @04:52PM (#14250460)
I'm sure they could get that 4mb down if they removed all text formatting, media, quotes, replies, editing tools, user icons, and pagination.
Re:Jeff Atwood on growing Discourse by hashhar on Tuesday May 02, 2017 @05:08PM (#14250611)
There's a lot of other things Discourse threads have (media, collapsing, proper markdown, editing toolbars etc.).
Re:Jeff Atwood on growing Discourse by mattmanser on Tuesday May 02, 2017 @05:35PM (#14250839)
HN has collapsable threads and uses tables for layout, which aren't exactly efficient markdown, so makes the opposite point you're trying to make.

Namely, even with bloody awful markdown, HN still delivers 1000 comments in 1/4 of the bytes.

Another interesting idea, as almost everyone doesn't actually comment, wouldn't it make more sense to load the editor javascript dynamically? As far as I know, the silent majority read comments but never reply. In fact, I vaguely remember Jeff even having a blog post that most people never participate, they just consume (could be wrong!).

Also, I haven't kept up with it, but mobile browsers used to have fairly aggressive cache invalidation to save space on the phone, so serving big chunks of JavaScript in the hope it might get reused one day wasn't actually a great idea.

Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @06:25PM (#14251186)
> Namely, even with bloody awful markdown, HN still delivers 1000 comments in 1/4 of the bytes.

Are you sure this is correct? I count 700kb of total content (including the actual HTML and CSS), not 4mb, so I think your comments are premised on a number that's off by almost 6X?

http://imgur.com/a/gPiEb

Re:Jeff Atwood on growing Discourse by mattmanser on Tuesday May 02, 2017 @07:37PM (#14251715)
Sorry! Was just repeating a number further up the thread, should have checked myself. Worse still, you'd already corrected him and I didn't notice :(
Re:Jeff Atwood on growing Discourse by Veelox on Wednesday May 03, 2017 @11:31AM (#14256560)
It is encouraging to see someone as high profile as you taking the time to have a evidence-based debate on the internet.
Re:Jeff Atwood on growing Discourse by ihuman on Tuesday May 02, 2017 @02:42PM (#14249267)
When did they make that change? A month ago or so, I remember having to click a link at the bottom of a page to load more comments.
Re:Jeff Atwood on growing Discourse by eriknstr on Wednesday May 03, 2017 @05:04AM (#14254081)
I've been on HN for a long time (this is not my first account even) but I had completely forgotten about pagination on HN. Even when you talked about it I only get a vague feeling that I've seen it ever. Probably I have seen it but still it feels like the sort of memory that one has of something that didn't actually happen but which you have a "memory" of because someone told you it happened.

I guess I usually simply stop scrolling before I get to the very bottom of HN.

Just to be clear though, are we talking about a "next" link at the bottom of the page, or Reddit-style "continue" links for subtrees of comments beyond a certain depth?

Re:Jeff Atwood on growing Discourse by cookiecaper on Tuesday May 02, 2017 @02:59PM (#14249478)
Same. I think that they enable it on a case-by-case basis as load gets high. Also, the "Who's hiring?" threads do not typically spawn active subthreads, so that may make them more cacheable/easier to load.
Re:Jeff Atwood on growing Discourse by finchisko on Tuesday May 02, 2017 @02:28PM (#14249139)
>Similarly, you can only Ctrl-S to save the current page, not the whole thread.

This brought me to thinking why browsers still save page as source code and not as serialised actual DOM? I mean developers still could use curl to save source code, but regular users will save what they see on the screen, similarly to printing to PDF.

Re:Jeff Atwood on growing Discourse by thristian on Tuesday May 02, 2017 @05:33PM (#14250828)
What do you mean? Browsers do serialise the actual DOM.

I know this because I once saved a JS-heavy page and when I loaded it back into the browser, I discovered the JS-generated menus were already present in the source and were re-generated by the JS each time the page loaded.

Re:Jeff Atwood on growing Discourse by finchisko on Wednesday May 03, 2017 @03:17PM (#14259104)
>re-generated by the JS each time the page loaded.

yes, regenerated because js files are also stored. So the menu generating functions and all constants needed to generate menus were probably present in downloaded js files. But imagine, site that is also fetching data via ajax and render that data somehow. When you save and then reopen saved page, you might not get exact state as you were in time of saving. There are many reason why state would be different (you could be logged off, etc...) So if you send saved page to somebody, he/she will see different state of page than you. All of this could be eliminated if browsers saved state of DOM instead of page source code (and js,css resources).

Re:Jeff Atwood on growing Discourse by xfalcox on Tuesday May 02, 2017 @02:50PM (#14249369)
We made a feature, where we capture a CTRL+P and open a new window with the full topic and start the print, so it's easier to save a big topic to PDF and read it offline.
Re:Jeff Atwood on growing Discourse by maxerickson on Tuesday May 02, 2017 @02:53PM (#14249412)
I don't care that it does it, but I do wish they would develop it on underpowered computers.
Re:Jeff Atwood on growing Discourse by gue5t on Tuesday May 02, 2017 @02:28PM (#14249140)
The tone of your message feels rather condescending, which is frustrating in the face of software usability issues. I think that in general it's a good idea to treat people's complaints as well-founded, even if they don't know exactly how to describe the underlying problem.

I don't think it's the case that I and other users don't know what we want. I do believe that "people engage more" on infinite-scroll-style pages, but I have no reason to believe this makes them happier or more productive. On the other hand, the jerkiness/glitches, breakage of common navigational tools, and slowness of Discourse pages are very annoying.

I should have been more descriptive than simply saying "broken", but I figured I was probably preaching to the choir and so I didn't go into details. In particular, it becomes much harder to use tools like ctrl+F and ctrl+S because the page content is dynamic and after scrolling down a little there's no way to easily tell which bits of the page are still loaded and which aren't. ctrl+F is useful not just for initially locating a key phrase, but also for jumping between bits of the page you've already read for comparison. In a manually-paginated thread this works fine, and I know for sure whether posts are on the same page (where I can use ctrl+F) or different pages (which I can open in separate tabs).

Basically, it becomes very difficult for a user to maintain an accurate mental model of the page content that they're using a browser to interact with. This is quite different from static pagination systems, where scrolling never changes page contents.

The scrollbar really is broken, because users expect its size to show the length of the page, which no longer holds for Discourse or other infinite-scroll pages. The fact that Discourse unloads earlier content makes this even worse, as you can't even remember an old scrollbar position to scroll to something you just saw or scroll halfway to the top to go halfway to the start of the page. Yes, Discourse does provide an alternative way to see some of this information, but user interface changes (having to move from the native scrollbar to the Discourse summary box) are frustrating for users: they break muscle memory and require learning a new interface, since they never work quite the same as the other one.

It makes me no less upset to hear that data was involved in the decision to ignore users' needs. I don't think it's intentional to annoy users, but hearing that there was some level of analysis involved rather than mere accident is upsetting because it shows the slight to be willful. I don't think websites should push worsened usability on their users in the name of driving up engagement metrics.

I think the arguments about automatic vs. manual page turning mostly come down to questions of control and implementation quality: users want to be in control (because the computer is a tool, and tools must be predictable), and it's difficult to avoid bugs when implementing automatic page turning on the Web. I'm not sure exactly why the latter is the case, but I've never seen a system without glitches in the history list, visual glitches, or slowness.

Re:Jeff Atwood on growing Discourse by dvt on Tuesday May 02, 2017 @02:52PM (#14249393)
Not sure why you're getting downvoted. Infinite-scroll pages are pretty well-documented to be shit. Even Facebook crashes or slows down to a crawl if I scroll enough (lol?). There might be a good idea somewhere in there, but current implementations fall short.
Re:Jeff Atwood on growing Discourse by jrochkind1 on Tuesday May 02, 2017 @04:21PM (#14250202)
You know what just occured to me -- Slack is effectively 'inifinite scroll' too (no pagination), of quite a bitof content sometimes... and I don't think people complain much about this aspect of Slack. Wonder how they managed to get it right.
Re:Jeff Atwood on growing Discourse by naiyt on Tuesday May 02, 2017 @05:23PM (#14250763)
Because Slack is a chat system and you typically just care about the most recent messages (which are always displayed). I find scrolling back in Slack to actually be very irritating, when I have to do it. It's slow and the view jumps around whenever the next page loads in. (The UX on the search functionality is also fairly lacking.)
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @06:03PM (#14251039)
Yeah, people basically don't care at all about chat history. Chat is short-term memory; forgetting is a feature.
Re:Jeff Atwood on growing Discourse by theparanoid on Tuesday May 02, 2017 @04:36PM (#14250329)
They add a nice ("109 comments since April 30th") link to click at the top of the chat window that does exactly what it says. Also there's a custom search box so ctrl+F isn't as broken.
Re:Jeff Atwood on growing Discourse by accountyaccount on Tuesday May 02, 2017 @03:18PM (#14249658)
How else to you handle an infinite thread of media without completely destroying browser performance? Seems to be an foundational internet issue.
Re:Jeff Atwood on growing Discourse by cookiecaper on Tuesday May 02, 2017 @03:06PM (#14249545)
I mostly agree with your post, but I would suggest refraining from accusing others of a "condescending tone" when it's unclear, at least when it's not blatant. I think you're getting downvotes because you seem overly defensive.

He appears to have accepted your statement without hostility and provided a fair reply. Please be careful not to interpret the lack of a pandering tone or excessive niceties as condescension. Remember, project runners hear complaints all day every day, they're never going to be able to make everyone happy, and this is a technical audience.

Re:Jeff Atwood on growing Discourse by mistermann on Tuesday May 02, 2017 @03:58PM (#14249999)
100% agreement from me.
Re:Jeff Atwood on growing Discourse by jwong_ on Tuesday May 02, 2017 @03:15PM (#14249624)
Breaking ctrl+f gets my blood boiling every time I have to use a Discourse site. I've recently started to have to use one, and searching for anything is incredibly hard. Ctrl+F will bring up their own hijacked search. But by default it searches for new topics. Ok, switch it to the current topic only for search. Great, now it just shows you the entire post, and doesn't highlight your search term.

I already knew where the post was, because I scrolled down to it. I don't need to be told where it was, I need to know where the specific phrase I searched for is.

I've seen complaints about it from the past, but given that 3 years has passed and it's still like that, I just give up any hope of being productive when having to use a Discourse site.

Re:Jeff Atwood on growing Discourse by mistermann on Tuesday May 02, 2017 @03:59PM (#14250018)
It's really surprising to see these sorts of problems in Discourse as Jeff is usually absolutely obsessed with user experience.
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @04:04PM (#14250063)
simply press CTRL+F twice. Note that on small topics, CTRL+F will work as you expect as the entire topic fits on one "page"
Re:Jeff Atwood on growing Discourse by Macha on Tuesday May 02, 2017 @01:24PM (#14248422)
Yeah. It's weird given he got it so right at SE and SO was just totally better than Yahoo Answers and Experts Exchange, but as a user, I hate discourse boards and would much rather good old 00s vBulletin or phpBB
Re:Jeff Atwood on growing Discourse by gavinpc on Tuesday May 02, 2017 @03:14PM (#14249612)
This is a case of "second system syndrome" (as I've heard it called).

http://wiki.c2.com/?SecondSystemEffect

(C2's new design is a bit of that in itself, IMHO.)

Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @04:05PM (#14250079)
As I like to say, if nobody hates what you're doing, it isn't very interesting.
Re:Jeff Atwood on growing Discourse by frik on Tuesday May 02, 2017 @01:54PM (#14248766)
vBulletin 3 was the gold standard and phpBB the second best.

StackOverflow has such a nice UI and UX. The UI is nice in Discourse too, but its UX needs more work. Bigger forums are hard to follow, infinite scroll comes with its own problems. The themes waste too much screen space.

Re:Jeff Atwood on growing Discourse by sbierwagen on Tuesday May 02, 2017 @02:10PM (#14248941)
Recently I've spent a certain amount of time on forums trying to troubleshoot a problem on an older car, and I'm having trouble agreeing with the statement that vBulletin was any kind of gold standard. There's just so much... junk. Huge post signatures, user badges, post counts, other post metadata... It's remarkably hard to skim a thread for relevant information.
Re:Jeff Atwood on growing Discourse by ihartley on Tuesday May 02, 2017 @02:36PM (#14249212)
A lot of that comes down to the quality and composition of the community you're looking at. The site admins have a lot of switch and levers to adjust the look and feel of a default vBulletin or phpBB install, and most communities' forums tend to end up having a similar aesthetic to the cars owned by the user base; anywhere from super bling'd out to subdued professionalism. The informational content seems to follow similar lines: some forums are populated by people who need hand holding through every step of an oil change, and others have more seasoned shade tree mechanics that just need some tips on how to do something without access to the factory tools.
Re:Jeff Atwood on growing Discourse by richardwhiuk on Tuesday May 02, 2017 @02:14PM (#14248989)
All of that stuff (post counts / signatures / badges) was part of trying to encourage it to be a community.
Re:Jeff Atwood on growing Discourse by ahartman00 on Tuesday May 02, 2017 @06:55PM (#14251437)
Can't figure out why you are being downvoted.

Post counts: a metric for how long they have been here, also an attempt to let new members know if this person knows what they are talking about. Yes, post count is a poor metric for level of knowledge, but measuring level of knowledge is not an easy problem(see controversy over IQ tests). Displaying upvotes could be better, but see reddit where people post the same dumb jokes to farm karma, or steal jokes from other subs.

Signatures: People like to express themselves. I'm not a fan of this one either, but hey. It can be useful when you see someone say something intelligent/helpful/etc, and their signature has a list of threads they started. You might find those threads filled with useful info.

Badges: This encourages desirable behavior. It can also help identify those who have a high level of knowledge.

I would add avatars: Have you every heard someone say they can remember faces, but not names? This is an attempt to help members identify each other.

Edit: post metadata: seeing the number of upvotes on a post gives you an idea on whether it is true or not.

Re:Jeff Atwood on growing Discourse by CM30 on Wednesday May 03, 2017 @05:20AM (#14254139)
Yeah, 100% this. For signatures, it's also (in a lot of cases) because people see the signature backlink as a 'reward' for using the community. Like "if I post content on a regular basis, you'll let me link back to my own site/social media presence in my signature".

This itself causes some issues (like with spammers joining simply for the 'SEO' benefits), but it's enough of a pattern that changing it will often kill a forum dead, especially in the webmaster/tech/marketing field.

Other things that encourage members (but that are often seen as clutter) include reputation systems (like the green bars vBulletin had), forum cash (points given for posts and other actions), fictional shop items (purchased with said forum cash), etc. Again, a lot of people on these forums rather like said systems and often find them useful, even if to an outsider that might be seen as overwhelming.

Re:Jeff Atwood on growing Discourse by HalfwayToDice on Tuesday May 02, 2017 @03:59PM (#14250014)
Discourse was a missed open-goal. Forum software was horrible, and Discourse were a smart team at the right point-in-time.

Unfortunately, they blew it. They created an over-engineered, over-complicated, bloated, heavy mess. Jeff bet on Moore's Law meaning that bandwidth/speed would eventually negate the bloat, but instead the world moved to low powered devices with mobile bandwidth.

They've spent years trying to get infinite scrolling working OK and installation OK. Why? Imagine if they'd actually used all their brainpower on features that forum owners actually wanted: automated spam tools, automated admin tasks, one-click install to any hosting plan (yes using PHP if necessary).

All the years of wasted talent, and now the other forum products have overtaken them on usability/maintainability. And they are STILL trying to fix the hijacked browser search feature, that you get lost in infinite scroll, and that you need to run a separate VM to run something as simple as forum software.

LESSON: beware second-system-syndrome, beware the CEO who has personal tech vendetas which are misaligned with your product strategy, and beware creating a team consisting solely of talented engineers who will do one thing: OVER-ENGINEER.

Re:Jeff Atwood on growing Discourse by Nition on Tuesday May 02, 2017 @04:41PM (#14250363)
It's interesting to hear someone else say this because all I'd really heard before this comment thread today was good things about Discourse.

I ran my own Discourse forum for a while. Users liked it well enough, but eventually I switched to using the free Steam community forums (it was a forum for a game) because it was costing me every month to run a separate server for it on Amazon.

During Discourse's life it also changed recommended install methods and auto-updates would occasionally break, so it was work to maintain. To be fair a lot of this was on relatively early versions.

I also found the Ctrl-F breaking and infinite scroll much more annoying than useful and tried to tell them[1] along with others. They listened somewhat and switched to only taking over Ctrl-F on long pages, but it's still not great. In fact I just tried to Ctrl-F for my post on the page I linked and got taken to my profile page instead.

[1] https://meta.discourse.org/t/discourse-taking-over-ctrl-f/16...

Re:Jeff Atwood on growing Discourse by movedx on Tuesday May 02, 2017 @06:11PM (#14251101)
Just as a side note, you said you hosted the Discourse on AWS, but Digital Ocean have a $10/month automated, one-click deployment which includes TBs per month of bandwidth.

Perhaps that's an option should you choose to self-host again? :-)

Re:Jeff Atwood on growing Discourse by Nition on Tuesday May 02, 2017 @06:16PM (#14251125)
Definitely. That wasn't an option when I first created the forum. Nor was using Docker. I changed my forum to Docker later, but things could still go wrong occasionally. There's a nice web interface for updating to newer forum versions but that still broke once or twice.
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @06:00PM (#14251021)
simply press CTRL+F twice.
Re:Jeff Atwood on growing Discourse by Nition on Tuesday May 02, 2017 @06:16PM (#14251130)
I tried to cover that in the example I gave at the link I posted. The forum link in the example is broken now since this was 2014 but the idea still holds:

Imagine Jimmy wants to know how to pin a topic on a Discourse forum. He searches Google for pin topic discourse or whatever, and he sees a result with a text preview saying "...icon in the upper right to get the staff menu for the topic; select Pin Topic."

That looks right, so he ends up here: http://www.phylobabble.org/t/discourse-admin-quick-start-gui...

That's a big post, so he Ctrl-F searches for "pin topic". Normally his browser would already be highlighting the text in the post, but nothing happens, so he tries clicking on the only result. This just refreshes the page and puts him back at the same post.

At this point Jimmy either leaves the forum to try another result that doesn't hijack his browser search, combs the whole thread manually, or mashes Ctrf-F enough that he discovers the Ctrl-F-F override and types "pin topic" again, instantly highlighting the section that he wanted all along.

Re:Jeff Atwood on growing Discourse by dbbk on Tuesday May 02, 2017 @06:11PM (#14251099)
How is the average person supposed to know to do that?
Re:Jeff Atwood on growing Discourse by pilsetnieks on Tuesday May 02, 2017 @06:31PM (#14251248)
The average person doesn't use ctrl+f/cmd+f; but still, for the ones who do, having to press it twice breaks muscle memory, it draws attention that something is broken or doesn't work quite like everything else.
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @06:23PM (#14251168)
the type of people that prefer the generic browser facilities over custom search aren't "average people".
Re:Jeff Atwood on growing Discourse by cookiecaper on Wednesday May 03, 2017 @12:34AM (#14253065)
Would these "average people" try to press Ctrl+F? If the argument is that most of the public is ignorant to the client-side jumping/highlighting facilitated by Ctrl+F, what purpose does overriding Ctrl+F serve? It seems that people who press Ctrl+F would have an expectation of what should happen next, and people who want custom search would move their mouse to the search bar and click.

Maybe a better compromise would be including a modal or a hint highlighting the site-wide search box without suppressing the native Ctrl+F functionality.

Re:Jeff Atwood on growing Discourse by JasonSage on Tuesday May 02, 2017 @06:53PM (#14251420)
I feel like I'm a pretty average person.

My instinct when I'm looking for something is to Ctrl+F, not scour the UI for a search bar.

Anecdotally, I know people who are not programmers who are the same way.

Re:Jeff Atwood on growing Discourse by accountyaccount on Wednesday May 03, 2017 @09:34AM (#14255483)
if you're here, you're not an average person
Re:Jeff Atwood on growing Discourse by codinghorror on Tuesday May 02, 2017 @04:13PM (#14250142)
In my opinion, it is a truism in software that it takes three years to build the thing you originally set out to build. This was true of Stack Overflow, and it's also true of Discourse.

We're supposed to be building software with the users, while observing them, while participating alongside. This takes a few years to get right.

No plan survives contact with users, and that's as it should be.

Re:Jeff Atwood on growing Discourse by debacle on Tuesday May 02, 2017 @04:21PM (#14250206)
It's also likely a truism that the things that add value and the things that make money converge into a Venn diagram, not always for the best.
Re:Jeff Atwood on growing Discourse by technion on Tuesday May 02, 2017 @09:47PM (#14252400)

    > one-click install to any hosting plan (yes using PHP if necessary).
I think you had to be fair on this - that requirement accounts for a large amount of the design compromises that make other products so poor.

Breaches on popular PHP forum software account for a disproportionate amount of the breaches we regularly hear about. It's caused issues for Linux Mint, Ubuntu, and the "Cosbycoin" compromise is hard to forget. I can't complain about any particular vendor because they have all had their share of issues in this space.

Yes, you can write good PHP - but start saying "one click on any hosting plan" and suddenly composer is out the door, every file is owned by the user the web servers runs as and you start pollyfilling for ancient versions. It means you can't assume SSL will exist, it means you can't get updates using git or any sane automation strategy, and look at how Wordpress deals with cron.

Wordpress is regularly lambasted for their support of ancient versions of PHP, which is something they do primarily to meet this goal.

In interested in what other options are out there. I rarely see Discourse on the open Internet and I cringe every time I get tempted to sign up to an old SMF or vBulletin installation.

Re:Jeff Atwood on growing Discourse by WhitneyLand on Tuesday May 02, 2017 @11:05PM (#14252707)
A week or two ago I was evaluating Discorse and by chance exchanged a few posts with Jeff, who to be frank seemed a little thin skinned.

Questions about feature priorities or technical architecture were met tersely and with a demand to know what kind of software I had ever built personally. So he wanted my resume rather that just discussing the merits of whatever topic.

Wasn't going to mention it but somehow your comment seemed to click.

Not sure what you mean about a tech vendetta, sounds like the tail end of a story.

Re:Jeff Atwood on growing Discourse by codinghorror on Wednesday May 03, 2017 @03:47AM (#14253779)
This was _literally_ your opening sentence (look it up if you don't believe me):

"I’ve started to research Discourse as a general solution and started with embed capabilities. To be frank the whole situation seems to be a bit of a mess."

To be frank, I would describe what you posted more as rants than actual discussions about features. You wanted Disqus and were pretty rude about it. That's not what we're building at Discourse. If you have a problem with that, sorry.

Re:Jeff Atwood on growing Discourse by WhitneyLand on Wednesday May 03, 2017 @11:48AM (#14256792)
You label that discussion as a rant, rather than honest questions about what Disourse users are asking for and architecture decisions? Wow.

https://meta.discourse.org/t/embed-discourse-comments-with-o...

I fully acknowledged the difficulty of your task, and tried to break down feed back into specific, actionable items.

Getting constructive criticism is not always fun, but it's part of our job. Besides that some people posting there are potential customers. Why call them ranters instead of a simple, we agree to disagree?

Re:Jeff Atwood on growing Discourse by devopsproject on Wednesday May 03, 2017 @10:52AM (#14256159)
> who to be frank seemed a little thin skinned

seems apt, lol

Re:Jeff Atwood on growing Discourse by accountyaccount on Tuesday May 02, 2017 @01:26PM (#14248447)
How is this any different from traditional pagination? My understanding is that discourse is essentially just removing the necessity to click a tiny number every time you want to view the next page.
Re:Jeff Atwood on growing Discourse by CM30 on Tuesday May 02, 2017 @04:32PM (#14250298)
Honestly, I think I (and a lot of people here) would probably prefer the numbers to what Discourse has at the moment. At least with numbered pagination you can choose to view page [whatever] to narrow down the posts you want to view. On Discourse you either scroll like mad and slowly load in crap, or click the last post and slowly scroll back up.

If I know something useful is on page 10... well I'm just out of luck.

Re:Jeff Atwood on growing Discourse by accountyaccount on Tuesday May 02, 2017 @04:42PM (#14250372)
Asking some questions because I'm legitimately curious, I'm not super familiar with Discourse... but from admin'ing some other forum platforms, their choices seem logical to me. Is the implementation just bad?

>At least with numbered pagination you can choose to view page [whatever] to narrow down the posts you want to view

Assuming you mean sequentially, isn't this the same as scrolling but with a click involved? If you don't mean sequentially, how would you know which page to click?

>If I know something useful is on page 10...

How do you know something useful is on page 10? Is it normal for forum users to remember specific page numbers within a post?

Re:Jeff Atwood on growing Discourse by detaro on Tuesday May 02, 2017 @06:42PM (#14251321)
Reasons you might want to address page numbers: Jumping ahead helps with skimming. You might (roughly) remember where you left off last. Other threads and page numbers are referenced in other threads (yes, people could link, but they don't always do)

I also like page sizes as "breaks" to follow up on links etc.

Discourse's implementation of infinite scroll isn't all that bad (it keeps position properly and doesn't seem to have strange glitches, although I haven't tried it on a bad connection), and at least navigation elements are there. But they feel strange and trip me up every time: the secondary "scroll bar", or in thinner browser windows the "progress bar" at the bottom that overlays the post content and you have to click to get the scroll bar pop up. It feels like a mobile app, half-way designed for touch, not a forum.

Re:Jeff Atwood on growing Discourse by accountyaccount on Tuesday May 02, 2017 @08:56PM (#14252185)
Interesting. Thanks for taking the time to explain.
Re:Jeff Atwood on growing Discourse by int_19h on Tuesday May 02, 2017 @06:43PM (#14251332)
Yes, it is actually pretty normal to remember such things, if it's a thread that you have read before, or otherwise kept track of.
Re:Jeff Atwood on growing Discourse by phaylon on Tuesday May 02, 2017 @05:45PM (#14250921)
At least for posts, on discourse forums I see a control on the right where I can go to specific posts. It's useful because it also shows you what date you are jumping to.
Re:Jeff Atwood on growing Discourse by ljw1001 on Friday May 05, 2017 @07:13PM (#14277519)
Sure, but how frequently would you know that something useful is on page 10? It doesn't seem like a very common use case to me. You can only optimize so many things at one time. Maybe this is a thing that's worth optimizing, but I think it's debatable.