News for hackers. Stuff that matters.
Re:Most software companies ignore user behavior by ABeeSea on Wednesday August 28, 2019 @03:37PM (#20823262)
Having worked on user data before, I think the issue is that for complex software, it’s hard to get value/insight from this data. Imagine if you are Microsoft and had every action every Excel user makes with office365. Where would you even start to be able to get value out of this data?
Re:Most software companies ignore user behavior by gxx on Wednesday August 28, 2019 @06:02PM (#20824491)
I worked on the design of the first several versions of Excel. For Excel 3.0 we were intensely interested in user behavior. We often compared alternative prototypes of proposed features in the usability lab. We sometimes would invite develpers to watch users strugging with what they thought was great idea...

Also, long before the Internet we asked users permission to send them a special version of Excel (called the Instrumented Version) that would intelligently log actions, but not data to a floppy disk. Users would send the disks back to us for analysis. We used the analysis to understand how users really did things vs what we thought the did. Sometimes we got some surprises. We used this to prioritize features where users were having difficulty that needed special attention. It also indicated frequenty performed actions that would benefit from, for example, being put on the toolbar.

I think our user focus was an important reason why Excel has been so enduring. (Although Office 2003 screwed it up to some extent - I was no longer there.)

Back then at Microsoft the applications group tended to take the lead in UI developement and many of the things we designed made their way into Windows. Some were even picked up by the Mac! Although Steve Jobs would never have admitted it.

It grieves me to see the shoddy state of software design these days. There is no craftsmanship. Visual design take precedence over real usability. Maybe this is because with fast developemnt cycles and the ability to instantly change a web based design, it's easer to throw crap at the wall and keep iterating until it sort of works.

These days user interaction designers have endless great user data on which to craft wonderful UI but it rarely happens. If they happen to hit on something good, usually another team takes over and changes it, often for the worse!

(End Rant)

Re:Most software companies ignore user behavior by galaxyLogic on Thursday August 29, 2019 @01:03AM (#20826830)
Interesting to hear. One thing I never understood about Excel is why the cells which have formulas don't look different than cells which contain leaf-data. That I think would make it a lot more "user-friendly".

2ndly why not allow users name their columns, why do they have to always be "A", "B", "C", .. ?

Re:Most software companies ignore user behavior by MaulingMonkey on Thursday August 29, 2019 @01:37AM (#20826939)
> One thing I never understood about Excel is why the cells which have formulas don't look different than cells which contain leaf-data.

There are some styles actually meant for this, but you have to apply them manually.

> 2ndly why not allow users name their columns, why do they have to always be "A", "B", "C", .. ?

Named columns do exist actually! Not of the excel sheet itself - but in tables you can mark within that sheet. You can use the names in equations and everything. You can also name individual cells as well.

Joel Spolsky has a whole talk where he goes into this and some of the other stuff Excel has that you might not realize it has: https://www.youtube.com/watch?v=0nbkaYsR94c

Re:Most software companies ignore user behavior by juped on Thursday August 29, 2019 @03:16AM (#20827418)
By far the worst UI choice in Excel, which has stopped many potential power users from forming, is that "Format as Table" is named like a visual formatting option, is stuck on the ribbon next to visual formatting options, and prominently makes you pick colors and border formatting.

Whereas the reality is that making a table is the on-ramp to many of Excel's more powerful features.

Re:Most software companies ignore user behavior by galaxyLogic on Monday September 02, 2019 @09:55PM (#20863114)
I imagine that some developer or team had to hide such useful features under the name of "table formatting" because they could not get the ideas through in their organization. Don't know but I imagine.
Re:Most software companies ignore user behavior by tempguy9999 on Thursday August 29, 2019 @09:13AM (#20829158)
This is good stuff. Excel was (and in many ways still is) extremely well designed UI-wise (thanks for that).

In fact a lot of windows is (up to 7), and MS can be very good at UIs when they try. It's remarkable what an extraordinary amount of work went into making the interface usable without a mouse - for example, selecting something in the taskbar without a mouse:

Press ctrl-esc, press escape, press tab, then press the right arrow to move along the taskbar, the press return when you're on the one you want. It is actually logical too!

Re:Most software companies ignore user behavior by ptidhomme on Thursday August 29, 2019 @02:33AM (#20827196)
Thanks for sharing this.

Totally agree with the nowadays lack of craftsmanship. I guess it goes with the "maximum profitability" focus we got to have.

Re:Most software companies ignore user behavior by tempguy9999 on Thursday August 29, 2019 @09:15AM (#20829177)
But the UI is the product for the user. The amount of lost goodwill (and lost customers if there is an alternative) is real money ie. less-than-max profitability. It baffles me because UI design needn't be very expensive.
Re:Most software companies ignore user behavior by gxx on Thursday August 29, 2019 @10:08AM (#20829609)
Paying attention to how users work and and what they need can also be extremely profitable. The entire idea for Microsoft Office came from our discovering how often they were struggling with differerences in basic UI between say Excel and Word (which were quite different back then). Also how often they wanted to say copy data from Excel to Word or embed an Excel table in a Word document.

Based on this we decided to make the products more compatible in UI and able to work together better. It was a huge challenge because the products were designed by different teams that intensely belived in they way they had chosen to do things. It required Bill Gates to push it to make it happen and even then it was difficult.

Office 97 was the result and Office grew into a product that made billions for Microsoft. This came from our obsession with user experience...

Re:Most software companies ignore user behavior by ptidhomme on Thursday August 29, 2019 @01:13PM (#20831506)
I think we all agree. I should have rather said maximum short term profitability : fancy features and half-baked UI redesigns, rather than carefully improving the efficiency of the existing ones.
Re:Most software companies ignore user behavior by ska on Wednesday August 28, 2019 @03:42PM (#20823327)
> Where would you even start to be able to get value out of this data?

It's an interesting question, but I think there are a few obvious easy places to get value (UX on common operations, most common error modes/corrections, etc.)

In my experience the problem is more that devs apply logging or telemetry where it is easy rather than where it is insightful. So if you didn't design the system up front to capture user behavior with some granularity you end up with a bunch of questionable proxies for it, which are hard/impossible to interpret.

Re:Most software companies ignore user behavior by panopticon on Wednesday August 28, 2019 @04:32PM (#20823710)
I've also observed the problem where analysts or product managers cherry pick the data that validates their assumptions.

A "funny" example I ran into was product wanted to ship a notification that "test better" (i.e., had a higher interaction rate) in A/B testing. Some developers pointed out that the notification was likely seeing higher click-throughs because it was incredibly vague and users clicked through to figure out what it was about, and this would likely result in user frustration. Well, this insight was ignored and the notification change was shipped.

Our notification opt-out rate spiked a few weeks later.

Re:Most software companies ignore user behavior by hinkley on Wednesday August 28, 2019 @04:25PM (#20823654)
I propose you start by studying a small batch of users, documenting their behaviors, develop a set of theories, then look at whether the larger pool of data agrees with or disproves your theory.

Try to come up with theories just from data and you end up with the Texas Sharpshooter scenario. We are complaining about this sort of behavior showing up in the scientific community, let's learn from that mistake.

Re:Most software companies ignore user behavior by munk-a on Wednesday August 28, 2019 @05:00PM (#20823915)
I agree, I think doing a deep dive interview with a small set of users is better than just collecting telemetry. Ask them questions, carry on conversations, notice when they become frustrated trying to do something.

All the users could be using the right-click context menu to copy text not out of preference but instead ignorance - telemetry can tell you what's wrong but you miss out on most of the chance to tell why.

Re:Most software companies ignore user behavior by tempguy9999 on Wednesday August 28, 2019 @04:59PM (#20823906)
Install an accelerometer in the keyboard. When heavy impacts are detected from someone smashing their face into it repeatedly, pop up a dialog box asking them if there is something wrong and would they like assistance? Extensive feedback will be forthcoming.

A bit more helpfully, MS were asked repeatedly not to fuck with the menus but they replaced it with the ribbon. Ditto that terrible new interface that was nothing like windows 7. They could have allowed the choice of new interface but they did not. MS got plenty of info and chose to discard it.

MS is now in a position where it doesn't need to care.

Re:Most software companies ignore user behavior by nxc18 on Wednesday August 28, 2019 @06:40PM (#20824797)
There’s a lot of interesting history that I think this comment ignores. The office 2007 project was one of their more heavily feedback-driven initiatives; had they been paying attention the same way for Windows 8, it likely would have looked a lot more like Windows 10.

Really interesting talk: https://youtu.be/AHiNeUTgGkk

They had really good reasons for using the ribbon, not the least of which was that people weren’t finding the features they needed. That was all driven by telemetry back before it was considered the evilest of evils.

I’m amazed that you’re still bitter after 13 years. Afaict actual user preference is strongly for the ribbon, minus a very vocal minority that were bothered by the change. Office 2007 was in fact not the boon for OpenOffice that was predicted.

edit: tone, realized it came across as not as respectful as I intended

Re:Most software companies ignore user behavior by dzdt on Thursday August 29, 2019 @07:15AM (#20828451)
After 13 years there are still things I have trouble finding on the ribbon that were easy with the menu. And the ribbon totally kills the menu item->keyboard shortcut learning path to efficiently activate things you use in your personal workflow. I am bitter about this one too!
Re:Most software companies ignore user behavior by nxc18 on Thursday August 29, 2019 @01:17PM (#20831549)
Everything in the ribbon has a keyboard shortcut. Just type 'alt' to see the guides. You can also see traditional shortcuts in the tooltips.

The new 'Tell me what you want to do' search bar should help you find everything else obscure, but that unfortunately doesn't show keyboard shortcuts.

Re:Most software companies ignore user behavior by Agenttin on Thursday August 29, 2019 @10:32AM (#20829814)
I think that's the difference with a lot of these things. If you are a primary keyboard user you tend to rage against a lot of these changes.
Re:Most software companies ignore user behavior by dzdt on Friday August 30, 2019 @12:16PM (#20839984)
That may be a good guess: people who prefer words to pictures and keyboard to mouse would prefer menus to the ribbon. That pattern holds for me anyway. And I would believe that word/keyboard people are in the minority, so a UI study would identify the ribbon as superior.
Re:Most software companies ignore user behavior by contextfree on Wednesday August 28, 2019 @06:45PM (#20824836)
Here's a blog post from 2006 discussing how usage data statistics were used in designing the original ribbon from Office 2007: https://blogs.msdn.microsoft.com/jensenh/2006/04/11/grading-...
Re:Most software companies ignore user behavior by airstrike on Wednesday August 28, 2019 @05:55PM (#20824423)
I, for one, love the ribbon...
Re:Most software companies ignore user behavior by tempguy9999 on Wednesday August 28, 2019 @06:05PM (#20824516)
Good for you. But so what? (Edit: my point is not about the ribbon)
Re:Most software companies ignore user behavior by airstrike on Wednesday August 28, 2019 @06:06PM (#20824522)
I'm just saying it's not necessarily true that the ribbon is worse than old school menus.
Re:Most software companies ignore user behavior by tempguy9999 on Wednesday August 28, 2019 @06:08PM (#20824538)
And I'd agree with you. So what do you think my point was?
Re:Most software companies ignore user behavior by airstrike on Wednesday August 28, 2019 @06:21PM (#20824659)
Your point seemed to be that MS chose not to care. I think they cared but made an informed decision to go down a path that many said was wrong. If anything, I'd say kudos to them for not living in an echo chamber.
Re:Most software companies ignore user behavior by tempguy9999 on Wednesday August 28, 2019 @06:38PM (#20824785)
> Your point seemed to be that MS chose not to care

Quite. It was not about the merits of the ribbon. Which sort of echoes the article "Most software companies ignore user behavior"

> I think they cared but made an informed decision

they were heavily "informed" the ribbon would upset a lot of their customers, and for good reason. If there is another meaning to 'informed' here, please clarify.

People were not against the ribbon, they just wanted the choice. Dynamically reskinning an app like excel/word is entirely possible, and in fact straightforward if you actually own the original skin, which of course MS do.

"kudos to them" - really? For unnecessarily upsetting people who'd paid good money for office? Whose workflow was broken until they had re-learnt the new interface? Who now have a reason to move to LibreOffice, which still has menus?

Why are you defending MS's obviously stupid business decision?

Re:Most software companies ignore user behavior by rpedela on Wednesday August 28, 2019 @10:32PM (#20826165)
It wasn't an obviously stupid business decision, it wasn't even stupid. But I can see how expert users like yourself would be upset.

Prior to the ribbon design, Office was extremely hard to use, excluding the most basic features, for novice and intermediate users. In general, endless menus are confusing and/or annoying to novice and intermediate users. The ribbon design enabled novice and intermediate users to find and use more advanced features that only expert users knew about in previous Office versions. MS optimized their product design for novice and intermediate users while still maintaining all the functionality needed by expert users.

From a business perspective this made sense for two reasons:

1. Most customers are either novice or intermediate users.

2. Even though expert users will likely get pissed off that they have to relearn the interface, they will still relearn the interface. Or put another way, designing for expert users should take a backseat because they will spend the time to learn an interface no matter how convoluted it is.

Re:Most software companies ignore user behavior by tempguy9999 on Thursday August 29, 2019 @03:23AM (#20827464)
"It wasn't an obviously stupid business decision, it wasn't even stupid." -and- "Prior to the ribbon design, Office was extremely hard to use"

I'm afraid I'm just going to disagree with both of these. I'd buy that menus are somewhat harder to use for novices and the ribbon has some greater discoverability, though I'd like to see usability stats (edit: I did a quick search but found nothing solid), but you are missing my point - despite me repeating it multiple times! - that it was not about ribbon/menu. You just aren't getting it. Will people please stop dislocating the discussion onto what you want me to be talking about.

(stuff about optimizing their product design for novice and intermediate users)

That is a really good point, but it was entirely possible to support both. I wonder how.

(edit: "Even though expert users will likely get pissed off that they have to relearn the interface, they will still relearn the interface" - this is exactly what you do not inflict on your customer base without exceedingly good reason)

Re:Most software companies ignore user behavior by princeb on Wednesday August 28, 2019 @11:36PM (#20826442)
exactly, if you were a power user you'd still remember your lotus123 / commands. you wouldn't need either a menu bar nor a ribbon. microsoft kept a lot of the features the power user uses. the menu is not one of them.
Re:Most software companies ignore user behavior by tempguy9999 on Wednesday August 28, 2019 @06:57PM (#20824921)
@contextfree: I'm not arguing with you.

@nxc18: Or you (but as for "Afaict actual user preference is strongly for the ribbon" show me the stats. All else is talk).

Both of your points are IRRELEVANT to the point I made. LMHY: "choice". Not anti-ribbon, not pro-menu.

Re:Most software companies ignore user behavior by esotericn on Wednesday August 28, 2019 @05:03PM (#20823941)
The very first thing I would do is look for repetitive behaviours and crack out Clippy v2.0.

You know when someone is like, writing 1 then 2 then 3 then 4 then ... or whatever? Yeah, Clippy 2.0.

"Did you know this hotkey called X exists"?

Multiply that by N users - bam you've saved the human race thousands of hours. I'll take my Nobel now.

Re:Most software companies ignore user behavior by buerkle on Wednesday August 28, 2019 @06:10PM (#20824565)
Re:Most software companies ignore user behavior by scarejunba on Wednesday August 28, 2019 @05:59PM (#20824465)
IntelliJ IDEA has a plugin that will prompt you with the keys for commands you click. Pretty neat. Not exactly what you're saying (no compound actions). Still neat.
Re:Most software companies ignore user behavior by bonestamp2 on Thursday August 29, 2019 @12:42AM (#20826744)
> Where would you even start to be able to get value out of this data?

Much like excel for certain professions, I work on a piece of software that is used all day by people in another profession.

One thing we do is look at which features are used most (and least). We make it easier to find and use the most popular features and we make rarely used features less prominent (and in some rare cases we might remove them altogether).

In our most recent redesign, we elevated some of the most commonly used information to the point where the user doesn't even have to click anything to gain some high level insight (previous versions needed at least 1-2 clicks to get to that same info).

We have about 30 power users who we work with continuously. Some of them are nearby, and we often go look over their shoulder and pick their brains. Some of them are in other regions where we get valuable global feedback that we wouldn't otherwise get from those regions.

They get early access to new features and they get to help shape the product that they rely on for their livelihood and help us decide on what we should be working on next. It's win/win and I would recommend forming this kind of relationship with a subset of your user base if you can.

Re:Most software companies ignore user behavior by jaclaz on Friday August 30, 2019 @12:18PM (#20840001)
>One thing we do is look at which features are used most (and least). We make it easier to find and use the most popular features and we make rarely used features less prominent (and in some rare cases we might remove them altogether).

Well, with all due respect, this is not about making a "better" product, it is about making a product "easier to use" and possibly even "more popular" (which not necessarily are the same thing).

>We have about 30 power users who we work with continuously. Some of them are nearby, and we often go look over their shoulder and pick their brains. Some of them are in other regions where we get valuable global feedback that we wouldn't otherwise get from those regions. They get early access to new features and they get to help shape the product that they rely on for their livelihood and help us decide on what we should be working on next. It's win/win and I would recommend forming this kind of relationship with a subset of your user base if you can.

On the other hand this can be a much more productive approach, the program will "evolve" following the lead of these "power users", until it will become "almost perfect" (and more complex, and less popular because it has so many functions ...)

In other words, both approaches have their merits (and downsides), and IMHO you have a good process in having both, but ultimately it is the "common sense" applied to the choices you make for your product that may make a difference.

Re:Most software companies ignore user behavior by pbhjpbhj on Wednesday August 28, 2019 @10:30PM (#20826153)
>Where would you even start to be able to get value out of this data?

I'd start with the most undo-ne operations. Which specific actions are most often immediately undone by users (that could lead to addition of functions, changing UI, adding visibility of the effects of an action, all sorts).

Then probably look at most searched terms in both Excel help and online, segmented by user experience if possible (to allow improvements for noobs and advanced users, whilst aiming not to be deleterious to either).

I'm not in software development though, curious what answers y'all have?

FWIW as a relatively novice LibreOffice user I probably most often undo auto-fills where a reference variable hasn't altered how I hoped. (I'd maybe fix that with a tailored tooltip - probably actually implemented as an info box - fired on long-hover of the auto-fill handle).

Re:Most software companies ignore user behavior by rzzzt on Wednesday August 28, 2019 @05:12PM (#20824018)
I read about Office 2000's dynamically hidden menu items feature (with the expand button added to the bottom of each sub-menu) somewhere, that the items that _are_ shown initially were determined by collected usage data. So it's probably aggregation that makes the most sense, not digging into each individual user's behavior.
Re:Most software companies ignore user behavior by draugadrotten on Wednesday August 28, 2019 @04:22PM (#20823628)
Well, mcDonalds draws maps of where their workers put their feet, and then designs the kitchens to minimize the number of steps the workers needs to take to complete their jobs.

One way to use Excel telemetry could surely be to minimize the number of cognitive steps workers needs to take to complete the tasks they are trying to do.

Another could be to use telemetry to see at which point a smooth flow suddenly takes a longer time - and perhaps split an action into two actions which are faster (in time) to accomplish

I could go on all day.

Re:Most software companies ignore user behavior by jaclaz on Friday August 30, 2019 @12:45PM (#20840221)
>Well, mcDonalds draws maps of where their workers put their feet, and then designs the kitchens to minimize the number of steps the workers needs to take to complete their jobs.

In a completely different field (architecture, public spaces, parks) it has become common (and I find it a particularly smart approach) to create a new garden/public space/park with no "paths" and open it to the public.

And put some benches "here and there" semi-randomly.

Soon the grass will be worn out where people actually walks (i.e. people that needs to cross the park because it needs to go from point A to point B), so there you make the actual paved paths and the same goes for benches, some will have a path in the grass leading to them and some will look like never used, etc.

But when it comes to Excel (or similar software) there is a difference.

In the case of McDonalds personnel are instructed on exactly what they have to do and how exactly do it, i.e. their footsteps are their own optimization of an exactly specified chore.

In the case of the people on public parks there is no need for instructions, as people actually needs to go through the park to get from point A to point B and knows where they love to seat down.

In the case of Excel (or similar software) the issue is IMHO that most often than not the user doesn't actually know what he/she is doing, in the sense that user may (and often does) take a "wrong" or exceedingly convoluted path to get to the actual wanted result (when/if he/she actually gets to the result AND the result is actually correct).

I often deal with people that (most probably in good faith) bluffed their way in "familiarity with Office" on their resumè and never actually learned to work in Excel, the spreadsheet they make are "terrible", with material (and sometimes also conceptual) mistakes that are all fine if you are using Excel to - say - keep your monthly budget under control but that cause (big) issues if you are using it at work to manage a project expenses/production/forecasts, a bid offer or similar.

Feedback/telemetry from these users would "dumbify" the product and probably even make it much worse.

>I could go on all day.

I could too, I have seen things ...

Re:Most software companies ignore user behavior by james_s_tayler on Wednesday August 28, 2019 @08:36PM (#20825560)
Can we get telemetry that reports on cognitive steps for developers working on code and minimize for that?

I know there is cyclomatic complexity. Mostly you can look at a method and tell "this is a clusterfuck" without needing to break out a specialized tool. I still feel like a lot of devs don't appreciate the simple philosophy of "don't make me think."

Re:Most software companies ignore user behavior by pbhjpbhj on Wednesday August 28, 2019 @10:35PM (#20826183)
Isn't that what Ribbons are supposed to do, raise the visibility of oft-used functions, respecting context.
Re:Most software companies ignore user behavior by airstrike on Wednesday August 28, 2019 @05:56PM (#20824439)
I'd say just invite me over for a chat. I've probably spent 10,000 hours in Excel and can tell you more about its shortcomings than a PB of telemetry ever will
Re:Most software companies ignore user behavior by asdff on Wednesday August 28, 2019 @08:17PM (#20825451)
You can do so much with this data, I'm surprised if it's not already collected. You can stratify your users based on what kind of commands they do, how their mouse or cursor is moved around the screen, and what functions they are getting out of excel, and see if you can improve their experiences by lowering unneeded friction and building new features.
Re:Most software companies ignore user behavior by tinus_hn on Thursday August 29, 2019 @05:48AM (#20828101)
Microsoft actually tracks this with their telemetry, they say they want to prioritize work to the features that are used most.
Re:Most software companies ignore user behavior by bgdnyxbjx on Wednesday August 28, 2019 @04:45PM (#20823801)
Parent is clearly a PM in Excel looking for ideas