News for hackers. Stuff that matters.
Re:The 12-bit rainbow palette by splittingTimes on Saturday November 19, 2022 @01:27AM (#33667575)
> rainbow palette for use in my data visualisations.

Indeed for her kind of data the rainbow palette works okay. But if you have to visualize more complex / denser data, beware of the pitfalls of the rainbow color palette. It is not always the best choice.

IBM did research back in the 90s on perceptually-based colormaps and how to best represent various types of data within the color dimensions of luminescence, saturation and hue [1]. For example, they found that,

(1) Hue was not a good dimension for encoding magnitude information, i.e. rainbow color maps are bad.

(2) The mechanisms in human vision responsible for high spatial frequency information processing are luminance channels. If the data to be represented have high spatial frequency, use a color map which has a strong luminance variation across the data range.

(3) For interval and ratio data, both luminance- and saturation-varying color maps should produce the effect of having equal steps in data value correspond to equal perceptual steps, but the first will be most effective for high spatial frequency data variations and the second will be most effective for low spatial frequency variations.

===

[1] the original link got removed from IBMs website. Back in the day it was under

https://www.research.ibm.com/people/l/lloydt/color/color.HTM

A pdf copy is here:

https://github.com/frankMilde/interesting-reads/blob/master/...

Re:The 12-bit rainbow palette by ajuc on Saturday November 19, 2022 @01:39AM (#33667642)
What's wrong with grayscale? Why do we need to add confounding variables?
Re:The 12-bit rainbow palette by WastingMyTime89 on Saturday November 19, 2022 @02:01AM (#33667770)
Pointing that luminance is the best channel to encode spatial frequency is akin to encouraging greyscale.

It’s just that you can do it with a hue and a non zero saturation if it suits the style you are looking for.

Plus sometimes you have more than on me set of data mixed and it’s useful to be able to distinguish both by using multiple colours.

Re:The 12-bit rainbow palette by visarga on Saturday November 19, 2022 @03:11AM (#33668158)
When you want to plot a categorical distribution you need to encode category by colour, but you want them to appear maximally distinctive.
Re:The 12-bit rainbow palette by nerdponx on Saturday November 19, 2022 @02:38AM (#33667973)
A whole lot of work has been done more recently on "perceptually uniform" color palettes. See the Brewer color palette family, the "scientific colourmaps" by Crameri, and the Viridis color palette family, the latter of which was famously adopted by Matplotlib several years ago.
Re:The 12-bit rainbow palette by p-e-w on Saturday November 19, 2022 @05:39AM (#33668975)
Note that most modern palettes are designed with various forms of color blindness in mind. For that purpose, they artificially restrict the range of colors, which in turn reduces the visual information they can carry for the vast majority of people who have normal color vision.

I'd be super interested to see a study that examines how color blindness-aware design affects people without color blindness. Such design often completely avoids red hues, which are of huge importance as visual cues to normally sighted people. It's hard to imagine this doesn't have a negative impact somehow, yet I've never seen this discussed anywhere.

Re:The 12-bit rainbow palette by realgeniushere on Saturday November 19, 2022 @07:01AM (#33669373)
Careful with that kind of talk. Accessibility trolls haunt these forums and will call you a ableist and threaten you with lawsuits and bad names.
Re:The 12-bit rainbow palette by touch_abs on Saturday November 19, 2022 @08:16AM (#33669769)
Its interesting, but I suspect its too close to wrongthink for anyone to touch. Current trends in design space are all about how catering for hyper-edge cases creates a better overall product; "normally sighted" is a microaggression.

Finding that you can set up a colour range that is better for the people who can see all the colours is inevitable; but the implication is that you will now have to decide between "best" and "inclusive".

Re:The 12-bit rainbow palette by ScottEvtuch on Saturday November 19, 2022 @09:10AM (#33670181)
Aren't something like 1 in 20 or so people color blind? I'd hardly consider that as an edge case. That's roughly the odds of being over 6ft tall in the US.
Re:The 12-bit rainbow palette by tygrak on Saturday November 19, 2022 @09:14AM (#33670217)
You might not know this based on your response, but almost 10% of men are colorblind.
Re:The 12-bit rainbow palette by nerdponx on Saturday November 19, 2022 @09:42AM (#33670496)
This is ignorant and wrong. You are assuming that colorblind-friendly palettes are worse than others, but that isn't the case. In my experience, colorblind-friendly palettes actually tend to be nicer looking.

It's not wrongthink, but you might just be a jerk.

Re:The 12-bit rainbow palette by nerdponx on Saturday November 19, 2022 @09:54AM (#33670606)
My subjective experience is that good color palettes don't have too many colors anyway. Colorblind-friendliness tends to mean avoiding pairs of complementary colors that don't necessarily convey information well anyway.

Remember that we are talking about data visualization, not color palettes in general. Red is not particularly important in data viz.

Consider that many non-color-blind Dota players use the colorblind settings because they like the colors better.

Re:The 12-bit rainbow palette by p-e-w on Saturday November 19, 2022 @11:14PM (#33678169)
> Red is not particularly important in data viz.

Traditionally, red is used to indicate problematic or dangerous values. This is backed up by a long cultural history, at least in the Western cultural context, that associates red with danger.

I'd say this fact alone makes the color red extremely important in data visualization. The current trend of "but some people can't see red, so let's just use yellow and blue everywhere" seems utterly inadequate for addressing both the importance of red and the problem of color blindness.

Re:The 12-bit rainbow palette by xyzzy_plugh on Saturday November 19, 2022 @02:19PM (#33673606)
They're designed with color blindness in mind for good reason. Prevalence in males is between 5-10% but in my experience it's higher in software industry, for whatever reason.

Of course restricting available colors affects the diversity of palettes, but often designs can accommodate both handily.

It's nearly 2023 and many, many charts are interactive. There's little excuse to at least having a color blind mode be opt-in for such things. If we're all looking at charts on our personal devices, then local accomodations render your entire argument moot.

You can have your cake and eat it too.

Re:The 12-bit rainbow palette by p-e-w on Saturday November 19, 2022 @11:18PM (#33678189)
> but often designs can accommodate both handily

Where is the research to back this up? While I've seen tons of articles that go into great detail on how to simulate and accommodate various forms of colorblindness, the idea that those accommodations have no negative impact on the rest of the population appears to be taken as an axiom that somehow requires no data to support it.

Re:The 12-bit rainbow palette by xyzzy_plugh on Sunday November 20, 2022 @11:30PM (#33688772)
Most charts don't have a ton of data. Choosing four accessible colors is not challenging. Most UIs are monochromatic.

I'm not sure I need data, most interfaces or designs you see already accommodate color blindness via simplicity. Those that do not can almost always do so by adjusting the palette subtly, with almost no perceptual difference for those who are not colorblind.

Obviously simulating colorblindness on a general graphics level is less effective, and I don't think anyone is suggesting we apply such filters universally.

The center of my argument is that it is easy with software, which has consumed the information world, to simply offer alternative viewing modes, of which colorblind modes are not very complicated.

Re:The 12-bit rainbow palette by maliker on Saturday November 19, 2022 @01:02PM (#33672745)
Great and fun talk on the development of Viridis: https://www.youtube.com/watch?v=xAoljeRJ3lU
Re:The 12-bit rainbow palette by twelvechairs on Saturday November 19, 2022 @03:52AM (#33668381)
> (1) Hue was not a good dimension for encoding magnitude information, i.e. rainbow color maps are bad.

Your inference doesnt follow from the first point. Hue is bad for magnitude because you dont see a different hue as 'more' or 'less' just 'different'. Hue is great for representing difference without defining one as a focus or preference over the other.

Re:The 12-bit rainbow palette by ilyt on Saturday November 19, 2022 @04:25AM (#33668546)
>Indeed for her kind of data the rainbow palette works okay. But if you have to visualize more complex / denser data, beware of the pitfalls of the rainbow color palette. It is not always the best choice.

There is already a trap in this palette, the first color looks awfully like the last. It's fine if you just want a palette for a bunch of lines but using it for heatmap could be a bit misleading in edge cases

Re:The 12-bit rainbow palette by IIAOPSW on Saturday November 19, 2022 @08:10AM (#33669736)
I have a pet theory that certain high spatial frequencies bleed into being perceived a colors anyway. The reason being that the red, green, and blue cones in the retina each have a different amount of space between them but are otherwise organized in the same pattern. Thus if the brain sees something with the same spacing as the blue cones, its going to assume that's caused by it being a blue object (rather than a black/white object which happened to have the same spatial freq as the blue cells). You seem to know the literature here, is there anything validating or invalidating my pet theory?
Re:The 12-bit rainbow palette by hunter2_ on Saturday November 19, 2022 @10:17AM (#33670854)
I'm no expert, but that sounds a lot like how halftone and dithering work.
Re:The 12-bit rainbow palette by nyanpasu64 on Saturday November 19, 2022 @10:50AM (#33671206)
I've never noticed such happening by eyes, but I've definitely seen distant ocean reflections (tiny randomly-shifting specks of light) being misinterpreted as colors by Bayer matrix camera sensors.
Re:The 12-bit rainbow palette by IIAOPSW on Saturday November 19, 2022 @12:46PM (#33672546)
full disclosure, this pet theory is entirely based on observations of people on LSD. High frequency spatial patterns consistently get distorted in colorful ways.
Re:The 12-bit rainbow palette by photoGrant on Saturday November 19, 2022 @01:03PM (#33672758)
This is called metameric failure
Re:The 12-bit rainbow palette by azalemeth on Saturday November 19, 2022 @08:17AM (#33669777)
This is a whole area of research (as you probably know). I personally only like HSV colourmaps for visualisations of phase, as it has no boundaries at the edges and therefore when you wrap over 2π again you don't get a hard discontinuity. Often you're not actually interested in what the "number" is, but how quickly it is cycling – something that it gets across quite well.
Re:The 12-bit rainbow palette by sj4nz on Saturday November 19, 2022 @09:32AM (#33670389)
I agree that trying to use hue for encoding magnatude information is not great, but man, how many times have I given up on someone's infographic that decided to use four different shades of blue and purple you can't tell apart when the markers are only eight or sixteen pixels on the screen.

I should hope the 12-bit rainbow palette would be adopted for those kinds of visualizations.

Re:The 12-bit rainbow palette by nine_k on Saturday November 19, 2022 @01:50PM (#33673309)
What is often needed in visualizations is showing several parameters next to each other. Think not color maps that showvariation of one value, like a heat map, but line or bar charts, or area maps with various pars marked.