News for hackers. Stuff that matters.
Re:Mandela was right: the Foreign Language Effect by yongjik on Wednesday March 05, 2014 @04:14PM (#7349984)
Out of curiosity, just checked the referenced paper[1] and there is no Korean/Japanese/French version of the questionnaire they used.

It's disappointing. We all know these kinds of polls can be easily gamed by subtle (or not-so-subtle) phrasing, and without the questions actually used, I have no way of knowing if the "Foreign Language Effect" actually exists or if their choice of words in the translation affected the outcome.

[1] http://psychology.uchicago.edu/people/faculty/foreignLanguae...

Re:Mandela was right: the Foreign Language Effect by colechristensen on Wednesday March 05, 2014 @06:15PM (#7350687)
Psychology studies are (in my general opinion) notoriously poor science to the point that the vast majority of them are worthless fluff useful only for sensational headlines.
Re:Mandela was right: the Foreign Language Effect by tedks on Wednesday March 05, 2014 @11:12PM (#7351820)
As someone with personal experience inside academic psychology and academic computer science, it's my impression that psychology is far stronger as a field, having a much more rigorous community dedicated to scientific truth, and exhaustive standards of review and experimental design.

But, I'm sure that your general opinion is well-informed as well, or you wouldn't make such strong claims about a very broad field. What's your background in psychology, and what makes you say the things you do about it?

Re:Mandela was right: the Foreign Language Effect by adrianbye on Thursday March 06, 2014 @12:24AM (#7352057)
Perhaps your experience inside psychology is limited?

Nobel prize winner Daniel Kahneman[1] would disagree with you, along with social psychologist Jonathan Haidt[2].

[1] http://www.nature.com/news/nobel-laureate-challenges-psychol...

[2] http://www.nytimes.com/2011/02/08/science/08tier.html

Re:Mandela was right: the Foreign Language Effect by btilly on Thursday March 06, 2014 @01:39AM (#7352255)
This point is critical. A study can have a good methodology. But if nobody tries to replicate it, you have no chance of finding out that you are missing something critical. And with something as complex as people, "missing something critical" is something that we need to figure out.

And this isn't exactly a new problem for psychology. Feynman somewhat famously questioned a lot of classic research with http://neurotheory.columbia.edu/~ken/cargo_cult.html. I say somewhat famously because people in areas like physics have all read that essay. But in my experience psychologists are a little less inclined to read the criticism.

Even at the best of times, replication of results in a complex system is hard. See, for instance, http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fj... for evidence that most published medical research is wrong.

But with psychology it is even worse. We lump people together by symptom, not by root cause. It is like lumping together people with migraines, head injuries, and caffeine headaches together. Then you find out that coffee beats a placebo for helping headaches, and give them all coffee!

You think I'm exaggerating? Read http://www.nimh.nih.gov/about/director/2013/transforming-dia... for verification that the NIH considers it a high priority research item to come up with classifications based on root causes, so that we have a chance of even being able to do useful research!

Yes, psychology has a lot of well-meaning people, and they stumble across a lot of interesting stuff. But it should be read with a critical eye, because the field as a whole does not perform reliably enough to compel our trust.

Re:Mandela was right: the Foreign Language Effect by thaumasiotes on Thursday March 06, 2014 @02:08AM (#7352327)
> But with psychology it is even worse. We lump people together by symptom, not by root cause. It is like lumping together people with migraines, head injuries, and caffeine headaches together. Then you find out that coffee beats a placebo for helping headaches, and give them all coffee!

This happens (in medicine, not just psychology), and there's definitely room for hypothetical improvement. But in many cases, it's hard to blame people, because there's no way to do better without doing an unknown but gargantuan amount of research. For example, lupus is (or was when I had the discussion with my mother) defined as exhibiting X of a list of Y symptoms, where Y > X. This leads to situations like the following:

1. You, the patient, present with X-1 symptoms of lupus. By definition, you don't have lupus, and treatment for lupus is not warranted.

2. Time passes.

3. You, the patient, come back to your doctor with one additional symptom of lupus. Medical doctrine now states that you have lupus (not so interesting) and that, more interestingly, those X-1 earlier symptoms are symptoms of lupus (which you didn't have when you developed those symptoms), not of some other yet-undiagnosed problem. You can now be treated for lupus.

Obviously, that satisfies no one and is crying out for a more "reality-based" definition. The problem is that no one has a candidate for the actual physical causes of lupus. The best anyone's ever been able to do is recognize that the same set of treatments are broadly effective against a constellation of symptoms, which may seem to be related to each other or not, but which co-occur to some degree in people who respond to these treatments.

Of course it's a high priority to learn what the root causes of symptoms are, but that doesn't mean it's easy or even, in the general case, possible. You have to start somewhere.

Re:Mandela was right: the Foreign Language Effect by tedks on Friday March 07, 2014 @01:36PM (#7361872)
Oh no, I'm well aware of those -- but academic computer science is even worse! It's very new to have artifact evaluation at all, meaning almost any published result that represents an evaluation of a system (as opposed to something purely theoretical) is probably bunk. Almost no academic systems are released publicly for evaluation, so reproduction isn't just something that should be done, but isn't -- it's entirely impossible.

This is basically the same as publishing a psych paper with a Methods section including a line that says "and then magic occurs". It's like an unsafe cast in a programming language -- you totally escape the guarantees provided by the wider structure of the academic system.

Academia in general has serious problems. There's a fundamental problem of incentive, and until that's solved, nothing's really going to change. But psychology is definitely unfairly maligned.

(It doesn't help that plenty of people doing doing what's almost psuedoscience are still harbored in a lot of psych departments, but their methods are still more rigorous than HCI research in most cases.)

Re:Mandela was right: the Foreign Language Effect by qq66 on Thursday March 06, 2014 @03:16AM (#7352520)
Psychology isn't really comparable to computer science since computer science is the study of a manmade system, making it more like mathematics. Computer science is not a traditional "science" studying the mechanisms of an unknown phenomenon, so concepts like "experimental design" aren't easily mappable.
Re:Mandela was right: the Foreign Language Effect by tedks on Friday March 07, 2014 @01:56PM (#7361993)
Theoretical computer science is much like mathematics. But virtually no other area in computer science is, even slightly.

If you look at computer science papers in machine learning, systems, human-computer interaction, networking, robotics, or architecture, you'll almost always see an experiment of some sort. These are typically benchmarks, but there are plenty of other examples of empiricism in computer science.

But the experiments in computer science are horribly designed! They lack almost any control, and use statistical methods that would make psychologists wince. Hypothesis testing is rare to the point of nonexistance. (Psychology sometimes adjusts too far in the other direction, using complex analyses where a simpler one would do.)

Further, experiments are nearly never replicable, at all, because the systems evaluated are never made public, or the experimental environment is never recorded. For a great treatment of this trend in systems, see http://www-plan.cs.colorado.edu/diwan/asplos09.pdf. Pointing out a systematic artifact in that many experimental designs would be career-making in psychology, or any other science! But you can look at modern papers and see exactly the same mistake being made.

Re:Mandela was right: the Foreign Language Effect by colechristensen on Thursday March 06, 2014 @12:20AM (#7352040)
>But, I'm sure that your general opinion is well-informed as well, or you wouldn't make such strong claims about a very broad field.

I don't believe you are being genuine here at all. This passive-aggressive, sarcastic response is not appreciated. If you don't like what I wrote, respond directly and honestly.

Re:Mandela was right: the Foreign Language Effect by jdn on Thursday March 06, 2014 @03:46AM (#7352603)
Well dodged
Re:Mandela was right: the Foreign Language Effect by jvm on Wednesday March 05, 2014 @09:41PM (#7351535)
> majority of them are worthless fluff useful only for sensational headlines

There's a sampling bias here. A similar dynamic goes on with Physics.

Re:Mandela was right: the Foreign Language Effect by throwaway7808 on Wednesday March 05, 2014 @08:33PM (#7351258)
Still, I would advice not to disregard this study completely and at least be careful about making decisions when using a foreign language. It well might be true that the emotional and other subsystems are somewhat inhibited when thinking in a foreign language and that might have both positive and negative consequences.
Re:Mandela was right: the Foreign Language Effect by colechristensen on Wednesday March 05, 2014 @09:46PM (#7351546)
Being careful with what you speak and write is naturally good advice. A worthless scientific article doesn't make the opposite of it's conclusion true.
Re:Mandela was right: the Foreign Language Effect by throwaway7808 on Wednesday March 05, 2014 @09:54PM (#7351579)
For what it is worth, I have anecdotal evidence that thinking in a foreign language in fact does somewhat inhibit emotional and experiential (common sense) subsystems. So beware.
Re:Mandela was right: the Foreign Language Effect by 001sky on Wednesday March 05, 2014 @11:53PM (#7351967)
It's also not inconsistent that being forced to work through a "bullshit" question in a foreign language makes it more likely that the "bullshit" with be self evident. If you think of how a "con" artist works, it's by manipulating your confidence. In a "foreign" language you are lacking this confidence and thus less subject to manipulation. That being said, this is not evidence that the field of Psychology itself is not primarily bullshit. Because the latter is typically propogated in our native language ;D.
Re:Mandela was right: the Foreign Language Effect by rikacomet on Wednesday March 05, 2014 @10:51PM (#7351761)
Well, actually more than how you put it, its actually the language people use INSIDE OF THEIR BRAIN that matters.

An average person, talks to himself multiple times in a day, evaluating decisions, simulating how things are/should be, thinking about course of action etc etc.

This is done in a language, which often ends up as mother tongue to the outside world.

But the missing link here is the mental stamina. The brain has a native locale language, but if the information is coming in any other language, which needs to be understood (decoded) first into the locale language, it consumes stamina & time.

But in the case of it being actually in the language in brain's native language, less time & stamina would be consumed in the same conversation, and more time and stamina would be left for actual thinking/analysis/evaluation/etc.. leading to better understanding between people.

Peace!

Re:Mandela was right: the Foreign Language Effect by thaumasiotes on Thursday March 06, 2014 @02:29AM (#7352381)
> An average person, talks to himself multiple times in a day, evaluating decisions, simulating how things are/should be, thinking about course of action etc etc.

> This is done in a language

Why do you believe this?

Re:Mandela was right: the Foreign Language Effect by hrktb on Thursday March 06, 2014 @03:53AM (#7352631)
beefsack's comment and yours are surprising. I thought it was fairly intuitive notion, and generally accepted that language provides the basic concept and structure for thoughts. Basically the Saphir-Whorf theory [1]. There surely must be a base layer that doesn't rely on language, but anything most of the time we are handling higher level problems.

This is a theory, but most bi/tri-langual people I talked to experienced some kind of shift in their way of modeling their thought, sometimes relying on a concept only existing in a specific language (that's what makes the reliance on the language obvious).

[1] http://en.wikipedia.org/wiki/Linguistic_relativity

Re:Mandela was right: the Foreign Language Effect by _glass on Thursday March 06, 2014 @05:24AM (#7352905)
Yes, it is strange. I am a native German speaker, but my thoughts are strongly dependent on what I am thinking about. As I am reading most of the CS or philosophy books in English they are naturally thought of in English. Family and so on in German. And everything about daily life in Turkish (as I am living right now in Istanbul). On the other hand when I read a French novel my mind is switching completely back to French. Despite the fact that I am aware there should be a layer closer to the metal or irrespective the brain tissue, I can't really think of it without relying well on a language.
Re:Mandela was right: the Foreign Language Effect by beefsack on Wednesday March 05, 2014 @11:56PM (#7351981)
Nearly all thought processes deal in abstract concepts directly without being wrapped in language. Language is a transport mechanism for sharing these abstract concepts from one one brain to another, not for processing in the mind.

The idea that there is a "mother tongue" of your thoughts is a common misconception. You can consciously think about speech and language, but it's an exception to how your brain usually operates.