News for hackers. Stuff that matters.
Re:Perl is no more accurate than randomly-generated language by celoyd on Monday October 24, 2011 @08:36PM (#3152237)
I’ll point out what a dozen others are probably typing right now: what works for beginners is not necessarily what’s best for experts.

An analogy: I don’t know how to read sheet music with any proficiency. It would be easier for me if note duration were shown by horizontal length instead of the system of tails and open/filled circles. However, this wouldn’t be as good for experts, who care more about fingering than about being able to see the melody in the most literal way.

I don’t happen to like perl’s syntax, but this study by itself isn’t proof that it’s objectively bad for the people who use it heavily.

Re:Perl is no more accurate than randomly-generated language by jerf on Monday October 24, 2011 @09:01PM (#3152303)
"what works for beginners is not necessarily what’s best for experts.... this study by itself isn’t proof that it’s objectively bad for the people who use it heavily."

More than that. Three languages were chosen. One was based on what previous studies had shown works, and one sounds like it was basically a ROT13'ed perl (only with symbols), and from what some were saying on Reddit it was an overcomplicated dialect of perl (though IMHO that would change little). Then, in a study in which they pitted Perl against a language designed to do well in studies, the language designed to do well in studies prevailed.

Even though I do question whether there may be a wee whiff of tautology about this whole exercise, this is interesting because it shows that studies may be able to distinguish between the features of two languages w.r.t. how easily they can be taught and learned. This is valuable stuff, millions upon millions of dollars to society's worth of valuable stuff. What it says about Perl is simply that it was not designed to do well in such studies, quelle surprise, and in particular it doesn't say anything at all about Perl relative to any other real language. $YOUR_FAVORITE_LANGUAGE may well have fared worse, and $YOUR_MOST_HATED_LANGUAGE may well have fared much better.

It is a true shame that the underlying valuable message of the study is being missed by so many people in a tearing hurry to go "hurr hurr, perl t3h suckz, hurr hurr".

Re:Perl is no more accurate than randomly-generated language by jessedhillon on Tuesday October 25, 2011 @05:46AM (#3153469)
Then, in a study in which they pitted Perl against a language designed to do well in studies, the language designed to do well in studies prevailed.

No, it's not surprising that perl performed poorer than Quorum. The surprise is that perl did as poorly as Randomo, which should not be sensible given that the operators and keywords are gibberish.

I generally agree with what you're saying, but the point of the study is not that the well-designed language did better. Who wouldn't expect that? But there is no tautological question when you realize that the result they are focusing on is the near-even performance with Randomo, not the failure to exceed or match Quorum.

It's pretty clear that they aren't engaging in perl bashing, but trying to provide data that backs up their experiential findings as teachers.

Re:Perl is no more accurate than randomly-generated language by loup-vaillant on Tuesday October 25, 2011 @06:07AM (#3153508)
From what I've understood, Randomo and Quorum's syntaxes share the same structure. Only keywords and operators changed. Therefore, Randomo has a much better structure than what we could expect from a truly randomly generated language.

So, while it still looks pretty bad for Perl, I'd say it's not that bad.

Re:Perl is no more accurate than randomly-generated language by Mithaldu on Tuesday October 25, 2011 @06:24AM (#3153544)
It doesn't look bad for Perl at all, because the entire setup of this study is flawed to the point of making the conclusion a non sequitur.
Re:Perl is no more accurate than randomly-generated language by jessedhillon on Tuesday October 25, 2011 @06:54AM (#3153595)
It always amazes me when people can dismiss academic papers -- the result of (at least) several weeks of work -- with a glib comment uttered anonymously, and no support given.

Have you read the study? If not, you can find it here: http://www.cs.siue.edu/~astefik/papers/StefikPlateau2011.pdf

Re:Perl is no more accurate than randomly-generated language by Mithaldu on Tuesday October 25, 2011 @07:01AM (#3153607)
I have read the study which is why i made that comment. In fact, i've even contacted the author to gain more details about how they selected code samples to serve as learning aids and how all the other code samples looked like.

Additionally, i am not anonymous. Google my name and you will find all about me, including, if you look for longer than a minute, my full name and address.

Lastly, there was no need to give support in that comment by repeating what others and myself have said copiously all over the comments here. This was my main post towards that. Feel free to argue it: http://news.ycombinator.com/item?id=3153249

Re:Perl is no more accurate than randomly-generated language by chromatic on Monday October 24, 2011 @09:09PM (#3152331)
What it says about Perl is simply that it was not designed to do well in such studies...

I disagree. If it says anything, it's that if you give bad code to people who don't know anything about programming, they'll have trouble writing good code.

Re:Perl is no more accurate than randomly-generated language by dpres on Tuesday October 25, 2011 @05:47AM (#3153472)
If you give a noob the task of writing a program in a language the noob has never seen before it makes sense the noob would write code that looks like random gibberish to a Perl programmer. Therefore, it's not surprising the random gibberish code would would resemble "a language design by chance" more than it would look like Perl.
Re:Perl is no more accurate than randomly-generated language by Mithaldu on Tuesday October 25, 2011 @06:23AM (#3153542)
The point he was making wasn't about the output, but about the fact that the learning material given to the test subjects was the worst perl imaginable.
Re:Perl is no more accurate than randomly-generated language by wazoox on Tuesday October 25, 2011 @07:01AM (#3153608)
There were 18 frigging participants to the study, for chrissake! You can't get any meaningful statistical data from such a ridiculously small sample!

The methodology may be sound, they may be good students and deserve a good grade, but there are absolutely zero conclusion to draw from this paper except for the fact that it may be valuable to make a larger study.

Re:Perl is no more accurate than randomly-generated language by gbog on Tuesday October 25, 2011 @01:04AM (#3152894)
These are teachers teaching software. They like the study because it somewhat confirm their experience (switching to python makes learning significantly faster).

It is not The Final Proof (against what? perl?), but it is nice to find one way, among maybe other, to give some ground to empirical teaching experience.

I don't know much of perl, but I tried bash, and know PHP well, and really, really, the language used does matter, it will shape your models and logic, and change the way you handle, debug, write, read, maintain code.

Some people seem to adhere to the relativist cliché: all languages are good for something, in their field of usage. It is a matter of personal taste (implying it doesn't matter at all).

I don't agree. All languages are not equal. The breadth or their application field is often not comparable (eg compare bash, which is useful for some unix scripting tasks, with python, which can do web, and math, and stats, and windows grey-hacking, and multiplatform desktop clients, and image processing, and Unix scripting, etc.)

Having worked with (and fought against) PHP for many years and recently switched away, I can tell, it is not a matter of taste, some languages are simply worse, which implies that some are better. There is no "equal rights" to enforce in this domain.

[edit: clarify]

Re:Perl is no more accurate than randomly-generated language by mst on Tuesday October 25, 2011 @03:01AM (#3153153)
I first learned programming writing BBC BASIC; perl is now my weapon of choice but I'm not sure I would have liked it nearly as much had I learned it first.

Interestingly (perhaps) I repeatedly hear from people with language/humanities background that they tried both python and perl and found perl much, much easier to start to get things done with - the more natural-language-ish aesthetic of perl being a strong contributor to that (I'm a pure maths grad but my parents are both Eng. Lit. grads, so I guess I sort of count in the "humanities background" category).

On the other hand, people with non-humanities backgrounds almost always found python easier to start to get things done with, even if they later found perl to be their preference.

Above comments based purely on anecdata; take them for what you will.

Re:Perl is no more accurate than randomly-generated language by Fliko on Monday October 24, 2011 @09:07PM (#3152321)
In the case of sheet music it's more about adapting yourself to the standard, so that when you write down music and some random guy in Russia writes down music you can both understand what you wrote without difficulty. (Unless you're that classical asshole who does C sharp sharp).

Most jazz musicians I have talked to and taken clinics from really don't like sheet music though, as it is an ineffective and inconcise way to represent a tune's structure and melody, hence why they prefer charts. Charts really are worlds ahead of sheet music in my opinion.

Re:Perl is no more accurate than randomly-generated language by colanderman on Monday October 24, 2011 @09:48PM (#3152407)
Double-sharps are actually a great example of syntax for experts being inappropriate for novices. The double-sharp on a note indicates that that particular note is part of an upward motion. Writing the same note as the equivalent natural would instead indicate downward motion (assuming a sharp key). Knowing the intended motion of a note can influence phrasing and help a reader predict the next note of the melody without looking ahead.

Of course when you start out reading notes, double-sharps are confusing as heck.

Re:Perl is no more accurate than randomly-generated language by Fliko on Tuesday November 01, 2011 @12:37PM (#3182862)
Haha, yeah I shouldn't of been so harsh with my mentioning of double-sharps.

I do still think that in the end people are just conforming to the standard to make life much much more easier, and that it isn't so much that certain things are better for the expert then the novice, but that experts are more used to the standards than a novice is.

I feel it's more of a matter of personal style than a programming language x being more efficient when you become an expert when compared to language y. Some people really fly with Perl, whereas other people are more of a Python kind of person.

Re:Perl is no more accurate than randomly-generated language by loup-vaillant on Tuesday October 25, 2011 @06:21AM (#3153537)
Wait a minute: the amount of information in a typical Jazz chart is vastly inferior compared to the information typically found in a score for a classical piece. This is because in Jazz, much more is left to the discretion of the musicians. So, it is quite difficult to correctly compare the two, since they don't have the same uses.

About the double sharp, it often has to do with tonality. Classical music is typically more tonal than jazz. The sharp is needed when you temporarily change tonality, and some tonalities just need double sharps then and there –Gsharp dur for instance. If you wrote the natural note instead, it would not convey the intended tonality.

Re:Perl is no more accurate than randomly-generated language by Fliko on Tuesday November 01, 2011 @12:40PM (#3182888)
That's exactly my point; programming languages aren't about x is better then y, but they are about personal style (and what they are built for). Other people really take off with x language but not y, and vice-versa.

I was also unnecessarily harsh towards double-sharps as well, when I was learning piano I would sight read a lot of easier pop/rock sheet music, and there were a few pieces I encountered with an unnecessary double-sharp that would catch me off guard because it was uncommon for the style.

Re:Perl is no more accurate than randomly-generated language by sk5t on Monday October 24, 2011 @11:07PM (#3152655)
Can you provide an example of what you mean re. the difference between sheet music and a jazz chart? I have played classical and jazz winds for years and consider them almost synonymous. (You probably won't find "changes" in the kind of sheet music other than that musicians call a "chart.")

I don't feel that any written music can or could adequately convey the feel, shape, or nature of the music--you've got to work through it with the group, or hear someone who already understands the piece.

Re:Perl is no more accurate than randomly-generated language by Fliko on Tuesday November 01, 2011 @12:35PM (#3182856)
Most jazz charts I have used just have the chord structure and the melody all on one page, whereas most classical charts I have seen (and the very very few I have used) have a lot of very intense information, and I understand that they have that much information because that is the style of classical music, but I personally very much prefer concise jazz charts.
Re:Perl is no more accurate than randomly-generated language by j_baker on Monday October 24, 2011 @11:36PM (#3152720)
I don't think anyone (the paper's authors included) would claim that this is objective proof that Perl is bad. I personally share your concerns. But wouldn't you at least agree that it's an interesting concept to try to test?
Re:Perl is no more accurate than randomly-generated language by celoyd on Tuesday October 25, 2011 @12:28AM (#3152815)
Oh, I certainly don’t begrudge them running the experiment. I just wanted to put a check on the excessively anti-Perl interpretations that I thought were suggested by the title.

A more interesting test to me would be something like seeing how fast experts in a number of languages could extend or find a bug in code by other experts. I think there’s been a little research on this, but I don’t know enough to link to the best of it.

As I said, I dislike Perl’s syntax. But I think that, on the available evidence, it makes sense to see that an an opinion on the level of disliking cilantro, not on the level of disliking geocentric cosmology.

Re:Perl is no more accurate than randomly-generated language by jimworm on Tuesday October 25, 2011 @04:39AM (#3153323)
I've played music for years and read sheet music well, but the first time I saw Singstar it was a huge wtf moment.