News for hackers. Stuff that matters.
Re:Why Python is Slow: Looking Under the Hood by gregwebs on Friday May 09, 2014 @01:21PM (#7722045)

    Dynamic typing makes Python easier to use than C
I disagree with the implications. The main reasons Python is easier to use is independent of type system. Not having to manually manage memory, for example! Overall it is a higher-level language, whereas C is designed for maximum performance.

Dynamic typing is probably preferable to a 40 year old type system. But Python could be easier to use (catch bugs ahead of time!) and execute faster by adding a modern type system. Optional typing (like TypeScript or Facebook's new PHP implemntation) would probably be appropriate.

Re:Why Python is Slow: Looking Under the Hood by Perseids on Friday May 09, 2014 @04:29PM (#7723115)
>> Dynamic typing makes Python easier to use than C

> Overall it is a higher-level language, whereas C is designed for maximum performance.

I agree with most of your points, but on this I think you are comparing apples to oranges. C is not designed for maximum performance, but as a system language and as such only as slim abstraction over assembler. As a side effect it allows for maximum performance. A more fair comparison (pretty much every widely used language is easier to use than C) would be C++ vs. Python, where in C++ most - if not all - of the higher level abstractions were explicitly designed not to worsen performance compared to low level code. And in my opinion Python is so much easier to use than C++ because it values simplicity and consistency more than efficiency.

For example the general loop constructions in Python which are possible because of nice generators and the wonderfully straightforward `yield` construction are unacceptable in C++ as they lack the flexibility to be as efficient as possible in every case.

The advantage of dynamic typing only becomes apparent in a third argumentative step; when you try build a language with consistent and efficient abstraction and you end up with something like Haskell whose type system complexity is huge entry barrier. That's why I think dynamic typing is good for Python.

Re:Why Python is Slow: Looking Under the Hood by DerpDerpDerp on Friday May 09, 2014 @05:01PM (#7723244)
I find the Haskell type system much easier than the Python type system.

I'd argue that Haskell actually has a pedagogy problem, because many of its proponents are academics or mathematicians, who are comfortable with that kind of language. Talking about monads, functors, and arrows is a very natural activity for them, and clarifies rather than complicates the subject. However, you don't really have to understand any of that to get started in Haskell, and much of the blogging community has (I think wrongly) focused on explaining advanced concepts rather than making easy introductions.

You don't have to deal with monads any more than you have to deal with Python's OO behavior - which is to say, for quite a while.

I'd also argue that once you take in to account the sometime strange OO implementation of Python, and that Haskell has type inference for most things, Haskell is easier to understand the high level concepts in. Typeclasses and higher order functions (functions which act on functions) provide a very neat way to substitute in different types to your algorithm without having to change the whole thing, and don't even delve in to the complicated world of functors and monads.

Re:Why Python is Slow: Looking Under the Hood by Jare on Friday May 09, 2014 @05:45PM (#7723426)
> much of the blogging community has (I think wrongly) focused on explaining advanced concepts rather than making easy introductions.

I would like to make two notes about this:

- Most of the Haskell tutorial examples are about computing pi, fibs, and other math functions or series. Which is fine, but rather obvious beyond the recursion vs iteration bit. It's not just that newcomers arrive to Haskell with an imperative mindset, it's that they (we?) come with imperative (stateful) algorithms, which of course turn out to be a nightmare to implement.

- I found those explanations about Monads, etc necessary because as soon as I wanted to do anything less obvious than calculating a function or series, it was pretty hard to figure out how to get it done. For example, adding print logs to my code to debug, or building the code to output the formatted result of my program. "Why can't I use map here?" "What is is this mapM thing?" are very real roadblocks.

Those problems are not unique to Haskell, of course, but Haskell's purity makes it much more inflexible - you can't do some part the Haskell way to learn the ropes while you do the rest imperatively to get actual, satisfying results.

Re:Why Python is Slow: Looking Under the Hood by millstone on Friday May 09, 2014 @05:33PM (#7723365)
You can maybe put off the theory of monads, but their machinery hits you fast and early. For example, the meet-and-greet from Learn You A Haskell:

    main = do  
        putStrLn "Hello, what's your name?"  
        name <- getLine  
        putStrLn ("Hey " ++ name ++ ", you rock!")
The monad effectively introduced a separate syntax for declaring variables, which you must use in preference to let/where, and the compiler will emit a gibberish error message if you mix them up. So you must acquire at least a working understanding of monadic syntax before you can write a trivial program.
Re:Why Python is Slow: Looking Under the Hood by Perseids on Saturday May 10, 2014 @04:31AM (#7724850)
> I'd argue that Haskell actually has a pedagogy problem, because many of its proponents are academics or mathematicians, who are comfortable with that kind of language. Talking about monads, functors, and arrows is a very natural activity for them, and clarifies rather than complicates the subject.

Btw. I am a mathematician and the only time I ever had contact with category theory was in a seminar presentation. The great majority of students at our university would be as new to functors as most of you.

But on the other hand the reason I am fascinated by Haskell are all these advanced methodologies that promise to make the act of solving a problem more manageable. To contrast that against the Python/C comparison I find that Python gets less in my way (probably even less than any other programming language I've tried) but hasn't taught me concepts that I didn't already know from C++/Java/…

So the question would be: If you don't want to learn about Monads, why would you come to Haskell in the first place?

Re:Why Python is Slow: Looking Under the Hood by Amadiro on Saturday May 10, 2014 @09:19AM (#7725292)
Category theory is pretty popular IME, I've seen lots of mathematician talk about it. It seems fairly popular especially with algebraic geometrists and algebraic topologists.

OTOH I've never seen any mathematician use (perhaps with the exception of myself, depending on at what point you start counting a person as "mathematician" and at what point you consider someone to be "using haskell") haskell. I doubt the haskell community actually has any mathematicians, it's mostly just people who'd like to be mathematicians but are too lazy to get a degree.

The overlap of mathematicians who care about category theory (some logicians, algebraic geometrists, algebraic topologists, ...) and mathematicians who program (mostly mathematicians from applied disciplines, numerical methods, computational physics, ...) is pretty much zero.

You probably won't find your algebraic topology professor programming in any language anytimes soon, except LaTeX.

Re:Why Python is Slow: Looking Under the Hood by gjm11 on Saturday May 10, 2014 @09:43AM (#7725358)
> The overlap of mathematicians who care about category theory [...] and mathematicians who program [...] is pretty much zero. You probably won't find your algebraic topology professor programming

Well, unless perhaps s/he has some involvement in a project like this one http://comptop.stanford.edu/ ("The overall goal of this project is to develop flexible topological methods which will allow the analysis of data which is difficult to analyze using classical linear methods"; first named person in left sidebar is an algebraic topologist).

Or this one http://www.esf.org/index.php?id=8764 ("Applied and Computational Algebraic Topology"; first named person on steering committee is an algebraic topologist).

Or this one http://munkres.us.es:8080/groups/catam/ ("Computational Applied Topology and Applied Mathematics"; directory is an algebraic topologist).

Or, turning away from algebraic topology as such to mathematics inspired by algebraic topology and involving both category theory and programming: http://homotopytypetheory.org/ ("... new program for a comprehensive, computational foundation for mathematics based on the homotopical interpretation of type theory. [...] currently being implemented with the help of the automated proof assistant Coq"; note that in practice doing nontrivial things in Coq is a matter of functional programming).

For sure there are plenty of mathematicians (in algebraic topology and elsewhere) who don't program, but I think the intersection between people interested in categories and people interesting in programming is bigger than you suggest.

I don't know how many of them are using Haskell, though.

Re:Why Python is Slow: Looking Under the Hood by Amadiro on Saturday May 10, 2014 @11:37AM (#7725760)
Yeah, I'm aware that some projects that apply computer science to pure mathematics (in various forms like Kenzo/CAT, PLEX (not CPLEX, that's for applied mathematics/finance/etc), agda, coq, GAP, ...) exist, but I don't think the claim that they are very very niche with mathematicians is exaggerated.

If you go to your average mathematics department and ask a few professors there that work in logic, algtop or alggeom, I doubt you'll find any that do any programming for their research. You probably won't find that many logicians that use proof-assistants either, although those are probably the least niche category of the things listed (and they are fairly popular with the CS folks)

Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @03:47AM (#7724788)
> However, you don't really have to understand any of that to get started in Haskell

For sure. Then you get a compiler error.

Programming Haskell without understand the type system and lambda calculus is not possible.

Edit: thanks for downvoting me. If you believe that you can program Haskell without understanding the basics of Functional Programming and without understanding the type system, then you live in an alternate reality or want to evangelize Haskell.

Re:Why Python is Slow: Looking Under the Hood by CHY872 on Saturday May 10, 2014 @07:42AM (#7725102)
I'm sorry, but to be an amazing programmer in Haskell, the understanding you need of the lambda calculus is minimal.. For example, consider this function to compute the Ackermann function in the lambda calculus:

    λx. x (λf y.y f (f 1) ) (λx1 f x.f (x1 f x))
or even just addition

    λx y f x.(x f) (y f x)
none of that will even come up in Haskell.

Even the type system - you need to understand some tiny amount - you can only add ints to ints etc. The more complicated stuff, the type inference, the monads etc - can be ignored until later.

Haskell can be used without understanding - almost all programming languages can. That's why we have so many newbie bugs.

Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @08:57AM (#7725232)
Until later? What later. An hour later?

Let's look at a few chapter titles of Real World Haskell.

Chapter 2: Types and Functions

Chapter 3: Defining types, streamlining functions

Chapter 4: Functional Programming

Chapter 6: Using Typeclasses

Chapter 14: Monads

Chapter 15: Programming with Monads

Chapter 18: Monad transformers

Re:Why Python is Slow: Looking Under the Hood by Amadiro on Saturday May 10, 2014 @11:43AM (#7725786)
It's a matter of perspective -- to someone who has taken a university class on lambda calculus/on logic that had a chapter on lambda calculus (e.g. as part of a M.Sc. in mathematical logic or CS), anything in RWH would probably seem extremely basic and superficial. It doesn't even introduce most of the basic things a first chapter in a book on lambda calculus would probably introduce you to.
Re:Why Python is Slow: Looking Under the Hood by pjmlp on Saturday May 10, 2014 @02:39PM (#7726436)
My degree was also heavy on FP and LP alongside many other themes.

I think the biggest issue is with those developers that never got a degree or were unfortunate to land in a degree that taught programming languages instead of programming concepts.

Re:Why Python is Slow: Looking Under the Hood by jgg on Sunday May 11, 2014 @01:46PM (#7729288)
The pretentious view that Haskell's core is a mathematical structure familiar to mathematicians is wrong.

Haskell borrows concepts from category theory (a "field" so abstract from most math that most mathematicians don't need but a handful of its concepts) to label typeclasses, and those typeclasses don't always follow from their namesake.

Further, Haskell could exist and keep its property of referential transparency without the the 'mathematical' structures or their names. Here's a version of Haskell without monads: http://donsbot.wordpress.com/2009/01/31/reviving-the-gofer-s...

Monads, functors, arrows, etc. are more aesthetic than fundamental to the core nature of Haskell. They're just a bookish (and sometimes bureaucratic, IMO) design choice. What I mean by that, is that the language designers took a concept (referential transparency) and built an understandable structure, but beside and aside from this, made a bunch of nested, derived typeclasses of dubious value or purpose. Sometimes I look at a Haskell library and have a more academic version of the, "Why the fuck is this a class?" moment.

I'd like to comment tangentially that Haskell is almost the OOP/Java of the 2010's - the programming community claims that it makes your code "safer", and in some sense it very much does, but its features are being perverted and overhyped while its caveats are being forgotten.

Re:Why Python is Slow: Looking Under the Hood by Spittie on Friday May 09, 2014 @01:44PM (#7722212)
I'd love to see optional typing in Python, I wonder if there is any official reasons about why it never got introduced.

I very rarely change the type of a variable, so it would be essentially free speed and free speeds for me.

I actually wonder, do people use dynamic typing so often? I mean, it's nice to do "variable = int(variable)" when I know that I'm getting an integer in a string, but that's probably the only use case can I can think off that doesn't just reuse variables for something else.

Re:Why Python is Slow: Looking Under the Hood by nairteashop on Friday May 09, 2014 @02:01PM (#7722335)
> I'd love to see optional typing in Python, I wonder if there is any official reasons about why it never got introduced.

Here are a few from Guido himself (not really anti static-typing, but just walking you through pros/cons as he sees them). Great reads:

http://www.artima.com/weblogs/viewpost.jsp?thread=85551

http://www.artima.com/weblogs/viewpost.jsp?thread=86641

http://www.artima.com/weblogs/viewpost.jsp?thread=87182

Re:Why Python is Slow: Looking Under the Hood by njharman on Friday May 09, 2014 @04:37PM (#7723141)
I consider http://cython.org/ to be the "optional typing" implementation of Python.
Re:Why Python is Slow: Looking Under the Hood by collyw on Friday May 09, 2014 @01:54PM (#7722277)
I started programming in Java, and moved to Perl and now Python. At first it seemed a bit weird, dynamic typing, but now I embrace it and enjoy the flexibility it offers. I see that many people prefer static typing and I am not sure why.

Can someone give me a concrete example of when static typing would be beneficial? (The majority of my work revolves around databases, so I guess I rely on that as a kind of type checking to a degree).

Re:Why Python is Slow: Looking Under the Hood by yogsototh on Friday May 09, 2014 @02:28PM (#7722510)
Static typing à la C,C++,Java,js,etc... is from my experience inferior to dynamic typing.

On the other hand, the Haskell typing is superior in many ways to dynamic typing. Because you lose very few power of expression but you gain a lot of time in your workflow (and also security).

Concrete example (I'll use js):

    function showField(data) {
       console.log(data.field1.filed2);
    }
you relaunch your application, you click on three to four elements, then you enter your name and a password. You click on the button, and "BAM, filed2 doesn't exists". Correct the typo or add a test and replay the game of executing your new code.

Static typing:

    showField : ConcreteData -> IO ()
    showField data = putStrLn $ filed2 (field1 data)
Try to compile, get the error: showField : filed2 doesn't exists, may be you mean "field2".

correct your code. Now you're done.

Here is another example:

Dynamic typing:

    function showField(data) {
      if (data.field) { console.log("OK"); } 
      else { console.log("Not OK")}
    }
    
    ...
    
    showField(myData);
Try it using all manipulations to reach the test case, then: ERROR, couldn't find field for null. :-| replace by if (data && data.field).

In static typing:

    showField data = if (field data) 
                        then putStrLn "OK"
                        else putStrLn "Not OK"
compile: could not match String with (Maybe String) at ... now:

    showField data 
      | field data == Nothing = putStrLn "Not OK"
      | otherwise = putStrLn "OK"
You fixed it, but you didn't had to lose your time searching the error.

The BIG bonus is that you detect the error before you discover it at runtime. Imagine you didn't detected the error during your test (even with unit tests). This is why it is so easy to push this kind of error in production in a dynamic typed language.

And I only scratched the surface.

I program mostly in JS now, and I love even more when I am doing Haskell.

Re:Why Python is Slow: Looking Under the Hood by yiransheng on Friday May 09, 2014 @05:44PM (#7723423)
Very well put, I am learning haskell at the moment, and beginning to appreciate the power of its type system in a way never which I never felt in Java, C etc.

When you chain a series of functions/actions together, only to supply data for computation last, type signatures almost always ensures the correctness of the entire computation. This is true even the computation occurs at a high abstraction level. It's almost like magic, when dealing with the more difficult concepts (well for beginners) like monads. There has been a number of times when I wrote something but cannot make sure it does what I want, yet it compiles and a few tests reveals it indeed works like a charm.

Whereas in dynamic languages, it'd be a nightmare to dig into the dirty details at runtime. I always have this problem in R, a series of supposedly elegantly linked operations fail for mistakes like forgetting to convert character values into factor type. To debug such errors, I always have to explicitly carry out middle steps and store intermediary results, until finally locating the problem.

Another note, even in javaScript, sometimes there at patterns encourage the use of implicit types or interfaces(typeclass in haskell). The canonical example is jQuery, most of the times you can safely do:

    $(something).method1().method2(param).method3()...
This is because any jQuery object inherits methods from $.fn, and most of these methods returns either the same jQuery object, or another jQuery object. In a sense, jQuery itself is a typeclass, anything looks like $(something) is a instance type.
Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @03:50AM (#7724793)
To find undefined slots or undefined functions, you don't need a type system. A competent compiler is sufficient.
Re:Why Python is Slow: Looking Under the Hood by yogsototh on Saturday May 10, 2014 @08:48AM (#7725204)
The type system enforce some kind of usage.

    myObject[ someFunction() ] = 1;
No compiler in the world would be able to detect if myObject.field should exists or not.

In a (good) type system oriented language, you have to declare that myObject is a Map, and therefore when you want to access "field" you know this access could be "Nothing". The type system alert you if you don't handle the "Nothing" value.

Re:Why Python is Slow: Looking Under the Hood by nly on Friday May 09, 2014 @03:29PM (#7722821)
Static typing makes it a lot easier to reason locally about code.

I can't understand what a function is doing in isolation when the types are unknown. A function takes a variable foo and returns foo[bar], what did it return? Is that even valid code? What does that even mean if foo is a string and bar is a database handle? Ok, this is a lookup of some kind... is it an index or a hash table? I have no way of knowing without reading the comments (which may or may not exist). The only other way to figure out what the function is used for is to trace the data all the way back to its creation... literally find every call site and slog my way up the call stack.

In a dynamic language you can't even tell if all your code will execute until you run it and test all the code paths, let alone attempting to convince yourself that it's correct. I don't understand why people want that cognitive burden when the compiler can tell you straight away that you've typed something nonsensical.

I've just never seen a code sample that made me want to throw away static typing. Not even one.

Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @03:58AM (#7724804)
If you use a language with type inference, you won't see what it returns either. Because it is not in the code. You would need an IDE which finds it out.

Sometimes it computes a type and you have no idea what the type is about.

Also dynamic typing does not mean you don't know what a function receives or returns. Many dynamically typed languages are object oriented and use classes.

For example in Lisp I would write:

    (defmethod collide ((s1 ship) (s2 submarine))
      ...
      (the collision-event (make-collision-event ...)))
Then I know that the arguments are objects of class ship and submarine and it returns an collision-event.

It's not statically typed, but the code is nicely readable and testable.

Re:Why Python is Slow: Looking Under the Hood by benjiweber on Saturday May 10, 2014 @05:24AM (#7724916)
With inferred types you still know that callers must be passing something for which the operations performed are valid.

Many languages allow you to specify types even when they may be inferred to add clarity/preconditions. This is useful for modelling the domain as well as local reasoning. Perhaps the current implementation is valid for all integers, but in the domain context it only makes sense for the range 0-100.

Re:Why Python is Slow: Looking Under the Hood by nly on Saturday May 10, 2014 @07:33AM (#7725091)
If the compiler can infer the type locally then so can I. At least for reasonably well structured code.
Re:Why Python is Slow: Looking Under the Hood by cousin_it on Saturday May 10, 2014 @08:39AM (#7725186)
I thought type inference in Haskell or ML was a global algorithm.
Re:Why Python is Slow: Looking Under the Hood by Aaronontheweb on Friday May 09, 2014 @03:10PM (#7722745)
Static typing lends itself to static analysis and other defensive programming practices that are easy to enforce at compile-time (such as design by contract.) A lot of bugs and design errors die long before erroneous code hits source control as a result - definitely not all of them, but many of them.

The best compromise between static typing and dynamic typing, IMHO, is what C# (and later generations of C++) do: implicit typing via the VAR keyword.

You can't implicitly type the members of an object or the arguments of a function, but you can implicitly type variables in local scope. This is how C# is able to support anonymous types and functions so easily - implicit typing abstracts away the gangly looking static objects that are produced by LINQ queries and the like.

Implicit typing makes it very easy to refactor large blocks of statically typed code without compromising the benefits of static typing. So you get some of the flexibility of dynamic typing with the predictability of static typing.

Realistically - you don't utterly redefine the type of objects at runtime very often in production code even with dynamic languages, so you don't lose much with implicit typing.

Re:Why Python is Slow: Looking Under the Hood by MichaelGG on Friday May 09, 2014 @04:41PM (#7723152)
>You can't implicitly type the members of an object or the arguments of a function

That was due more to architectural issues in the C# compiler than any principled reason. C#'s type inference is extremely weak and incomplete and is a poor example of "getting it right".

Re:Why Python is Slow: Looking Under the Hood by Aaronontheweb on Friday May 09, 2014 @05:26PM (#7723333)
I'm failing to imagine a scenario where implicitly typing either of these would benefit me as the developer - having those elements remain statically typed seems like "the right thing to do" given their role in defining public code contracts. Could you help me understand why this is a bad thing?
Re:Why Python is Slow: Looking Under the Hood by MichaelGG on Friday May 09, 2014 @07:43PM (#7723881)
They are always statically typed; no one is talking about dynamic typing. Inferred types are just as static as any others.

Example: Dictionary<string, Func<string, int, Dictionary<string, string>>> somedic = new Dictionary<string, Func<string, int, Dictionary<string, string>>> { ... }

Is almost entirely better served by

  let somedic = dict [ ... ]
Your point about defining a public interface is separate. If you have a specific API that you cannot break, then feel free to type it out all you want. If you feel a piece of code is confusing or unclear without an annotation, go ahead and add it.

For the majority of code, having to specify the types is an exercise in verbosity, nothing more. Unless you're only writing public libraries with no internal implementation, I don't see how there's not a scenario.

Re:Why Python is Slow: Looking Under the Hood by Aaronontheweb on Saturday May 10, 2014 @02:36PM (#7726428)
I agree that doing that type of inference would be convenient - I deal with a lot of nested generics like that on daily basis.

But this is just syntactic sugar, and the var keyword already takes care of the left-hand operand in this equation. Generic functions also do a reasonably good job of type inference under this set of circumstances, although I've found that generic delegates and lambdas not so much.

Re:Why Python is Slow: Looking Under the Hood by Aaronontheweb on Friday May 09, 2014 @06:29PM (#7723593)
whoops, meant to say "gangly looking HIDDEN objects" instead of "static" objects
Re:Why Python is Slow: Looking Under the Hood by antocv on Friday May 09, 2014 @02:10PM (#7722394)
Static typing provides more information for the programmer and for the runtime.

More information makes the code somewhat readable and understandable 10 years after when it was written. Dynamic typing often becomes a much more messy affair.

Static typing is beneficial when you want to catch a certain type of errors before your code enters production, it makes you write less error prone code.

Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @04:02AM (#7724812)
Not my experience. Dynamically typed OO language carry enough information around.
Re:Why Python is Slow: Looking Under the Hood by oldmanjay on Saturday May 10, 2014 @07:53AM (#7725117)
the point is that in statically typed languages, the type information is used at compile time, and the computer can reason about certain types of errors for you prior to execution. in dynamic languages, the type information may well be there, but you need to exercise the code at runtime (via tests or whatever, but still runtime) to make use of it.
Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @09:04AM (#7725252)
True, but code is running. If it's not used, then the error won't be relevant anyway. I'm not talking about rocket, aircraft, power plant software. But even there, I never heard that any of those really critical domains use Haskell (or similar) in their control systems.
Re:Why Python is Slow: Looking Under the Hood by zmmmmm on Friday May 09, 2014 @10:02PM (#7724203)
Your only experience with static typing is with Java which has one of the lowest "value for effort" type systems around. Java's type system is mostly bookkeeping and doesn't help you functionally really at all while taking a lot of effort to deal with at the programmer end. By contrast there are much more powerful type systems where the typing takes much less effort AND delivers you actual functional benefits. Crucially Java's generics are not preserved through to runtime, so there is no actually difference between List<Integer> and List<String> to the JVM, only the compiler. If there was a difference all sorts of powerful things could be done with the types at runtime, but as it is it's mostly just the compiler complaining about whether you dotted i's and crossed t's.

I program a lot in Groovy these days, and it now has optional static typing with a limited amount of type inference. What I observe is that I voluntarily prefer to type my variables much of the time because it really does save time and takes only a fraction more effort than leaving them untyped. I find Python quite hard to decipher much of the time because it's nearly impossible to know what type a variable passed into a function is unless you trace back to the caller.

Re:Why Python is Slow: Looking Under the Hood by vorg on Saturday May 10, 2014 @01:43AM (#7724632)
> I program a lot in Groovy these days, and it now has optional static typing with a limited amount of type inference

Groovy has enabled types on variables and functions (and fields and methods) since Groovy 1.0 but that makes the code run slower.

Re:Why Python is Slow: Looking Under the Hood by zmmmmm on Saturday May 10, 2014 @02:31AM (#7724692)
That is not what I am referring to. 2.0 introduced true static typing that compiles to code that not only enforces complete type correctness at compile time (unlike the old option) but executes at near Java speed.
Re:Why Python is Slow: Looking Under the Hood by maxlybbert on Friday May 09, 2014 @02:26PM (#7722496)
In Javascript (which is also dynamically typed) I've had a few times where adding 1 and 0, say, yielded "10" because either the 1 or the 0 originally came from a string. OK, I can live with that, but I find the fact that you can use that string in numeric comparisons potentially confusing.

The general argument is that if you write enough unit tests, you can guarantee that your code doesn't make those kinds of mistakes. The statically-typed response is "why should you have to write unit tests when the compiler can make that guarantee for you?"

Re:Why Python is Slow: Looking Under the Hood by ajanuary on Friday May 09, 2014 @02:38PM (#7722561)
Adding strings to integers is usually referred to as weak typing, which is a seperate and orthogonal concept to dynamic typing. The runtime of a dynamic language could look at the two types of the values, decide they're different and throw a type error. Similarly, a static type checker could look at the types of the values and decide it knows how to do an implicit cast from one to the other.
Re:Why Python is Slow: Looking Under the Hood by maxlybbert on Friday May 09, 2014 @07:12PM (#7723770)
That's a valid point. But, being dynamically typed, you don't find out about the type error until runtime. It's possible, although unlikely, that a Python web application can run for months before hitting a particular code branch where a string and an int are added together, and an exception is thrown. (In Python, it's also possible to get syntax errors long after you start your program).

It's possible that the compiler would have had enough information to determine this, if the compiler were to check types. Again, the proposed solution is to simply write enough tests to exercise all code paths.

For what it's worth, I enjoy working in Perl. But I realize when I do that some things are deferred until runtime. I also enjoy working in C and C++, partly because I can push some things to compile time (type checks, sure, but also arithmetic ( http://en.cppreference.com/w/cpp/numeric/ratio/ratio ), unit checking ( http://www.boost.org/doc/libs/1_55_0/doc/html/boost_units.ht... ), a decent amount of reflection ( http://en.cppreference.com/w/cpp/header/type_traits ), some assertions (static_assert), etc.). I don't necessarily push it all to compile time, but C++ allows me to.

Re:Why Python is Slow: Looking Under the Hood by rectangletangle on Friday May 09, 2014 @03:00PM (#7722697)
Python is a strong dynamically typed language. Unlike JavaScript, which is a weak dynamically typed language. In Python `'1' + 0` throws a `TypeError`. While JavaScript attempts to figure out what you meant.
Re:Why Python is Slow: Looking Under the Hood by Chattered on Friday May 09, 2014 @06:41PM (#7723634)
Which would be fine if I only ever used "+" with literals. But normally, I write things like

x + y

where x and y are values I got from who knows where. Javascript shouldn't pretend to figure out what I mean by this, because in many cases, I'm talking gibberish, and all I have is a bug.

I'd rather not talk about this stuff in terms of "types." It's about assertions, and Python makes them early and throws the exceptions early. It's a defensive practice that you can emulate in any language, and your assertions can be much richer than anything that is typically thought of as a type.

Re:Why Python is Slow: Looking Under the Hood by rectangletangle on Friday May 09, 2014 @11:13PM (#7724352)
I'm definitely a fan of Python's strategy. It's much better at detecting bugs early and often. That, and there's a distinction in Python between identity and equality, with the `is` and `==` operators respectively.
Re:Why Python is Slow: Looking Under the Hood by thaumasiotes on Saturday May 10, 2014 @08:41AM (#7725192)
Frankly, I think Perl has the best approach to this specific problem. We all want to do some string concatenation. We all want to render some non-string values as strings sometimes. So:

    1 + 0 = 1
    1 . 0 = 10
Just stop using + to concatenate strings.
Re:Why Python is Slow: Looking Under the Hood by redler on Friday May 09, 2014 @09:36PM (#7724166)
> In Javascript (which is also dynamically typed) I've had a few times where adding 1 and 0, say, yielded "10" because either the 1 or the 0 originally came from a string. OK, I can live with that, but I find the fact that you can use that string in numeric comparisons potentially confusing.

There are two problems demonstrated by your example; the other is the overloading of the + operator as a design decision in JavaScript. Easier, but worse.

Re:Why Python is Slow: Looking Under the Hood by collyw on Saturday May 10, 2014 @03:50PM (#7726654)
That's a JS probelem. The majority of dynamic languages would handle this "properly".
Re:Why Python is Slow: Looking Under the Hood by tetha on Friday May 09, 2014 @02:12PM (#7722410)
We are currently refactoring a bunch of stuff at work, and by now we can largely manage dependencies between various subsystems with the type system - without the type checking being too intrusive. Basically this means: If I have the current application and I add a new subsystem because I need it, and I don't have all the requirements of this system in place already, I get an error at compile time telling me to fix this. This makes it very hard to do certain classes of mistakes.

The interesting thing is that a sufficiently powerful type system with strong type inference eventually converges with dynamic typing in ease of use, but it offers the option to do rather complex reasoning about the code at compile time, again, preventing certain classes of errors.

Beyond the classes of errors being prevented, I feel like a mature, strongly typed architecture offers a certain amount of guidance in implementing new solutions. If you start implementing certain interfaces in our more mature codebases, you get a number of situations you need to handle - since the interface forces you to implement certain methods. You can't forget these situations, again, preventing mistakes or recreating the same bugs.

Note that both situations assume a certain level of maturity in a solution. Initially, a type system can be somewhat annoying while you work out the kinks, I'm perfectly fine to admit this. This requirement also implies what I feel - in small, hacky scripts, static type systems tend to be annoying to some degree. But in large, complex systems, I don't want to miss them.

Re:Why Python is Slow: Looking Under the Hood by im3w1l on Friday May 09, 2014 @05:23PM (#7723321)
I recently made a class implementing an interface from a library in python. That interface had a "canonical" implementation, in that most instances of that interface were of that class. When I tried to call some functions from that library with my own class, they tried to call methods from the "canonical class", which were neither present in the interface nor my implementation.

Result: program crashed when trying to call not present method. Had to clear up a few of these before it would work. If the type system hadn't been so forgiving the library implementers would have realized how their abstractions were leaking, and it would have been a lot easier for me to implement the interface correctly.

Re:Why Python is Slow: Looking Under the Hood by gizmo686 on Friday May 09, 2014 @04:18PM (#7723051)
There is no reason you can not have something like "variable = int(variable)" in a strongly typed system. In fact, Haskell lets you do (essentially) this by shadowing variables. This particular example wouldn't work, because Haskell would view it as a recursive definition, but there is no reason you couldn't design a language so that the asignee side looks at the pre-shadow variable.
Re:Why Python is Slow: Looking Under the Hood by skriticos2 on Friday May 09, 2014 @03:30PM (#7722824)
In my experience the dynamic typing is very useful when you start to do collections and nested data structures. You easily create a mixed type nested directory tree with only a few lines of code without all that boilerplate.
Re:Why Python is Slow: Looking Under the Hood by spion on Friday May 09, 2014 @03:44PM (#7722886)
And because you can create them so easily, soon you end up with hundreds of them and you have no idea which one contains what :)
Re:Why Python is Slow: Looking Under the Hood by Dewie on Friday May 09, 2014 @06:55PM (#7723697)
> You easily create a mixed type nested directory tree with only a few lines of code without all that boilerplate.

A similar thing can be achieved in Haskell, with the Typeable typeclass. The Scrap Your Boilerplate also fixes problems like this.

There has to be some use for dynamic typing when even Haskell (ghc) adds support for it, I guess.

Re:Why Python is Slow: Looking Under the Hood by chriswarbo on Friday May 09, 2014 @01:40PM (#7722174)
> Dynamic typing is probably preferable to a 40 year old type system.

I don't think ML users will agree ;)

Re:Why Python is Slow: Looking Under the Hood by freyrs3 on Friday May 09, 2014 @01:48PM (#7722236)
Both System-F and Martin-Löf type theory are roughly 40 years old as well.
Re:Why Python is Slow: Looking Under the Hood by pekk on Friday May 09, 2014 @03:30PM (#7722825)
What is wrong with type theory that it needs to be replaced every few decades, just because it got "old"?
Re:Why Python is Slow: Looking Under the Hood by freyrs3 on Friday May 09, 2014 @03:53PM (#7722916)
Nothing is wrong with it, it's just as relevant today as it was 40 years ago, if not more. Most of the really interesting modern work is just building on top of some form intensional Martin-Löf theory.
Re:Why Python is Slow: Looking Under the Hood by chadzawistowski on Friday May 09, 2014 @04:38PM (#7723143)
I don't think there's anything implicitly wrong with a 40 year old type theory. Rather, C's type system is pretty decrepit.
Re:Why Python is Slow: Looking Under the Hood by pekk on Friday May 09, 2014 @11:34PM (#7724387)
This was a rhetorical question, it is clearly ridiculous to toss things out just because they are 40 years old
Re:Why Python is Slow: Looking Under the Hood by adamnemecek on Friday May 09, 2014 @03:44PM (#7722887)
Because older type systems aren't webscale /s.
Re:Why Python is Slow: Looking Under the Hood by munro on Friday May 09, 2014 @01:48PM (#7722234)
Please continue! Don't leave us hanging for the riveting conclusion :) I don't know ML so I would love to hear another perspective
Re:Why Python is Slow: Looking Under the Hood by chriswarbo on Friday May 09, 2014 @04:05PM (#7722975)
Take a look at http://en.wikipedia.org/wiki/ML_%28programming_language%29

ML dates from the 70s and its type system is the inspiration for Haskell's, although Haskell also adds typeclasses (and various Haskell extensions add a bunch of other stuff).

The most widely used versions today are Standard ML and Ocaml, although many languages take inspiration from ML, for example Coq, Haskell, Clean, etc.

Re:Why Python is Slow: Looking Under the Hood by nirvdrum on Friday May 09, 2014 @06:10PM (#7723506)
Just to add to the list: Scala takes a lot of nods from ML and F# is a nice variant if you're on .NET.
Re:Why Python is Slow: Looking Under the Hood by michaelmior on Friday May 09, 2014 @01:35PM (#7722133)
Cython[1] is the closest I'm aware of to optional type annotation for Python. It works quite well, although requires a separate compilation step and the source code is no longer Python.

I assume by "new PHP implementation", you're referring to Hack[2] which is a different language, although heavily based on PHP. (I believe Hack is a superset?)

[1] http://cython.org/ [2] http://hacklang.org/

Re:Why Python is Slow: Looking Under the Hood by nly on Friday May 09, 2014 @02:50PM (#7722628)
Cython actually shows the cost of interpretation quite well. Even without added type declarations it speeds up a quicksort of a list of integers by anywhere from 40-50%.

https://github.com/psoberoi/stepanov-conversations-course/tr...

I certainly don't see Cython as anything but a quick way to get efficient C code in to Python module though... you typically get the worst of both worlds with compilation + dynamic typing.

Re:Why Python is Slow: Looking Under the Hood by pekk on Friday May 09, 2014 @03:31PM (#7722829)
Why are you not using existing, efficient sort implementations?
Re:Why Python is Slow: Looking Under the Hood by nly on Saturday May 10, 2014 @07:13AM (#7725069)
The github repo is from Alex Stepanovs course at A9, which is largely focused on data structures and algorithms. The point of the benchmarks is to compare 'FORTRAN like' code in many languages and to demonstrate that languages don't really matter if you pick the right DS&As.

That quicksort algorithm is about as efficient as it gets btw.

Re:Why Python is Slow: Looking Under the Hood by girvo on Saturday May 10, 2014 @11:40AM (#7725768)
Well yes, Hack is a "new language" in a similar way TypeScript is, but Hack is built to interoperate with regular PHP code. It's a superset, similar to how Objective-C was/is with C, only even more integrated with it's subset language :)

Regardless, it's damned nice (especially with TypeScript on the front end: static optional typing everywhere!)

Re:Why Python is Slow: Looking Under the Hood by maxerickson on Friday May 09, 2014 @02:52PM (#7722641)
There is support in Cython for doing the compilation transparently:

http://docs.cython.org/src/tutorial/cython_tutorial.html#pyx...

Re:Why Python is Slow: Looking Under the Hood by benselme on Friday May 09, 2014 @01:55PM (#7722282)
Optional typing is the main goal of the mypy project: http://www.mypy-lang.org/
Re:Why Python is Slow: Looking Under the Hood by sgt101 on Friday May 09, 2014 @04:39PM (#7723146)
In my land we call this "julia"
Re:Why Python is Slow: Looking Under the Hood by nkozyra on Friday May 09, 2014 @01:57PM (#7722300)
I always wondered why more languages didn't do this with the goal - ostensibly - being faster overall performance.

At the same time I hate it when syntax vacillates wildly from application to application.

Re:Why Python is Slow: Looking Under the Hood by sgt101 on Friday May 09, 2014 @04:46PM (#7723167)
Ok, I wanted to write "julia, julia, julia..." (check out the varargs) but I shall be sensible. Julia's syntax is what an algol culture programmer would expect in order to deal with a late 2000's concept of typing. It has the HCI virtue of being what I (you?) expect.

At the same time it is 40x faster (in my applications developed in a fortune 500 company, ok the research bit - but still delivered for use if not prod) than python.

Now, if only we got it running in SPARK...

Re:Why Python is Slow: Looking Under the Hood by lispm on Saturday May 10, 2014 @03:45AM (#7724785)
Modern type systems tend to be complicated and tend to hinder incremental development.

It wouldn't make Python easier to use. Just the opposite.

Re:Why Python is Slow: Looking Under the Hood by girvo on Saturday May 10, 2014 @11:43AM (#7725783)
Whoah, hold on there, I disagree entirely. Modern optional type systems are great for incremental development, as I can ignore them for the most part in my code when rapidly iterating, but then when my APIs are starting to solidify, bring in some proper guarantees about my code's correctness. I've used Hack and TypeScript in production, and while they're no Haskell in terms of "moderness" of the type system, they're both quite nice.
Re:Why Python is Slow: Looking Under the Hood by shocks on Friday May 09, 2014 @08:44PM (#7724034)
Python4! More sharding! :D