News for hackers. Stuff that matters.
Re:On the Impact of Programming Languages on Code Quality by stcredzero on Wednesday June 05, 2019 @02:00PM (#20107280)
Ruby's community has an obsessive culture towards unit testing, that could impact bug levels.

Like Smalltalk, they're forced to do this to catch the errors that would've been caught by type annotation. So then, could the argument be made that less stringent type annotation hurts code quality by removing effort from unit testing?

Re:On the Impact of Programming Languages on Code Quality by Zak on Wednesday June 05, 2019 @04:04PM (#20108549)
Python is a language fundamentally similar to Ruby, that has no static type checking, that's used in similar application domains, etc.... It does not have as strong a culture of unit testing as Ruby, and falls above the line (by a statistically insignificant amount) in figure 5 while Ruby is below (by a statistically significant amount).

It does not appear that the paper took automated testing into account at all. Whether greater use of automated testing in Ruby is responsible for the lower defect rate observed here relative to Python would definitely be an interesting topic for another paper.

Clojure is also dynamically typed by default and below the line. It does not have Ruby's strong unit testing culture, but it does have a design that encourages functional programming, which proponents argue reduces sources of error. It also has a culture of REPL-driven development that arguably fills some of the role of automated testing.

Re:On the Impact of Programming Languages on Code Quality by robbrit on Wednesday June 05, 2019 @02:08PM (#20107388)
> they're forced to do this

Figuratively speaking. None of the languages they test enforce any unit testing. What I'm suggesting is that since the Ruby community tends to be more obsessive about testing, that might lead to an improvement in code quality when comparing against other similar languages like PHP or JS which are less obsessive about testing. It's something you might have to control for to see the impact.

Type systems are a completely different factor; you'd have to control for that variable too to determine the impact of it. My experience with both systems makes me predict that static typing would improve code quality, but if you want to actually be scientific you'd want to add that factor to the statistical analysis to see if the data support that hypothesis. Anecdotes like personal experience don't count.

Re:On the Impact of Programming Languages on Code Quality by stcredzero on Wednesday June 05, 2019 @02:12PM (#20107444)
Figuratively speaking. None of the languages they test enforce any unit testing.

The trivial type-mistake "Unhandled Exceptions" in Smalltalk would leak out more often than was comfortable, if the project didn't have a good means of testing to catch those. I suspect that has something to do with the Ruby community being more obsessive about testing.

Re:On the Impact of Programming Languages on Code Quality by igouy on Wednesday June 05, 2019 @03:33PM (#20108277)
> "Unhandled Exceptions" in Smalltalk

?

MessageNotUnderstood

Re:On the Impact of Programming Languages on Code Quality by stcredzero on Wednesday June 05, 2019 @04:29PM (#20108785)
Right. This, and many others, would result in an "Unhandled Exception" notifier dialog in many versions of Smalltalk. I used to work for the company acting as the vendor of 2 (3?) commercial Smalltalks, also doing consulting work for others.
Re:On the Impact of Programming Languages on Code Quality by dragonwriter on Wednesday June 05, 2019 @04:44PM (#20108931)
> Like Smalltalk, they're forced to do this to catch the errors that would've been caught by type annotation.

Very few of the unit tests I've written for Ruby/Python catch errors that would be caught by typical type system use in C/Java/etc. (Haskell, maybe, but...) The main thing I miss in dynamic languages vs. static is the more powerful automatic testing possible when test specs can leverage type information (e.g., QuickCheck/ScalaCheck), not an absence of need for testing.

Re:On the Impact of Programming Languages on Code Quality by larzang on Wednesday June 05, 2019 @09:20PM (#20110720)
Yeah it's easy to see writing in dynamic languages with optional typing and static analysis tools (e.g. JS with TS/Flow, PHP with phpstan or psalm), the type analysis finds all kinds of different and subtle problems that unit tests probably wouldn't catch. Large integration tests often would, but are even harder to write exhaustive cases for.

Types just make everything easier to do right the first time.

Re:On the Impact of Programming Languages on Code Quality by joshlemer on Wednesday June 05, 2019 @05:05PM (#20109127)
I've only ever done property based testing in Scala, but I thought it was pretty popular in dynamic languages like clojure and erlang. What would prevent it from working in Ruby/Python?
Re:On the Impact of Programming Languages on Code Quality by dragonwriter on Wednesday June 05, 2019 @05:11PM (#20109183)
Without type information already in the code (for parameters, etc.) there would be a lot more overhead in setting it up; it's possible, but higher marginal friction in the ideal case.

Plus, AFAIK, no one has written the libraries, making it even higher marginal friction in practice even more than than is true in the ideal case.

Re:On the Impact of Programming Languages on Code Quality by ramchip on Wednesday June 05, 2019 @08:12PM (#20110349)
Type information generally isn’t used when doing property testing in Elixir, and Python has a very mature library too (hypothesis). If there’s a difference in popularity, it could just be culture. The Erlang/Elixir community is rather fanatical about reliability.
Re:On the Impact of Programming Languages on Code Quality by dragonwriter on Friday June 07, 2019 @04:18AM (#20122628)
Hypothesis uses the same type annotations as Python's optional typechecker as a tool to select appropriate input data generators without additional test-specific description. That's a fairly common feature of property-based testing tools; I don't know for sure, but I wouldn't be surprised to find that hypothesis and mypy tend to be used in the same segments of the Python community.
Re:On the Impact of Programming Languages on Code Quality by darkmarmot on Wednesday June 05, 2019 @06:35PM (#20109820)
We use property testing with Elixir (erlang VM) -- and it would translate perfectly well to Ruby or Python. I also think it's a community difference, not a technical one.
Re:On the Impact of Programming Languages on Code Quality by gnaritas on Wednesday June 05, 2019 @03:58PM (#20108491)
No, the behavioral test [1] one writes cannot be replaced by type checks nor does a type system reduce the need to write tests if you're doing testing correctly.

[1] https://twitter.com/unclebobmartin/status/113589437016571084...