News for hackers. Stuff that matters.
Re:Parse, don’t type-check by dgentile on Thursday November 26, 2020 @12:36PM (#25221993)
The problem is that fundamentally we always have types. We must define different types of bytes and the different things we can do with those bytes. If you can generate a binary from your programming language, it must use a form of static or inferred typing to know what assembly code to generate. A dynamic language just checks at runtime, and adds a bunch of overhead, which isn't always necessary, and is more likely to result in weird "defined" behavior like we get from javascript and php. Typescript is very popular because you can make certain guarantees at compile time, instead of a vague hand-wave of "the code looks good".

As an example of the benefits of type-checking, in the Vulkan api, there are a lot of handles. VkRenderPass, VkPipeline, VkSwapchain, VkDevice, etc. All of these are just pointers. If we take a function like:

    void vkDestroyCommandPool(VkDevice,VkCommandPool,const VkAllocationCallbacks*);`
And remove the type checking:

    void vkDestroyCommandPool(void*,void*,const void*);
It is the same API, but without type-checking. Even if the parameters are labelled, with this new API I could mess up and pass the wrong thing.
Re:Parse, don’t type-check by mumblemumble on Thursday November 26, 2020 @05:22PM (#25223959)
I don't see this as challenging anything that the article is ultimately proposing. See, for example, the last paragraph:

> I thank the flying spaghetti monster almost every day for the type system in my day job (and that is only Java’s tepid concoction)...

Isn't exactly a statement you'd expect to find in the concluding remarks an essay whose goal is to question the value of type systems or static types. It's presumably something more nuanced like that. Maybe something more like

> we are in danger of thinking that type systems are the only way of achieving correctness in software construction.

Which seems reasonable to me. Type systems are excellent for eliminating certain classes of errors. But we shouldn't let them become a golden hammer. Even if they can be used to eliminate other classes of errors, that doesn't necessarily mean they're the best tool for the job. Lately, for example, I've been seeing some disillusionment with dependent typing, and people saying, in effect, "Yeah, it's a really impressive technique, but try to find a simpler solution first."

And some of those simpler solutions do come from the dynamic programming world. For example, "You can then go further and remove the more primitive operations, only allowing access to the higher level abstractions," is another excellent way to make illegal states unrepresentable. And you don't need shiny new programming languages or rocket powered type systems to do it. I was really rather disappointed that that section of the article gave a nod to Dijkstra, but completely failed to mention Alan Kay's The Early History of Smalltalk, which was, to an approximation, several thousand words' worth of grinding away on that point.

Re:Parse, don’t type-check by wool_gather on Thursday November 26, 2020 @01:50PM (#25222619)
The article is not even remotely suggesting removing type information. On the contrary, it's talking about some ways to augment a type checker with different grammar or ways of constructing APIs.
Re:Parse, don’t type-check by MetaDark on Thursday November 26, 2020 @05:42PM (#25224073)
No, but you can always encode this augmented information in types to make it explicit, and possibly help the compiler make optimizations. Using a weaker type when you can use a stronger type is just as bad as removing type information.
Re:Parse, don’t type-check by masklinn on Friday November 27, 2020 @04:30AM (#25226951)
> No, but you can always encode this augmented information in types to make it explicit

Technically yes, but not all type systems make it practical, or really relevant e.g. you can encode nullability in a type in java… but your reference to your Optional is still itself nullable.

Re:Parse, don’t type-check by cle on Thursday November 26, 2020 @04:08PM (#25223541)
I think it’s important to be more specific here. You can always mess up and pass the wrong thing, the type system can never know what is semantically correct, no matter how strict your types are. They’re about ergonomically reducing the space of valid programs.

There are a lot of interesting tradeoffs to be made there. Over strict specification (whether parsing or type checking), specifically checking for invariants that aren’t actually useful, can make code and systems brittle and hard to change, just like under specifying them. The specifications can also be different depending on what you’re doing with the data.

Also as the expressiveness of types increases, the space of possible ways to constrain your program space goes up, along with the complexity of the transformations of that space, making it difficult to understand what the valid program space actually is, hard to understand when you’ve accidentally excluded perfectly valid programs, etc.

So yes, fundamentally there are always types and underlying structure to useful data, but saying that it has “a” type is dramatically over-simplifying things.

Re:Parse, don’t type-check by choeger on Thursday November 26, 2020 @05:05PM (#25223860)
>I think it’s important to be more specific here. You can always mess up and pass the wrong thing, the type system can never know what is semantically correct

This is not true. Consider the map function of a typical functional language with parametric polymorphism:

map : (a -> b) -> [a] -> [b]

That signature is complete, it covers everything there is to know about the function. And, except for trivial implementations, there is no way to implement it wrongly.

In some cases, one can even rule out trivial implementations and infer the correct implementations from the type signature alone.

In any case, there is no "semantically wrong" input to such a function. It is just a function and totally agnostic regarding your use case.

Re:Parse, don’t type-check by tsimionescu on Thursday November 26, 2020 @06:45PM (#25224372)
Of course that type doesn't encode everything there is to know about that function, even assuming purity.

Here are some functions that match that type signature:

    map1 foo x:xs = [foo x]

    mapR foo x:xs = append (mapR foo xs) foo x

    mapI foo x:xs = foo x : mapI foo x:xs
Of course, we can create many more functions that arrange the values in other creative ways, that add more or fewer values etc. If the function isn't pure, we can also imagine many more dimensions of functions that do arbitrarily different things from what you would expect.

If you want complete signatures without dependent types, you need functions which take only single values of different unknown types, like apply: (a -> b) -> a -> b. If you have more than one parameter of the same unknown type, you'll have some ambiguity already.

Non-dependent types can only be used to encode extremely simple properties of a program. They are certainly useful, but they are not in any way the be-all, end-all of static verification.

Re:Parse, don’t type-check by euiq on Thursday November 26, 2020 @09:13PM (#25225048)
> Of course that type doesn't encode everything there is to know about that function, even assuming purity.

Right—we need to require foo id = id.

Re:Parse, don’t type-check by tsimionescu on Sunday November 29, 2020 @08:55AM (#25245105)
That only works because Haskell can't really express it. That is, if you could write Haskell code that checked that equality, that equality wouldn't be enough, because you could write a function `mapStrange foo [x]` that is equal to `map` if `foo = id` and is something else otherwise.

But since you can't compare 2 functions for equality, and you can't compare two arbitrary values for equality, then yes - your informal requirement is enough togethet with the type to force the function to be `map`.

Re:Parse, don’t type-check by cle on Friday November 27, 2020 @07:30PM (#25233937)
Sorry for the confusion, I think we are using different definitions of "semantics" here, I'm not talking about formal semantics. I'm considering these to be semantically different, even though their structural types are the same:

    fn min(x: int, y: int) -> int
    fn max(x: int, y: int) -> int
The meaning of a computation changes depending on which one we use.

I probably should have used a different word than "semantics" since that has a technical definition in the PL field...

Re:Parse, don’t type-check by valenterry on Thursday November 26, 2020 @06:33PM (#25224327)
> I think it’s important to be more specific here. You can always mess up and pass the wrong thing, the type system can never know what is semantically correct, no matter how strict your types are.

Can you give an example?

Re:Parse, don’t type-check by tobyjsullivan on Thursday November 26, 2020 @07:40PM (#25224610)

  transferAmount(from: Account, to: Account, amount: Money)
How can a type system know that you are passing the accounts in the correct order?

You might start by trying to make more strict types such as SourceAccount and DestinationAccount.

  transferAmount(from: SourceAccount, to: DestinationAccount, amount: Money)
But we know that any account is likely to be both of these at different times. We only persist Accounts and have to convert at runtime. Now you face the challenge of converting a regular Account to a FromAccount.

  src := fromAccount.toSourceAccount()
  dest := toAccount.toDestinationAccount()
  transferAmount(src, dest, amt)
How can the type system know that you are converting the correct Account? The type system cannot determine what is semantically correct. It's a recursive problem.
Re:Parse, don’t type-check by valenterry on Thursday November 26, 2020 @09:04PM (#25224990)
What you are saying is all correct, but I think we disagree about the terminology. You said "the type system can never know what is semantically correct" but I think the right way of saying it is "the type system can sometimes not know what is semantically correct".

Because in practice, code like "src := fromAccount.toSourceAccount()" is very rare and happens at system boundaries or logic boundaries once - after that, all semantical errors can be caught by the typesystem, and this accounts for the vast majority of the code.

So yes, the typesystem can and will prevent semantical errors. But it can not protect you from making them in all cases, that's impossible.

Re:Parse, don’t type-check by codebje on Thursday November 26, 2020 @09:40PM (#25225154)
A programmer will still need to write correct code, but in your first example the error happens at the boundary between two modules. In the second example, the error is fully contained within one module.

One of those two is easier to spot, either by the original programmer, or by a code reviewer, or by someone trying to track down a fault.

If all the type system does is make semantic errors easier to spot and fix, it's still offering a lot of value.

Re:Parse, don’t type-check by moonchild on Thursday November 26, 2020 @06:15PM (#25224245)
And indeed, in opengl, where all handles have the same type (GLuint), it's very easy to mix up handles of different types.

It's quite easy to fix this without breaking ABI compatibility; but it hasn't been done in any implementation that I know of.

Re:Parse, don’t type-check by inetknght on Thursday November 26, 2020 @03:31PM (#25223313)
In C perhaps that's unfortunate. I'm sure glad we have more modern C++ that would enforce pointer types.

... as long as the functions aren't declared in `extern "C" { ... }`

which many libraries are. That's for many reasons, some of which include the very type system itself being an inhibitor of easy integration across languages.

Re:Parse, don’t type-check by moonchild on Thursday November 26, 2020 @06:28PM (#25224298)
I don't quite follow. C will also prevent you from mixing up disparate pointer types; and c++ has no protection against void pointers.
Re:Parse, don’t type-check by inetknght on Thursday November 26, 2020 @08:35PM (#25224876)
> C will also prevent you from mixing up disparate pointer types

No it won't. In C++ it's a compile error [0]. In C it's just a warning [1].

> c++ has no protection against void pointers

You're somewhat correct but the answer is a lot more nuanced (because void* is very nuanced). Again, C++ will complain unless you do it "right" [2] while C is ... willing to let you blow your leg off [3]. However the definition of "right" is still just as dangerous as C's because all type information was lost in the void and it's up to the programmer to get it right -- and programmers are notoriously buggy.

[0] https://gcc.godbolt.org/z/166ns8

[1] https://gcc.godbolt.org/z/vEnajj

[2] https://gcc.godbolt.org/z/cGe39z

[3] https://gcc.godbolt.org/z/orb1s8

Re:Parse, don’t type-check by int_19h on Saturday November 28, 2020 @08:54PM (#25242302)
Using extern "C" doesn't change the C++ rules for implicit pointer conversions, though.