News for hackers. Stuff that matters.
Re:Speeding Up the Rust Compiler by burntsushi on Wednesday December 11, 2019 @08:36AM (#21762169)
> `unwrap()` is "handling" errors by crashing the program, so it shouldn't really be used

This isn't the right advice to give, and is only going to confuse beginners. Panicking via unwrap/expect is perfectly fine, whether in a library or an application, only when the panic represents a bug. For example, accessing an element of a Vec with an incorrect index because of a logic error. If a panic occurs, then it should reflect a bug that is intended to be fixed.

Stated differently, it should be impossible for an end user to cause a Rust application to panic. If they can, then it's a bug.

This advice permits use of unwrap/expect anywhere, so long as its occurrence is never expected.

Re:Speeding Up the Rust Compiler by bluejekyll on Wednesday December 11, 2019 @09:42AM (#21762749)
I mostly agree with you, but in practice I think using unwrap or panicking in libraries is usually wrong.

As an example it’s quite easy to fall astray of taking your perspective to say read a packet off the network, and panic on malformed data. I know you’d agree that would be a inappropriate time to use panic, as that would crash any upstream program with trivial DOS exploits. But this is easy to do if you say have an API that takes a value, translates it to something else and panics on invalid inputs.

My advice is generally in line with the GP, pornel—use the tools at hand for avoiding panics where it’s easy to do so, such as ?, map, etc. Only panic/unwrap on bad library API usage (which I think is what you’re suggesting). Feel free to panic anywhere in main.

People often translate “ use of unwrap/expect anywhere, so long as its occurrence is never expected” in ways that can create major bugs as the software goes into more use.

Re:Speeding Up the Rust Compiler by burntsushi on Wednesday December 11, 2019 @09:58AM (#21762917)
I understand that perspective to an extent, but I really want to double down here because I think it's important. :-)

> but in practice I think using unwrap or panicking in libraries is usually wrong

Very strongly disagree. I've created dozens of Rust libraries, and probably all of them have dozens of code paths that can panic. Other core libraries do the same. Just a simple slice access, e.g., `slice[i]`, is a line of code that could panic. (Since it's just a shorter way of writing `slice.get(i).unwrap()`.) I don't think we should be giving advice that runs contrary to how important libraries actually work. A lot of people learn to code by reading others' code, and when we give advice like "don't use unwrap/expect," they get confused when they see that virtually every widely used piece of Rust code violates it.

The key here is really that one shouldn't panic unless the panic itself is indicative of a bug somewhere. Blanket advice like "don't use unwrap/panic in libraries" is bad because---as I argued in the Clippy issue I posted in a sibling comment---it's effectively a prohibition against runtime invariants themselves. As a programmer, you insert a panic when you've failed (for any number of reasons) to capture the invariant in the type system. Blanket advice saying that one shouldn't use unwrap/expect in these circumstances leads one toward a path of much more complex APIs with error types that are never constructed unless there is a bug in the code. (It's likely that actually adding all of those error types will be so annoying that it's plausible the programmer will give up on Rust.)

> As an example it’s quite easy to fall astray of taking your perspective to say read a packet off the network, and panic on malformed data. I know you’d agree that would be a inappropriate time to use panic, as that would crash any upstream program with trivial DOS exploits. But this is easy to do if you say have an API that takes a value, translates it to something else and panics on invalid inputs.

I think this is a reflection of error handling being hard. It's just as easy to code a program with the mistaken assumption that a particular file path will always point to a valid and readable file. It takes a bit of learning to understand which things you can rely on never happening and which you can't. In the mean time, I don't think we should be giving advice that is very easy to misinterpret into a conclusion that just isn't tenable. Personally, I think it's much easier to talk about end user behavior. If there's a panic, then it's a bug that ought to be fixed. If you follow that, it's hard to go wrong.

You could rephrase it with, "If there's a reachable code path that panics, then the code path should be removed." You could then talk about what "reachable" means, i.e., code paths that are determine based on data that the program doesn't control vs code paths that are enforced for all inputs to the program.

Re:Speeding Up the Rust Compiler by Tainnor on Wednesday December 11, 2019 @02:10PM (#21765708)
I unfortunately know very little about Rust, but is it possible to recover from panics in Rust?

Because the problem that I'm seeing in Swift code (which also has a "crash on logic errors" approach) is that bugs can bring your whole system down, which is especially bad on server-side apps with multiple threads. Yes, you can use supervisord and/or load balancers, but you still lose in-flight requests.

By contrast, in a language with a runtime like Java or Ruby, you can catch almost everything at the top level, so you could just have some logic that generates a "whoops something went wrong" response in case of a serious error.

The point here is resiliency. I agree that you want to catch bugs early, and you should immediately abort execution once bad things happen; I also fundamentally agree that you don't want to litter your code with error types or other constructs that are supposed to never actually be used. But faults do happen in practice, because we write buggy code, and in such a case, it's good if you can isolate the fault and recover at a higher level. Languages like Erlang take this idea to an extreme.

This is currently a real problem for us with Swift, so I was wondering whether Rust has a better solution here.

Re:Speeding Up the Rust Compiler by burntsushi on Wednesday December 11, 2019 @03:02PM (#21766195)
> I unfortunately know very little about Rust, but is it possible to recover from panics in Rust?

Yes: https://doc.rust-lang.org/std/panic/fn.catch_unwind.html

However, this comes with a critical caveat: unwinding can be disabled when compiling an application, which means one cannot guarantee that catch_unwind will actually work. (If unwinding is disabled, then panics turn into unrecoverable aborts.)

For this reason, and because the standard error handling mechanism is done through return values, panicking is not an acceptable way to do robust error handling in Rust. Recovering from panics is useful in niche scenarios, like keeping a web server running even if a request causes a panic or in tests for ensuring that all tests run even if one panics. Which basically matches your key concern here.

(To be clear, I think this is mostly orthogonal to my original comment in this thread. :-))

Re:Speeding Up the Rust Compiler by Tainnor on Thursday December 12, 2019 @11:03AM (#21772983)
Yep, that sounds like kind of what I would need. :)

But in general, exception handling is hard. There is value in having locally-unrecoverable, but globally-recoverable faults, stuff like that is probably where languages like Erlang shine.

Re:Speeding Up the Rust Compiler by bluejekyll on Wednesday December 11, 2019 @11:36AM (#21764084)
I can’t tell if you and I are agreeing or disagreeing at this point. And yes, I would not disagree with the quality of your code and the libraries you’ve published, they’re some of the best and most widely used in the community.

You’ve said don’t panic for code paths that the program doesn’t control. That is nuanced, and often is not always obvious and easy to reason about, but the language makes those exceptional cases obvious, so why not use that to your advantage?

edit: and by the way, I didn't say that on indexes, I totally agree with you. Though, sometimes it is valuable to go to the extreme and prevent malicious index values from untrusted sources crashing your program...

Re:Speeding Up the Rust Compiler by burntsushi on Wednesday December 11, 2019 @01:23PM (#21765233)
>I can’t tell if you and I are agreeing or disagreeing at this point.

I think we are disagreeing mostly over pedagogy.

> That is nuanced, and often is not always obvious and easy to reason about

Right. I think this is what I meant by "error handling is hard." But this really boils down to understanding what a runtime invariant is, and that takes time to learn. It's hard to do good error handling without internalizing that.

> but the language makes those exceptional cases obvious, so why not use that to your advantage?

I think you are, specifically by using unwrap/expect. In many such cases, the unwrap/expect has a comment explaining why it's impossible to panic.

> edit: and by the way, I didn't say that on indexes, I totally agree with you. Though, sometimes it is valuable to go to the extreme and prevent malicious index values from untrusted sources crashing your program...

Well, `&slice[i]` and `slice.get(i).unwrap()` are equivalent. So if we give blanket advice like "don't use unwrap/expect in libraries" then the latter gets caught up in that advice while the former doesn't, even though they are exactly equivalent. To me, this reveals the problem in that pedagogy because it focuses too much on one particularly common manifestation rather than the thing that actually matters: a panic visible to an end user is always a bug.

To be clear, the thing I am disagreeing with is the advice to "not use unwrap/expect; use case analysis instead." I can appreciate a pedagogy that simplifies things upfront with the cost of getting some corner cases wrong. But unwrap/expect are used too much in too many valid cases IMO for that type of strategy to be effective.

Re:Speeding Up the Rust Compiler by jayflux on Wednesday December 11, 2019 @08:54AM (#21762285)
I’m pretty sure clippy “encourages” you to use .get() for Vectors returning an Option<> for you to deal with so accessing a bad index is avoidable in idiomatic rust.

I’m not sure that was the best example but I agree with your overall point.

Re:Speeding Up the Rust Compiler by burntsushi on Wednesday December 11, 2019 @09:20AM (#21762524)
It does not. I know because I advocated against it. :-) https://github.com/rust-lang/rust-clippy/issues/1300

Also, Clippy's defaults are developed to be quite opinionated. It makes many suggestions that I (and many others) disagree with. So Clippy's defaults should not be used as a bludgeon for what's idiomatic and correct.

Re:Speeding Up the Rust Compiler by steveklabnik on Wednesday December 11, 2019 @10:14AM (#21763095)
(I also do not use clippy very aggressively due to disagreeing with a lot of lints)
Re:Speeding Up the Rust Compiler by GrayShade on Wednesday December 11, 2019 @09:12AM (#21762473)