News for hackers. Stuff that matters.
Re:Async-await on stable Rust by phamilton on Thursday November 07, 2019 @12:31PM (#21475205)
Does the compiler prevent me from calling a library that calls a library that performs a sync action?
Re:Async-await on stable Rust by eximius on Thursday November 07, 2019 @12:45PM (#21475350)
What is a 'sync action'?

Async is fundamentally cooperative multitasking. There is no real difference between the 'blocking'-ness of iterating over a large for-loop and doing a blocking I/O action - the rest of your async tasks are blocked either way while another task is doing something.

Re:Async-await on stable Rust by phamilton on Thursday November 07, 2019 @12:48PM (#21475402)
While the behavior of a large for-loop and a blocking I/O action doesn't change the event loop, I'd still appreciate the compiler helping me identify the blocking I/O loop. I'll take whatever help I can get.
Re:Async-await on stable Rust by asdkhadsj on Thursday November 07, 2019 @01:00PM (#21475539)
I think I can agree with you, but first I think we'd have to somehow define how to even approach this feature.

Eg, fundamentally I feel like you're making a distinction between blocking I/o and a "blocking" for loop. At the end of the day, they're the same in my view - one is just more likely to be costly.

So I think for this feature to be done right, we'd have to somehow be able to analyze the likelihood of an expensive operation - and the negative consequence that action might have on the rest of the workload. Eg, I would want the same hypothetical behavior and compile-time warnings/errors that a huge file-load might cause, with a huge loop.

Otherwise a simple function call which involves no I/O and looks innocent could have the same terrible behavior as some I/O call does.

Defining that, and informing the compiler seems obscenely difficult. To that degree, I think any interaction with any sort of heap-y thing like iterating over a Vec would have to error the compiler if used in a Future context.

_everything_ would have to be willing to yield. Not sure I like it. Interesting thought experiment though. I imagine some GC languages do exactly this.

Re:Async-await on stable Rust by eximius on Thursday November 07, 2019 @03:53PM (#21477144)
I mean, what you're asking for is just profiling, but only of your async methods. I'm not familiar enough with the details to predict how async messes with profilers, so maybe it'd need support. But using a flamegraph profiler would show a big chunk of time in a function that only has small amounts of time spent deeper in the stack.
Re:Async-await on stable Rust by bluejekyll on Thursday November 07, 2019 @12:41PM (#21475301)
No, but if that library claims to be an async library, wouldn't that be a bug in the library?

Edit: I'm interpreting your use of sync here as "blocking" and not as Sync in Rust, meaning safe to share across threads. To be clear in my initial response I was talking about shared memory across threads, and may have misunderstood your original statement.

Re:Async-await on stable Rust by phamilton on Thursday November 07, 2019 @12:45PM (#21475355)
Yes. And I want the language to use types and compilers to eliminate that whole class of bugs.
Re:Async-await on stable Rust by bluejekyll on Thursday November 07, 2019 @12:52PM (#21475450)
I'm not sure this is really possible. Given that async programming is cooperative by nature, how do you tell the difference between a blocking IO task, and a really long running loop in a piece of code that is itself blocking others from executing because it's doing too much work?

The blocking IO might be something in Rust that a type could be created for to denote that they are not async, and therefor warn you in some way, but I think that one is easy to detect in testing.

Re:Async-await on stable Rust by phamilton on Thursday November 07, 2019 @12:57PM (#21475496)
> I think that one is easy to detect in testing

I have seen that not detected in testing too many times. With a work stealing execution context the code will still run fine unless under heavy load (which will exhaust the thread pool and lock the application).

Re:Async-await on stable Rust by woah on Thursday November 07, 2019 @01:59PM (#21476186)
“Non-blocking” code is basically just code that takes a short enough amount of time that we don’t care that it blocks the thread. It’s inherently a matter of judgement.
Re:Async-await on stable Rust by pas on Thursday November 07, 2019 @01:16PM (#21475707)
Static analysis should help with this. Basically it should identify every call site where I/O happens (and other syscalls), and then you have to check them that they are invoked with the right async/nonblocking dance.

This is basically a code audit problem.

Of course something like taint analysis could also work. Every such callsite should be counted as tainted unless it gets wrapped with something that's whitelisted (or uses the right marker type wrapper).

Even effects as types can't help much, because the basic interfere to the kernels (Linux, WinNT, etc.) are not typesafe, and as long as the language provides FFI/syscall interfaces you have to audit/trust the codebase/ecosystem.