Re:Correctness and composability bugs in the Julia ecosystem
by one-more-minute on Monday May 16, 2022 @10:39AM
(#31398051)
Right. It's important to remember that tools like JAX and PyTorch have total control over the numerical libraries they are differentiating, and have freedom to impose whatever semantics, rules and restrictions are convenient (immutability and referential transparency in JAX, for example). Seemingly small decisions in an existing language and library can have a big impact on the feasibility and practicality of AD.
Re:Correctness and composability bugs in the Julia ecosystem
by dklend122 on Monday May 16, 2022 @10:50AM
(#31398239)
That's exactly where Dex might improve over Julia, with language level control over mutability and effect handlers and array access safety ... time will tell.
So packages just use those features
Maybe it will hit the right trade off, or maybe Julia will adopt similar language level tools, but adjusted for dynamic semantics. Is that even possible?
Re:Correctness and composability bugs in the Julia ecosystem
by catchclose8919 on Monday May 16, 2022 @10:06AM
(#31397413)
> a type system that could describe and enforce numerical stability traits
Wow, that sounds cool! have your reasearched if anyone has done anything in this are? how would you even start to approach the problem?
Do you think it has any change of being done without massive sacrifices to performance?
Re:Correctness and composability bugs in the Julia ecosystem
by jstrong on Monday May 16, 2022 @12:16PM
(#31399584)
in rust code, I like using `debug_assert!` to represent numerical expectations/assumptions of the implementation. later if I have a problem, I can turn on debug assertions and I will get a bunch of additional checks. but I can also turn them off and not pay for them all the time.
As someone who has been writing a lot of numerical analysis code recently, I would absolutely love a type system that could describe and enforce numerical stability traits.