News for hackers. Stuff that matters.

A comment on Ask HN: Compiler Engineers, what would you advise new grads/students to learn?. Parent comment

Re:Ask HN: Compiler Engineers, what would you advise new gra... by bogomipz on Sunday September 08, 2019 @10:54PM (#20914854)
>"The growth is in the application of compiler technologies to Machine Learning ..."

A couple of others have also mentioned compiling and ML. Aren't there already many ML libraries for compiled languages out there or are you referring to something else? I would love to hear more about this.

I would be similarly interested for how compilation might be applied to distributed systems. Cheers.

[ Parent | on HN ]
Re:Ask HN: Compiler Engineers, what would you advise new gra... by mynegation on Monday September 09, 2019 @01:34AM (#20915442)
> Aren't there already many ML libraries for compiled languages out there or are you referring to something else?

Something else. If your program is a well-defined set of operations (basically matrix operations for ML), you can optimize the whole specific program instead of calling bunch of individually optimized functions from the library and target a specific hardware (e.g. given GPU). Check for example Chris Lattner’s interview [1] and presentations on MLIR, or proceedings of C4ML workshop [2].

Application in distributed systems: from the top of my head - protobufs, compilation of Erlang and Elixir to BEAM, dask.

[1] https://youtu.be/yCd3CzGSte8 [2] http://c4ml.org/

[ Parent | on HN ]