Re:Ask HN: Compiler Engineers, what would you advise new gra...
by mynegation on Monday September 09, 2019 @01:34AM
(#20915442)
> Aren't there already many ML libraries for compiled languages out there or are you referring to something else?
Something else. If your program is a well-defined set of operations (basically matrix operations for ML), you can optimize the whole specific program instead of calling bunch of individually optimized functions from the library and target a specific hardware (e.g. given GPU). Check for example Chris Lattner’s interview [1] and presentations on MLIR, or proceedings of C4ML workshop [2].
Application in distributed systems: from the top of my head - protobufs, compilation of Erlang and Elixir to BEAM, dask.
Something else. If your program is a well-defined set of operations (basically matrix operations for ML), you can optimize the whole specific program instead of calling bunch of individually optimized functions from the library and target a specific hardware (e.g. given GPU). Check for example Chris Lattner’s interview [1] and presentations on MLIR, or proceedings of C4ML workshop [2].
Application in distributed systems: from the top of my head - protobufs, compilation of Erlang and Elixir to BEAM, dask.
[1] https://youtu.be/yCd3CzGSte8 [2] http://c4ml.org/