Show HN: Compile ML models into dependency-free source code for easy deployment

Re:Show HN: Compile ML models into dependency-free source co... by bheadmaster on Thursday April 06, 2023 @03:48PM (#35473438)

If I may ask, why not just share the compiler code? Do you plan to monetize this? Not that I personally have any problem with that, but I like to know when I'm reading an advertisement.

That being said, sounds like a great idea. It would definitely help a lot with deployment. Does the generated source code work GPUs, or does it just run on CPU?

[ Parent | on HN ]

Re:Show HN: Compile ML models into dependency-free source co... by gustafwaveworks on Thursday April 06, 2023 @04:04PM (#35473616)

Of course you may ask! Exactly that, I want to see if I can monetize in one way or the other, so that's why I keep the compiler code to myself for now.

I'm planning to support generation of CUDA code and maybe also Triton for GPU inference. Would that be helpful for you?

[ Parent | on HN ]

Re:Show HN: Compile ML models into dependency-free source co... by bheadmaster on Thursday April 06, 2023 @06:19PM (#35475299)

I don't have a particular use case in mind, I am just curious about the capabilities.

Hope your project succeeds !

[ Parent | on HN ]