News for hackers. Stuff that matters.
Re:Why do tree-based models still outperform deep learning o... by hansvm on Tuesday March 05, 2024 @11:34AM (#39605807)
You probably want something equivalent to (however you make it fast in your chosen framework):

einsum('bf,fc->bfc', batched_inputs, channel_embedding)

Then carry that info through the network and project it down at the end. It's roughly equivalent to the token embedding step in an LLM.

There are no comments on this comment yet.