Ask HN: How to Do ML Research?
For the researchers out there, how do you do research?Background:I've been looking at how to create a recurrent seq-to-seq model, that's not transformers. The ideas I implement do not work. It seems like off the well trodden path, there are traps everywhere - how should I tune parameters, add biases, normalize, is this dataset impossible, gradient explosion and vanishing, etc.From a "research =...