Really interesting article! This is a great example of scientific strategy and thought being used in an applied setting. I also like the effort to make the different choices interpretable.

Loss functions are an often overlooked area of machine learning and tend to be taken for granted.

Too many times I have seen others (and been guilty of the same) just arbitrarily choose torch.nn.NLLLoss/TensorFlow equivalent or some other loss function that’s the flavour of the day for the task.