Temperature check: theory and practice for training models with softmax-cross-entropy losses
OpenReviewTemperature check: theory and practice for training models with...The softmax function combined with a cross-entropy loss is a principled approach to modeling probability distributions that has become ubiquitous in deep learning. The softmax function is defined...