The PyTorch Implementation of Stable Weight Decay. The algorithms are proposed in the paper: "Stable Weight Decay Regularization".