Please check ref for further details. Three main differences from torch.optim.SGD: The loss to be minimized is passed through as a closure to the optimizer to support more dynamic behaviors, notably, ...