Abstract: In Deep Neural Networks (DNNs), optimization is necessary for adjusting model parameters to reduce the loss function, which directly affects the model’s performance. Effective optimization ...