Awesome list for Neural Network Optimization methods.

Stochastic gradient descent with model building

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

Implementation and comparison of zero order vs first order method on the AdaMM (aka AMSGrad) optimizer: analysis of convergence rates and minima shape

Some VASP processing and convergence-testing shell scripts.

Worth-reading papers and related awesome resources on deep learning optimization algorithms. 值得一读的深度学习优化器论文与相关资源。

Collection of methods for numerical analysis and scientific computing, including numerical root-finders, numerical integration, linear algebra, and data visualization. Created for APPM4600 at CU Boulder.

Official implementation of "Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes"

[EE580: Network System - Modelling & Analysis] This repo contains all the assignment of EE580 offered at IIT Mandi by Dr.Sreelakshmi Manjunath during Fall Session 2023.

Toy models for Cauchy-Characteristic Extraction (CCE) and Matching (CCM)

This project investigates convergence for solving linear systems. It implements Jacobi and SOR methods, explores convergence, optimizes performance via ω, and analyzes spectral radius/determinant. It aims to enhance iterative method efficiency for linear systems.

Implementation and evaluation of the Ant Colony Optimization algorithm on the bin-packing problem

Alpha Belief Propagation

Special Project - CA classification (2019 Fall)

Record of Gachon Convergence Research Assistant

Official code repository for "Penalized MLE of multi-layer Gaussian Graphical Models"

Analysis of simulation data obtained with the ParMooN finite element package.

Differential Evolution Algorithm to minimize a function

StoMADS algorithm for stochastic blackbox optimization

[Optimization algorithms] Study of the Proximal Gradient Method, Stochastic Gradient Descent method and Adam optimizer