This is an implementation of different optimization algorithms such as: - Gradient Descent (stochastic - mini-batch - batch) - Momentum - NAG - RMS-prop - BFGS - Adam Also, most of them are implemented in vectorized form for multi-variate problems
heba-atef99 / ml_optimization_algorithms Goto Github PK
View Code? Open in Web Editor NEWThis is an implementation of different optimization algorithms such as: - Gradient Descent (stochastic - mini-batch - batch) - Momentum - NAG - Adagrad - RMS-prop - BFGS - Adam Also, most of them are implemented in vectorized form for multi-variate problems