Create Time: 5th April 2024
Title: "[[Gradient Descent]]"
status: UNFINISHED
Author:
  - AllenYGY
tags:
  - DeepLearning
  - GradientDecent
  - NOTE
created: 2024-04-05T23:05
updated: 2024-04-05T23:11

Gradient Descent Gradient Descent

Gradient Descent 梯度下降算法 GD
Stochastic Gradient Descent 随机梯度下降 SGD
Momentum 动量
Adaptive learning 自适应学习
- AdaGrad
- RMSProp
Momentum & Adaptive learning
- Adam

Gradient DescentGradient Descent

Gradient Descent Gradient Descent