Gradient Descent with Large Datasets

倒數第二週！！　ＧＯＧＯ～～

Large scale machine learning - Learning with large datasts

It’s not who has the best algorithm that wins. It’s who has the most data.

Large scale machine learning - Stochastic gradient descent

Stochastic gradient descent

畢卡索手稿

quiz

Large scale machine learning - Mini-batch gradient descent

Mini-batch gredient descent

• Batch gradient descent: Use all m examples in each iteration

• Stocahastic gradient descent: Use 1 example in each iteration

• Mini-batch gradient descent: Use b examples in each iteration

quiz

Large scale machine learning - Stochastic gradient descent convergence

Checking for convergence