## Stochastic Gradient Descent update and the intuition behind it

Training a neural network involves some form of optimisation (minimisation) of an objective function. The root strategy from which all...

Search

l.cristian

- Dec 1, 2020
- 1 min

Training a neural network involves some form of optimisation (minimisation) of an objective function. The root strategy from which all...

23 views0 comments

l.cristian

- May 30, 2020
- 1 min

I’ve just stumbled upon this wiki page which describes optimisation methods that can be used for optimising functions (or programs) where...

10 views0 comments

l.cristian

- Jan 20, 2020
- 1 min

This post tries to implement it in pure python to better understand it’s inner workings and then compare it to other popular...

5 views0 comments

l.cristian

- Nov 18, 2019
- 1 min

The goal for today is to make a chart.

7 views0 comments

l.cristian

- Nov 11, 2019
- 1 min

We have some data. Our goal for today would be to find the cyclical pattern that the data presents.

11 views0 comments