Stochastic Gradient Descent update and the intuition behind it
Training a neural network involves some form of optimisation (minimisation) of an objective function. The root strategy from which all...
top of page
Search
-
- May 30, 2020
- 1 min
How can you visualise stochastic gradient descent in action?
I’ve just stumbled upon this wiki page which describes optimisation methods that can be used for optimising functions (or programs) where...
23 views0 comments
-
- Jan 20, 2020
- 1 min
On Cross Entropy
This post tries to implement it in pure python to better understand it’s inner workings and then compare it to other popular...
8 views0 comments
-
- Nov 11, 2019
- 1 min
SSA - Singular Spectrum Analisys
We have some data. Our goal for today would be to find the cyclical pattern that the data presents.
13 views0 comments
bottom of page