l.cristianDec 1, 20201 minStochastic Gradient Descent update and the intuition behind itTraining a neural network involves some form of optimisation (minimisation) of an objective function. The root strategy from which all...

l.cristianMay 30, 20201 minHow can you visualise stochastic gradient descent in action?I’ve just stumbled upon this wiki page which describes optimisation methods that can be used for optimising functions (or programs) where...

l.cristianJan 20, 20201 minOn Cross EntropyThis post tries to implement it in pure python to better understand it’s inner workings and then compare it to other popular...

l.cristianNov 11, 20191 minSSA - Singular Spectrum AnalisysWe have some data. Our goal for today would be to find the cyclical pattern that the data presents.