Mnist

[Download this notebook](07 - First Neural Net.ipynb) In this lesson you’ll learn: how one-hot encoding works. how to program a simple neural net in Python. Before we train the neural network, the first thing we need to do is load the relevant libraries and functions. import numpy as np from matplotlib import pyplot as plt %matplotlib inline Activation functions def sigmoid(x): return 1 / (1 + np.exp(-x)) # np.exp() = e^() def softmax(x, axis=1): return np.

[Download this notebook](08 - PyTorch.ipynb) In this lesson you’ll learn: how to program a simple neural net using PyTorch. how to implement more advanced layers in your neural net (Dropout, Batchnorm). about more advanced optimisation (Momentum, adam). Last week you programmed a simple neural network yourself. As mentioned earlier, it is not necessary to program every net yourself. Certain software packages take care of many of the inconveniences of creating and training nets “by hand”.