The next section of the course I'm taking covers some theoretical topics (perceptrons, activation and cost functions, gradient descent, and back propagation) before diving into the manual creation of a Neural Network using Python. Here is the code I wrote while following this section of the course, without using Tensorflow or any other machine learning specific libraries. Additionally, here are some notes I took during the lectures: Introduction to Neural Networks A “perceptron” is an artificial attempt to mimic biological neurons biological neurons have a body that accepts input through many Dendrites and pushes output through a single Axon, which connects to another neuron artificial neurons (perceptrons) have a similar structure: only 2 inputs allowed each input has a feature value each input is multiplied by a “weight”, the value of which is typically random the result of input*weight are passed to an activation function in the body e.g. if ...