MOB LEC5 Feed Forward Neural Network

Since most material has been covered in previous blogs, I will go through this lecture contents in brief.

Brief overview

More Contents

Activation function example

Task example

For classification we have:

1. Softmax output layer
2. Cross-entropy Loss function

For regression we have:

1. Linear output layer
2. Mean square error lLoss function

Supplement reading

1. LeCun, Yann, Yoshua Bengio, and Geoffrey Hinton. “Deep learning.” nature 521.7553 (2015): 436-444.
2. A Comprehensive Guide to Convolutional Neural Networks.

Origin: Dr. Chris Lu (Homepage) Translate Edit: YangSier (Homepage)