Understand Dense Layer (Fully Connected Layer) in Neural Networks – Deep Learning Tutorial

By | July 23, 2020

Dense Layer is also called fully connected layer, which is widely used in deep learning model. In this tutorial, we will introduce it for deep learning beginners.

The structure of dense layer

The structure of a dense layer look like:

the structure of dense layer in neural network

Here the activation function is Relu.

What is dense layer in neural network?

A dense layer can be defined as:

y = activation(W * x + b)

where W is weight, b is a bias, x is input and y is output, * is matrix multiply.

It can be viewed as: MLP (Multilayer Perceptron)

In keras, we can use tf.keras.layers.Dense() to create a dense layer.