# Understand Dense Layer (Fully Connected Layer) in Neural Networks – Deep Learning Tutorial

By | July 23, 2020

Dense Layer is also called fully connected layer, which is widely used in deep learning model. In this tutorial, we will introduce it for deep learning beginners.

## The structure of dense layer

The structure of a dense layer look like:

Here the activation function is Relu.

## What is dense layer in neural network?

A dense layer can be defined as:

y = activation(W * x + b)

where W is weight, b is a bias, x is input and y is output, * is matrix multiply.

It can be viewed as: MLP (Multilayer Perceptron)

In keras, we can use tf.keras.layers.Dense() to create a dense layer.