An Introduction to Bahdanau Attention for Beginners – Deep Learning Tutorial
In this tutorial, we will introduce what is bahdanau attention mechanism and how to implement it.
Understand __call__() and call() Inheriting From RNNCell in TensorFlow – TensorFlow Tutorial
In this tutorial, we will tell you why some child classes of RNNCell create a __call__(), some classes create call() when building a custom rnn.
Regularizing LSTM at Each Timestep with Zoneout – Deep Learning Tutorial
Zoneout is proposed in paper: Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations. It is also used in Tacotron 2. In this tutorial, we will introduce what it is and how to implement it using tensorflow.
Fix Python IndentationError: unindent does not match any outer indentation level – Python Tutorial
In this tutorial, we will introduce you how to fix IndentationError: unindent does not match any outer indentation level in python script.
Understand Smoothing Normalization in Speech Recognition – Deep Learning Tutorial
Smoothing normalization is proposed in paper: Attention-Based Models for Speech Recognition. In this tutorial, we will introduce how to implement it in tensorflow.
Implement Convolution Module in Conformer Using TensorFlow – TensorFlow Tutorial
In this tutorial, we will introduce how to use tensorflow to implement convolution module in conformer.
Python __call__(): Call Function with Dynamic Parameters – Python Tutorial
In this tutorial, we will introduce how to use python __call__() function to call other functions with dynamic parameters.
Understand Dropout – Place it Before or After Activation Function in Dense Layer?
In deep learning, we usually place a dropout layer after a dense layer. However, here is a problem? Dropout layer is placed before or after activation function.
Understand Convolution Subsampling Module in Conformer – Deep Learning Tutorial
Convolution subsampling module is an important part for processing inputs in conformer. In this tutorial, we will introduce how to implement it using tensorflow.
Implement Sinusoidal Position Encoding in TensorFlow – TensorFlow Tutorial
Sinusoidal position encoding or postion embedding is used in transformer. In this tutorial, we will introduce you how to implement it using tensorflow.