We often use RNN/GRU/LSTM/BiLSTM to encode sequence. In order to get the output of these models. We can average outputs or use attention to compute. In this tutorial, we will introduce how to average their outputs.
Advanced LSTM is a variation of LSTM, which is proposed in paper <> In this tutorial, we will compare it with Conventional LSTM, which will help us to understand it.
LSTM is a good method to process sequence in NLP, however, how long sequence can be handled effectively by it? In this tutorial, we will discuss this topic.
Highway LSTM is a variants of LSTM, it adds highway networks inside an LSTM. In this tutorial, we will introduce it for LSTM beginners.
Highway Networks is proposed in paper: Highway Networks. It is proposed based on LSTM. In this tutorial, we will introduce it for machine learning beginners.
LSTMP (LSTM with Recurrent Projection Layer) is an improvement of LSTM with peephole conncections. In this tutorial, we will introduce this model for LSTM Beginners.
Convolutional LSTM Network is a variant of lstm network. In this tutorial, we will discuss it and help you understand and use it.
Tree LSTM model is widely used in many deep learning fields. It is often used to process tree structure data. In this tutorial, we will introduce it for deep learning beginners.
In order to improve the performance of lstm model in deep learning, we can use stacked lstm. In this tutorial, we will introduce the stacked lstm for deep learning beginners.
To improve lstm and bilsm, you should implement them by your own tensorflow code. In this tutorial, we will discuss why the performance of your custom lstm or bilstm model are worse than tf.nn.dynamic_rnn() and tf.nn.bidirectional_dynamic_rnn().