The Order of BatchNorm and ReLU in Convolutional Networks
conv(weight)+BN+ReLU is the basic operation when building convolutional networks. How about conv(weight)+ReLU+BN? In this tutorial, we will discuss this topic.
Machine Learning Tutorials and Examples for Beginners
Machine learning is a data analytics technique that teaches computers to do what comes naturally to humans and animals: learn from experience.
In this page, we write some tutorials and examples on machine learning algorithms and applications. You can learn how to use machine learning in life by following our tutorials.
Mixed Precision Training for Beginners – Deep Learning Tutorial
In this tutorial, we will introduce what is mixed precision training, how about the effect of it and how to use it.
Layer Normalization Effect in RNN, CNN and Feed-Forward Networks – Deep Learning Tutorial
In this tutorial, we will discuss the different effect of layer normalization in RNN, CNN and Feed-Forward Networks.
Resnet V1 vs Resnet V2: Compare the Structure – Deep Learning Tutorial
In this tutorial, we will introduce the structure of Resnet V1 and Resnet V2, we also discuss the performance of them.
Understand Causal Padding in Convolutional Neural Networks – Deep Learning Tutorial
In this tutorial, we introduce what is causal padding, and discuss the difference SAME or VALID padding. It will be very useful to you.
Python Generate Hash Audio Fingerprinting for Audio Retrieval and Detection – Machine Learning Tutorial
In this tutorial, we will introduce you how to use python to generate hash audio fingerprinting for audio retrieval and detection. It contains three parts, we will introduce you one by one.
Split MUSAN Dataset for Audio Augmentation: A Step Guide – Deep Learning Tutorial
In this tutorial, we will use an example code to show you how to split musan dataset to musan_split dataset, which cotains many small wav files from musan dataset.
Channel Attention in Squeeze-and-Excitation (SE) Block Explained – Deep Learning Tutorial
Channel attention is the core of Squeeze-and-Excitation (SE) block. In this tutorial, we will analysis how to implement it for beginners.
Compute Recall Based on EER in Speaker Verification – Deep Learning Tutorial
In speaker verification task, we often use EER to measure the performance of a deep learning model. However, if you also need to compute Recall, we will tell you how to do in this tutorial.
What Random Seed We Should Use – Find Best Random Seed in Deep Learning Model
We have known that random seed value can affect the performance of a deep learning model. In this tutorial, we will discuss what random seed we should use when building an AI model.