Understand Python action=”store_true” in argparse.ArgumentParser with Example – Python Tutorial
In this tutorial, we will use some examples to show you how to use action=”store_true” in python argparse.ArgumentParser.
Understand torch.nn.Module.modules() with Examples – PyTorch Tutorial
In this tutorial, we will use some examples to show how to use torch.nn.Module.modules().
Saved a Trained PyTorch Model and Can We Change the Model Structure? – PyTorch Tutorial
In this tutorial, we will discuss if we have saved a model object using torch.save(), can we change our model structure before we plan to load this saved model?
Fix torch.save() Take Much Disk Space – PyTorch Tutorial
This tutorial will introduce you how to fix torch.save() take much disk space when we are using torch.save().
PyTorch Split a Wave to Some Clips with Same Length – PyTorch Tutorial
In this tutorial, we will use an example to show you how to split a big wave file to some clips (small wave files) with same length.
Understand NumPy Array Three Dots(…) or Ellipsis with Examples – NumPy Tutorial
In this tutorial, we will use an example to show you what this ellipsis means when we are using numpy array.
LLM Train and Inference vs Right Padding and Left Padding – LLM Tutorial
Padding method will affect the performance of LLM. There are two padding method: left and right padding.
Understand tokenizer add_special_tokens with Examples in LLM – LLM Tutorial
As to a tokenizer instance, it contains add_special_tokens parameter. In this tutorial, we will introduce what it mean.
Understand padding_side with Examples in LLM – LLM Tutorial
Most of LLMs are decoder-only architectures, which means they are not trained to continue from pad tokens. This strategy may cause wrong outputs when batch inference.
Understand load_in_8bit in AutoModelForCausalLM.from_pretrained() – LLM Tutorial
In this tutorial, we will introduce load_in_8bit parameter in AutoModelForCausalLM.from_pretrained()