Cls token

In the context of natural language processing, a CLS token is a special token used at the beginning of a text sequence to aggregate information for classification tasks. It stands for 'classification token' and is primarily used in models like BERT to represent the entire sequence for tasks such as sentiment analysis or document classification.