make ?single_word ?lstrip ?rstrip ?normalized token creates a special token configuration.

All parameters default to appropriate values for special tokens:

• single_word: false - can match partial words
• lstrip: false - don't strip left whitespace
• rstrip: false - don't strip right whitespace
• normalized: false - special tokens not normalized

pad token creates a padding token (e.g., "<pad>").

unk token creates an unknown token (e.g., "<unk>").

bos token creates a beginning-of-sequence token (e.g., "<s>").

eos token creates an end-of-sequence token (e.g., "</s>").

cls token creates a classification token (e.g., "[CLS]").

sep token creates a separator token (e.g., "[SEP]").

mask token creates a mask token (e.g., "[MASK]").