the process of dividing a series of characters (= letters, numbers, or other marks or signs used in writing or printing) into separate tokens (= units) that have a meaning

Tokenization shows the text as a series of tokens or useful meaningful units that are larger than individual characters, but smaller than phrases and sentences.

The lowest-level form of annotation is tokenisation. 最低层次的注释是离散单元化。

the process of replacing a private piece of data with a token (= a different piece of data that represents the first one), in order to prevent private information being seen by someone who is not allowed to do so

Tokenization protects sensitive cardholder data by removing it from merchant systems entirely. 令牌化通过将敏感的持卡人数据从商户系统中完全移除来保护这些数据。

the act of doing something that seems to support or help a group of people who are treated unfairly in society, such as giving a member of that group an important or public position, but that does not make changes that would help that group of people in a lasting way

Research shows that groups who experience minority status often encounter tokenisation. 研究表明那些有过成为少数族裔经历的人常常被人（优待）用来做门面功夫。