Meaning

2 senses
  1. (countable, uncountable)The act or process of tokenizing.

  2. (countable, uncountable)An instance created by that act or process: something tokenized.

    This was an unlikely tokenization of the input string.

Origin

From token + -ization.

From token + -ization.

Wiktionary, CC BY-SA 4.0 · source

Forms

plural: tokenizations
Singulartokenization
Pluraltokenizations

regular

Word family

2 related words

See also

neighbours in the dictionary
tokenization — meaning, examples, forms, synonyms | Krumeto