Meaning

1 senses

  1. To convert (a tokenized representation) back to the original form.

Origin

From de- + tokenize.

From de- + tokenize.

Wiktionary, CC BY-SA 4.0 · source

Forms

detokenizes, detokenizing, detokenized, detokenized
Base formdetokenize · to detokenize
3rd person singulardetokenizes
Present participledetokenizing
Past simpledetokenized
Past participledetokenized

regular · Lesson

Present simpleLesson

I, you, we, theydetokenize
he, she, itdetokenizes

Past simpleLesson

all personsdetokenized

Present perfectLesson

I, you, we, theyhave detokenized
he, she, ithas detokenized

Future simple (will)Lesson

all personswill detokenize

Word family

1 related words
Deriveddetokenizer

Lessons for this word

3 lessons

See also

neighbours in the dictionary
deterrentC2detestC1detestableC1dethronedetonatedetonatordetour
detokenize — meaning, examples, forms, synonyms | Krumeto