Skip to main content

Vocabulary of natural language processing (POC)

Search from vocabulary

Concept information

Preferred term

token  

Definition

  • In lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence. (Wikidata)

Broader concept

Narrower concepts

In other languages

URI

http://data.loterre.fr/ark:/67375/8LP-TX1JH6ZL-6

Download this concept:

RDF/XML TURTLE JSON-LD Last modified 6/14/24