token
token — A unit of information.
Synopsis
token ::= ![[-]](figs/web/nav/down.gif)
- Zero or more of:
- text
replaceable- Graphic inlines
- Indexing inlines
- Linking inlines
- Ubiquitous inlines
abbrevacronymaltanchorannotationbibliorefcorefdateemphasis(db._emphasis)firstterm(db._firstterm)footnotefootnoterefforeignphrase(db._foreignphrase)glossterm(db._glossterm)indexterm(db.indexterm.endofrange)indexterm(db.indexterm.singular)indexterm(db.indexterm.startofrange)inlinemediaobjectlinkolinkphrase(db._phrase)quote(db._quote)remarksubscriptsuperscripttrademarkwordaswordxref
Attributes
Description
A token identifies a unit of information.
Usually, “tokens” are the result of some processing pass
that has performed lexical analysis and divided a data set into the
smallest units of information used for subsequent processing.
Exactly what constitutes a token varies by context.
Processing expectations
Formatted inline.
Parents ![[+]](figs/web/nav/right.gif)
This element occurs in 54 elements.
Children
This element contains 29 elements.
Examples
<article xmlns='http://docbook.org/ns/docbook'> <title>Example token</title> <para>In parsing, line ends are turned into the <token>CRLF</token>, all other whitespace becomes <token>WHITESP</token>. </para> </article>
In parsing, line ends are turned into the CRLF, all other whitespace becomes WHITESP.