Tokens

The definition of a token that I am using here is a symbol that cannot contain internal separating whitespace.

Symbol	Syntax
IntegerLiteral	Digit+
DecimalLiteral	(. Digit+) (Digit+ . Digit*)
DoubleLiteral	((. Digit+) (Digit + (. Digit*)?)) (e E) (+ -) ? Digit+
Digit	[0-9]
StringLiteral	(" ([^"]) * ")+ (' ([^']) * ') +
Wildcard	* NCName :* *: NCName
NCName	See XML Namespaces Recommendation
QName	See XML Namespaces Recommendation
Char	See XML Recommendation

A comment can appear anywhere the separating whitespace can appear. A comment is introduced by «(: » and terminated by a matching «:) ». Comments can be nested.