W3C CSS2 Cascading Style Sheets, level 2 - instructional media + ...

* after the "#"; e.g., "#000" is OK, but "#abcd" is not.
*/
hexcolor
: HASH S*
;
D.2 Lexical scanner
The following is the tokenizer, written in Flex (see [FLEX]) notation. The tokenizer
is case-insensitive.
The two occurrences of "\377" represent the highest character number that
current versions of Flex can deal with (decimal 255). They should be read as
"\4177777" (decimal 1114111), which is the highest possible code point in
Unicode/ISO-10646.
%option case-insensitive
h
[0-9a-f]
nonascii [\200-\377]
unicode
\\{h}{1,6}[ \t\r\n\f]?
escape {unicode}|\\[ -~\200-\377]
nmstart
[a-z]|{nonascii}|{escape}
nmchar
[a-z0-9-]|{nonascii}|{escape}
string1
\"([\t !#$%&(-~]|\\{nl}|\’|{nonascii}|{escape})*\"
string2
\’([\t !#$%&(-~]|\\{nl}|\"|{nonascii}|{escape})*\’
ident
{nmstart}{nmchar}*
name
{nmchar}+
num [0-9]+|[0-9]*"."[0-9]+
string
{string1}|{string2}
url
([!#$%&*-~]|{nonascii}|{escape})*
w
[ \t\r\n\f]*
nl
\n|\r\n|\r|\f
range
\?{1,6}|{h}(\?{0,5}|{h}(\?{0,4}|{h}(\?{0,3}|{h}(\?{0,2}|{h}(\??|{h})))))
%%
[ \t\r\n\f]+ {return S;}
\/\*[^*]*\*+([^/][^*]*\*+)*\/ /* ignore comments */
"" {return CDC;}
"~=" {return INCLUDES;}
"|=" {return DASHMATCH;}
{string}
{ident}
"#"{name}
"@import"
"@page"
"@media"
"@font-face"
"@charset"
"@"{ident}
"!{w}important"
{num}em
{num}ex
{num}px
{num}cm
{num}mm
{num}in
{num}pt
{num}pc
{num}deg
{return STRING;}
{return IDENT;}
{return HASH;}
{return IMPORT_SYM;}
{return PAGE_SYM;}
{return MEDIA_SYM;}
{return FONT_FACE_SYM;}
{return CHARSET_SYM;}
{return ATKEYWORD;}
{return IMPORTANT_SYM;}
{return EMS;}
{return EXS;}
{return LENGTH;}
{return LENGTH;}
{return LENGTH;}
{return LENGTH;}
{return LENGTH;}
{return LENGTH;}
{return ANGLE;}
311