To be completed.

• Source Text
  • white spaces
  • end of lines
  • comments
  • tokens
    • Identifiers
    • String Literals
    • Character Literals
    • Integer Literals
    • Float Literals
    • Keywords
    • Operators
  • special token sequences
  • end of file