Add information about previous / next token to each terminal
Initialise variables related to caching
add_terminal_token_after(pd_flat)add_terminal_token_before(pd_flat)
add_attributes_caching(pd_flat, transformers)
remove_terminal_token_before_and_after(pd_flat)
A flat parse table.
A list with transformer functions, used to check if the code is cached.
add_attributes_caching: Initializes newlines and lag_newlines.
remove_terminal_token_before_and_after: Removes column terimnal_token_before. Might
be used to prevent the use of invalidated information, e.g. if tokens were
added to the nested parse table.