Interface TokenType

All Known Implementing Classes:
TokenTypes

public interface TokenType

Interface for enum members used by Lexer

  • Method Details

    • isWhitespace

      boolean isWhitespace()
      Returns:
      true if this is a whitespace type token
    • matcher

      TokenMatcher matcher()
      Returns:
      a TokenMatcher that is used to match tokens of this type. Note that matchers might actually match other tokens as well - the enum should declare the tokens in order of precedence so that the most specific are first