tokens.txt

The details of this tokens is present in readme.

STRINGVAL
NEWLINE 
BREAK
CHAR
STRING
CONTINUE
ELSE
FOR 
IF 
INT
RETURN 
VOID 
WHILE 
INPUT 
OUTPUT 
IDENTIFIER 
INT 
CHAR 
AND 
OR 
LE 
GE 
EQ 
NE 
SEMICOLON	
LBRACE   
RBRACE 
COMMA 
ASSIGN 
LPAREN 
RPAREN 
LBRACKET 
RBRACKET 
BITAND 
NOT 
MINUS 
PLUS 
MUL 
DIV 
MOD 
LT 
GT 
XOR 
BITOR	 
IF 
COLON