Tokens are defined as the meaningful elements that are generated by using techniques of lexical analysis.
