About Tokens and Lexemes

A Parser is an integral part when building a Domain Specific Language or file format parser, such as our example usage case: the Ical format. This session will cover the general concept about tokenizing and parsing into a data structure, as well as going into depth about how to keep the memory footprint and runtime low with the help of a stream-tokenizer.