0
Vote

Improve the Tokenizer class

description

The Tokenizer class is yet functional but needs to get improved in the future. Some features may not work as they should. The part that scans for numbers has to get better when it comes to floating point numbers.

comments