Commit Graph

8 Commits

Author SHA1 Message Date
43d3133583 Whitespace 2020-06-11 14:00:13 -04:00
81d937ee97 Performance optimization of Tokenizer
Reduces string allocations and removes std::vector from Tokenizer
Most processing now happens on-demand.
2020-06-11 00:22:04 -04:00
6c41c2f69d Make Tokenizers movable 2020-06-04 16:23:46 -04:00
f5be01e4f1 sync with header 2020-05-31 10:05:39 -04:00
74249380ec Add count method to ValueTokenizer 2020-05-26 16:30:46 -04:00
7ac0f869ef Add ValueTokenizer 2020-05-20 15:53:50 -04:00
9e3759d0fc Add missing newlines 2020-05-20 15:53:29 -04:00
d41927b056 Add Tokenizer class 2020-05-20 15:49:02 -04:00