Commit Graph

6 Commits

Author SHA1 Message Date
6c41c2f69d Make Tokenizers movable 2020-06-04 16:23:46 -04:00
f5be01e4f1 sync with header 2020-05-31 10:05:39 -04:00
74249380ec Add count method to ValueTokenizer 2020-05-26 16:30:46 -04:00
7ac0f869ef Add ValueTokenizer 2020-05-20 15:53:50 -04:00
9e3759d0fc Add missing newlines 2020-05-20 15:53:29 -04:00
d41927b056 Add Tokenizer class 2020-05-20 15:49:02 -04:00