Timestamp:
04/28/08 22:02:04 (7 months ago)
Author:
karpet
Message:

alternate utf8-savvy tokenizer with iterator. initial naive benchmark shows it is about as fast, with far fewer malloc/free calls. could like speed it up some by refactoring how "context" is stored internally

Files:

Legend:

Unmodified
Added
Removed
Modified
Copied
Moved