aboutsummaryrefslogtreecommitdiff
path: root/test.utf16 (follow)
AgeCommit message (Collapse)Author
2012-03-25Code is all reorganized. We're about ready to release. I should write up aMike Buland
little explenation of the arrangement.
2011-04-04UtfString is going really well. It can now parse Utf8, Utf16 (le,be), andMike Buland
Utf32 (le,be). The internal storage seems to be working fine, although we do have a problem with random access, but at least we can tell which half of a surrogate pair we're on, so we can always rapidly determine the entire code point from any utf16 index that we're on. The only optomization that I'm not doing yet is reading in entire 16bit or 32bit words at a time and converting them from their byte order to native. There are a few potential issues with that, so we'll see. I added a couple of testing datafiles and a test program, I'll delete them all just as soon as it's verified to write correctly.