diff options
| author | murphy <murphy@rubychan.de> | 2009-04-20 21:08:33 +0000 |
|---|---|---|
| committer | murphy <murphy@rubychan.de> | 2009-04-20 21:08:33 +0000 |
| commit | 13c1a74215c2af9150f6e61adbfc6c3e48689770 (patch) | |
| tree | d9906e0dccf6d9004185f571850048c35918f2bf /lib/coderay/tokens.rb | |
| parent | ebcf3ab3e0814e4a0187ab23f3209ed162576ef8 (diff) | |
| download | coderay-13c1a74215c2af9150f6e61adbfc6c3e48689770.tar.gz | |
Experimental Unicode support for Scanners in Ruby 1.9.
* Python scanner uses it for idents.
* Scanner#column method needed to be fixed for multibyte characters because
StringScanner#pos still works on bytes.
Diffstat (limited to 'lib/coderay/tokens.rb')
0 files changed, 0 insertions, 0 deletions