| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| | |
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
| |
* test:clean task also deletes .expected.html files
* LinesOfCode encoder can deal with tokens that have no scanner.
Tests were added for this.
* JSON encoder load rubygems if necessary.
* NEW :loc as an alias for :lines_of_code
* NEW Scanner methods marshal_dump, marshal_load
FIXED Tokens dumping (failed while trying to dump @scanner)
|
| | |
|
| |
|
|
|
|
|
| |
* Python scanner uses it for idents.
* Scanner#column method needed to be fixed for multibyte characters because
StringScanner#pos still works on bytes.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
YAML Scanner:
* Added another example (multiline).
* Added multiline string recognition.
* This should be enough for most people.
Else:
* New method: Scanner#column (very useful and fast!)
* Added new token type :doctype, used also by HTML scanner.
* coderay_suite: minor output tweaks.
|
| |
|
|
|
|
| |
* Added more YAML example files (website, database).
* Minor code cleanup in Scanner.
|
| |
|
|
|
|
|
|
|
|
|
| |
* It's quite good and fast, but still a beta.
* I included Prototype and script.aculo.us as example code for testing.
More changes:
* Added two new token classes, :keyword and :key, along with CSS styles.
** Actually, we should use :keyword for most scanners that now use :reserved.
* HTML Encoder: The CSS parser understands multiple selectors separated by commas.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Test and example added.
Token changed: operator_fat instead of operator_name (for use with LISP-like
parentheses).
Added file_extension for Scanners.
Improved CodeRay::Suite:
- uses scanners file extension now
- example parameter is now named "only"
- only param overwrite MAX_CODE_SIZE_TO_HIGHLIGHT
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
General:
- Declared version 0.7.6.
- Moved WordList, CaseIgnoringWordList, Plugin, PluginHost and FileType
into CodeRay namespace. CodeRay should be "clean" now, except for the
String#to_unix helper function.
- Fixed a bit of documentation.
- CodeRay binary: Prepare for streaming switch.
Scanners:
- Added code= alias for string=.
- Added streaming? method: Is this Scanner in streaming mode?
- Enhanced error info a bit.
- Ruby scanner:
- Highlights Regexp heredocs now. They may be added to Ruby 1.9.
- Speedups with better support for Ruby 1.9.
- Change in whitespace handling (faster and cleaner now.)
- Speed up some operator recognition (saving two string comparisons).
- Declared C and Plaintext Scanners as Streamable.
Tokens:
- Changed Text/Block token recognition (#is_a? ::String for Ruby 1.9 support).
- New method: Tokens#text yields the code string.
- text_size fixed.
- Token kind shortcuts (like r for reserved) are now defined in
token_classes.rb (instead of encoders/html/classes.rb).
Encoders:
- Debug Scanner added.
- Base encoder class adds to @out when encoding (if @out is set).
- A little Tokens scanner speedup.
- Text encoder uses text_token.
- Statistic encoder counts block tokens.
- Smaller changes in XML and HTML encoders.
Styles:
- cYcnus style defines a debug class now.
Duo:
- scanner and encoder are now methods. Scanner and Encoder are created (and
cached) when needed, not earlier.
- Documented.
Tests:
- Disabled encoder and scanner list check (breaks too often).
- Added identity test, which checks if tokens#text matches the input.
- Added nocolor switch.
Developer tools:
- Benchmark uses Encoder#file_extension for output now.
- Rakefile: Support for 19, 18, yarv and ruby switches for easy comparing
different Ruby versions.
- Statistic: Demos are no longer tests.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
- improved coderay_suite.rb (random and shuffled tests, max parameter, scannerlang->lang, sorted test cases...)
- changed html output extension to .actual.html to svn:ignore them
- fixed some tests (deleted $Id$ etc.)
- made XHTML testcase work
Scanners:
- fixed HTML, Delphi and Nitro scanners thanks to new tests
Engine:
- Tokens#fix and #fix! added (yet to be tested)
- improved Scanner#raise_inspect a bit
Converted more files to UNIX format (go away, stinkin' \r!)
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
debug mode, but token kind is nil unless assigned.
Small fixes for C and Ruby scanners.
Renamed local variable type to kind in Ruby scanner.
Improved RHTML scanner to recognize -%> as delimiter.
HTML encoder: improved handling of malformed token strings.
Fixed PluginHost#inspect including docu.
Scanner#raise_inspect also shows state if given.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
HTML Scanner: Fixed a nasty bug with invalid entities. Thanks to Daniel Bovensiepen.
Scanner: added Scanner.normify.
Plugin: small documentation fix.
Code statistic:
added lib root folder
rake_helpers/code_statistics.rb: added ability to include non-Ruby code in the statistics
used it to count the mountain of test data
There is some mixed space/tab indentation now. Complete 2-space-re-indentation will follow.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
CSS style changes/enhancments (mainly the new background color for inline code, affects all Ruby code.)
Demos and tests adjusted.
Plugin: new PluginHost::default method.
Scanner:
- New setup method
- ability to re-use a scanner
- ability to keep the tokens
- minor changes to token caching and string flattening
Encoder: Error if token content is neither String nor Symbol.
HTML encoder:
- more warnings for unclosed tokens
- output now UTF-8
Ruby Scanner:
- bug: symbols before => now do not include =; {:foo=>bar} is valid Ruby code
- try to close all open tokens
- constants now all with specific namespace (for speed, I hope)
Styles: new :entity/en class.
Test suite now gives hinted HTML output.
|
| |
|
|
|
|
|
|
| |
New demo: demo/demo_html_list.rb.
Some demos adjusted.
C Scanner: error messages fixed.
Rakefile: test_demos now in debug mode.
test/suite.rb is using reusable Scanners now.
|
| |
|
|
|
|
|
|
| |
bench/caching.rb added t´for demonstrating this.
HTML Encoder: creates unwrapped output by default (still problems with that.)
Numerizing changed (doesn't try to prevent nesting errors)
Speedup: "::String" is faster.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
demo/demo_load_encoder.rb enhanced
demo/demo_load_scanner.rb added
.outs added
plugin.rb: Fixed load_all
encoder.rb, scanner.rb adjusted
helpers/word_list.rb: Fixed a bug in CaseIgnoringWordList.new
TODO: Updated
new ROADMAP
coderay.rb: increased Version number
added Version System documentation
|
| |
|
|
|
|
|
|
| |
new CaseIgnoringWordList class
simplified implementation
Performance gain should be small.
Adjusted scanner.rb and scanners/delphi.rb
|
| | |
|
| | |
|
| | |
|
| |
|
