summaryrefslogtreecommitdiff
path: root/pygments
Commit message (Collapse)AuthorAgeFilesLines
* Prepare 2.7.2 release.2.7.2Matthäus G. Chajdas2020-10-241-1/+1
| | | | Update CHANGES, bump version.
* Speculative fix for #1579. (#1583)Matthäus G. Chajdas2020-10-241-2/+2
| | | | This removes the top/bottom padding changes, and only keeps left/right padding, in the hope that this does not break all Sphinx themes.
* TNTLexer: Don't crash on unexpected EOL. (#1570)Ken2020-10-141-54/+67
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | * TNTLexer: Don't crash on unexpected EOL Catch IndexErrors in each line and error the rest of the line, leaving whatever tokens were found. * Write and pass tests for Typographic Number Theory pygments/lexers/tnt.py: * Fix indentation on import * Fix: TNTLexer.cur is class-level reference if not initialized in get_tokens_unprocessed, so init it in __init__ too * Fix: Fantasy markers are not allowed as components of other formulas, so have a dedicated check for them in the body of get_tokens_unprocessed which disables the normal formula handling if present * Clarify TNTLexer.lineno docstring * Attempt to discard tokens before an IndexError +tests/test_tnt.py: * Test every method, and test both +ve and -ve matches for most * Lexer fixture is test-level to reinitialize cur clean each time * Don't test actual get_tokens_unprocessed method (besides for fantasy markers) because the text testing is left to examplefiles AUTHORS: + Add myself to credits :) * Add a TNT test just to make sure no crashes
* llvm lexer: add freeze instruction and bfloat type (#1565)Nuno Lopes2020-10-061-11/+12
|
* Fix spelling mistakes - fixes #1562.Matthäus G. Chajdas2020-10-041-2/+2
|
* Add missing tokens to SPARQL lexer (#1559)Lucas Werkmeister2020-10-021-5/+5
| | | | | | | | | | | | | | | | @belett noticed that VALUES was missing [1]; I found the other ones by running the following snippet on the SPARQL 1.1 Query Language spec: new Set(Array.from(document.querySelectorAll('.grammarTable')) .reduce((text, elem) => text + elem.textContent) .match(/'[a-z0-9-_ ]*'/ig)) I don’t know why a few keywords were missing; the docstring linked to the SPARQL 1.0 Query Language spec (also fixed here), but the lexer already contained other tokens which were only added in SPARQL 1.1, such as the aggregate functions (MIN, MAX etc.), which have already been in Pygments since the initial commit of the current history (6ded9db394). [1]: https://phabricator.wikimedia.org/T264175
* Fix LatexEmbeddedLexer (#1517)Eric Wieser2020-09-301-9/+42
| | | | | | | * Fix LatexEmbeddedLexer to not call the nested tokenizer piecewise * Reuse the existing do_insertions function * Add a test for the `LatexEmbeddedLexer`
* Add analyze_text to make make check happy. (#1549)Matthäus G. Chajdas2020-09-2326-6/+314
| | | | | | | | | | | | | | | | | | | * Add analyze_text to make make check happy. This also fixes a few small bugs: * Slash uses *.sla as the file ending, not *.sl * IDL has endelse, not elseelse * Improve various analyse_text methods. * Improve various analyse_text methods. * Make Perl less confident in presence of :=. * Improve brainfuck check to not parse the whole input. * Improve Unicon by matching \self, /self * Fix Ezhil not matching against the input text * Simplify Modula2::analyse_text.
* Grammar correction 'an generator' -> 'a generator'zkneupper2020-09-231-1/+1
|
* image formatter: find ttc fonts on MacGeorg Brandl2020-09-201-1/+2
| | | | fixes #1223
* python traceback lexer: fix custom exceptions without messageGeorg Brandl2020-09-191-1/+1
| | | | fixes #1548
* fix regression in JSON lexer, bump to 2.7.12.7.1Georg Brandl2020-09-172-3/+3
| | | | Fixes #1544
* Preparing 2.7.0 release.2.7.0Matthäus G. Chajdas2020-09-121-1/+1
|
* all: remove "u" string prefix (#1536)Georg Brandl2020-09-0837-1932/+1828
| | | | | | | | | | | * all: remove "u" string prefix * util: remove unirange Since Python 3.3, all builds are wide unicode compatible. * unistring: remove support for narrow-unicode builds which stopped being relevant with Python 3.3
* Fix a Windows/PyPy3 test failure (#1533)Kurt McKee2020-09-071-1/+8
| | | | | | | PyPy3 on Windows has a test failure in `test_cmdline:test_outfile()` when trying to unlink the temporary output file. The root cause is that `cmdline:inner_main()` does not explicitly close the file that it opens, and PyPy3 isn't auto-closing the file when `inner_main()` returns. This prevents the file from being unlinked, and the test case fails.
* fennel: fixup string regexGeorg Brandl2020-09-071-1/+1
|
* Avoid catastrophic backtracking.Phil Hagelberg2020-09-071-1/+1
| | | | as advised in https://github.com/pygments/pygments/pull/1535/files/f581f2892154e8e4ed673ab940abf8af43ebe66b#r484028618
* Add support for # as lambda shorthand.Phil Hagelberg2020-09-071-0/+3
|
* Remove old python-2-style strings.Phil Hagelberg2020-09-071-17/+17
|
* Update Fennel keywords to catch up to version 0.6.0.Phil Hagelberg2020-09-071-10/+14
| | | | | | Remove support for single-quoted strings. Update fennelview example to latest version of library.
* all: revert changes of [a-zA-Z0-9_] to \wGeorg Brandl2020-09-0713-51/+52
| | | | ... which is not equivalent in Unicode mode
* Update mapfilesGeorg Brandl2020-09-061-2/+2
|
* all: use argumentless super()Georg Brandl2020-09-0612-151/+81
|
* Add comment.Matthäus G. Chajdas2020-09-061-0/+3
| | | | Add a quick reminder that Javascript doesn't need integers.
* Overhaul Javascript numeric literals (#1534)Kurt McKee2020-09-061-5/+8
| | | | | | | | | | | | | | | | | | | | | | * Rename the "Javascript" tests to reflect that they are for CoffeeScript This change also modifies the module docstring to reflect the file's purpose. * Overhaul the Javascript numeric literal parsing Fixes #307 This patch contains the following changes: * Adds 50+ unit tests for Javascript numeric literals * Forces ASCII numbers for float literals (so, now reject `.୪`) * Adds support for Javascript's BigInt notation (`100n`) * Adds support for leading-zero-only octal notation (`0777`) * Adds support for scientific notation with no significand (`1e10`) Numeric literal parsing is based on information at: * https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Grammar_and_types * https://developer.mozilla.org/en-US/docs/Web/JavaScript/Data_structures
* Simplify regex.Matthäus G. Chajdas2020-09-061-1/+1
|
* Overhaul the MySQL lexer (#1527)Kurt McKee2020-09-062-56/+1435
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Overhaul the MySQL lexer Fixes #975, #1063, #1453 Changes include: Documentation ------------- * Note in the lexer docstring that Oracle MySQL is the target syntax. MariaDB syntax is not a target (though there is significant overlap). Unit tests ---------- * Add 140 unit tests for MySQL. Literals -------- * Hexadecimal/binary/date/time/timestamp literals are supported. * Integer mantissas are supported for scientific notation. * In-string escapes are now tokenized properly. * Support the "unknown" constant. Comments -------- * Optimizer hints are now supported, and keywords are recognized and tokenized as preprocessor instructions. * Remove nested multi-line comment support, which is no longer supported in MySQL. Variables --------- * Support the '@' prefix for variable names. * Lift restrictions on characters in unquoted variable names. (MySQL does not impose a restriction on lead characters.) * Support single/double/backtick-quoted variable names, including escapes. * Support the '@@' prefix for system variable names. * Support '?' as a variable so people can demonstrate prepared statements. Keywords -------- * Keyword / data type / function are now in a separate, auto-updating file. * Support 25 additional data types (including spatial and JSON types). * Support 460 additional MySQL keywords. * Support 372 MySQL functions. Explicit function support resolves a bug that causes non-function items to be treated as functions simply because they have a trailing opening parenthesis. * Support exceptions for the 'SET' keyword, which is both a datatype and a keyword depending on context. Schema object names ------------------- * Support Unicode in MySQL schema object names. * Support parsing of backtick-quoted schema object name escapes. (Escapes do not produce a distinct token type at this time.) Operators --------- * Remove non-operator characters from the list of operators. * Remove non-punctuation characters from the list of punctuation. * Cleanup items based on feedback * Remove an unnecessary optional newline lookahead for single-line comments
* all: use yield from (#1537)Georg Brandl2020-09-0628-160/+91
|
* all: fixup some file headersGeorg Brandl2020-09-068-52/+50
|
* all: fixup remaining regexlint warningsGeorg Brandl2020-09-0645-332/+338
|
* angular2: fix missing bygroups() assignmentGeorg Brandl2020-09-061-2/+2
|
* Merge pull request #1530 from btashton/arm-gasGeorg Brandl2020-09-061-1/+1
|\ | | | | Add support for ARM constant notation in GAS lexer
| * Add support for ARM constant notation in GAS lexerBrennan Ashton2020-09-021-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | GNU supports ARM syntax which uses notation like #1 for constants. Currently this is handled like a comment which is incorrect. Take the case of: ldr r0, [r1, #0] Right now the #0] would be treated like a comment and looks very poor. Was referenced in issue #627 Signed-off-by: Brennan Ashton <bashton@brennanashton.com>
* | Add lexer for PsySH console for PHP (#1438)Ben Ramsey2020-09-042-4/+58
|/ | | | | This lexer is based on the PythonConsoleLexer and provides the ability to highlight console input and output for PsySH, a developer console and REPL for PHP. See https://psysh.org.
* more explicitly define escape sequencies in JsonLexer (fix #1065) (#1528)Nick Gerner2020-08-311-2/+2
| | | | | * more explicitly define escape sequencies in JsonLexer (fix #1065) * adding test coverage for #1065
* Make group optionalrugk2020-08-231-2/+2
|
* Fix HttpLexer to allow 2.0rugk2020-08-231-2/+2
| | | | | According to [RFC7540 (section 3.5)](https://tools.ietf.org/html/rfc7540#section-3.5), if I interpret it correctly, it actually even _has to_ start with `2.0` and not `2`. As HTTP/3 is also defined there, I have not looked into how that has to be used/started.
* Fix cmake header (#1491)Thomas Aglassinger2020-08-231-1/+6
| | | | | | | | | * Fixed guessing of CMake by header. * Version number can have multiple digits. * Tabs are handled as white space. * Trailing comments are ignored. * Cleaned up regex to detect CMake header.
* Add lexer for Pointless (#1494)Avery N. Nortonsmith2020-08-232-0/+71
| | | | | | | | | | | | | | | | | | | * add lexer for pointless * lexer docstring formatting * added link to languages doc * update authors * update version * added double string * added upval keyword * simplify ptls example code * rename doubleString -> multiString
* Fix #1502.Matthäus G. Chajdas2020-08-221-4/+5
| | | | | Single-quoted strings were handled differently in the Ruby lexer compared to double-quoted strings, leading to catastrophic backtracking.
* Update copyright year (fixes #1514.)Matthäus G. Chajdas2020-08-22221-224/+224
|
* Merge pull request #1480 from ↵Matthäus G. Chajdas2020-08-221-3/+4
|\ | | | | | | | | Noordsestern/Noordsestern-robotframework-tasks-table [Robot Framework] Add syntax for tasks
| * typoNoordsestern2020-06-151-1/+1
| |
| * adding *task* to settings sectionNoordsestern2020-06-151-3/+3
| |
| * add new tables *tasks* and *task*Noordsestern2020-06-151-0/+1
| | | | | | available since Robot Framework 3.1 (January 2019)
* | Merge pull request #1500 from pygments/improve-linenos-handlingMatthäus G. Chajdas2020-08-221-4/+8
|\ \ | | | | | | Improve HTML formatter output.
| * | Improve HTML formatter output.improve-linenos-handlingMatthäus G. Chajdas2020-07-311-4/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | With the previous changes, we started to emit one <pre> per line for line numbers. This breaks for instance the Sphinx-RTD-Theme, which expects the line numbers to be formatted the same way as the normal content. This commit makes the following changes: * Emit a single <pre> inside the linenos div * Wrap individual lines into <span> as needed * Update all tests * Don't yield empty <span> elements when no style is specified This also makes the .html test files look correct when looked at with a browser, as there is no extra whitespace in them which needs stripping.
* | | Added BARE schema lexer (#1488)Martijn Braam2020-08-222-0/+101
| | |
* | | Mark 'syntax' as a keyword in the protobuf lexer. (#1505)Benjamin Peterson2020-08-221-1/+1
| | |
* | | Manually merge PR#1497.Matthäus G. Chajdas2020-08-221-3/+2
| | | | | | | | | | | | | | | This is a manual merge as we don't want to pull in the documentation change as part of this fix for a cleaner history.