delta/python-packages/pygments-git.git/tests/examplefiles/pike, branch regex github.com: pygments/pygments.git CFamily: Lex identifiers after `case` as constants (#2084) 2022-03-12T14:00:31+00:00 amitkummer 49096391+amitkummer@users.noreply.github.com 2022-03-12T14:00:31+00:00 62dd19e9d3e0400fff0aeddabae490797425c87e * Lex identifiers after `case` as constants Add a state for marking identifiers preceded by a `case` keyword as constants. Additionally, refactor the `label` rule to no longer permit a `case` keyword before a label. Consequentially, identifiers after a `case` keyword (like `foo` in `case foo:`) are no longer wrongly lexed as `Name.Label`, but as `Name.Constant`. In addition, this fixes #2076, as multiple `case` keywords in one line are lexed the same. * Add test for multiple `case` keywords in one line * Fix existing tests * Lex `::` as Operator and not Name.Constant After a `case`, when lexing a namespaced name, like `foo::bar`, lex the namespace operator `::` as Operator, and not Name.Constant. * Regenerate tokens 
* Lex identifiers after `case` as constants

Add a state for marking identifiers preceded by  a `case` keyword as
constants.

Additionally, refactor the `label` rule to no longer permit a `case`
keyword before a label.

Consequentially, identifiers after a `case` keyword (like `foo` in
`case foo:`) are no longer wrongly lexed as `Name.Label`, but as
`Name.Constant`.

In addition, this fixes #2076, as multiple `case` keywords in one
line are lexed the same.

* Add test for multiple `case` keywords in one line

* Fix existing tests

* Lex `::` as Operator and not Name.Constant

After a `case`, when lexing a namespaced name, like `foo::bar`, lex the
namespace operator `::` as Operator, and not Name.Constant.

* Regenerate tokens
 Use the correct whitespace token for the C family. 2021-06-20T09:42:04+00:00 Matthäus G. Chajdas dev@anteru.net 2021-06-20T09:42:04+00:00 a537d5e9663e888706df75c40826be3aed177959 The CFamilyLexer was matching whitespace as Text instead of Whitespace. 
The CFamilyLexer was matching whitespace as Text instead of Whitespace.
Fixes for C and C++ functions and namespaces (#1722) 2021-02-27T16:32:41+00:00 amitkummer 49096391+amitkummer@users.noreply.github.com 2021-02-27T16:32:41+00:00 c1a0d82acbe6fa026a1f6843fee00cc1df626549 * Fix lexing of function names This fixes #1561. Add a keywords state that matches inside and outside functions for keywords. Before this, when a keyword would appear the lexer would go to the statements state, in which functions were not matched. * Add tests for lexing of function names * Unbreak previous tests * Allow namespaced names in function statements Add a second identifiers regex that matces all the previous identifiers and also '::'. I took the decision to create a second identifiers regex with '::' inside, simply because using the old identifiers regex would hurt performance massively on every solution I tried to craft. * Add tests for namespaced names in functions * Unbreak previous tests * Add support for namespaces in namespace declarations Add a namespace state that is entered each time the namespace keyword is matched and lexes all name matches as namespaces. Cases this approach doesn't cover: * Namespaces in using declarations. * Namespaces that prefix names in random code. Unfortunately, in both of these cases the names before and after '::' are not always namespaces. * Add tests for namespace declartions * Unbreak previous tests * Tidy functions regex Remove group nesting that became unneeded after fc56ab8 (the last big refactor). * Remove f string usage I introduced by mistake 
* Fix lexing of function names

This fixes #1561.

Add a keywords state that matches inside and outside functions for
keywords.

Before this, when a keyword would appear the lexer would go to the
statements state, in which functions were not matched.

* Add tests for lexing of function names

* Unbreak previous tests

* Allow namespaced names in function statements

Add a second identifiers regex that matces all the previous identifiers
and also '::'.

I took the decision to create a second identifiers regex with '::'
inside, simply because using the old identifiers regex would hurt
performance massively on every solution I tried to craft.

* Add tests for namespaced names in functions

* Unbreak previous tests

* Add support for namespaces in namespace declarations

Add a namespace state that is entered each time the namespace keyword
is matched and lexes all name matches as namespaces.

Cases this approach doesn't cover:
* Namespaces in using declarations.
* Namespaces that prefix names in random code.
Unfortunately, in both of these cases the names before and after '::'
are not always namespaces.

* Add tests for namespace declartions

* Unbreak previous tests

* Tidy functions regex

Remove group nesting that became unneeded after fc56ab8 (the last big
refactor).

* Remove f string usage I introduced by mistake
 Also add auto-updatable output-based tests to examplefiles (#1689) 2021-01-20T09:48:45+00:00 Oleh Prypin oleh@pryp.in 2021-01-20T09:48:45+00:00 6f4309217326430145564ae8b1bb393ea684f39f Co-authored-by: Georg Brandl <georg@python.org> 
Co-authored-by: Georg Brandl <georg@python.org>