delta/cpython-git.git/Parser, branch bind-socket

bpo-36459: Fix a possible double PyMem_FREE() due to tokenizer.c's tok_nextc() (12601)

2019-03-28T13:53:00+00:00

Remove the PyMem_FREE() call added in cb90c89.  The buffer will be
freed when PyTokenizer_Free() is called on the tokenizer state.

bpo-36143: Regenerate Lib/keyword.py from the Grammar and Tokens file using pgen (GH-12456)

2019-03-25T22:01:12+00:00

Now that the parser generator is written in Python (Parser/pgen) we can make use of it to regenerate the Lib/keyword file that contains the language keywords instead of parsing the autogenerated grammar files. This also allows checking in the CI that the autogenerated files are up to date.

bpo-36385: Add ``elif`` sentence on to avoid multiple ``if`` (GH-12478)

2019-03-21T04:39:17+00:00

Currently, when arguments on Parser/asdl_c.py are parsed
``ìf`` sentence is used. This PR Propose to use ``elif``
to avoid multiple evaluting of the ifs.





https://bugs.python.org/issue36385

bpo-36367: Free buffer if realloc fails in tokenize.c (GH-12442)

2019-03-19T17:17:58+00:00

bpo-36280: Add Constant.kind field (GH-12295)

2019-03-13T20:00:46+00:00

The value is a string for string and byte literals, None otherwise.
It is 'u' for u"..." literals, 'b' for b"..." literals, '' for "..." literals.
The 'r' (raw) prefix is ignored.
Does not apply to f-strings.

This appears sufficient to make mypy capable of using the stdlib ast module instead of typed_ast (assuming a mypy patch I'm working on).

WIP: I need to make the tests pass. @ilevkivskyi @serhiy-storchaka 



https://bugs.python.org/issue36280

Remove d_initial from the parser as it is unused (GH-12212)

2019-03-09T15:35:50+00:00

d_initial, the first state of a particular DFA in the parser has always been initialized to 0 in the old pgen as well as the new pgen. As this value is not used and the first state of each DFA is assumed to be the first element in the array representing it, remove d_initial from the parser to reduce complexity.

bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)

2019-03-07T20:38:08+00:00

This adds a `feature_version` flag to `ast.parse()` (documented) and `compile()` (hidden) that allow tweaking the parser to support older versions of the grammar. In particular if `feature_version` is 5 or 6, the hacks for the `async` and `await` keyword from PEP 492 are reinstated. (For 7 or higher, these are unconditionally treated as keywords, but they are still special tokens rather than `NAME` tokens that the parser driver recognizes.)



https://bugs.python.org/issue35975

bpo-36187: Remove NamedStore. (GH-12167)

2019-03-05T18:42:06+00:00

NamedStore has been replaced with Store. The difference between
NamedStore and Store is handled when precess the NamedExpr node
one level upper.

Clean implementation of Parser/pgen and fix some style issues (GH-12156)

2019-03-04T07:26:13+00:00

Remove some code which has been dead since 1994 (#12136)

2019-03-02T04:37:34+00:00