delta/cpython-git.git/Python/Python-ast.c, branch v3.9.6

[3.9] bpo-11105: Do not crash when compiling recursive ASTs (GH-20594) (GH-26522)

2021-06-03T21:22:34+00:00

When compiling an AST object with a direct / indirect reference
cycles, on the conversion phase because of exceeding amount of
calls, a segfault was raised. This patch adds recursion guards to
places for preventing user inputs to not to crash AST but instead
raise a RecursionError..
(cherry picked from commit f3491242e41933aa9529add7102edb68b80a25e9)

Co-authored-by: Batuhan Taskaya

[3.9] bpo-41631: _ast module uses again a global state (GH-21961) (GH-22258)

2020-09-15T18:32:56+00:00

Partially revert commit ac46eb4ad6662cf6d771b20d8963658b2186c48c:
"bpo-38113: Update the Python-ast.c generator to PEP384 (gh-15957)".

Using a module state per module instance is causing subtle practical
problems.

For example, the Mercurial project replaces the __import__() function
to implement lazy import, whereas Python expected that "import _ast"
always return a fully initialized _ast module.

Add _PyAST_Fini() to clear the state at exit.

The _ast module has no state (set _astmodule.m_size to 0). Remove
astmodule_traverse(), astmodule_clear() and astmodule_free()
functions..
(cherry picked from commit e5fbe0cbd4be99ced5f000ad382208ad2a561c90)

Co-authored-by: Victor Stinner

[3.9] bpo-41194: Convert _ast extension to PEP 489 (GH-21807)

2020-08-10T13:55:54+00:00

* bpo-41194: Convert _ast extension to PEP 489 (GH-21293)

Convert the _ast extension module to PEP 489 "Multiphase
initialization". Replace the global _ast state with a module state.

(cherry picked from commit b1cc6ba73a51d5cc3aeb113b5e7378fb50a0e20a)

* bpo-41204: Fix compiler warning in ast_type_init() (GH-21307)

(cherry picked from commit 1f76453173267887ed05bb3783e862cb22365ae8)

[3.9] bpo-41194: The _ast module cannot be loaded more than once (GH-21290) (GH-21292)

2020-07-03T14:57:19+00:00

* bpo-41194: Pass module state in Python-ast.c (GH-21284)

Rework asdl_c.py to pass the module state to functions in
Python-ast.c, instead of using astmodulestate_global.

Handle also PyState_AddModule() failure in init_types().

(cherry picked from commit 74419f0c64959bb8392fcf3659058410423038e1)

* bpo-41194: The _ast module cannot be loaded more than once (GH-21290)

Fix a crash in the _ast module: it can no longer be loaded more than
once. It now uses a global state rather than a module state.

* Move _ast module state: use a global state instead.
* Set _astmodule.m_size to -1, so the extension cannot be loaded more
  than once.

(cherry picked from commit 91e1bc18bd467a13bceb62e16fbc435b33381c82)

bpo-40217: Ensure Py_VISIT(Py_TYPE(self)) is always called for PyType_FromSpec types (reverts GH-19414) (GH-20264)

2020-05-28T15:12:23+00:00

Heap types now always visit the type in tp_traverse. See added docs for details.

This reverts commit 0169d3003be3d072751dd14a5c84748ab63a249f.

Automerge-Triggered-By: @encukou
(cherry picked from commit 1cf15af9a6f28750f37b08c028ada31d38e818dd)

Co-authored-by: Pablo Galindo

bpo-36290: Fix keytword collision handling in AST node constructors (GH-12382)

2020-05-24T21:32:32+00:00

(cherry picked from commit c73914a562580ae72048876cb42ed8e76e2c83f9)

Co-authored-by: Rémi Lapeyre

bpo-40528: Improve and clear several aspects of the ASDL definition code for the AST (GH-19952)

2020-05-06T14:29:32+00:00

bpo-40268: Remove unused structmember.h includes (GH-19530)

2020-04-15T00:35:41+00:00

If only offsetof() is needed: include stddef.h instead.

When structmember.h is used, add a comment explaining that
PyMemberDef is used.

bpo-40141: Add line and column information to ast.keyword nodes (GH-19283)

2020-04-01T23:47:39+00:00

bpo-39999: Improve compatibility of the ast module. (GH-19056)

2020-03-22T18:33:34+00:00

* Re-add removed classes Suite, slice, Param, AugLoad and AugStore.
* Add docstrings for dummy classes.
* Add docstrings for attribute aliases.
* Set __module__ to "ast" instead of "_ast".