delta/cpython-git.git/Parser, branch faster-bytes-iter

closes bpo-38156: Always handle interrupts in PyOS_StdioReadline. (GH-21569)

2020-07-29T00:57:12+00:00

This consolidates the handling of my_fgets return values, so that interrupts are always handled, even if they come after EOF.

 I believe PyOS_StdioReadline is still buggy in that I/O errors will not result in a proper Python exception being set. However, that is a separate issue.

Validate the AST produced by the parser in debug mode (GH-21643)

2020-07-27T22:46:59+00:00

This will improve the debug experience if something fails in the produced AST. Previously, errors in the produced AST can be felt much later like in the garbage collector or the compiler, making debugging them much more difficult.

Fix trivial typo in the PEG string parser (GH-21508)

2020-07-16T16:10:23+00:00

Fix possibly-unitialized warning in string_parser.c. (GH-21503)

2020-07-16T13:07:29+00:00

GCC says
```
../cpython/Parser/string_parser.c: In function ‘fstring_find_expr’:
../cpython/Parser/string_parser.c:404:93: warning: ‘cols’ may be used uninitialized in this function [-Wmaybe-uninitialized]
  404 |     p2->starting_col_offset = p->tok->first_lineno == p->tok->lineno ? t->col_offset + cols : cols;
      |                               ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~
../cpython/Parser/string_parser.c:384:16: note: ‘cols’ was declared here
  384 |     int lines, cols;
      |                ^~~~
../cpython/Parser/string_parser.c:403:45: warning: ‘lines’ may be used uninitialized in this function [-Wmaybe-uninitialized]
  403 |     p2->starting_lineno = t->lineno + lines - 1;
      |                           ~~~~~~~~~~~~~~~~~~^~~
../cpython/Parser/string_parser.c:384:9: note: ‘lines’ was declared here
  384 |     int lines, cols;
      |         ^~~~~
```

and, indeed, if `PyBytes_AsString` somehow fails, lines & cols will not be initialized.

bpo-41215: Make assertion in the new parser more strict (GH-21364)

2020-07-06T22:42:21+00:00

bpo-41215: Don't use NULL by default in the PEG parser keyword list (GH-21355)

2020-07-06T19:31:16+00:00

Automerge-Triggered-By: @lysnikolaou

bpo-41204: Fix compiler warning in ast_type_init() (GH-21307)

2020-07-04T21:18:15+00:00

bpo-41194: Convert _ast extension to PEP 489 (GH-21293)

2020-07-03T18:01:46+00:00

Convert the _ast extension module to PEP 489 "Multiphase
initialization". Replace the global _ast state with a module state.

bpo-41194: The _ast module cannot be loaded more than once (GH-21290)

2020-07-03T12:15:53+00:00

Fix a crash in the _ast module: it can no longer be loaded more than
once. It now uses a global state rather than a module state.

* Move _ast module state: use a global state instead.
* Set _astmodule.m_size to -1, so the extension cannot be loaded more
  than once.

bpo-41194: Pass module state in Python-ast.c (GH-21284)

2020-07-03T09:35:37+00:00

Rework asdl_c.py to pass the module state to functions in
Python-ast.c, instead of using astmodulestate_global.

Handle also PyState_AddModule() failure in init_types().