diff options
| author | Guido van Rossum <guido@python.org> | 2019-03-07 12:38:08 -0800 |
|---|---|---|
| committer | Miss Islington (bot) <31488909+miss-islington@users.noreply.github.com> | 2019-03-07 12:38:08 -0800 |
| commit | 495da292255b92dd73758fdd0e4c7d27d82b1e57 (patch) | |
| tree | 1378cf049d2d125593fa970ea1e9a9f77604fab1 /Doc/library/token.rst | |
| parent | bf94cc7b496a379e1f604aa2e4080bb70ca4020e (diff) | |
| download | cpython-git-495da292255b92dd73758fdd0e4c7d27d82b1e57.tar.gz | |
bpo-35975: Support parsing earlier minor versions of Python 3 (GH-12086)
This adds a `feature_version` flag to `ast.parse()` (documented) and `compile()` (hidden) that allow tweaking the parser to support older versions of the grammar. In particular if `feature_version` is 5 or 6, the hacks for the `async` and `await` keyword from PEP 492 are reinstated. (For 7 or higher, these are unconditionally treated as keywords, but they are still special tokens rather than `NAME` tokens that the parser driver recognizes.)
https://bugs.python.org/issue35975
Diffstat (limited to 'Doc/library/token.rst')
| -rw-r--r-- | Doc/library/token.rst | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/Doc/library/token.rst b/Doc/library/token.rst index 4936e9aa08..5c641ef46d 100644 --- a/Doc/library/token.rst +++ b/Doc/library/token.rst @@ -88,3 +88,6 @@ the :mod:`tokenize` module. .. versionchanged:: 3.8 Added :data:`TYPE_COMMENT`. + Added :data:`AWAIT` and :data:`ASYNC` tokens back (they're needed + to support parsing older Python versions for :func:`ast.parse` with + ``feature_version`` set to 6 or lower). |