summaryrefslogtreecommitdiff
path: root/sqlparse/lexer.py
Commit message (Collapse)AuthorAgeFilesLines
* change singleton behaviorSimon Heisterkamp2023-01-021-18/+34
|
* additional documentationSimon Heisterkamp2023-01-021-1/+3
|
* flake8Simon Heisterkamp2023-01-021-1/+4
|
* lexer documentationSimon Heisterkamp2023-01-021-2/+3
|
* test for changing the regexSimon Heisterkamp2023-01-021-6/+4
|
* remove type annotations for python 3.5 compatibilitySimon Heisterkamp2023-01-021-6/+2
|
* configurable syntaxSimon Heisterkamp2023-01-021-15/+72
|
* Update copyright notice.Andi Albrecht2020-10-071-1/+1
|
* Remove support for end-of-life PythonsJon Dufresne2020-08-311-6/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Python 2.7 and 3.4 are end-of-life. They are no longer receiving bug fixes, including for security issues. Python 2.7 went EOL on 2020-01-01 and 3.4 on 2019-03-18. For additional details on support Python versions, see: Supported: https://devguide.python.org/#status-of-python-branches EOL: https://devguide.python.org/devcycle/#end-of-life-branches Removing support for EOL Pythons will reduce testing and maintenance resources while allowing the library to move towards modern Python 3. Using pypinfo, we can show the PyPI download statistics, showing less than 10% of users are using Python 2.7. | python_version | percent | download_count | | -------------- | ------: | -------------: | | 3.7 | 45.36% | 3,056,010 | | 3.6 | 26.46% | 1,782,778 | | 3.8 | 12.22% | 823,213 | | 2.7 | 9.97% | 671,459 | | 3.5 | 5.86% | 394,846 | | 3.4 | 0.10% | 6,700 | | 3.9 | 0.03% | 2,346 | | 2.6 | 0.00% | 57 | | 3.3 | 0.00% | 21 | | 3.10 | 0.00% | 6 | | Total | | 6,737,436 | Library users who continue to use Python 2.7 will still be able to install previous versions of sqlparse. Compatibility shims have been dropped, simplifying the code. Using pyupgrade, the codebase has been updated to take advantage of modern syntax <https://github.com/asottile/pyupgrade>. The wheel is no longer marked as "universal" as it is now Python 3 only.
* Remove unnecessary compat shim for bytesJon Dufresne2019-03-101-2/+2
| | | | | | | | | | Both Python 2.7 and Python 3 have the type bytes. On Python 2.7, it is an alias of str, same as was previously defined in compat.py. Makes the code slightly more compatible with Python 3 style syntax. Observe: $ python2 >>> bytes <type 'str'>
* Update copyright header (fixes #372).Andi Albrecht2018-07-311-1/+2
|
* Fix typostypoVictor Uriarte2017-11-291-1/+1
|
* Fix encoding logic/orderVictor Uriarte2017-01-101-5/+6
| | | | | | - If user provides an encoding value, use it instead of trying to _guess_ first. - If no value is provided, then decode with default of utf-8, otherwise try with unicode-escape
* Fix #315 support utf-8 by defaultTao Wang2017-01-111-1/+1
| | | | Signed-off-by: Tao Wang <twang2218@gmail.com>
* Correct license link (fixes #288).Andi Albrecht2016-09-141-1/+1
|
* Decode bytes to unicode in Lexer.get_tokens().Oleg Broytman2016-08-311-5/+16
| | | | | | | Raise TypeError if the input is neither bytes in a known encoding nor unicode nor a file-like object (file, StringIO). Remove function u(). Add bytes_type to compat. Add tests for non-ascii.
* Revert "Parse double dollars (PostgreSQL) as literal strings (fixes #277)."Victor Uriarte2016-08-131-5/+2
| | | | This reverts commit 2893bd1857d685cf892beac3a7429d03cf1a09f1.
* Parse double dollars (PostgreSQL) as literal strings (fixes #277).Andi Albrecht2016-08-131-2/+5
|
* Move file_types list to compat module.Andi Albrecht2016-08-101-9/+1
|
* Fix a bug: recognize file (Python 2) as a streamOleg Broytman2016-08-061-1/+7
|
* Fix parsing of streams (fixes #273).Andi Albrecht2016-07-221-1/+3
|
* Misc. small code clean-up/commentsVictor Uriarte2016-06-181-1/+1
|
* Redo unicode-encoding on lexer.pyVictor Uriarte2016-06-111-11/+4
|
* Allow re to compile onceVictor Uriarte2016-06-041-12/+6
| | | | | Otherwise re will need to recompile everytime a call to tokenize is made.
* Simplify multi-line commentsVictor Uriarte2016-06-041-28/+6
|
* Add or Update copyright year to filesVictor Uriarte2016-06-041-3/+3
|
* Replace iter(range(len(...))) with enumerateVictor Uriarte2016-06-021-5/+4
|
* Pass encoding into lexer as a parameterVictor Uriarte2016-06-021-7/+4
|
* Simplify handling of encoding in lexer.pyVictor Uriarte2016-05-291-22/+10
|
* Remove encoding guessing on lexer.pyVictor Uriarte2016-05-291-11/+1
|
* Refactor lexer.tokens_unprocessedVictor Uriarte2016-05-291-60/+27
| | | | | | | Remove unused return pos Remove redundant streamer func Remove unreached else statement Clean-up Lexer tokenization
* Bid Adieu to metaclassVictor Uriarte2016-05-291-40/+17
| | | | | | | | | | The singleton pattern isn't applicable since only one language is being implemented. Simplify Lexer initialization. Fix compat func `u` on Py3. Signature didn't match Py2. Feature isn't used yet.
* Merge process_state and __call__Victor Uriarte2016-05-291-34/+16
| | | | | | | | Other Changes: Only #pop state is used by multiline comments. Remove unused states Simplify RegEx compilation RegEx Exception too generic
* Merge process_tokendef and __call__Victor Uriarte2016-05-291-16/+6
| | | | Remove unused token_variants
* Remove assert statements from lexer.pyVictor Uriarte2016-05-291-19/+0
|
* Remove undocumented ws handlers from lexer.pyVictor Uriarte2016-05-291-15/+2
| | | | | Removing nl before tokenizing breaks comments (stripnl/stripall) Remove tab-expansion.
* Remove unused func/class/args in lexer.pyVictor Uriarte2016-05-291-60/+3
| | | | | | Remove unused apply_filters from lexer.py Remove unused filters function from lexer.py Remove unused arguments get_tokens func
* Refactor var Lexer.tokens & func is_keywordVictor Uriarte2016-05-291-68/+3
|
* Don't call is_keyword for the new 'USING(' regexkoljonen2016-05-151-1/+1
|
* Recognize USING as a keyword in 'USING(', not just in 'USING ('koljonen2016-05-141-0/+1
| | | | These were previously caught by (r'[^\W\d_]\w*(?=[.(])', tokens.Name), so I added a special regex just above that one.
* fix issue #215Shen Longxing2015-12-181-1/+1
| | | Add token for 'END WHILE'
* Cleanup module code.Andi Albrecht2015-10-261-1/+1
|
* Fix tab expansion for Python 3.Andi Albrecht2015-10-261-5/+7
|
* Use compat module for single Python 2/3 code base.Andi Albrecht2015-10-261-13/+16
| | | | This change includes minor fixes and code cleanup too.
* Recognize MSSQL temp tables and distinguish from MySQL comments (fixes #192).Andi Albrecht2015-07-261-3/+3
|
* Never interpret IN keyword as function name (fixes #183).Andi Albrecht2015-04-121-0/+3
|
* Fix other regex to identify comments starting with '#' character.Andi Albrecht2015-03-161-1/+1
|
* Support comments starting with '#' character (fixes #178).Andi Albrecht2015-03-161-1/+1
|
* get rid of tokens.Punctuation.ArrayIndex, add negative lookbehind for sqlite ↵Darik Gamble2015-03-041-2/+4
| | | | identifiers
* Allow identifiers to start with an underscore (fixes #175).Andi Albrecht2015-03-011-2/+1
|
View Lorry Controller Status