summaryrefslogtreecommitdiff
path: root/sqlparse/lexer.py
Commit message (Collapse)AuthorAgeFilesLines
* Add or Update copyright year to filesVictor Uriarte2016-06-041-3/+3
|
* Replace iter(range(len(...))) with enumerateVictor Uriarte2016-06-021-5/+4
|
* Pass encoding into lexer as a parameterVictor Uriarte2016-06-021-7/+4
|
* Simplify handling of encoding in lexer.pyVictor Uriarte2016-05-291-22/+10
|
* Remove encoding guessing on lexer.pyVictor Uriarte2016-05-291-11/+1
|
* Refactor lexer.tokens_unprocessedVictor Uriarte2016-05-291-60/+27
| | | | | | | Remove unused return pos Remove redundant streamer func Remove unreached else statement Clean-up Lexer tokenization
* Bid Adieu to metaclassVictor Uriarte2016-05-291-40/+17
| | | | | | | | | | The singleton pattern isn't applicable since only one language is being implemented. Simplify Lexer initialization. Fix compat func `u` on Py3. Signature didn't match Py2. Feature isn't used yet.
* Merge process_state and __call__Victor Uriarte2016-05-291-34/+16
| | | | | | | | Other Changes: Only #pop state is used by multiline comments. Remove unused states Simplify RegEx compilation RegEx Exception too generic
* Merge process_tokendef and __call__Victor Uriarte2016-05-291-16/+6
| | | | Remove unused token_variants
* Remove assert statements from lexer.pyVictor Uriarte2016-05-291-19/+0
|
* Remove undocumented ws handlers from lexer.pyVictor Uriarte2016-05-291-15/+2
| | | | | Removing nl before tokenizing breaks comments (stripnl/stripall) Remove tab-expansion.
* Remove unused func/class/args in lexer.pyVictor Uriarte2016-05-291-60/+3
| | | | | | Remove unused apply_filters from lexer.py Remove unused filters function from lexer.py Remove unused arguments get_tokens func
* Refactor var Lexer.tokens & func is_keywordVictor Uriarte2016-05-291-68/+3
|
* Don't call is_keyword for the new 'USING(' regexkoljonen2016-05-151-1/+1
|
* Recognize USING as a keyword in 'USING(', not just in 'USING ('koljonen2016-05-141-0/+1
| | | | These were previously caught by (r'[^\W\d_]\w*(?=[.(])', tokens.Name), so I added a special regex just above that one.
* fix issue #215Shen Longxing2015-12-181-1/+1
| | | Add token for 'END WHILE'
* Cleanup module code.Andi Albrecht2015-10-261-1/+1
|
* Fix tab expansion for Python 3.Andi Albrecht2015-10-261-5/+7
|
* Use compat module for single Python 2/3 code base.Andi Albrecht2015-10-261-13/+16
| | | | This change includes minor fixes and code cleanup too.
* Recognize MSSQL temp tables and distinguish from MySQL comments (fixes #192).Andi Albrecht2015-07-261-3/+3
|
* Never interpret IN keyword as function name (fixes #183).Andi Albrecht2015-04-121-0/+3
|
* Fix other regex to identify comments starting with '#' character.Andi Albrecht2015-03-161-1/+1
|
* Support comments starting with '#' character (fixes #178).Andi Albrecht2015-03-161-1/+1
|
* get rid of tokens.Punctuation.ArrayIndex, add negative lookbehind for sqlite ↵Darik Gamble2015-03-041-2/+4
| | | | identifiers
* Allow identifiers to start with an underscore (fixes #175).Andi Albrecht2015-03-011-2/+1
|
* Recognize escaped backslashes within stringscasey2015-02-261-2/+1
| | | | | Previously if a single quoted string ended with an escaped backslash, parsing would not consider the string to be terminated.
* Fix of problem with multiline treated as stackable while /* /* */ is one ↵JacekPliszka2015-02-121-1/+7
| | | | comment, not two stacked
* (postgresql) Add support for square bracket array indexing, by darikg.Andi Albrecht2015-02-081-0/+1
| | | | Pull request #170 with trivial conflicts resolved.
* Add double precision as a built-in datatypeDarik Gamble2015-02-061-0/+1
|
* Fix a regression for identifiers with square bracktes notation (fixes #153).Andi Albrecht2014-12-011-1/+1
|
* Handle modulo operator without spacesGavin Wahl2014-08-071-1/+2
| | | | | | | `x %3` should be interpreted as a modulo operation, not a parameter marker. Co-authored-by: Rocky Meza <rmeza@fusionbox.com>
* Fix incorrect parsing of string literals with line breaks (fixes #118).Andi Albrecht2013-11-061-2/+2
|
* Merge pull request #112 from alexander-beedie/masterAndi Albrecht2013-10-231-1/+1
|\ | | | | extended JOIN token recognition/lexing (eg: FULL OUTER JOIN, NATURAL JOIN)
| * tighten up JOIN regexAlexander Beedie2013-10-171-1/+1
| | | | | | ensure the regex does not match against invalid permutations such as 'LEFT OUTER CROSS JOIN', since CROSS/NATURAL keywords were added
| * extend regex to allow recognition of 'NATURAL JOIN'Alexander Beedie2013-10-171-1/+1
| |
| * add keyword recognition for "FULL OUTER JOIN" and "CROSS JOIN"Alexander Beedie2013-09-021-1/+1
| |
* | Remove buffered reading again (fixes #114).Andi Albrecht2013-10-231-21/+1
|/ | | | It causes problems with some sources.
* Parse scientific numbers as floats (fixes #107).Andi Albrecht2013-08-261-0/+1
|
* Improve parsing of PEP249-style placeholder (fixes #103).Andi Albrecht2013-06-291-0/+1
|
* Allow whitespaces in certain keywords (fixes #97).Andi Albrecht2013-06-171-3/+3
|
* Improve performance of reindent engine a bit (targets issue41).Andi Albrecht2013-05-101-1/+1
|
* Added STRAIGHT_JOIN token.Yago Riveiro2013-04-251-1/+1
|
* Add encoding parameter to top-level functions (fixes issue20).Andi Albrecht2013-04-041-2/+5
|
* Unicode-escape for binary data (sqlparse/lexer.py)Alexey Malyshev2013-02-251-1/+4
| | | fix "UnicodeDecodeError: 'utf8' codec can't decode byte 0xfd in position 71: invalid start byte" when query contains binary data
* Dynamically change bufsize to parse lenghty tokens faster (fixes #86).Andi Albrecht2013-02-131-1/+8
|
* Python 3 is now fully supported without any patches.Andi Albrecht2012-12-311-1/+4
| | | | | | | | | This change makes the extras/py3k stuff obsolete and installing for Python 3 is as easy as "python3 setup.py install". setup.py uses distribute's use_2to3 flag to automatically run 2to3 when Python 3 is used. \o/ Happy New Year, everyone!
* Fix parsing error with dollar-quoted procedure bodies (fixes issue83).Andi Albrecht2012-12-221-1/+1
|
* PEP8'ified to code a bit.Andi Albrecht2012-11-121-1/+2
|
* Simplify the regular expressions by using character groups, allow all ↵Andi Albrecht2012-08-121-7/+7
| | | | unicode letters.
* Add FIXME.Andi Albrecht2012-04-231-0/+2
|
View Lorry Controller Status