<feed xmlns='http://www.w3.org/2005/Atom'>
<title>delta/python-packages/pygments-git.git/pygments/formatters, branch raw-alias</title>
<subtitle>github.com: pygments/pygments.git
</subtitle>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/'/>
<entry>
<title>ImgFormatter: Use the start position based on the length of text (#1611)</title>
<updated>2020-11-28T09:18:59+00:00</updated>
<author>
<name>strawberry beach sandals</name>
<email>30496251+15b3@users.noreply.github.com</email>
</author>
<published>2020-11-28T09:18:59+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=1d51df138f6aa8b4b2eed53ca8505dcfd225b562'/>
<id>1d51df138f6aa8b4b2eed53ca8505dcfd225b562</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Remove margin: 0 from &lt;pre&gt; styling.</title>
<updated>2020-10-28T18:33:47+00:00</updated>
<author>
<name>Matthäus G. Chajdas</name>
<email>dev@anteru.net</email>
</author>
<published>2020-10-28T18:33:47+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=4dede4010180c8a5a231628deedcf393565cf785'/>
<id>4dede4010180c8a5a231628deedcf393565cf785</id>
<content type='text'>
This seems to break some themes which were not expecting Pygments to
change margins, and it doesn't look like it makes a difference for
standalone Pygments.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This seems to break some themes which were not expecting Pygments to
change margins, and it doesn't look like it makes a difference for
standalone Pygments.
</pre>
</div>
</content>
</entry>
<entry>
<title>Speed up JSON and reduce HTML formatter consumption (#1569)</title>
<updated>2020-10-26T20:33:05+00:00</updated>
<author>
<name>Kurt McKee</name>
<email>contactme@kurtmckee.org</email>
</author>
<published>2020-10-26T20:33:05+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=164dcb5a6b192ef6488f378b166d2fec8a708a0b'/>
<id>164dcb5a6b192ef6488f378b166d2fec8a708a0b</id>
<content type='text'>
* Update the JSON-LD keyword list to match JSON-LD 1.1

Changes in this patch:

* Update the JSON-LD URL to HTTPS
* Update the list of JSON-LD keywords
* Make the JSON-LD parser less dependent on the JSON lexer implementation
* Add unit tests for the JSON-LD lexer

* Add unit tests for the JSON parser

This includes:

* Testing valid literals
* Testing valid string escapes
* Testing that object keys are tokenized differently from string values

* Rewrite the JSON lexer

Related to #1425

Included in this change:

* The JSON parser is rewritten
* The JSON bare object parser no longer requires additional code
* `get_tokens_unprocessed()` returns as much as it can to reduce yields
  (for example, side-by-side punctuation is not returned separately)
* The unit tests were updated
* Add unit tests based on Hypothesis test results

* Reduce HTML formatter memory consumption by ~33% and speed it up

Related to #1425

Tested on a 118MB JSON file. Memory consumption tops out at ~3GB before
this patch and drops to only ~2GB with this patch. These were the command
lines used:

python -m pygments -l json -f html -o .\new-code-classes.html .\jc-output.txt
python -m pygments -l json -f html -O "noclasses" -o .\new-code-styles.html .\jc-output.txt

* Add an LRU cache to the HTML formatter's HTML-escaping and line-splitting

For a 118MB JSON input file, this reduces memory consumption by ~500MB
and reduces formatting time by ~15 seconds.

* JSON: Add a catastrophic backtracking test back to the test suite

* JSON: Update the comment that documents the internal queue

* JSON: Document in comments that ints/floats/constants are not validated</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
* Update the JSON-LD keyword list to match JSON-LD 1.1

Changes in this patch:

* Update the JSON-LD URL to HTTPS
* Update the list of JSON-LD keywords
* Make the JSON-LD parser less dependent on the JSON lexer implementation
* Add unit tests for the JSON-LD lexer

* Add unit tests for the JSON parser

This includes:

* Testing valid literals
* Testing valid string escapes
* Testing that object keys are tokenized differently from string values

* Rewrite the JSON lexer

Related to #1425

Included in this change:

* The JSON parser is rewritten
* The JSON bare object parser no longer requires additional code
* `get_tokens_unprocessed()` returns as much as it can to reduce yields
  (for example, side-by-side punctuation is not returned separately)
* The unit tests were updated
* Add unit tests based on Hypothesis test results

* Reduce HTML formatter memory consumption by ~33% and speed it up

Related to #1425

Tested on a 118MB JSON file. Memory consumption tops out at ~3GB before
this patch and drops to only ~2GB with this patch. These were the command
lines used:

python -m pygments -l json -f html -o .\new-code-classes.html .\jc-output.txt
python -m pygments -l json -f html -O "noclasses" -o .\new-code-styles.html .\jc-output.txt

* Add an LRU cache to the HTML formatter's HTML-escaping and line-splitting

For a 118MB JSON input file, this reduces memory consumption by ~500MB
and reduces formatting time by ~15 seconds.

* JSON: Add a catastrophic backtracking test back to the test suite

* JSON: Update the comment that documents the internal queue

* JSON: Document in comments that ints/floats/constants are not validated</pre>
</div>
</content>
</entry>
<entry>
<title>Speculative fix for #1579. (#1583)</title>
<updated>2020-10-24T09:46:11+00:00</updated>
<author>
<name>Matthäus G. Chajdas</name>
<email>Anteru@users.noreply.github.com</email>
</author>
<published>2020-10-24T09:46:11+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=20fb8fd85f37d79b37ac79f14774b9cc4ae77731'/>
<id>20fb8fd85f37d79b37ac79f14774b9cc4ae77731</id>
<content type='text'>
This removes the top/bottom padding changes, and only keeps left/right
padding, in the hope that this does not break all Sphinx themes.</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
This removes the top/bottom padding changes, and only keeps left/right
padding, in the hope that this does not break all Sphinx themes.</pre>
</div>
</content>
</entry>
<entry>
<title>Fix LatexEmbeddedLexer (#1517)</title>
<updated>2020-09-30T07:41:40+00:00</updated>
<author>
<name>Eric Wieser</name>
<email>wieser.eric@gmail.com</email>
</author>
<published>2020-09-30T07:41:40+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=a886f74acae50a3016dcb75ba92784e345fd8905'/>
<id>a886f74acae50a3016dcb75ba92784e345fd8905</id>
<content type='text'>
* Fix LatexEmbeddedLexer to not call the nested tokenizer piecewise

* Reuse the existing do_insertions function

* Add a test for the `LatexEmbeddedLexer`</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
* Fix LatexEmbeddedLexer to not call the nested tokenizer piecewise

* Reuse the existing do_insertions function

* Add a test for the `LatexEmbeddedLexer`</pre>
</div>
</content>
</entry>
<entry>
<title>image formatter: find ttc fonts on Mac</title>
<updated>2020-09-20T06:27:56+00:00</updated>
<author>
<name>Georg Brandl</name>
<email>georg@python.org</email>
</author>
<published>2020-09-20T06:27:56+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=45b3dc6891c6ece14e0ea5e017624fef36c6beea'/>
<id>45b3dc6891c6ece14e0ea5e017624fef36c6beea</id>
<content type='text'>
fixes #1223
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
fixes #1223
</pre>
</div>
</content>
</entry>
<entry>
<title>all: remove "u" string prefix (#1536)</title>
<updated>2020-09-08T18:20:19+00:00</updated>
<author>
<name>Georg Brandl</name>
<email>georg@python.org</email>
</author>
<published>2020-09-08T18:20:19+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=9f5672672bd61f7149d2a165b49f0617a1a9fe8e'/>
<id>9f5672672bd61f7149d2a165b49f0617a1a9fe8e</id>
<content type='text'>
* all: remove "u" string prefix

* util: remove unirange

Since Python 3.3, all builds are wide unicode compatible.

* unistring: remove support for narrow-unicode builds

which stopped being relevant with Python 3.3</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
* all: remove "u" string prefix

* util: remove unirange

Since Python 3.3, all builds are wide unicode compatible.

* unistring: remove support for narrow-unicode builds

which stopped being relevant with Python 3.3</pre>
</div>
</content>
</entry>
<entry>
<title>all: use yield from (#1537)</title>
<updated>2020-09-06T12:35:14+00:00</updated>
<author>
<name>Georg Brandl</name>
<email>georg@python.org</email>
</author>
<published>2020-09-06T12:35:14+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=40baa94a6bf0c62be8c8b03a942116869ce80128'/>
<id>40baa94a6bf0c62be8c8b03a942116869ce80128</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Update copyright year (fixes #1514.)</title>
<updated>2020-08-22T14:08:07+00:00</updated>
<author>
<name>Matthäus G. Chajdas</name>
<email>dev@anteru.net</email>
</author>
<published>2020-08-22T14:08:07+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=5bd2a84bc1db0120828606c900a14276414fecdc'/>
<id>5bd2a84bc1db0120828606c900a14276414fecdc</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Improve HTML formatter output.</title>
<updated>2020-07-31T10:20:04+00:00</updated>
<author>
<name>Matthäus G. Chajdas</name>
<email>dev@anteru.net</email>
</author>
<published>2020-07-31T10:16:36+00:00</published>
<link rel='alternate' type='text/html' href='http://91.123.203.49/cgit/delta/python-packages/pygments-git.git/commit/?id=b6fb70f88a4bf270a36515e958fdf124a70543ad'/>
<id>b6fb70f88a4bf270a36515e958fdf124a70543ad</id>
<content type='text'>
With the previous changes, we started to emit one &lt;pre&gt; per line for
line numbers. This breaks for instance the Sphinx-RTD-Theme, which
expects the line numbers to be formatted the same way as the normal
content. This commit makes the following changes:

* Emit a single &lt;pre&gt; inside the linenos div
* Wrap individual lines into &lt;span&gt; as needed
* Update all tests
* Don't yield empty &lt;span&gt; elements when no style is specified

This also makes the .html test files look correct when looked at with a
browser, as there is no extra whitespace in them which needs stripping.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
With the previous changes, we started to emit one &lt;pre&gt; per line for
line numbers. This breaks for instance the Sphinx-RTD-Theme, which
expects the line numbers to be formatted the same way as the normal
content. This commit makes the following changes:

* Emit a single &lt;pre&gt; inside the linenos div
* Wrap individual lines into &lt;span&gt; as needed
* Update all tests
* Don't yield empty &lt;span&gt; elements when no style is specified

This also makes the .html test files look correct when looked at with a
browser, as there is no extra whitespace in them which needs stripping.
</pre>
</div>
</content>
</entry>
</feed>
