| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
| |
Fix #1633
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
I noticed that pack/unpack functions from
https://github.com/dpkp/kafka-python/blob/master/kafka/protocol/types.py
might be slightly improved. I made pre-compilation for them. It gives
about 10% better performance compared to the current implementation.
Consumption of 100msg:
```
239884 0.187 0.000 0.287 0.000 types.py:18(_unpack) # new version
239884 0.192 0.000 0.323 0.000 types.py:17(_unpack)
```
I also made some profiling for producers/consumers. It gives about
1-1.5% time savings.
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
`random_string` now comes from `test.fixtures` and was being
transparently imported via `test.testutil` so this bypasses the
pointless indirect import.
Similarly, `kafka_version` was transparently imported by `test.testutil`
from `test.fixtures`.
Also removed `random_port()` in `test.testutil` because its unused as its been replaced
by the one in `test.fixtures`.
This is part of the pytest migration that was started back in
a1869c4be5f47b4f6433610249aaf29af4ec95e5.
|
| | |
|
| |
|
|
| |
This is no longer used anywhere in the codebase
|
| |
|
|
|
|
|
| |
Removed some of the hardcoded values as they are now outdated, and just
pointed to where to find the current value in the code.
Also some minor wordsmithing.
|
| |
|
|
| |
I missed this in my previous cleanup back in 9221fcf83528b5c3657e43636cb84c1d18025acd.
|
| |
|
|
|
|
|
|
|
| |
We have many deprecation warnings in the travis logs for things that are
fixed in newer versions of `pylint` or `pylint`'s dependencies.
Note that `pylint` >= 2.0 does not support python 2, so this will result
in different versions of pylint running for python 2 vs python 3.
Personally, I am just fine with this.
|
| |
|
|
| |
Temporarily workaround https://github.com/PyCQA/pylint/issues/2571 so that we can stop pinning `pylint`.
|
| |
|
|
|
|
| |
Requires cluster version > 0.10.0.0, and uses new wire protocol
classes to do many things via broker connection that previously
needed to be done directly in zookeeper.
|
| |
|
|
|
|
|
| |
When I was fixing urls the other day, I noticed that sphinx hadn't added
https but there was an open ticket: https://github.com/sphinx-doc/sphinx/issues/5522
Now that that is resolved, I'm updating it here.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
`six.moves` is a dynamically-created namespace that doesn't actually
exist and therefore `pylint` can't statically analyze it.
By default, `pylint` is smart enough to realize that and ignore the
import errors.
However, because we vendor it, the location changes to
`kafka.vendor.six.moves` so `pylint` doesn't realize it should be
ignored.
So this explicitly ignores it.
`pylint` documentation of this feature:
http://pylint.pycqa.org/en/1.9/technical_reference/features.html?highlight=ignored-modules#id34
More background:
* https://github.com/PyCQA/pylint/issues/1640
* https://github.com/PyCQA/pylint/issues/223
|
| |
|
|
|
|
|
|
|
| |
This is needed for https://github.com/dpkp/kafka-python/pull/1540
While the usage there is trivial and could probably be worked around, I'd
rather vendor it so that future code can use enums... since `enum` is
already available in the python 3 stdlib, this will be easy enough to
eventually stop vendoring whenever we finally drop python 2 support.
|
| |
|
|
| |
Use vendored `six`, and also `six.moves.range` rather than `xrange`
|
| |
|
|
|
| |
Snappy URL was outdated. Similarly, many of these sites now support
https.
|
| |
|
|
|
|
|
|
|
| |
Bump `six` to `1.11.0`. Most changes do not affect us, but it's good to
stay up to date. Also, we will likely start vendoring `enum34` in which
case https://github.com/benjaminp/six/pull/178 is needed.
Note that this preserves the `kafka-python` customization from https://github.com/dpkp/kafka-python/pull/979
which has been submitted upstream as https://github.com/benjaminp/six/pull/176 but not yet merged.
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
| |
This solves a warning in linters like PyCharm, which warns that a line like:
from kafka import ConsumerRebalanceListener
is actually accessing a protected member of a class or module. Adding it to __all__ should solve this.
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
| |
This was added in #1068 but never documented.
Fix #1497
|
| |
|
|
| |
This finishes the split from `kafka.common` to `kafka.errors`/`kafka.structs`.
|
| | |
|
| | |
|
| | |
|
| |
|
|
| |
* only perform single dns lookup for connect_blocking()
* fix blocking timeout in check_version()
|
| | |
|
| |
|
|
|
| |
If a valid broker in the cluster has no partitions, it will return None rather than an empty set.
Similarly updated a few other methods.
|
| |
|
|
|
|
|
|
|
|
| |
In Python3, `ConnectionError` is a native exception. So rename our
custom one to `KafkaConnectionError` to prevent accidentally
shadowing the native one.
Note that there are still valid uses of `ConnectionError` in this code.
They already expect a native Python3 `ConnectionError`, and also already
handle the Python2 compatibility issues.
|
| | |
|
| | |
|
| | |
|
| | |
|
| | |
|
