summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Allow disabling thread wakeup in send_request_to_node (#2335)HEADmasterAndrew Zhang2023-03-021-2/+3
|
* Fix producerconfigs documentation link (#2226)MandarJKulkarni2021-08-031-1/+1
|
* Fix typo: veriication -> verification (#2207)Dongwook Chan2021-02-211-1/+1
| | | Co-authored-by: will.k <will.k@kakaocorp.com>
* fix typo in documentation (#2178)Nikolay Vasiliev2021-02-201-2/+2
|
* Core Protocol: Add support for flexible versions (#2151)Tincu Gabriel2020-12-025-16/+294
| | | | | | | - Add support for new request and response headers, supporting flexible versions / tagged fields - Add List / Alter partition reassignments APIs - Add support for varints - Add support for compact collections (byte array, string, array)
* Support configuration of custom kafka client for Admin/Consumer/Producer (#2144)Tincu Gabriel2020-12-023-8/+17
|
* Hotfix: TypeError: object of type 'dict_itemiterator' has no len() (#2167)Krzysztof Grabowski2020-11-191-2/+3
| | | | | | | * Hotfix: TypeError: object of type 'dict_itemiterator' has no len() * Avoid looping over items 2x Co-authored-by: Grabowski <chris@crawlinski.com>
* Add Kafka 2.6.0 to tests and protocol compatibility matrix (#2162)Lourens Naudé2020-11-154-2/+57
| | | | * Co-authored-by: Andrew Brown <andrew.brown@shopify.com> * Co-authored-by: Aaron Brady <aaron.brady@shopify.com>
* KafkaConsumer: Exit poll if consumer is closed (#2152)Rauli Ikonen2020-11-151-2/+4
|
* Only try to update sensors fetch lag if the unpacked list contains elements ↵Keith So2020-11-051-2/+3
| | | | | (#2158) Previously, if the `unpacked` list was empty, the call to `unpacked[-1]` would throw an `IndexError: list index out of range`
* Cover sticky assignor's metadata method with tests (#2161)Valeria Chernenko2020-11-051-3/+7
|
* Use six.viewitems instead of six.iteritems to avoid encoding problems (#2154)Valeria Chernenko2020-10-301-1/+1
|
* Bump version for developmentDana Powers2020-09-301-1/+1
|
* Patch Release 2.0.22.0.2Dana Powers2020-09-291-1/+1
|
* KIP-54: Implement sticky partition assignment strategy (#2057)Valeria Chernenko2020-09-295-1/+897
|
* Fix crc32c deprecation warning (#2128)Jeff Widman2020-09-171-1/+1
| | | Fix a deprecation warning in the newest version.
* Merge _find_coordinator_id methods (#2127)Jeff Widman2020-09-171-42/+27
| | | | | | | | | | | | | | | | Previously there were two methods: * `_find_coordinator_id()` * `_find_many_coordinator_ids()` But they do basically the same thing internally. And we need the plural two places, but the singular only one place. So merge them, and change the function signature to take a list of `group_ids` and return a dict of `group_id: coordinator_id`s. As a result of this, the `describe_groups()` command should scale better because the `_find_coordinator_ids()` command issues all the requests async, instead of sequentially blocking as the `described_groups()` used to do.
* Lint cleanup (#2126)Jeff Widman2020-09-171-4/+3
| | | Small cleanup leftover from https://github.com/dpkp/kafka-python/pull/2035
* Feature: delete consumergroups (#2040)Swen Wenzel2020-09-173-4/+142
| | | | | * Add consumergroup related errors * Add DeleteGroups to protocol.admin * Implement delete_groups feature on KafkaAdminClient
* Fix initialization order in KafkaClient (#2119)Pedro Calleja2020-09-161-3/+6
| | | Fix initialization order in KafkaClient
* Allow configurable timeouts in admin client check versionHimanshu Mishra2020-09-161-2/+2
| | | Currently there's no way to pass timeout to check_version if called from admin.
* Enhancement for Kafka Admin Client's "Describe Consumer Group" (#2035)Apurva0072020-09-162-14/+46
| | | | | | Adding namedtuples for DescribeConsumerGroup response; Adding Serialization of MemberData and MemberAssignment for the response Co-authored-by: Apurva Telang <atelang@paypal.com> Co-authored-by: Jeff Widman <jeff@jeffwidman.com>
* producer/kafka: Disable logging during object destruction (#2043)Gioele2020-09-071-0/+8
|
* Add kafka.structs docstrings (#2080)Mostafa-Elmenbawy2020-09-071-3/+58
| | | Co-authored-by: MostafaElmenabawy <momenabawy@synapse-analytics.io>
* Add support for `zstd` compression (#2021)Tincu Gabriel2020-09-075-8/+48
|
* Fix typo (#2096)KimDongMin2020-09-071-1/+1
|
* Fix #1985: fix consumer deadlock when heartbeat thread request timeout (#2064)huangcuiyang2020-09-071-8/+12
|
* remove unused importsJames Lamb2020-07-103-3/+0
|
* Add logic for inferring newer broker versions (#2038)Tincu Gabriel2020-05-054-5/+298
| | | | | | | | | | | | | | * Add logic for inferring newer broker versions - New Fetch / ListOffsets request / response objects - Add new test cases to inferr code based on mentioned objects - Add unit test to check inferred version against whatever resides in KAFKA_VERSION - Add new kafka broker versions to integration list - Add more kafka broker versions to travis task list - Add support for broker version 2.5 id * Implement PR change requests: fewer versions for travis testing, remove unused older versions for inference code, remove one minor version from known server list Do not use newly created ACL request / responses in allowed version lists, due to flexible versions enabling in kafka actually requiring a serialization protocol header update Revert admin client file change
* Add `log_start_offset` to message protocol parsing (#2020)Tincu Gabriel2020-03-254-15/+107
| | | This is in preparation for adding `zstd` support.
* Fix docs by adding SASL mentionJeff Widman2020-03-021-1/+2
| | | | | This was previously supported but wasn't documented. Fix #1990.
* Set length of header value to 0 if Nonekvfi2020-03-021-1/+3
|
* Bump version for developmentDana Powers2020-02-191-1/+1
|
* Patch Release 2.0.12.0.1Dana Powers2020-02-191-1/+1
|
* KAFKA-8962: Use least_loaded_node() for describe_topics()Jeff Widman2020-02-161-15/+7
| | | | | | | | | | | | | | | | | | | | | | | In KAFKA-8962 the `AdminClient.describe_topics()` call was changed from using the controller to using the `least_loaded_node()`: https://github.com/apache/kafka/commit/317089663cc7ff4fdfcba6ee434f455e8ae13acd#diff-6869b8fccf6b098cbcb0676e8ceb26a7R1540 As a result, no metadata request/response processing needs to happen through the controller, so it's safe to remove the custom error-checking. Besides, I don't think this error-checking even added any value because AFAIK no metadata response would return a `NotControllerError` because the recipient broker wouldn't realize the metadata request was intended for only the controller. Originally our admin client was implemented using the least-loaded-node, then later updated to the controller. So updating it back to least-loaded node is a simple case of reverting the associated commits. This reverts commit 7195f0369c7dbe25aea2c3fed78d2b4f772d775b. This reverts commit 6e2978edee9a06e9dbe60afcac226b27b83cbc74. This reverts commit f92889af79db08ef26d89cb18bd48c7dd5080010.
* Fix topic error parsing in MetadataResponseJeff Tribble2020-02-151-6/+11
|
* Bump version for development of next releaseDana Powers2020-02-101-1/+1
|
* Release 2.0.02.0.0Dana Powers2020-02-101-1/+1
|
* _send_request_to_controller returns a raw result, not a futureTyler Lubeck2020-02-061-6/+6
|
* Use the controller for topic metadata requestsTyler Lubeck2020-02-061-6/+9
| | | | Closes #1994
* Implement list_topics, describe_topics, and describe_clusterTyler Lubeck2020-02-061-6/+40
|
* Implement methods to convert a Struct object to a pythonic object (#1951)Tyler Lubeck2020-02-062-1/+37
| | | Implement methods to convert a Struct object to a pythonic object
* Remove unused importJeff Widman2020-02-051-1/+0
| | | | | Forgot to remove this in https://github.com/dpkp/kafka-python/pull/1925 / ca2d76304bfe3900f995e6f0e4377b2ef654997e
* Remove some dead codeJeff Widman2020-02-053-196/+0
|
* Fix slots usage and use more slotsCarson Ip2020-02-054-0/+26
| | | | | Use empty slots for ABC classes, otherwise classes which inherit from them will still have __dict__. Also use __slots__ for more classes.
* Do not log topic-specific errors in full metadata fetch (#1980)Dana Powers2019-12-291-0/+4
|
* Optionally return OffsetAndMetadata from consumer.committed(tp) (#1979)Dana Powers2019-12-294-9/+16
|
* Do not block on sender thread join after timeout in producer.close() (#1974)Dana Powers2019-12-291-5/+1
|
* Raise AssertionError if consumer closed in poll() (#1978)Dana Powers2019-12-291-0/+3
|
* Reset conn configs on exception in conn.check_version() (#1977)Dana Powers2019-12-291-2/+7
|
View Lorry Controller Status