summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
...
* Log retriable coordinator NodeNotReady, TooManyInFlightRequests as debug not ↵Dana Powers2019-12-291-2/+5
| | | | error (#1975)
* Implement __eq__ and __hash__ for ACL objects (#1955)Tyler Lubeck2019-12-291-1/+33
|
* Fixes KafkaAdminClient returning `IncompatibleBrokerVersion` when passing an ↵Ian Bucad2019-12-291-0/+1
| | | | `api_version` (#1953)
* Fix typoDana Powers2019-12-291-1/+1
|
* Admin protocol updates (#1948)Tyler Lubeck2019-12-292-30/+266
|
* Style updates to scram sasl supportDana Powers2019-12-292-78/+87
|
* Enable SCRAM-SHA-256 and SCRAM-SHA-512 for sasl (#1918)Swen Wenzel2019-12-295-35/+157
|
* Improve docs for reconnect_backoff_max_ms (#1976)Dana Powers2019-12-285-25/+30
|
* Fix simple typo: managementment -> managementTim Gates2019-12-081-1/+1
| | | | Closes #1965
* Fix typosCarson Ip2019-11-087-9/+9
|
* Remove deprecated `ConnectionError` (#1816)Jeff Widman2019-10-111-4/+0
| | | | | | This has been deprecated for a bit in favor of `KafkaConnectionError` because it conflicts with Python's built-in `ConnectionError`. Time to remove it as part of cleaning up our old deprecated code.
* Remove SimpleClient, Producer, Consumer, Unittest (#1196)Jeff Widman2019-10-1123-3408/+79
| | | | | | | | | | | | | | | | | | In the 2.0 release, we're removing: * `SimpleClient` * `SimpleConsumer` * `SimpleProducer` * Old partitioners used by `SimpleProducer`; these are superceded by the `DefaultPartitioner` These have been deprecated for several years in favor of `KafkaClient` / `KafkaConsumer` / `KafkaProducer`. Since 2.0 allows breaking changes, we are removing the deprecated classes. Additionally, since the only usage of `unittest` was in tests for these old Simple* clients, this also drops `unittest` from the library. All tests now run under `pytest`.
* Fix describe config for multi-broker clusters (#1869)Jeppe Andersen2019-10-111-14/+56
| | | | | | | * Fix describe config for multi-broker clusters Currently all describe config requests are sent to "least loaded node". Requests for broker configs must, however, be sent to the specific broker, otherwise an error is returned. Only topic requests can be handled by any node. This changes the logic to send all describe config requests to the specific broker.
* Update docstring to match conn.py's (#1921)David Bouchare2019-10-031-1/+2
|
* Release 1.4.7 (#1916)1.4.7Dana Powers2019-09-301-1/+1
|
* Follow up to PR 1782 -- fix tests (#1914)Dana Powers2019-09-301-1/+2
|
* Improve/refactor bootstrap_connectedDana Powers2019-09-304-14/+22
|
* Added a function to determine if bootstrap is successfully connected (#1876)PandllCom2019-09-302-7/+20
|
* Issue #1780 - Consumer hang indefinitely in fetcher._retrieve_offsets() due ↵Commander Dishwasher2019-09-302-8/+26
| | | | to topic deletion while rebalancing (#1782)
* Change coordinator lock acquisition order (#1821)Dana Powers2019-09-292-43/+39
|
* Send socket data via non-blocking IO with send buffer (#1912)Dana Powers2019-09-293-12/+105
|
* Do not use wakeup when sending fetch requests from consumer (#1911)Dana Powers2019-09-291-1/+1
|
* Rely on socket selector to detect completed connection attempts (#1909)Dana Powers2019-09-283-9/+13
|
* Wrap consumer.poll() for KafkaConsumer iteration (#1902)Dana Powers2019-09-283-11/+74
|
* Fix Admin Client api version checking; only test ACL integration on 0.11+Dana Powers2019-09-281-4/+10
|
* Add ACL api to KafkaAdminClient (#1833)Ulrik Johansson2019-09-284-9/+488
|
* Improve connection lock handling; always use context manager (#1895)Dana Powers2019-09-031-126/+151
|
* Reduce internal client poll timeout for consumer iterator interface (#1824)Dana Powers2019-08-161-3/+1
| | | More attempts to address heartbeat timing issues in consumers, especially with the iterator interface. Here we can reduce the `client.poll` timeout to at most the retry backoff (typically 100ms) so that the consumer iterator interface doesn't block for longer than the heartbeat timeout.
* Update conn.pyCameron Boulton2019-08-161-0/+3
|
* Break FindCoordinator into request/response methodsJeff Widman2019-07-311-32/+48
| | | | | | | | | | | | | | | | | | This splits the `_find_coordinator_id()` method (which is blocking) into request generation / response parsing methods. The public API does not change. However, this allows power users who are willing to deal with risk of private methods changing under their feet to decouple generating the message futures from processing their responses. In other words, you can use these to fire a bunch of requests at once and delay processing the responses until all requests are fired. This is modeled on the work done in #1845. Additionally, I removed the code that tried to leverage the error checking from `cluster.add_group_coordinator()`. That code had changed in #1822, removing most of the error checking... so it no longer adds any value, but instead merely increases complexity and coupling.
* Fix minor typo (#1865)Carson Ip2019-07-142-2/+2
|
* Update link to upstream Kafka docsJeff Widman2019-07-111-1/+1
| | | the new consumer is now the standard consumer, so they dropped the `new_` from the anchor
* Add the `sasl_kerberos_domain_name` arg to `KafkaAdminClient`Jeff Widman2019-06-281-0/+3
| | | | | | Previously the `sasl_kerberos_domain_name` was missing from the Admin client. It is already present in the Consumer/Producer, and in all three cases gets transparently passed down to the client.
* Update KafkaAdminClient DocsRob Cardy2019-06-211-1/+2
| | | Updated to include SASL_PLAINTEXT and SASL_SSL as options for security_protocol.
* Allow the coordinator to auto-commit for all api_version.Jay Chan2019-06-201-1/+1
|
* Break consumer operations into request / response methods (#1845)Jeff Widman2019-06-191-94/+155
| | | | | | | | | | This breaks some of the consumer operations into request generation / response parsing methods. The public API does not change. However, this allows power users who are willing to deal with risk of private methods changing under their feet to decouple generating the message futures from processing their responses. In other words, you can use these to fire a bunch of request at once and delay processing the responses until all requests are fired.
* Use dedicated connection for group coordinator (#1822)Dana Powers2019-06-192-25/+17
| | | This changes the coordinator_id to be a unique string, e.g., `coordinator-1`, so that it will get a dedicated connection. This won't eliminate lock contention because the client lock applies to all connections, but it should improve in-flight-request contention.
* Delay converting to secondsJeff Widman2019-05-301-2/+2
| | | | Delaying the conversion to seconds makes the code intent more clear.
* Reduce client poll timeout when no ifrsDana Powers2019-05-291-0/+3
|
* Catch TimeoutError in BrokerConnection send/recv (#1820)Dana Powers2019-05-291-6/+7
|
* Remove unused/weird comment line (#1813)Jeff Widman2019-05-281-1/+0
|
* Update docs for api_version_auto_timeout_ms (#1812)Jeff Widman2019-05-242-2/+2
| | | | | | | | | The docs for `api_version_auto_timeout_ms` mention setting `api_version='auto'` but that value has been deprecated for years in favor of `api_version=None`. Updating the docs for now, and will remove support for `'auto'` in next major version bump.
* Fix typo in _fetch_all_topic_metadata function (#1809)Brian Sang2019-05-231-1/+1
|
* Make partitions_for_topic a read-through cache (#1781)Brian Sang2019-05-221-8/+25
| | | If the cluster metadata object has no info about the topic, then issue a blocking metadata call to fetch it.
* Remove unused imports (#1808)Jeff Widman2019-05-221-2/+2
|
* Use futures to parallelize calls to _send_request_to_node() (#1807)Lou-Cipher2019-05-211-34/+75
| | | | | Use `futures` to parallelize calls to `_send_request_to_node()` This allows queries that need to go to multiple brokers to be run in parallel.
* Update link to kafka docsJeff Widman2019-05-171-1/+1
| | | Now that the old zookeeper consumer has been completely deprecated/removed, these are no longer the "new consumer configs" but rather simply the "consumer configs"
* A little python cleanup (#1805)Jeff Widman2019-05-171-4/+2
| | | | | | 1. Remove unused variable: `partitions_for_topic` 2. No need to cast to list as `sorted()` already returns a list 3. Using `enumerate()` is cleaner than `range(len())` and handles assigning `member`
* Bump version for development of next releaseDana Powers2019-04-031-1/+1
|
* Release 1.4.61.4.6Dana Powers2019-04-021-1/+1
|
View Lorry Controller Status