summaryrefslogtreecommitdiff
path: root/kafka/cluster.py
Commit message (Collapse)AuthorAgeFilesLines
* Do not log topic-specific errors in full metadata fetch (#1980)Dana Powers2019-12-291-0/+4
|
* Use dedicated connection for group coordinator (#1822)Dana Powers2019-06-191-22/+14
| | | This changes the coordinator_id to be a unique string, e.g., `coordinator-1`, so that it will get a dedicated connection. This won't eliminate lock contention because the client lock applies to all connections, but it should improve in-flight-request contention.
* Remove unused imports (#1808)Jeff Widman2019-05-221-2/+2
|
* Maintain shadow cluster metadata for bootstrapping (#1753)Dana Powers2019-03-211-10/+11
|
* Retry bootstrapping after backoff when necessary (#1736)Dana Powers2019-03-141-1/+23
| | | | | | | The current client attempts to bootstrap once during initialization, but if it fails there is no second attempt and the client will be inoperable. This can happen, for example, if an entire cluster is down at the time a long-running client starts execution. This commit attempts to fix this by removing the synchronous bootstrapping from `KafkaClient` init, and instead merges bootstrap metadata with the cluster metadata. The Java client uses a similar approach. This allows us to continue falling back to bootstrap data when necessary throughout the life of a long-running consumer or producer. Fix #1670
* Ignore MetadataResponses with empty broker list (#1506)Dana Powers2018-05-261-1/+2
|
* Document methods that return NoneJeff Widman2018-05-231-0/+3
| | | | | If a valid broker in the cluster has no partitions, it will return None rather than an empty set. Similarly updated a few other methods.
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-061-3/+3
|
* KAFKA-3949: Avoid race condition when subscription changes during rebalance ↵Dana Powers2018-02-021-0/+7
| | | | (#1364)
* Add ClusterMetadata documentationDana Powers2017-03-071-0/+14
|
* Drop old brokers when rebuilding broker metadata (#1005)Dana Powers2017-03-031-3/+6
|
* Metadata with_partitions() (#787)Dana Powers2016-08-011-1/+20
| | | | add method ClusterMetadata.with_partitions also fixup ClusterMetadata __str__
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Use MetadataRequest v1 for 0.10+ api_versionmetadata_v1Dana Powers2016-07-161-6/+37
|
* Add rack to BrokerMetadata - it is always None when using MetadataRequest v0Dana Powers2016-07-161-8/+11
|
* Avoid busy poll during metadata refresh failure with retry_backoff_ms (#733)Dana Powers2016-06-201-0/+4
|
* Remove unused importskafka-3318Dana Powers2016-04-051-1/+0
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-2/+2
|
* Improve kafka.cluster docstringsDana Powers2016-02-161-7/+65
|
* Add lock to synchronize metadata updates and future handlingDana Powers2016-02-151-18/+34
|
* warn (not error) on LeaderNotAvailable - this is usually not cause for concernDana Powers2016-02-151-2/+2
|
* Update ClusterMetadata commentsDana Powers2016-02-151-7/+7
|
* Track set of unauthorized_topics in ClusterMetadataDana Powers2016-02-151-0/+3
|
* Remove unused cluster._version private attributeDana Powers2016-02-151-4/+1
|
* Keep full PartitionMetadata from MetadataResponsesDana Powers2016-02-151-6/+10
|
* Implement KafkaConsumer.topics()Dana Powers2016-02-011-2/+4
| | | | | - add ClusterMetadata.need_all_topic_metadata attribute - client requests metadata for all topics if attribute True
* Add available_partitions_for_topic() and partitions_for_broker()Dana Powers2016-01-231-2/+23
|
* Improve cluster.ttl() readabilityDana Powers2016-01-101-3/+7
|
* Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-291-8/+12
|
* Add ClusterMetadata.add_group_coordinator()Dana Powers2015-12-281-0/+39
|
* Rename Cluster -> ClusterMetadata; align with upstream Metadata classDana Powers2015-12-281-66/+121
|
* Switch BrokerConnection to (mostly) non-blocking IO.Dana Powers2015-12-171-1/+1
| | | | | | - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion
* few small cleanupsZack Dever2015-12-041-1/+1
|
* Add simple Cluster class to manage broker metadataDana Powers2015-12-041-0/+91