summaryrefslogtreecommitdiff
path: root/kafka/client_async.py
Commit message (Collapse)AuthorAgeFilesLines
* Add KafkaAdmin classRichard Lee2018-10-241-0/+16
| | | | | | Requires cluster version > 0.10.0.0, and uses new wire protocol classes to do many things via broker connection that previously needed to be done directly in zookeeper.
* add kerberos domain name config for gssapi sasl mechanism handshake (#1542)the-sea2018-08-311-0/+3
|
* add support for smaller topic metadata fetch during bootstrap (#1541)Ning Xie2018-08-311-3/+10
|
* Document connections_max_idle_msJeff Widman2018-06-261-0/+5
| | | | | This was added in #1068 but never documented. Fix #1497
* Stop shadowing `ConnectionError`Jeff Widman2018-05-231-1/+1
| | | | | | | | | | In Python3, `ConnectionError` is a native exception. So rename our custom one to `KafkaConnectionError` to prevent accidentally shadowing the native one. Note that there are still valid uses of `ConnectionError` in this code. They already expect a native Python3 `ConnectionError`, and also already handle the Python2 compatibility issues.
* Minor doc capitalization cleanupJeff Widman2018-04-241-15/+15
|
* Fix KafkaConsumer docstring for request_timeout_ms default (#1459)Dana Powers2018-03-231-2/+2
|
* Do not validate api_version against known versions (#1434)Dana Powers2018-03-101-16/+1
|
* Add BrokerConnection.connect_blocking() (#1411)Dana Powers2018-03-091-5/+1
|
* Check timeout type in KafkaClient constructorAndre Araujo2018-02-211-0/+2
| | | | | | | | | | If a future was passed as the only positional parameter it would be assigned to the "timeout_ms" parameter erroneously. This mistake would not raise any exception but would lead to odd behaviour later, what could make it extremely difficult to troubleshoot. Adding a type check ensures that an exception is raise earlier to notify the user about the problem.
* Fix pending completion IndexError bug caused by multiple threads (#1372)Dana Powers2018-02-081-2/+8
|
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-061-12/+12
|
* Remove assertion with side effect (#1348)Buğra Gedik2018-01-231-2/+2
|
* Read all available socket bytes (#1332)Dana Powers2018-01-101-0/+2
| | | | * Recv all available network bytes before parsing * Add experimental support for configuring socket chunking parameters
* Improve KafkaConsumer cleanup (#1339)Dana Powers2018-01-101-8/+17
|
* KAFKA-3888 Use background thread to process consumer heartbeats (#1266)Dana Powers2017-12-211-283/+182
|
* use python standard max value (#1303)lukeWx2017-12-071-1/+1
|
* Fixup for PR 1264 -- required to propagate configuration to BrokerConnectionDana Powers2017-10-211-0/+3
|
* Merge pull request #1258 from dpkp/pending_completionsTaras Voinarovskyi2017-10-211-7/+25
|\ | | | | Move callback processing from BrokerConnection to KafkaClient
| * Move callback processing from BrokerConnection to KafkaClientpending_completionsDana Powers2017-10-151-7/+25
| |
* | Explicitly check for None rather than falseyJeff Widman2017-10-191-3/+3
|/ | | | Be pedantic about checking for identity rather than equality to avoid issues like #1237 / 411bc08f214b7afc36f11bde2047096c06467088
* Remove a few unused imports (#1188)James Lamb2017-08-291-1/+2
| | | | | * Removed a few unused imports * Added note on socketpair monkey-path
* BrokerConnection receive bytes pipe (#1032)Dana Powers2017-08-151-13/+3
|
* Drop unused sleep kwarg to poll (#1177)Dana Powers2017-08-151-9/+3
|
* Select on sockets to avoid busy polling during bootstrap (#1175)Dana Powers2017-08-131-0/+2
|
* KIP-144: Exponential backoff for broker reconnections (#1124)Dana Powers2017-06-191-19/+14
|
* Fixup for #1085 -- only check for changed metadata on disconnected nodesDana Powers2017-06-181-17/+23
|
* Deal with brokers that disappear, reappear with different IP address (#1085)Mike Fischer2017-06-181-1/+12
| | | | | | | | | | | | | | | | | | | | When KafkaClient connects to a broker in _maybe_connect, it inserts into self._conns a BrokerConnection configured with the current host/port for that node. The BrokerConnection remains there forever, though, so if the broker's IP or host ever changes, KafkaClient has no way to deal with this. The fix is to compare the latest metadata with the current node's connection, and if the host/IP has changed, decommission the old connection and allow a new one to be created. There's also a common race condition on broker startup where the initial metadata request sometimes returns an empty list of brokers, but subsequent requests behave normally. So, we must deal with broker being None here. This change is conservative in that it doesn't remove the connection from self._conns unless the new broker metadata contains an entry for that same node with a new IP/port.
* Timeout idle connections via connections_max_idle_ms (#1068)Dana Powers2017-04-101-1/+94
|
* Avoid multiple connection attempts when refreshing metadata (#1067)Dana Powers2017-04-051-44/+48
|
* Catch socket.errors when sending / recving bytes on wake socketpair (#1069)Dana Powers2017-04-051-2/+4
|
* Fix poll() hyperlink in KafkaClientJeff Widman2017-03-291-1/+1
| | | Previously Sphinx was auto-linking to `poll()` in `KafkaConsumer`, so made the link explicit.
* Fix typo (#1054)Jeff Widman2017-03-271-1/+1
|
* Derive all api classes from Request / Response base classes (#1030)Dana Powers2017-03-141-6/+1
|
* Add optional kwarg to ready and is_ready to disable metadata-priority logic ↵Dana Powers2017-03-081-7/+16
| | | | (#1017)
* Add ClusterMetadata documentationDana Powers2017-03-071-0/+4
|
* Fixup comment reference to _maybe_connectDana Powers2017-03-071-1/+1
|
* Add client info logging re bootstrap; log connection attempts to balance ↵Dana Powers2017-03-061-0/+3
| | | | with close
* Added `max_bytes` option and FetchRequest_v3 usage. (#962)Taras Voinarovskyi2017-03-061-0/+2
| | | | * Added `max_bytes` option and FetchRequest_v3 usage. * Add checks for versions above 0.10 based on ApiVersionResponse
* Fix BrokerConnection api_version docs default (#909)Jeff Widman2017-02-281-4/+4
|
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-11/+11
|
* Move docstring so it shows up in Sphinx/RTD (#952)Jeff Widman2017-01-211-83/+83
|
* Use connection state functions where possibleDana Powers2017-01-191-3/+3
|
* Pass error to BrokerConnection.close()Dana Powers2017-01-191-1/+1
|
* Fix possible request draining in ensure_active_group (#896)Dana Powers2016-12-021-9/+10
|
* DOC: Fix typo 'Defualt' -> 'Default'. (#895)Rolando (Max) Espinoza2016-11-301-1/+1
|
* setting proper topic value in case if it's empty (#867)Alexander Sibiryakov2016-11-181-11/+4
|
* Always check for request timeouts (#887)Dana Powers2016-11-181-0/+8
| | | | * Check for requests that timeout without causing a socket read/write event
* Fix typosJeff Widman2016-11-141-2/+2
|
* Added ssl_password config option to KafkaProducer class, identical to… (#830)kierkegaard132016-09-151-0/+2
| | | | | | | | * Added ssl_password config option to KafkaProducer class, identical to option in KafkaConsumer class * removed non-ascii characters * changed - to : in comments