summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Add private map of api key -> min/max versions to BrokerConnectionhandle_api_versionsDana Powers2017-08-052-11/+58
|
* Use for join-time-max and sync-time-max metrics Max() measure function (#1146)Alexey Pervushin2017-07-201-2/+2
|
* added gssapi support (Kerberos) for SASL (#1152)Harald2017-07-201-2/+75
|
* Add note, that `max_in_flight_requests_per_connection>1` may change order or ↵Taras Voinarovskyi2017-07-171-1/+4
| | | | messages (#1149)
* producer: fix produce timeout message (#1151)Mika Eloranta2017-07-171-1/+1
|
* Protocol updates for 0.11.0.0 (#1127)Dana Powers2017-07-097-41/+508
|
* Use logging's built-in string interpolationJeff Widman2017-07-072-6/+5
|
* change_subscription called only when necessary (#1132)Petr Šebek2017-07-071-2/+3
| | | | | | When we are using subscription by pattern change subscription is called every metadata update even when nothing changes. This PR ensures that change subscription is called only when set of topics changes.
* producer: Set exit timeout to 0 for atexit handler to match __del__ (#1126)Hannu Valtonen2017-06-191-1/+1
| | | | | | | | Hit a problem with pytest hitting the atexit handler and waiting for close() timeout forever at teardown. This commit makes atexit close() equivalent to __del__ behavior, namely using timeout of 0 for close() completion. If you need a longer timeout you should be setting it explicitly.
* KIP-144: Exponential backoff for broker reconnections (#1124)Dana Powers2017-06-194-22/+69
|
* Backoff on unavailable group coordinator retry (#1125)Dana Powers2017-06-191-0/+2
|
* Fixup for #1085 -- only check for changed metadata on disconnected nodesDana Powers2017-06-181-17/+23
|
* Deal with brokers that disappear, reappear with different IP address (#1085)Mike Fischer2017-06-181-1/+12
| | | | | | | | | | | | | | | | | | | | When KafkaClient connects to a broker in _maybe_connect, it inserts into self._conns a BrokerConnection configured with the current host/port for that node. The BrokerConnection remains there forever, though, so if the broker's IP or host ever changes, KafkaClient has no way to deal with this. The fix is to compare the latest metadata with the current node's connection, and if the host/IP has changed, decommission the old connection and allow a new one to be created. There's also a common race condition on broker startup where the initial metadata request sometimes returns an empty list of brokers, but subsequent requests behave normally. So, we must deal with broker being None here. This change is conservative in that it doesn't remove the connection from self._conns unless the new broker metadata contains an entry for that same node with a new IP/port.
* Describe consumer thread-safetyLinus Wallgren2017-06-161-0/+2
|
* Update exception docstringAndrew Kowalik2017-06-161-1/+1
|
* raise KafkaTimeoutException when flush times outAndrew Kowalik2017-06-162-2/+9
|
* Improve error message when expiring batches in KafkaProducer (#1077)Dana Powers2017-05-031-7/+11
|
* Warn dont raise on DNS lookup failures (#1091)Dana Powers2017-05-031-5/+7
|
* Follow-up to #1068: remove not-implemented commentsDana Powers2017-04-102-2/+2
|
* Timeout idle connections via connections_max_idle_ms (#1068)Dana Powers2017-04-103-4/+99
|
* Avoid multiple connection attempts when refreshing metadata (#1067)Dana Powers2017-04-051-44/+48
|
* Catch socket.errors when sending / recving bytes on wake socketpair (#1069)Dana Powers2017-04-051-2/+4
|
* Fix poll() hyperlink in KafkaClientJeff Widman2017-03-291-1/+1
| | | Previously Sphinx was auto-linking to `poll()` in `KafkaConsumer`, so made the link explicit.
* Fix typo (#1054)Jeff Widman2017-03-271-1/+1
|
* Bump version for developmentDana Powers2017-03-141-1/+1
|
* Release 1.3.31.3.3Dana Powers2017-03-141-1/+1
|
* Derive all api classes from Request / Response base classes (#1030)Dana Powers2017-03-1411-84/+140
|
* LZ4 support in kafka 0.8/0.9 does not accept a ContentSize headerDana Powers2017-03-141-6/+14
|
* Prefer python-lz4 over lz4f if availableDana Powers2017-03-141-7/+32
|
* Free lz4 decompression context to avoid leakDana Powers2017-03-141-0/+1
|
* Avoid re-encoding for message crc check (#1027)Dana Powers2017-03-131-6/+12
|
* Additional docstrings for autocommit close optionDana Powers2017-03-133-3/+17
|
* Optionally skip auto-commit during consumer.close (#1031)Dana Powers2017-03-132-4/+5
|
* Return copy of consumer subscription set (#1029)Dana Powers2017-03-131-1/+1
|
* Fix kwarg handing in kafka.protocol.struct.Struct (#1025)Dana Powers2017-03-091-1/+6
|
* Short-circuit group coordinator requests when NodeNotReady (#995)Dana Powers2017-03-091-0/+23
|
* Avoid unknown coordinator after client poll (#1023)Dana Powers2017-03-091-7/+6
|
* Add optional kwarg to ready and is_ready to disable metadata-priority logic ↵Dana Powers2017-03-081-7/+16
| | | | (#1017)
* A few Sphinx documentation updates (#1019)Jeff Widman2017-03-081-3/+3
|
* Fixed couple of "leaks" when gc is disabled (#979)Max Baryshnikov2017-03-074-16/+27
|
* Fixup :meth: sphinx documentation for use in KafkaConsumer.rst etcDana Powers2017-03-072-35/+49
|
* Add ClusterMetadata documentationDana Powers2017-03-072-0/+18
|
* For 0.8.2, only attempt connection to coordinator if least_loaded_node succeedsDana Powers2017-03-071-1/+2
|
* Fixup comment reference to _maybe_connectDana Powers2017-03-071-1/+1
|
* Disable default consumer group (#1016)Dana Powers2017-03-061-2/+2
|
* change default timeout of KafkaProducer.close() to threading.TIMEOUT_MAXgaosheng2017-03-061-2/+6
|
* Add client info logging re bootstrap; log connection attempts to balance ↵Dana Powers2017-03-062-1/+4
| | | | with close
* Small cleanup for #962Dana Powers2017-03-061-4/+9
|
* Added `max_bytes` option and FetchRequest_v3 usage. (#962)Taras Voinarovskyi2017-03-064-8/+71
| | | | * Added `max_bytes` option and FetchRequest_v3 usage. * Add checks for versions above 0.10 based on ApiVersionResponse
* Minor additional logging for consumer coordinatorDana Powers2017-03-061-0/+2
|