summaryrefslogtreecommitdiff
path: root/kafka/consumer/group.py
Commit message (Collapse)AuthorAgeFilesLines
* Add CRL support to SSL support (#683)Vincent Bernat2016-05-191-0/+6
| | | | A user can provide a CRL whose peer certificate will be checked against. This only works with Python 3.4+ and Python 2.7.9+.
* Add protocol support for ApiVersionRequest; identify 0.10 brokers in ↵check_version_0_10Dana Powers2016-05-021-1/+1
| | | | check_version
* instrument metrics for fetch requestsZack Dever2016-04-131-2/+2
|
* Beginnings of metrics instrumentation in kafka consumer.Zack Dever2016-04-131-6/+23
| | | | | | This adds the parent metrics instance to kafka consumer, which will eventually be used to instrument everything under consumer. To start I ported the java consumer coordinator metrics.
* Add SSL configuration kwargs to KafkaClient, KafkaConsumer, KafkaProducerDana Powers2016-04-091-0/+21
|
* Default sleep=True in client.pollDana Powers2016-04-081-1/+1
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-1/+1
|
* Merge pull request #602 from zackdever/KAFKA-2698Dana Powers2016-03-171-0/+8
|\ | | | | KAFKA-2698: add paused API
| * KAFKA-2698: add paused APIZack Dever2016-03-161-0/+8
| |
* | Add default_offset_commit_callback to KafkaConsumer DEFAULT_CONFIGSDana Powers2016-03-171-0/+1
|/
* KafkaConsumer.poll should sleep to prevent tight-loopsconsumer_poll_sleepDana Powers2016-03-141-1/+1
|
* Raise TypeError in KafkaConsumer when partition is not a TopicPartitiontopic_partition_type_errorDana Powers2016-03-141-0/+17
|
* Consumer should timeout internal iterator if heartbeat ttl is expiredconsumer_heartbeat_fixesDana Powers2016-03-121-3/+15
|
* factor group checking logic to KafkaConsumer._use_consumer_group()Dana Powers2016-03-121-24/+37
|
* Bug fix: KafkaConsumer.position()Stefán Þorvarðarson2016-03-091-1/+1
| | | | | Method KafkaConsumer.position() was not refreshing position correctly when calling self._update_fetch_positions().
* Merge pull request #557 from dpkp/socket_buffer_size_optionalDana Powers2016-02-181-4/+6
|\ | | | | Dont override system rcvbuf or sndbuf unless user configures explicitly
| * Dont override system rcvbuf or sndbuf unless user configures explicitlysocket_buffer_size_optionalDana Powers2016-02-171-4/+6
| |
* | Add RangePartitionAssignor (and use as default); add assignor testsrange_assignorDana Powers2016-02-161-2/+4
|/
* KAFKA-3044: Re-word consumer.poll behaviourDana Powers2016-02-151-3/+4
|
* Issue 545: Convert deserializer StopIteration errors to raw ExceptionsDana Powers2016-02-151-1/+1
|
* Fix Typos (Issue 536)Dana Powers2016-02-151-1/+1
|
* KAFKA-3191: Improve offset committing docstringsDana Powers2016-02-021-2/+6
|
* a few extra AssertionError messages in KafkaConsumerDana Powers2016-02-021-2/+2
|
* KAFKA-3170: default consumer config for fetch_min_bytes should be 1Dana Powers2016-02-021-2/+2
|
* Add more assertions in KafkaConsumer (primarily to seek* methods)Dana Powers2016-02-011-3/+28
|
* Be sure to get all metadata when subscribing to a regex pattern.Dana Powers2016-02-011-12/+19
|
* Implement KafkaConsumer.topics()Dana Powers2016-02-011-7/+14
| | | | | - add ClusterMetadata.need_all_topic_metadata attribute - client requests metadata for all topics if attribute True
* Add KafkaConsumer.highwater(partition) to get highwater offsets from ↵Dana Powers2016-01-311-0/+22
| | | | FetchResponses
* Fix internal timeout / sleep handling in consumer iteratoriterator_timeoutDana Powers2016-01-291-15/+16
|
* Disable offset commits and auto-partition-assignment when group_id is NoneDana Powers2016-01-241-20/+28
|
* Sleep in KafkaConsumer iterator if no partition assignment; dont block in ↵iterator_fetchesDana Powers2016-01-121-4/+25
| | | | poll if no in-flight fetches
* Move consumer_timeout handling to private methodDana Powers2016-01-121-5/+7
|
* Reorganize init_fetches calls during iterationDana Powers2016-01-101-2/+3
| | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests.
* Fetcher logging should be debug or trace (left higher during testing)Dana Powers2016-01-101-0/+1
|
* Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleepDana Powers2016-01-101-1/+4
| | | | iterating fetcher
* Fix sec / millisec unit bug in KafkaConsumer._poll_once()Dana Powers2016-01-101-1/+1
|
* Fix delayed_task timeout commit 45d26b6Dana Powers2016-01-101-1/+1
|
* Improve KafkaConsumer iterator loop timeoutstask_poll_timeoutDana Powers2016-01-101-8/+8
| | | | | | - Consider all delayed tasks, not just heartbeat - Include metadata update timeout - Fix second / millisecond bug calling client.poll()
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-101-2/+2
| | | | out of sync
* Docstring updatesDana Powers2016-01-071-129/+127
|
* Add deprecated methods to KafkaConsumer w/ notes on alternativesDana Powers2016-01-031-0/+31
|
* Disable pylint error on __iter__ (next is provided via six.Iterator)Dana Powers2016-01-031-1/+1
|
* Keep support for old largest/smallest auto_offset_reset optionsDana Powers2016-01-031-0/+7
|
* Return empty dict from KafkaConsumer.poll if no recordsDana Powers2016-01-031-1/+1
|
* Support consumer_timeout_ms in new KafkaConsumerDana Powers2016-01-031-2/+17
|
* Add api_version config to KafkaConsumer; disable features inline by versionDana Powers2016-01-031-11/+36
|
* Raise exception in KafkaConsumer on unrecognized kwargsDana Powers2016-01-021-1/+4
|
* Batched message methods now return dict of listsDana Powers2016-01-021-2/+2
|
* Improve iterator interfaceDana Powers2016-01-021-6/+22
| | | | | | | | - Support single message consumption via next(consumer) in py2/py3 - batch message methods (Fetcher.fetched_records / KafkaConsumer.poll) are incompatible with iterators -- message generator state keeps messages internally after they are popped from _records, but before subscription_state is updated.
* Remove some unused bits from kafka.consumer.groupDana Powers2015-12-311-5/+0
|