summaryrefslogtreecommitdiff
path: root/kafka/consumer
Commit message (Collapse)AuthorAgeFilesLines
* Default sleep=True in client.pollDana Powers2016-04-071-1/+1
|
* KAFKA-2136: support Fetch and Produce v1 (throttle_time_ms)kafka-2136Dana Powers2016-04-061-2/+4
|
* Merge pull request #634 from dpkp/fetchDana Powers2016-04-061-18/+32
|\ | | | | Small improvements to fetching logic
| * Dont send FetchRequest for (obviously) pending datafetchDana Powers2016-04-061-3/+12
| |
| * Increase coverage of StopIteration check in _unpack_message_setDana Powers2016-04-061-15/+15
| |
| * Log debug messages when skipping fetched messages due to offset checksDana Powers2016-04-061-0/+5
| |
* | Use version-indexed lists for request/response protocol structsprotocol_versionsDana Powers2016-04-051-2/+2
|/
* Remove unused importskafka-3318Dana Powers2016-04-051-1/+1
|
* KAFKA-3318: clean up consumer logging and error messagesDana Powers2016-04-051-5/+5
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-054-10/+9
|
* Drop now-redundant ready() check in Fetcher._handle_offset_responseDana Powers2016-04-041-3/+0
|
* Merge pull request #602 from zackdever/KAFKA-2698Dana Powers2016-03-172-0/+13
|\ | | | | KAFKA-2698: add paused API
| * KAFKA-2698: add paused APIZack Dever2016-03-162-0/+13
| |
* | Add default_offset_commit_callback to KafkaConsumer DEFAULT_CONFIGSDana Powers2016-03-171-0/+1
|/
* Attempt to clarify error message on consumer subscribe/assign assert failureDana Powers2016-03-141-2/+5
|
* KafkaConsumer.poll should sleep to prevent tight-loopsconsumer_poll_sleepDana Powers2016-03-141-1/+1
|
* Raise TypeError in KafkaConsumer when partition is not a TopicPartitiontopic_partition_type_errorDana Powers2016-03-141-0/+17
|
* Add ignore_leadernotavailable kwarg to SimpleClient.load_metadata_for_topicsDana Powers2016-03-131-1/+1
|
* Consumer should timeout internal iterator if heartbeat ttl is expiredconsumer_heartbeat_fixesDana Powers2016-03-121-3/+15
|
* factor group checking logic to KafkaConsumer._use_consumer_group()Dana Powers2016-03-121-24/+37
|
* Bug fix: KafkaConsumer.position()Stefán Þorvarðarson2016-03-091-1/+1
| | | | | Method KafkaConsumer.position() was not refreshing position correctly when calling self._update_fetch_positions().
* Merge pull request #557 from dpkp/socket_buffer_size_optionalDana Powers2016-02-181-4/+6
|\ | | | | Dont override system rcvbuf or sndbuf unless user configures explicitly
| * Dont override system rcvbuf or sndbuf unless user configures explicitlysocket_buffer_size_optionalDana Powers2016-02-171-4/+6
| |
* | Add RangePartitionAssignor (and use as default); add assignor testsrange_assignorDana Powers2016-02-161-2/+4
|/
* KAFKA-3044: Re-word consumer.poll behaviourDana Powers2016-02-151-3/+4
|
* Issue 545: Convert deserializer StopIteration errors to raw ExceptionsDana Powers2016-02-152-2/+9
|
* Fix Typos (Issue 536)Dana Powers2016-02-151-1/+1
|
* KAFKA-3191: Improve offset committing docstringsDana Powers2016-02-021-2/+6
|
* a few extra AssertionError messages in KafkaConsumerDana Powers2016-02-021-2/+2
|
* KAFKA-3170: default consumer config for fetch_min_bytes should be 1Dana Powers2016-02-022-4/+4
|
* Add more assertions in KafkaConsumer (primarily to seek* methods)Dana Powers2016-02-011-3/+28
|
* Be sure to get all metadata when subscribing to a regex pattern.Dana Powers2016-02-011-12/+19
|
* Implement KafkaConsumer.topics()Dana Powers2016-02-011-7/+14
| | | | | - add ClusterMetadata.need_all_topic_metadata attribute - client requests metadata for all topics if attribute True
* Add KafkaConsumer.highwater(partition) to get highwater offsets from ↵Dana Powers2016-01-313-1/+26
| | | | FetchResponses
* Fetcher iterator should check for pause and seek resetsDana Powers2016-01-311-3/+5
|
* Fetcher should filter compressed messages with offsets lower than were requestedDana Powers2016-01-311-0/+8
|
* Fix internal timeout / sleep handling in consumer iteratoriterator_timeoutDana Powers2016-01-291-15/+16
|
* Fix Fetch._create_fetch_requests docstringDana Powers2016-01-251-1/+1
|
* Ok to sleep in blocking poll for metadata updateDana Powers2016-01-251-1/+1
|
* Disable offset commits and auto-partition-assignment when group_id is NoneDana Powers2016-01-241-20/+28
|
* Merge pull request #507 from dpkp/deprecation_warningsDana Powers2016-01-123-0/+15
|\ | | | | Add DeprecationWarnings to legacy classes
| * Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-123-0/+15
| | | | | | | | and KafkaConnection
* | Sleep in KafkaConsumer iterator if no partition assignment; dont block in ↵iterator_fetchesDana Powers2016-01-121-4/+25
| | | | | | | | poll if no in-flight fetches
* | Move consumer_timeout handling to private methodDana Powers2016-01-121-5/+7
| |
* | Attempt to pipeline fetchrequests in iteratorDana Powers2016-01-121-1/+2
| |
* | Use private deque to track in-flight fetchrequestsDana Powers2016-01-121-0/+16
| |
* | Update docstring and comments in _create_fetch_requests re KAFKA-2978Dana Powers2016-01-101-5/+2
| |
* | Reorganize init_fetches calls during iterationDana Powers2016-01-102-7/+20
| | | | | | | | | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests.
* | Check for assignment changes before yielding new recordDana Powers2016-01-101-0/+9
| |
* | Fetcher logging should be debug or trace (left higher during testing)Dana Powers2016-01-102-9/+12
|/