summaryrefslogtreecommitdiff
path: root/kafka/consumer/fetcher.py
Commit message (Collapse)AuthorAgeFilesLines
* Added `max_bytes` option and FetchRequest_v3 usage. (#962)Taras Voinarovskyi2017-03-061-7/+36
| | | | * Added `max_bytes` option and FetchRequest_v3 usage. * Add checks for versions above 0.10 based on ApiVersionResponse
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-8/+8
|
* Fix of exception raise in case of auto_offset_reset is set to None in ↵Alexander Sibiryakov2016-12-271-2/+2
| | | | KafkaConsumer (#860)
* Add kafka.serializer interfaces (#912)Dana Powers2016-12-191-12/+19
|
* Fix fetcher bug when processing offset out of range (#911)Dana Powers2016-12-171-1/+1
|
* Revert consumer iterators from max_poll_records (#856)Dana Powers2016-10-241-7/+92
|
* Bugfix on max_poll_records - TypeError: object of type NoneType has no len()Dana Powers2016-10-041-1/+1
|
* KAFKA-3007: KafkaConsumer max_poll_records (#831)Dana Powers2016-09-281-135/+91
|
* Treat metric_group_prefix as config in KafkaConsumerDana Powers2016-08-041-3/+3
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Expand consumer.fetcher comment re comparing request / response offsetsDana Powers2016-07-171-1/+3
|
* KAFKA-3196: Add checksum and size to RecordMetadata and ConsumerRecord ↵Dana Powers2016-07-171-3/+8
| | | | (#770 / #594)
* Explicit format string argument indices for python 2.6 compatibilityDana Powers2016-07-171-1/+1
|
* Add comment re fetcher stats on compressed topicsDana Powers2016-07-161-0/+2
|
* KAFKA-3785: Fetcher spending unnecessary time during metrics recordingDana Powers2016-07-161-2/+4
|
* Add skip_double_compressed_messages option to KafkaConsumerunrecurse_unpack_message_setDana Powers2016-07-141-0/+12
|
* Log warning if message set appears double-compressed in KafkaConsumerDana Powers2016-07-141-0/+8
|
* Drop recursion in _unpack_message_setDana Powers2016-07-141-17/+36
|
* Use explicit subscription state flag to handle seek() during message iterationcompacted_offsetsDana Powers2016-07-081-1/+15
|
* Fix consumer iteration on compacted topicsDana Powers2016-07-081-1/+1
|
* Randomize order of topics/partitions processed by fetcher to improve balance ↵Dana Powers2016-06-291-0/+4
| | | | (#732)
* Use Fetch/Produce API v2 for brokers >= 0.10 (uses message format v1) (#694)Dana Powers2016-05-221-1/+6
|
* KAFKA-3025: Message v1 -- add timetamp and use relative offset in compressed ↵Dana Powers2016-05-221-4/+20
| | | | messagesets
* Fix throttle_time_ms sensorZack Dever2016-04-251-1/+2
| | | Fixes #665
* instrument metrics for fetch requestsZack Dever2016-04-131-63/+91
|
* Changing some commented out metrics to avoid future gotchas.Zack Dever2016-04-131-1/+1
|
* KAFKA-2136: support Fetch and Produce v1 (throttle_time_ms)kafka-2136Dana Powers2016-04-061-2/+4
|
* Merge pull request #634 from dpkp/fetchDana Powers2016-04-061-18/+32
|\ | | | | Small improvements to fetching logic
| * Dont send FetchRequest for (obviously) pending datafetchDana Powers2016-04-061-3/+12
| |
| * Increase coverage of StopIteration check in _unpack_message_setDana Powers2016-04-061-15/+15
| |
| * Log debug messages when skipping fetched messages due to offset checksDana Powers2016-04-061-0/+5
| |
* | Use version-indexed lists for request/response protocol structsprotocol_versionsDana Powers2016-04-051-2/+2
|/
* KAFKA-3318: clean up consumer logging and error messagesDana Powers2016-04-051-5/+5
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-2/+2
|
* Drop now-redundant ready() check in Fetcher._handle_offset_responseDana Powers2016-04-041-3/+0
|
* Issue 545: Convert deserializer StopIteration errors to raw ExceptionsDana Powers2016-02-151-1/+8
|
* KAFKA-3170: default consumer config for fetch_min_bytes should be 1Dana Powers2016-02-021-2/+2
|
* Add KafkaConsumer.highwater(partition) to get highwater offsets from ↵Dana Powers2016-01-311-1/+3
| | | | FetchResponses
* Fetcher iterator should check for pause and seek resetsDana Powers2016-01-311-3/+5
|
* Fetcher should filter compressed messages with offsets lower than were requestedDana Powers2016-01-311-0/+8
|
* Fix Fetch._create_fetch_requests docstringDana Powers2016-01-251-1/+1
|
* Ok to sleep in blocking poll for metadata updateDana Powers2016-01-251-1/+1
|
* Attempt to pipeline fetchrequests in iteratorDana Powers2016-01-121-1/+2
|
* Use private deque to track in-flight fetchrequestsDana Powers2016-01-121-0/+16
|
* Update docstring and comments in _create_fetch_requests re KAFKA-2978Dana Powers2016-01-101-5/+2
|
* Reorganize init_fetches calls during iterationDana Powers2016-01-101-5/+17
| | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests.
* Check for assignment changes before yielding new recordDana Powers2016-01-101-0/+9
|
* Fetcher logging should be debug or trace (left higher during testing)Dana Powers2016-01-101-9/+11
|
* Fix debug logging call in PR 500Dana Powers2016-01-101-1/+1
|
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-101-48/+38
| | | | out of sync
View Lorry Controller Status