summaryrefslogtreecommitdiff
path: root/kafka/consumer/fetcher.py
Commit message (Collapse)AuthorAgeFilesLines
* set.discard is much betterfetchable_key_errorDana Powers2018-01-121-4/+2
|
* Avoid KeyError when filtering fetchable partitionsDana Powers2018-01-111-2/+4
|
* KAFKA-3888 Use background thread to process consumer heartbeats (#1266)Dana Powers2017-12-211-0/+3
|
* Minor Exception cleanupJeff Widman2017-12-121-2/+2
|
* Revert ffc7caef13a120f69788bcdd43ffa01468f575f9 / PR #1239Dana Powers2017-11-161-7/+2
| | | | The change caused a regression documented in issue #1290
* Use correct casing for MBJeff Widman2017-11-151-1/+1
| | | | | | These values refer to Megabytes, not Megabits. Fix #1295
* Add DefaultRecordBatch implementation aka V2 message format parser/builder. ↵Taras Voinarovskyi2017-10-251-7/+23
| | | | | (#1185) Added bytecode optimization for varint and append/read_msg functions. Mostly based on avoiding LOAD_GLOBAL calls.
* Merge pull request #1252 from dpkp/legacy_records_refactorTaras Voinarovskyi2017-10-141-79/+27
|\ | | | | Refactor MessageSet and Message into LegacyRecordBatch
| * Fix tests and rebase problemsTaras2017-10-121-2/+1
| |
| * Remove the check for timestamp None in producer, as it's done in RecordBatch ↵Taras2017-10-121-6/+0
| | | | | | | | | | | | anyway. Minor abc doc fixes.
| * Refactor MessageSet and Message into LegacyRecordBatch to later support v2 ↵Taras2017-10-111-72/+27
| | | | | | | | message format
* | KAFKA-4034: Avoid unnecessary consumer coordinator lookup (#1254)Dana Powers2017-10-111-3/+12
|/
* More testsKAFKA_3977_defer_fetch_parsingDana Powers2017-10-081-0/+5
|
* Avoid sys.maxint; not supported on py3Dana Powers2017-10-081-2/+4
|
* KAFKA-3977: Defer fetch parsing for space efficiency, and to raise ↵Dana Powers2017-10-071-261/+230
| | | | exceptions to user
* Fix Fetcher.PartitionRecords to handle fetch_offset in the middle of ↵Dana Powers2017-10-051-2/+7
| | | | compressed messageset (#1239)
* Fix grammarJeff Widman2017-10-041-1/+1
|
* Drop unused sleep kwarg to poll (#1177)Dana Powers2017-08-151-2/+1
|
* Added unit tests for fetcher's `_reset_offset` and related functions.Taras Voinarovskiy2017-08-071-5/+16
|
* Added `beginning_offsets` and `end_offsets` API's and fixed @jeffwidman ↵Taras Voinarovskiy2017-08-071-4/+19
| | | | review issues
* Fix test for older brokersTaras Voinarovskiy2017-08-071-1/+1
|
* Changed retrieve_offsets to allow fetching multiple offsets at onceTaras Voinarovskiy2017-08-071-95/+130
|
* Added basic support for offsets_for_times API. Still needs to group by nodes ↵Taras Voinarovskiy2017-08-071-18/+76
| | | | and send in parallel.
* Fixed Issue 1033.Raise AssertionError when decompression unsupported. (#1159)webber2017-08-051-0/+7
|
* Added `max_bytes` option and FetchRequest_v3 usage. (#962)Taras Voinarovskyi2017-03-061-7/+36
| | | | * Added `max_bytes` option and FetchRequest_v3 usage. * Add checks for versions above 0.10 based on ApiVersionResponse
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-8/+8
|
* Fix of exception raise in case of auto_offset_reset is set to None in ↵Alexander Sibiryakov2016-12-271-2/+2
| | | | KafkaConsumer (#860)
* Add kafka.serializer interfaces (#912)Dana Powers2016-12-191-12/+19
|
* Fix fetcher bug when processing offset out of range (#911)Dana Powers2016-12-171-1/+1
|
* Revert consumer iterators from max_poll_records (#856)Dana Powers2016-10-241-7/+92
|
* Bugfix on max_poll_records - TypeError: object of type NoneType has no len()Dana Powers2016-10-041-1/+1
|
* KAFKA-3007: KafkaConsumer max_poll_records (#831)Dana Powers2016-09-281-135/+91
|
* Treat metric_group_prefix as config in KafkaConsumerDana Powers2016-08-041-3/+3
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Expand consumer.fetcher comment re comparing request / response offsetsDana Powers2016-07-171-1/+3
|
* KAFKA-3196: Add checksum and size to RecordMetadata and ConsumerRecord ↵Dana Powers2016-07-171-3/+8
| | | | (#770 / #594)
* Explicit format string argument indices for python 2.6 compatibilityDana Powers2016-07-171-1/+1
|
* Add comment re fetcher stats on compressed topicsDana Powers2016-07-161-0/+2
|
* KAFKA-3785: Fetcher spending unnecessary time during metrics recordingDana Powers2016-07-161-2/+4
|
* Add skip_double_compressed_messages option to KafkaConsumerunrecurse_unpack_message_setDana Powers2016-07-141-0/+12
|
* Log warning if message set appears double-compressed in KafkaConsumerDana Powers2016-07-141-0/+8
|
* Drop recursion in _unpack_message_setDana Powers2016-07-141-17/+36
|
* Use explicit subscription state flag to handle seek() during message iterationcompacted_offsetsDana Powers2016-07-081-1/+15
|
* Fix consumer iteration on compacted topicsDana Powers2016-07-081-1/+1
|
* Randomize order of topics/partitions processed by fetcher to improve balance ↵Dana Powers2016-06-291-0/+4
| | | | (#732)
* Use Fetch/Produce API v2 for brokers >= 0.10 (uses message format v1) (#694)Dana Powers2016-05-221-1/+6
|
* KAFKA-3025: Message v1 -- add timetamp and use relative offset in compressed ↵Dana Powers2016-05-221-4/+20
| | | | messagesets
* Fix throttle_time_ms sensorZack Dever2016-04-251-1/+2
| | | Fixes #665
* instrument metrics for fetch requestsZack Dever2016-04-131-63/+91
|
* Changing some commented out metrics to avoid future gotchas.Zack Dever2016-04-131-1/+1
|
View Lorry Controller Status