summaryrefslogtreecommitdiff
path: root/kafka/consumer/fetcher.py
Commit message (Collapse)AuthorAgeFilesLines
* Remove unused `skip_double_compressed_messages`Jeff Widman2019-01-131-8/+0
| | | | | | | | | | This `skip_double_compressed_messages` flag was added in https://github.com/dpkp/kafka-python/pull/755 in order to fix https://github.com/dpkp/kafka-python/issues/718. However, grep'ing through the code, it looks like it this is no longer used anywhere and doesn't do anything. So removing it.
* Be explicit with tuples for %s formattingJeff Widman2018-11-181-7/+7
| | | | Fix #1633
* Expose record headers in ConsumerRecordsHeikki Nousiainen2018-09-271-3/+5
|
* Stop using deprecated log.warn()Jeff Widman2018-05-101-3/+3
|
* Use local copies in Fetcher._fetchable_partitions to avoid mutation errors ↵Dana Powers2018-03-071-3/+6
| | | | (#1400)
* Fix KafkaConsumer compacted offset handling (#1397)Dana Powers2018-02-261-8/+9
|
* Avoid consuming duplicate compressed messages from mid-batch (#1367)Dana Powers2018-02-051-2/+11
|
* KAFKA-3949: Avoid race condition when subscription changes during rebalance ↵Dana Powers2018-02-021-6/+0
| | | | (#1364)
* Avoid KeyError when filtering fetchable partitions (#1344)Dana Powers2018-01-121-2/+2
| | | | * Avoid KeyError when filtering fetchable partitions
* KAFKA-3888 Use background thread to process consumer heartbeats (#1266)Dana Powers2017-12-211-0/+3
|
* Minor Exception cleanupJeff Widman2017-12-121-2/+2
|
* Revert ffc7caef13a120f69788bcdd43ffa01468f575f9 / PR #1239Dana Powers2017-11-161-7/+2
| | | | The change caused a regression documented in issue #1290
* Use correct casing for MBJeff Widman2017-11-151-1/+1
| | | | | | These values refer to Megabytes, not Megabits. Fix #1295
* Add DefaultRecordBatch implementation aka V2 message format parser/builder. ↵Taras Voinarovskyi2017-10-251-7/+23
| | | | | (#1185) Added bytecode optimization for varint and append/read_msg functions. Mostly based on avoiding LOAD_GLOBAL calls.
* Merge pull request #1252 from dpkp/legacy_records_refactorTaras Voinarovskyi2017-10-141-79/+27
|\ | | | | Refactor MessageSet and Message into LegacyRecordBatch
| * Fix tests and rebase problemsTaras2017-10-121-2/+1
| |
| * Remove the check for timestamp None in producer, as it's done in RecordBatch ↵Taras2017-10-121-6/+0
| | | | | | | | | | | | anyway. Minor abc doc fixes.
| * Refactor MessageSet and Message into LegacyRecordBatch to later support v2 ↵Taras2017-10-111-72/+27
| | | | | | | | message format
* | KAFKA-4034: Avoid unnecessary consumer coordinator lookup (#1254)Dana Powers2017-10-111-3/+12
|/
* More testsKAFKA_3977_defer_fetch_parsingDana Powers2017-10-081-0/+5
|
* Avoid sys.maxint; not supported on py3Dana Powers2017-10-081-2/+4
|
* KAFKA-3977: Defer fetch parsing for space efficiency, and to raise ↵Dana Powers2017-10-071-261/+230
| | | | exceptions to user
* Fix Fetcher.PartitionRecords to handle fetch_offset in the middle of ↵Dana Powers2017-10-051-2/+7
| | | | compressed messageset (#1239)
* Fix grammarJeff Widman2017-10-041-1/+1
|
* Drop unused sleep kwarg to poll (#1177)Dana Powers2017-08-151-2/+1
|
* Added unit tests for fetcher's `_reset_offset` and related functions.Taras Voinarovskiy2017-08-071-5/+16
|
* Added `beginning_offsets` and `end_offsets` API's and fixed @jeffwidman ↵Taras Voinarovskiy2017-08-071-4/+19
| | | | review issues
* Fix test for older brokersTaras Voinarovskiy2017-08-071-1/+1
|
* Changed retrieve_offsets to allow fetching multiple offsets at onceTaras Voinarovskiy2017-08-071-95/+130
|
* Added basic support for offsets_for_times API. Still needs to group by nodes ↵Taras Voinarovskiy2017-08-071-18/+76
| | | | and send in parallel.
* Fixed Issue 1033.Raise AssertionError when decompression unsupported. (#1159)webber2017-08-051-0/+7
|
* Added `max_bytes` option and FetchRequest_v3 usage. (#962)Taras Voinarovskyi2017-03-061-7/+36
| | | | * Added `max_bytes` option and FetchRequest_v3 usage. * Add checks for versions above 0.10 based on ApiVersionResponse
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-8/+8
|
* Fix of exception raise in case of auto_offset_reset is set to None in ↵Alexander Sibiryakov2016-12-271-2/+2
| | | | KafkaConsumer (#860)
* Add kafka.serializer interfaces (#912)Dana Powers2016-12-191-12/+19
|
* Fix fetcher bug when processing offset out of range (#911)Dana Powers2016-12-171-1/+1
|
* Revert consumer iterators from max_poll_records (#856)Dana Powers2016-10-241-7/+92
|
* Bugfix on max_poll_records - TypeError: object of type NoneType has no len()Dana Powers2016-10-041-1/+1
|
* KAFKA-3007: KafkaConsumer max_poll_records (#831)Dana Powers2016-09-281-135/+91
|
* Treat metric_group_prefix as config in KafkaConsumerDana Powers2016-08-041-3/+3
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Expand consumer.fetcher comment re comparing request / response offsetsDana Powers2016-07-171-1/+3
|
* KAFKA-3196: Add checksum and size to RecordMetadata and ConsumerRecord ↵Dana Powers2016-07-171-3/+8
| | | | (#770 / #594)
* Explicit format string argument indices for python 2.6 compatibilityDana Powers2016-07-171-1/+1
|
* Add comment re fetcher stats on compressed topicsDana Powers2016-07-161-0/+2
|
* KAFKA-3785: Fetcher spending unnecessary time during metrics recordingDana Powers2016-07-161-2/+4
|
* Add skip_double_compressed_messages option to KafkaConsumerunrecurse_unpack_message_setDana Powers2016-07-141-0/+12
|
* Log warning if message set appears double-compressed in KafkaConsumerDana Powers2016-07-141-0/+8
|
* Drop recursion in _unpack_message_setDana Powers2016-07-141-17/+36
|
* Use explicit subscription state flag to handle seek() during message iterationcompacted_offsetsDana Powers2016-07-081-1/+15
|
View Lorry Controller Status