summaryrefslogtreecommitdiff
path: root/kafka/consumer
Commit message (Collapse)AuthorAgeFilesLines
...
* Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleepDana Powers2016-01-101-1/+4
| | | | iterating fetcher
* Fix sec / millisec unit bug in KafkaConsumer._poll_once()Dana Powers2016-01-101-1/+1
|
* Fix delayed_task timeout commit 45d26b6Dana Powers2016-01-101-1/+1
|
* Merge pull request #502 from dpkp/task_poll_timeoutDana Powers2016-01-101-8/+8
|\ | | | | Add delayed task timeouts to _poll calls
| * Improve KafkaConsumer iterator loop timeoutstask_poll_timeoutDana Powers2016-01-101-8/+8
| | | | | | | | | | | | - Consider all delayed tasks, not just heartbeat - Include metadata update timeout - Fix second / millisecond bug calling client.poll()
* | Fix debug logging call in PR 500Dana Powers2016-01-101-1/+1
|/
* Remove old kafka.consumer.kafka moduleDana Powers2016-01-101-771/+0
|
* KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-103-73/+51
| | | | out of sync
* Add error checking to mark_for_reassignmentDana Powers2016-01-101-0/+3
|
* Fix KafkaClient->SimpleClient references0.9Dana Powers2016-01-074-5/+5
|
* Docstring updatesDana Powers2016-01-071-129/+127
|
* Import queue from six.movesDana Powers2016-01-032-8/+3
|
* Switch to new KafkaConsumer in module importsDana Powers2016-01-031-1/+1
|
* Add deprecated methods to KafkaConsumer w/ notes on alternativesDana Powers2016-01-031-0/+31
|
* Disable pylint error on __iter__ (next is provided via six.Iterator)Dana Powers2016-01-032-2/+2
|
* Keep support for old largest/smallest auto_offset_reset optionsDana Powers2016-01-031-0/+7
|
* Return empty dict from KafkaConsumer.poll if no recordsDana Powers2016-01-031-1/+1
|
* Support consumer_timeout_ms in new KafkaConsumerDana Powers2016-01-031-2/+17
|
* Add api_version config to KafkaConsumer; disable features inline by versionDana Powers2016-01-031-11/+36
|
* Raise exception in KafkaConsumer on unrecognized kwargsDana Powers2016-01-021-1/+4
|
* Batched message methods now return dict of listsDana Powers2016-01-022-4/+4
|
* Improve iterator interfaceDana Powers2016-01-022-12/+44
| | | | | | | | - Support single message consumption via next(consumer) in py2/py3 - batch message methods (Fetcher.fetched_records / KafkaConsumer.poll) are incompatible with iterators -- message generator state keeps messages internally after they are popped from _records, but before subscription_state is updated.
* Disable pylint errors for py2/py3 compatibility workaroundsDana Powers2016-01-012-2/+3
|
* Remove some unused bits from kafka.consumer.groupDana Powers2015-12-311-5/+0
|
* Improve request pipelining in consumer iteratorDana Powers2015-12-312-13/+28
|
* Support message decompressionDana Powers2015-12-311-19/+15
|
* Support simple message iteration in Fetcher and new KafkaConsumerDana Powers2015-12-302-0/+71
|
* Prefer assert or more-specific error to IllegalState / IllegalArgumentDana Powers2015-12-303-25/+14
|
* More Docstring ImprovementsDana Powers2015-12-303-62/+194
|
* Drop unused KafkaConsumer._ensure_not_closed methodDana Powers2015-12-301-4/+0
|
* Make group_id a Coordinator kwarg (not arg) for consistencyDana Powers2015-12-301-1/+1
|
* Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-292-79/+76
|
* Log as INFO: group join, leader election, partition assignmentsDana Powers2015-12-291-0/+1
|
* Improve various docstringsDana Powers2015-12-291-3/+10
|
* Make add_assigned_partition private(ish) in SubscriptionStateDana Powers2015-12-291-3/+3
|
* Pass auto commit parameters from KafkaConsumer to ConsumerCoordinatorDana Powers2015-12-291-0/+2
|
* Fix broken SubscriptionState.is_assigned callDana Powers2015-12-291-1/+1
|
* kafka.consumer.group.KafkaConsumer: 0.9 coordinator-aware consumerDana Powers2015-12-281-797/+480
| | | | | | | - use ConsumerCoordinator to manage group membership - dynamically assign partitions via group using topic subscription - use upstream configuration parameters as __init__ kwargs - metrics and SSL are still TODO
* Define ConsumerRebalanceListener abstract classDana Powers2015-12-281-0/+84
|
* New class: kafka.consumer.fetcher.FetcherDana Powers2015-12-281-0/+523
| | | | | - manages fetch requests via async client and subscription_state - based on upstream java client
* New class SubscriptionState, based on upstream Java clientDana Powers2015-12-281-0/+304
|
* pylint fixesDana Powers2015-12-103-3/+4
| | | | | | - temporarily ignore kafka/consumer/group.py - temporarily ignore test/test_protocol.py - disable-msg deprecated; use disable= instead
* Drop kafka_bytestringDana Powers2015-12-103-20/+17
|
* Convert OffsetCommit and OffsetFetch protocol encode/decodeDana Powers2015-12-102-6/+6
|
* Handle PartialMessage / ConsumerFetchSizeTooSmall in SimpleConsumerDana Powers2015-12-091-21/+24
|
* Update references to kafka.common Request/Response (now Payload)Dana Powers2015-12-093-23/+18
|
* Fix _mp_consume queue variable name conflictDana Powers2015-12-091-2/+2
|
* Merge branch 'master' into 0.9Zack Dever2015-12-071-0/+4
|\
| * Merge pull request #426 from ucarion/ucarion-kafkaconsumer-closeDana Powers2015-12-061-0/+4
| |\ | | | | | | Add KafkaConsumer#close
| | * Add KafkaConsumer#closeUlysse Carion2015-07-071-0/+4
| | |
View Lorry Controller Status