summaryrefslogtreecommitdiff
path: root/kafka/consumer/multiprocess.py
Commit message (Collapse)AuthorAgeFilesLines
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-121-0/+5
| | | | and KafkaConnection
* Fix KafkaClient->SimpleClient references0.9Dana Powers2016-01-071-1/+1
|
* Import queue from six.movesDana Powers2016-01-031-4/+2
|
* Fix _mp_consume queue variable name conflictDana Powers2015-12-091-2/+2
|
* Fix python3 / python2 comments re queue/QueueDana Powers2015-12-021-5/+5
|
* Merge pull request #457 from saaros/block-for-number-of-messagesDana Powers2015-12-021-5/+9
|\ | | | | Consumers get_messages: allow blocking until some messages are received
| * Consumers get_messages: allow blocking until some messages are receivedOskari Saarenmaa2015-09-181-5/+9
| | | | | | | | | | | | | | | | | | Modified MultiProcessConsumer's and SimpleConsumer's `block` argument to allow integer value which defines the number of messages to block for. This allows callers to ask for a high number of messages and block only until some of them are received. Otherwise callers would have to request messages one by one or block for some time.
* | Merge pull request #456 from barricadeio/mp-retryDana Powers2015-12-021-46/+58
|\ \ | | | | | | Support retry semantics in MultiProcessConsumer
| * | Support retry semantics in MultiProcessConsumerRoss Duggan2015-09-141-46/+58
| |/
* | allow to retrieve partition info in mp consumerMartin Olveyra2015-06-291-1/+2
|/
* Cleanup imports in kafka/client and kafka/consumerDana Powers2015-06-081-8/+7
|
* Merge pull request #380 from dpkp/multiprocess_consumer_partitionsDana Powers2015-06-081-3/+7
|\ | | | | Support optional partitions kwarg in MultiProcessConsumer
| * Support optional partitions kwarg in MultiProcessConsumerDana Powers2015-05-171-3/+7
| |
* | Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-061-1/+3
|/
* Make external API consistently support python3 strings for topic.Space2015-04-031-1/+1
|
* Fetch previously committed offsets in base consumer class so long asDana Powers2015-03-301-0/+2
| | | | | | | | a group is configured (but document that group must be None for old servers). This fixes multiprocessor consumer issue that prevented access to commit offsets if auto_commit is disabled. Also refactor fetch_last_known_offsets based on KafkaConsumer While still setting unknown offsets to 0
* Manageable queue.put() operation for MPConsumer processesViktor Shlapakov2015-03-251-4/+11
|
* Using mp.manager to solve the issue with join for MPConsumerViktor Shlapakov2015-03-241-6/+7
|
* Moving to **kwargs for MPConsumer optionsViktor Shlapakov2015-03-241-1/+2
|
* Moved additional MP consumer options to **kwargsViktor Shlapakov2015-03-131-3/+3
|
* Using additional params for MP consumer child processViktor Shlapakov2015-03-131-26/+32
| | | | | | | - Moved the events params to a separate param for consistency - Passing additional params to internal SimpleConsumer worker for multiprocessing high-level consumer. It allows to use non-default consumer settings (fetch_size_bytes, buffer_size, max_buffer_size).
* Used thread-safe dict.copy().keys() for MP consumer partitionsViktor Shlapakov2015-03-121-1/+4
|
* Cleaned code for MP consumer chunkingViktor Shlapakov2015-03-111-10/+9
|
* Fixing distribution for MP ConsumerViktor Shlapakov2015-03-031-1/+1
|
* Add Sphinx API docsWill Daly2015-01-151-18/+21
|
* Separate consumers/producers/partitionersDana Powers2014-09-101-0/+248