summaryrefslogtreecommitdiff
path: root/kafka/consumer/simple.py
Commit message (Collapse)AuthorAgeFilesLines
* Vendor six 1.10.0sixDana Powers2016-08-011-2/+2
|
* Remove unused importskafka-3318Dana Powers2016-04-051-1/+1
|
* Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-121-0/+6
| | | | and KafkaConnection
* Fix KafkaClient->SimpleClient references0.9Dana Powers2016-01-071-1/+1
|
* Import queue from six.movesDana Powers2016-01-031-4/+1
|
* Disable pylint errors for py2/py3 compatibility workaroundsDana Powers2016-01-011-1/+1
|
* pylint fixesDana Powers2015-12-101-2/+2
| | | | | | - temporarily ignore kafka/consumer/group.py - temporarily ignore test/test_protocol.py - disable-msg deprecated; use disable= instead
* Handle PartialMessage / ConsumerFetchSizeTooSmall in SimpleConsumerDana Powers2015-12-091-21/+24
|
* Update references to kafka.common Request/Response (now Payload)Dana Powers2015-12-091-16/+10
|
* new pylint disables for pylint 1.5.1Zack Dever2015-12-021-1/+1
| | | | | tested locally with `pylint --rcfile=pylint.rc -E kafka test`. should pass travis builds.
* Fix python3 / python2 comments re queue/QueueDana Powers2015-12-021-5/+5
|
* Merge pull request #457 from saaros/block-for-number-of-messagesDana Powers2015-12-021-6/+9
|\ | | | | Consumers get_messages: allow blocking until some messages are received
| * Consumers get_messages: allow blocking until some messages are receivedOskari Saarenmaa2015-09-181-6/+9
| | | | | | | | | | | | | | | | | | Modified MultiProcessConsumer's and SimpleConsumer's `block` argument to allow integer value which defines the number of messages to block for. This allows callers to ask for a high number of messages and block only until some of them are received. Otherwise callers would have to request messages one by one or block for some time.
* | allow to retrieve partition info in mp consumerMartin Olveyra2015-06-291-7/+0
|/
* fix #410 SimpleConsumer cannot seek to an absolute offset.haosdent2015-06-201-17/+46
|
* Refactor SimpleConsumer get_messages and _fetchDana Powers2015-06-101-29/+33
| | | | | - attempt to make these easier to read - add marginal retry logic to internal _fetch loop
* Merge pull request #405 from dpkp/log_error_typeDana Powers2015-06-101-5/+8
|\ | | | | Log response error types in consumer and producer logs
| * Add error type to SimpleConsumer error loggingDana Powers2015-06-101-5/+8
| |
* | Change SimpleConsumer.reset_partition_offset to return offset / None on ↵Dana Powers2015-06-101-5/+19
|/ | | | failure (dont raise exception)
* Cleanup imports in kafka/client and kafka/consumerDana Powers2015-06-081-14/+13
|
* SimpleConsumer should refresh metadata and retry on leadership changes; only ↵Dana Powers2015-06-081-1/+4
| | | | raise on UnknownTopicOrPartition
* try to fix uncaught FailedPayloadsErrorreAsOn20102015-06-091-1/+8
|
* Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-061-1/+3
|
* Fetch previously committed offsets in base consumer class so long asDana Powers2015-03-301-0/+2
| | | | | | | | a group is configured (but document that group must be None for old servers). This fixes multiprocessor consumer issue that prevented access to commit offsets if auto_commit is disabled. Also refactor fetch_last_known_offsets based on KafkaConsumer While still setting unknown offsets to 0
* Increase count_since_commit on seekEnrico Canzonieri2015-03-201-1/+1
| | | | | | When auto_commit is False this change enables an explicit call to commit() to actually commit the offsets. Otherwise a consumer won't be able to commit until at least one message is read.
* Merge pull request #328 from wkiser/validate_offsetDana Powers2015-03-021-0/+4
|\ | | | | Fixes consumer/kafka and consumer/simple to only yield messages if the m...
| * Fixes consumer/kafka and consumer/simple to only yield messages if the ↵wkiser2015-03-021-0/+4
| | | | | | | | message's offset is greater than or equal to the consumer offset.
* | Retry failed partitions and add integration testsEnrico Canzonieri2015-01-261-0/+2
| |
* | Merge branch 'master' of github.com:mumrah/kafka-python into ↵Enrico Canzonieri2015-01-261-31/+43
|\ \ | |/ | | | | | | | | | | validate_consumer_offset Conflicts: kafka/consumer/simple.py
| * Add Sphinx API docsWill Daly2015-01-151-28/+39
| |
* | Make SimpleConsumer auto_offset_reset more like KafkaConsumerEnrico Canzonieri2015-01-261-4/+19
| |
* | use a list in send_offset_requestEnrico Canzonieri2015-01-141-3/+4
| |
* | Implement offsets reset when OffsetOutOfRangeErrorEnrico Canzonieri2015-01-141-3/+35
|/ | | | | | | | This slightly changes the SimpleConsumer interface adding the default option use_latest_offsets. The fetch behaviour is also changed since it does not raise OffsetOutOfRangeError anymore. Resetting the offsets automatically is especially useful in MultiprocessConsumer, where an explicit seek call is not possible.
* Merge pull request #242 from wizzat/pr_225Mark Roberts2014-09-231-1/+1
|\ | | | | Resolve merge conflict in PR #225
| * Resolve merge conflict in PR #225Mark Roberts2014-09-231-1/+1
| |
* | Fix SimpleConsumer timeout behavior in get_messages (Issue 237)Dana Powers2014-09-211-4/+5
|/
* Separate consumers/producers/partitionersDana Powers2014-09-101-0/+318