diff options
| author | Dana Powers <dana.powers@rd.io> | 2014-09-11 00:12:38 -0700 |
|---|---|---|
| committer | Dana Powers <dana.powers@rd.io> | 2014-12-15 12:42:54 -0800 |
| commit | fa6738b8f49735df1812e2e9068e227fcaca961d (patch) | |
| tree | 7140dcdeb9ad9e4d30d8c66014fb54f577c1f2a1 /kafka/common.py | |
| parent | 02124907ff2ddf26cf7a09564c3d7ded95822349 (diff) | |
| download | kafka-python-fa6738b8f49735df1812e2e9068e227fcaca961d.tar.gz | |
A simpler kafka consumer:
```
kafka = KafkaConsumer('topic1')
for m in kafka:
print m
kafka = KafkaConsumer('topic1', 'topic2',
group_id='my_consumer_group',
auto_commit_enable=True,
auto_commit_interval_ms=30 * 1000,
auto_offset_reset='smallest')
for m in kafka:
process_message(m)
kafka.task_done(m)
```
Diffstat (limited to 'kafka/common.py')
| -rw-r--r-- | kafka/common.py | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/kafka/common.py b/kafka/common.py index 008736c..2e817cb 100644 --- a/kafka/common.py +++ b/kafka/common.py @@ -63,6 +63,9 @@ Message = namedtuple("Message", TopicAndPartition = namedtuple("TopicAndPartition", ["topic", "partition"]) +KafkaMessage = namedtuple("KafkaMessage", + ["topic", "partition", "offset", "key", "value"]) + ################# # Exceptions # @@ -182,6 +185,10 @@ class ConsumerNoMoreData(KafkaError): pass +class ConsumerTimeout(KafkaError): + pass + + class ProtocolError(KafkaError): pass |