summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
...
* | | Refactor SimpleConsumer get_messages and _fetchDana Powers2015-06-101-29/+33
| | | | | | | | | | | | | | | - attempt to make these easier to read - add marginal retry logic to internal _fetch loop
* | | Merge pull request #405 from dpkp/log_error_typeDana Powers2015-06-102-7/+11
|\ \ \ | | | | | | | | Log response error types in consumer and producer logs
| * | | Add error type to SimpleConsumer error loggingDana Powers2015-06-101-5/+8
| | | |
| * | | Log response error type in async producerDana Powers2015-06-101-2/+3
| |/ /
* | | Change SimpleConsumer.reset_partition_offset to return offset / None on ↵Dana Powers2015-06-101-5/+19
| | | | | | | | | | | | failure (dont raise exception)
* | | Change Consumer commit() to return True/False and log error; dont raise ↵Dana Powers2015-06-101-12/+18
|/ / | | | | | | client exceptions
* | Fix KafkaClient request / response orderingDana Powers2015-06-101-10/+20
|/
* Add send/receive debug logging to async producerDana Powers2015-06-091-8/+11
|
* KafkaClient log new broker and topic metadata received as INFODana Powers2015-06-091-2/+2
|
* KafkaClient: log responses by requestId for debuggingDana Powers2015-06-091-1/+4
|
* KafkaClient: log requestId on ConnectionError instead of hexdump of request ↵Dana Powers2015-06-091-6/+5
| | | | contents
* Merge pull request #398 from dpkp/kafka_consumer_failed_payloadsDana Powers2015-06-091-37/+61
|\ | | | | Kafka consumer failed payloads
| * KafkaConsumer style nitsDana Powers2015-06-081-26/+48
| |
| * Update KafkaConsumer to handle request-specific FailedPayloadsErrorsDana Powers2015-06-081-11/+13
| |
* | Support sync_fail_on_error kwarg in ProducerDana Powers2015-06-091-2/+12
| |
* | Use a list, not request_tries.keys(), to track requests / responses in async ↵Dana Powers2015-06-091-2/+4
|/ | | | producer
* Fixup for loop vars in kafka/protocol.pyDana Powers2015-06-081-14/+14
|
* Improve kafka client debug request/response loggingDana Powers2015-06-081-5/+5
|
* Prefer single quotes for stringsDana Powers2015-06-081-14/+12
|
* Add a few extra docstring comments about thread-safe clients/connectionsDana Powers2015-06-083-5/+12
|
* Dont maintain all producer args / kwargs in subclass __init__ and docstrings ↵Dana Powers2015-06-082-91/+24
| | | | -- just refer to super class (Producer)
* Cleanup imports in kafka/client and kafka/consumerDana Powers2015-06-083-23/+21
|
* Merge pull request #389 from dpkp/task_done_key_errorDana Powers2015-06-081-2/+10
|\ | | | | KafkaConsumer.task_done: warn and skip unrecognized topic-partitions
| * KafkaConsumer.task_done - warn and skip messages from unrecognized ↵Dana Powers2015-06-061-2/+10
| | | | | | | | topic-partitions
* | SimpleConsumer should refresh metadata and retry on leadership changes; only ↵Dana Powers2015-06-081-1/+4
| | | | | | | | raise on UnknownTopicOrPartition
* | Merge pull request #380 from dpkp/multiprocess_consumer_partitionsDana Powers2015-06-081-3/+7
|\ \ | | | | | | Support optional partitions kwarg in MultiProcessConsumer
| * | Support optional partitions kwarg in MultiProcessConsumerDana Powers2015-05-171-3/+7
| | |
* | | Merge pull request #379 from dpkp/deprecate_keyed_producer_sendDana Powers2015-06-081-5/+6
|\ \ \ | | | | | | | | Deprecate KeyedProducer.send in favor of send_messages
| * | | Deprecate KeyedProducer.send in favor of send_messages -- keep interface ↵Dana Powers2015-05-171-5/+6
| | | | | | | | | | | | | | | | consistent
* | | | try to fix uncaught FailedPayloadsErrorreAsOn20102015-06-092-1/+10
| | | |
* | | | Add async_stop_timeout parameter to tune how long to let the producerDana Powers2015-06-061-3/+26
| | | | | | | | | | | | | | | | | | | | keep trying to send messages before timing out. Log an error if async producer was stopped before all messages sent.
* | | | Dont stop async producer until all pending messages have been processedDana Powers2015-06-061-1/+1
| | | |
* | | | Update Producer class docstringDana Powers2015-06-061-4/+25
| | | |
* | | | Deprecate async producer batch_send kwarg -- use 'async' insteadDana Powers2015-06-063-26/+44
| | | |
* | | | Log retries and failed messages in async producer (configurable as full ↵Dana Powers2015-06-061-12/+24
| | | | | | | | | | | | | | | | messages or hash())
* | | | PR 331 fixup: do not attempt to get new messages if there are pending retriesDana Powers2015-06-061-4/+9
| | | |
* | | | PR 331 fixup: Rename reqs dict to request_triesDana Powers2015-06-061-9/+13
| | | |
* | | | PR 331 fixup: Dont need try/except when calling send_produce_requests with ↵Dana Powers2015-06-061-15/+16
| | | | | | | | | | | | | | | | fail_on_error=False
* | | | PR 331 fixup: log warnings on async producer backoff and metadata refreshDana Powers2015-06-061-1/+2
| | | |
* | | | PR 331 fixup: Support unlimited retries with async_retry_limit=NoneDana Powers2015-06-061-6/+8
| | | | | | | | | | | | | | | | Async producer defaults are now retry everything always w/ 100ms backoff
* | | | PR 331 fixup: fix _handle_error closureDana Powers2015-06-061-16/+17
| | | |
* | | | PR 331 fixup: Fix kafka.common imports from kafka.producer.base (one import ↵Dana Powers2015-06-061-3/+2
| | | | | | | | | | | | | | | | block, add ProduceResponse)
* | | | KafkaClient should try/except ConnnectionError when calling _get_connDana Powers2015-06-061-2/+2
| | | |
* | | | FailedPayloadsError now only has a single payload; use .payload attributeDana Powers2015-06-061-2/+2
| | | | | | | | | | | | | | | | .failed_payloads attribute has been removed.
* | | | Raise an error if we attempt to group duplicate topic-partition payloadsDana Powers2015-06-062-0/+5
| | | | | | | | | | | | | | | | - previously this would simply drop one of the payloads
* | | | Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-069-9/+17
| |_|/ |/| |
* | | Fix import error in kafka/producer/base.pyDana Powers2015-06-061-1/+1
| | |
* | | Set __version__ string in kafka/version.pyDana Powers2015-06-042-3/+2
| | |
* | | Check response.error for async producerViktor Shlapakov2015-06-031-19/+24
| | |
* | | Async producer: py2.6 backward compatibility fixViktor Shlapakov2015-06-031-2/+2
| | |
View Lorry Controller Status