summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
...
* Merge pull request #398 from dpkp/kafka_consumer_failed_payloadsDana Powers2015-06-091-37/+61
|\ | | | | Kafka consumer failed payloads
| * KafkaConsumer style nitsDana Powers2015-06-081-26/+48
| |
| * Update KafkaConsumer to handle request-specific FailedPayloadsErrorsDana Powers2015-06-081-11/+13
| |
* | Support sync_fail_on_error kwarg in ProducerDana Powers2015-06-091-2/+12
| |
* | Use a list, not request_tries.keys(), to track requests / responses in async ↵Dana Powers2015-06-091-2/+4
|/ | | | producer
* Fixup for loop vars in kafka/protocol.pyDana Powers2015-06-081-14/+14
|
* Improve kafka client debug request/response loggingDana Powers2015-06-081-5/+5
|
* Prefer single quotes for stringsDana Powers2015-06-081-14/+12
|
* Add a few extra docstring comments about thread-safe clients/connectionsDana Powers2015-06-083-5/+12
|
* Dont maintain all producer args / kwargs in subclass __init__ and docstrings ↵Dana Powers2015-06-082-91/+24
| | | | -- just refer to super class (Producer)
* Cleanup imports in kafka/client and kafka/consumerDana Powers2015-06-083-23/+21
|
* Merge pull request #389 from dpkp/task_done_key_errorDana Powers2015-06-081-2/+10
|\ | | | | KafkaConsumer.task_done: warn and skip unrecognized topic-partitions
| * KafkaConsumer.task_done - warn and skip messages from unrecognized ↵Dana Powers2015-06-061-2/+10
| | | | | | | | topic-partitions
* | SimpleConsumer should refresh metadata and retry on leadership changes; only ↵Dana Powers2015-06-081-1/+4
| | | | | | | | raise on UnknownTopicOrPartition
* | Merge pull request #380 from dpkp/multiprocess_consumer_partitionsDana Powers2015-06-081-3/+7
|\ \ | | | | | | Support optional partitions kwarg in MultiProcessConsumer
| * | Support optional partitions kwarg in MultiProcessConsumerDana Powers2015-05-171-3/+7
| | |
* | | Merge pull request #379 from dpkp/deprecate_keyed_producer_sendDana Powers2015-06-081-5/+6
|\ \ \ | | | | | | | | Deprecate KeyedProducer.send in favor of send_messages
| * | | Deprecate KeyedProducer.send in favor of send_messages -- keep interface ↵Dana Powers2015-05-171-5/+6
| | | | | | | | | | | | | | | | consistent
* | | | try to fix uncaught FailedPayloadsErrorreAsOn20102015-06-092-1/+10
| | | |
* | | | Add async_stop_timeout parameter to tune how long to let the producerDana Powers2015-06-061-3/+26
| | | | | | | | | | | | | | | | | | | | keep trying to send messages before timing out. Log an error if async producer was stopped before all messages sent.
* | | | Dont stop async producer until all pending messages have been processedDana Powers2015-06-061-1/+1
| | | |
* | | | Update Producer class docstringDana Powers2015-06-061-4/+25
| | | |
* | | | Deprecate async producer batch_send kwarg -- use 'async' insteadDana Powers2015-06-063-26/+44
| | | |
* | | | Log retries and failed messages in async producer (configurable as full ↵Dana Powers2015-06-061-12/+24
| | | | | | | | | | | | | | | | messages or hash())
* | | | PR 331 fixup: do not attempt to get new messages if there are pending retriesDana Powers2015-06-061-4/+9
| | | |
* | | | PR 331 fixup: Rename reqs dict to request_triesDana Powers2015-06-061-9/+13
| | | |
* | | | PR 331 fixup: Dont need try/except when calling send_produce_requests with ↵Dana Powers2015-06-061-15/+16
| | | | | | | | | | | | | | | | fail_on_error=False
* | | | PR 331 fixup: log warnings on async producer backoff and metadata refreshDana Powers2015-06-061-1/+2
| | | |
* | | | PR 331 fixup: Support unlimited retries with async_retry_limit=NoneDana Powers2015-06-061-6/+8
| | | | | | | | | | | | | | | | Async producer defaults are now retry everything always w/ 100ms backoff
* | | | PR 331 fixup: fix _handle_error closureDana Powers2015-06-061-16/+17
| | | |
* | | | PR 331 fixup: Fix kafka.common imports from kafka.producer.base (one import ↵Dana Powers2015-06-061-3/+2
| | | | | | | | | | | | | | | | block, add ProduceResponse)
* | | | KafkaClient should try/except ConnnectionError when calling _get_connDana Powers2015-06-061-2/+2
| | | |
* | | | FailedPayloadsError now only has a single payload; use .payload attributeDana Powers2015-06-061-2/+2
| | | | | | | | | | | | | | | | .failed_payloads attribute has been removed.
* | | | Raise an error if we attempt to group duplicate topic-partition payloadsDana Powers2015-06-062-0/+5
| | | | | | | | | | | | | | | | - previously this would simply drop one of the payloads
* | | | Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-069-9/+17
| |_|/ |/| |
* | | Fix import error in kafka/producer/base.pyDana Powers2015-06-061-1/+1
| | |
* | | Set __version__ string in kafka/version.pyDana Powers2015-06-042-3/+2
| | |
* | | Check response.error for async producerViktor Shlapakov2015-06-031-19/+24
| | |
* | | Async producer: py2.6 backward compatibility fixViktor Shlapakov2015-06-031-2/+2
| | |
* | | Improve async producer code: logic and style fixesViktor Shlapakov2015-06-034-43/+55
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - send_producer_request with fail_on_error=False to retry failed reqs only - using an internal dict with with namedtuple keys for retry counters - refresh metadata on refresh_error irrespective to retries options - removed infinite retries (retry_options.limit=None) as an over-feature - separate producer init args for retries options (limit,backoff,on_timeouts) - AsyncProducerQueueFull returns a list of failed messages - producer tests improved thanks to @rogaha and @toli
* | | Change backoff message log levelViktor Shlapakov2015-06-031-1/+1
| | |
* | | Fix async producer queue put argumentsViktor Shlapakov2015-06-031-2/+4
| | |
* | | Fix names for async retries opts, add timeout for putViktor Shlapakov2015-06-034-20/+34
| | |
* | | Simplification of retry logicViktor Shlapakov2015-06-032-31/+29
| | |
* | | Fix small issues with names/testsViktor Shlapakov2015-06-032-9/+11
| | |
* | | async queue: refactored code; add one more testEduard Iskandarov2015-06-031-2/+7
| | |
* | | add producer send batch queue overfilled testИскандаров Эдуард2015-06-031-1/+7
| | |
* | | Disable retry on timeouts by default (old behaviour)Viktor Shlapakov2015-06-031-1/+1
| | |
* | | Clean and simplify retry logicViktor Shlapakov2015-06-032-60/+49
| | |
* | | Arg fixes for base/keyed producersViktor Shlapakov2015-06-032-4/+2
| | |
View Lorry Controller Status