summaryrefslogtreecommitdiff
path: root/kafka/producer/base.py
Commit message (Collapse)AuthorAgeFilesLines
* Use logging's built-in string interpolationJeff Widman2017-07-071-2/+1
|
* Add sphinx formatting to hyperlink methods (#898)Jeff Widman2017-03-031-3/+5
|
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-2/+2
|
* Fix typosJeff Widman2016-11-141-1/+1
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-5/+4
|
* Update base.pyTom Most2016-02-261-1/+1
| | | | | | | | | Our app uses `SimpleProducer` and logs lots of these warnings (from line 438): producer.stop() called, but producer is not async This destructor appears to be the cause. (Also, is it wise to do a thread join from a destructor?)
* Fixup RequestTimeoutError -> RequestTimedOutErrorDana Powers2016-02-151-1/+1
|
* Docstring updatesDana Powers2016-01-071-18/+35
|
* Disable pylint errors for py2/py3 compatibility workaroundsDana Powers2016-01-011-3/+4
|
* Use log exception for metadata failure in async producerDana Powers2016-01-011-2/+2
|
* Rename TopicAndPartition -> TopicPartitionDana Powers2015-12-281-2/+2
|
* Drop kafka_bytestringDana Powers2015-12-101-6/+0
|
* Update references to kafka.common Request/Response (now Payload)Dana Powers2015-12-091-8/+9
|
* Log deprecation warning for timeout argument in Producer.stop()Dana Powers2015-12-061-3/+7
|
* Producer.stop() now blocks until async thread completes (drop confusing ↵async_producer_stopDana Powers2015-12-051-7/+12
| | | | timeout arg)
* client.reinit() can raise an exception; catch in async producerDana Powers2015-12-041-2/+10
|
* Merge pull request #467 from bschopman/masterDana Powers2015-12-021-1/+4
|\ | | | | Prevents crashing communication thread of async producer
| * Prevents crashing communication thread of async producerBalthasar Schopman2015-10-221-1/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash.
* | Merge pull request #454 from trbs/gzip_compressionlevelDana Powers2015-12-021-4/+8
|\ \ | | | | | | allow to specify compression level for codecs which support this
| * | allow to specify compression level for codecs which support thistrbs2015-09-121-4/+8
| |/
* | Merge pull request #435 from docker-hub/fix-producer-cleanup-logicDana Powers2015-12-021-1/+1
|\ \ | | | | | | Reworked the if statement logic to only call stop() on not-stopped producer objects
| * | Fixing https://github.com/mumrah/kafka-python/issues/434toli2015-07-241-1/+1
| |/ | | | | | | | | Reworked the if statement logic to only call stop() on not-stopped objects. added tests
* | Merge pull request #409 from scrapinghub/feature-allow-null-payloadDana Powers2015-12-021-3/+9
|\ \ | |/ |/| Allow null payload for deletion feature
| * Exclude (null,null) pair for producerViktor Shlapakov2015-06-171-3/+9
| |
| * Allow null payload for deletion featureViktor Shlapakov2015-06-161-1/+1
| |
* | Log response error type in async producerDana Powers2015-06-101-2/+3
|/
* Add send/receive debug logging to async producerDana Powers2015-06-091-8/+11
|
* Support sync_fail_on_error kwarg in ProducerDana Powers2015-06-091-2/+12
|
* Use a list, not request_tries.keys(), to track requests / responses in async ↵Dana Powers2015-06-091-2/+4
| | | | producer
* Add a few extra docstring comments about thread-safe clients/connectionsDana Powers2015-06-081-0/+2
|
* Add async_stop_timeout parameter to tune how long to let the producerDana Powers2015-06-061-3/+26
| | | | | keep trying to send messages before timing out. Log an error if async producer was stopped before all messages sent.
* Dont stop async producer until all pending messages have been processedDana Powers2015-06-061-1/+1
|
* Update Producer class docstringDana Powers2015-06-061-4/+25
|
* Deprecate async producer batch_send kwarg -- use 'async' insteadDana Powers2015-06-061-22/+40
|
* Log retries and failed messages in async producer (configurable as full ↵Dana Powers2015-06-061-12/+24
| | | | messages or hash())
* PR 331 fixup: do not attempt to get new messages if there are pending retriesDana Powers2015-06-061-4/+9
|
* PR 331 fixup: Rename reqs dict to request_triesDana Powers2015-06-061-9/+13
|
* PR 331 fixup: Dont need try/except when calling send_produce_requests with ↵Dana Powers2015-06-061-15/+16
| | | | fail_on_error=False
* PR 331 fixup: log warnings on async producer backoff and metadata refreshDana Powers2015-06-061-1/+2
|
* PR 331 fixup: Support unlimited retries with async_retry_limit=NoneDana Powers2015-06-061-6/+8
| | | | Async producer defaults are now retry everything always w/ 100ms backoff
* PR 331 fixup: fix _handle_error closureDana Powers2015-06-061-16/+17
|
* PR 331 fixup: Fix kafka.common imports from kafka.producer.base (one import ↵Dana Powers2015-06-061-3/+2
| | | | block, add ProduceResponse)
* Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-061-1/+1
|
* Fix import error in kafka/producer/base.pyDana Powers2015-06-061-1/+1
|
* Check response.error for async producerViktor Shlapakov2015-06-031-19/+24
|
* Async producer: py2.6 backward compatibility fixViktor Shlapakov2015-06-031-2/+2
|
* Improve async producer code: logic and style fixesViktor Shlapakov2015-06-031-24/+33
| | | | | | | | | | - send_producer_request with fail_on_error=False to retry failed reqs only - using an internal dict with with namedtuple keys for retry counters - refresh metadata on refresh_error irrespective to retries options - removed infinite retries (retry_options.limit=None) as an over-feature - separate producer init args for retries options (limit,backoff,on_timeouts) - AsyncProducerQueueFull returns a list of failed messages - producer tests improved thanks to @rogaha and @toli
* Change backoff message log levelViktor Shlapakov2015-06-031-1/+1
|
* Fix async producer queue put argumentsViktor Shlapakov2015-06-031-2/+4
|
View Lorry Controller Status