summaryrefslogtreecommitdiff
path: root/kafka/producer
Commit message (Collapse)AuthorAgeFilesLines
* Remove unused importskafka-3318Dana Powers2016-04-053-6/+1
|
* KAFKA-3013: Include topic-partition in exception for expired batchesDana Powers2016-04-051-1/+4
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-056-14/+12
|
* Update max.block.ms docstringDana Powers2016-04-041-3/+5
|
* remove unused import. needed a change to kick travis.Zack Dever2016-03-141-1/+0
|
* make Sender._topics_to_add a set instead of a listZack Dever2016-03-141-3/+4
|
* only make a metadata event if we don't know the partitionsZack Dever2016-03-141-1/+4
|
* Fix producer threading bug that could crash sender (dict changing during ↵accumulator_bugfixDana Powers2016-03-141-2/+4
| | | | iteration)
* Always truncate deallocated produce message bufferstruncate_bufferDana Powers2016-03-131-12/+5
|
* Add ignore_leadernotavailable kwarg to SimpleClient.load_metadata_for_topicsDana Powers2016-03-131-1/+1
|
* Add optional timeout parameter to KafkaProducer.flush()Dana Powers2016-03-132-9/+13
|
* Fix for FutureProduceResult.await on python2.6Dana Powers2016-03-131-1/+2
|
* Update base.pyTom Most2016-02-261-1/+1
| | | | | | | | | Our app uses `SimpleProducer` and logs lots of these warnings (from line 438): producer.stop() called, but producer is not async This destructor appears to be the cause. (Also, is it wise to do a thread join from a destructor?)
* Catch duplicate batch.done() calls -- this can happen if we maybe_expire ↵Dana Powers2016-02-181-1/+4
| | | | then process a response errback
* Warn if pending batches failed during flushDana Powers2016-02-181-0/+3
|
* Fix concurrency bug in RecordAccumulator.ready()Dana Powers2016-02-181-2/+6
|
* Some attributes may not exist in __del__ if we failed assertionsDana Powers2016-02-181-1/+1
|
* Fix bug in SimpleBufferPool memory condition waiting / timeoutDana Powers2016-02-181-4/+5
|
* Merge pull request #558 from dpkp/batch_size_zeroDana Powers2016-02-182-5/+7
|\ | | | | Support batch_size = 0 in producer buffers
| * Support batch_size = 0 in producer buffersbatch_size_zeroDana Powers2016-02-172-5/+7
| |
* | Dont override system rcvbuf or sndbuf unless user configures explicitlysocket_buffer_size_optionalDana Powers2016-02-171-4/+6
|/
* Cleanup docstring nested indent (acks values)Dana Powers2016-02-151-9/+10
|
* Cleaner event handling in _wait_on_metadataDana Powers2016-02-151-15/+9
|
* Remove unused internal sender lockDana Powers2016-02-152-24/+20
|
* Revisit _wait_on_metadata to address timeout and error handling (Issue 539)Dana Powers2016-02-151-20/+19
|
* Fixup RequestTimeoutError -> RequestTimedOutErrorDana Powers2016-02-151-1/+1
|
* Add more debug/trace statements to sender loopDana Powers2016-02-021-0/+2
|
* Fix accumulator bug: expired batches should be removed from the internal queueDana Powers2016-02-021-0/+10
|
* Add support for LZ4 compressed messages using python-lz4 moduleDana Powers2016-01-253-4/+5
|
* Add KafkaProducer to kafka and kafka.producer module importsDana Powers2016-01-241-1/+3
|
* Implement new KafkaProducer, mimicing java client interface / designDana Powers2016-01-241-0/+496
|
* Sender class to manage background IO for KafkaProducerDana Powers2016-01-241-0/+272
|
* RecordAccumulator and RecordBatch, for use by async batching KafkaProducerDana Powers2016-01-241-0/+500
|
* Add thread-aware futures for use with KafkaProducerDana Powers2016-01-241-0/+66
|
* Add MessageSetBuffer and SimpleBufferPool to manage producer messagesDana Powers2016-01-241-0/+388
|
* Merge branch '0.9'Dana Powers2016-01-073-43/+51
|\ | | | | | | | | | | | | | | Conflicts: kafka/codec.py kafka/version.py test/test_producer.py test/test_producer_integration.py
| * Docstring updatesDana Powers2016-01-071-18/+35
| |
| * Disable pylint errors for py2/py3 compatibility workaroundsDana Powers2016-01-011-3/+4
| |
| * Use log exception for metadata failure in async producerDana Powers2016-01-011-2/+2
| |
| * Rename TopicAndPartition -> TopicPartitionDana Powers2015-12-281-2/+2
| |
| * Drop kafka_bytestringDana Powers2015-12-103-11/+0
| |
| * Update references to kafka.common Request/Response (now Payload)Dana Powers2015-12-091-8/+9
| |
* | Handle new topic creation / LeaderNotAvailableError in initial ↵Dana Powers2015-12-161-1/+1
|/ | | | SimpleProducer.send_messages call
* Log deprecation warning for timeout argument in Producer.stop()Dana Powers2015-12-061-3/+7
|
* Producer.stop() now blocks until async thread completes (drop confusing ↵async_producer_stopDana Powers2015-12-051-7/+12
| | | | timeout arg)
* client.reinit() can raise an exception; catch in async producerDana Powers2015-12-041-2/+10
|
* Merge pull request #467 from bschopman/masterDana Powers2015-12-021-1/+4
|\ | | | | Prevents crashing communication thread of async producer
| * Prevents crashing communication thread of async producerBalthasar Schopman2015-10-221-1/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash.
* | Merge pull request #454 from trbs/gzip_compressionlevelDana Powers2015-12-021-4/+8
|\ \ | | | | | | allow to specify compression level for codecs which support this
| * | allow to specify compression level for codecs which support thistrbs2015-09-121-4/+8
| |/
View Lorry Controller Status