summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Fix typo in docblockMatthias Endler2015-12-181-1/+1
|
* Handle new topic creation / LeaderNotAvailableError in initial ↵Dana Powers2015-12-161-1/+1
| | | | SimpleProducer.send_messages call
* Fix _mp_consume queue variable name conflictDana Powers2015-12-091-2/+2
|
* Bump version for development of next releaseDana Powers2015-12-091-1/+1
|
* Release 0.9.5v0.9.5Dana Powers2015-12-071-1/+1
|
* Merge pull request #426 from ucarion/ucarion-kafkaconsumer-closeDana Powers2015-12-061-0/+4
|\ | | | | Add KafkaConsumer#close
| * Add KafkaConsumer#closeUlysse Carion2015-07-071-0/+4
| |
* | Log deprecation warning for timeout argument in Producer.stop()Dana Powers2015-12-061-3/+7
| |
* | Producer.stop() now blocks until async thread completes (drop confusing ↵async_producer_stopDana Powers2015-12-051-7/+12
| | | | | | | | timeout arg)
* | Revert broken send_produce_request try/except from PR 467 (resps=None)Dana Powers2015-12-051-5/+1
| |
* | Fix requestId handling in send_broker_aware_requestDana Powers2015-12-041-2/+2
| |
* | client.reinit() can raise an exception; catch in async producerDana Powers2015-12-041-2/+10
| |
* | new pylint disables for pylint 1.5.1Zack Dever2015-12-022-2/+2
| | | | | | | | | | tested locally with `pylint --rcfile=pylint.rc -E kafka test`. should pass travis builds.
* | Merge pull request #420 from toddpalino/masterDana Powers2015-12-023-6/+197
|\ \ | | | | | | Initial support for consumer coordinator
| * | Support consumer metadata requeststpalino2015-07-013-6/+197
| |/ | | | | | | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator
* | Fix python3 / python2 comments re queue/QueueDana Powers2015-12-022-10/+10
| |
* | Add Murmur2Partitioner to kafka __all__ imports - fix issue 471Dana Powers2015-12-021-1/+1
| |
* | Merge pull request #473 from ecanzonieri/use_unblocking_io_for_aware_requestsDana Powers2015-12-022-18/+35
|\ \ | | | | | | Use unblocking io for broker aware requests
| * | Add tests. Bug fix. Rename socket_conn dict.Enrico Canzonieri2015-11-101-7/+7
| | |
| * | Unblocking broker aware requestEnrico Canzonieri2015-11-102-18/+35
| | |
* | | Merge pull request #467 from bschopman/masterDana Powers2015-12-022-2/+9
|\ \ \ | | | | | | | | Prevents crashing communication thread of async producer
| * | | Prevents crashing communication thread of async producerBalthasar Schopman2015-10-222-2/+9
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash.
* | | Merge pull request #457 from saaros/block-for-number-of-messagesDana Powers2015-12-022-11/+18
|\ \ \ | | | | | | | | Consumers get_messages: allow blocking until some messages are received
| * | | Consumers get_messages: allow blocking until some messages are receivedOskari Saarenmaa2015-09-182-11/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Modified MultiProcessConsumer's and SimpleConsumer's `block` argument to allow integer value which defines the number of messages to block for. This allows callers to ask for a high number of messages and block only until some of them are received. Otherwise callers would have to request messages one by one or block for some time.
* | | | Merge pull request #446 from zackdever/consumer-class-configsDana Powers2015-12-021-2/+3
|\ \ \ \ | | | | | | | | | | Set default config on consumer class to support subclass config changes.
| * | | | set default config on consumer class to support subclass config changes.Zack Dever2015-08-131-2/+3
| | |_|/ | |/| |
* | | | Merge pull request #456 from barricadeio/mp-retryDana Powers2015-12-023-46/+63
|\ \ \ \ | | | | | | | | | | Support retry semantics in MultiProcessConsumer
| * | | | Support retry semantics in MultiProcessConsumerRoss Duggan2015-09-143-46/+63
| | |/ / | |/| |
* | | | Merge pull request #454 from trbs/gzip_compressionlevelDana Powers2015-12-023-10/+17
|\ \ \ \ | | | | | | | | | | allow to specify compression level for codecs which support this
| * | | | allow to specify compression level for codecs which support thistrbs2015-09-123-10/+17
| |/ / /
* | | | Merge pull request #439 from chrischamberlin/fix-murmurDana Powers2015-12-021-10/+12
|\ \ \ \ | | | | | | | | | | Fix translation of Java murmur2 code, fix byte encoding for Python 3.
| * | | | Fix translation of Java murmur2 code, fix byte encoding for Python 3.Chris Chamberlin2015-07-281-10/+12
| | |/ / | |/| | | | | | | | | | | | | | | | | | Avoid further type changes when Murmur2Partitioner is passed a byte array. Change leftover-bytes logic to match the Java switch statement, and add tests to verify that partition selection matches Java implementation.
* | | | Merge pull request #435 from docker-hub/fix-producer-cleanup-logicDana Powers2015-12-021-1/+1
|\ \ \ \ | | | | | | | | | | Reworked the if statement logic to only call stop() on not-stopped producer objects
| * | | | Fixing https://github.com/mumrah/kafka-python/issues/434toli2015-07-241-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | Reworked the if statement logic to only call stop() on not-stopped objects. added tests
* | | | | Merge pull request #418 from scrapinghub/mp_partition_infoDana Powers2015-12-023-8/+10
|\ \ \ \ \ | | | | | | | | | | | | allow to retrieve partition info in mp consumer
| * | | | | allow to retrieve partition info in mp consumerMartin Olveyra2015-06-293-8/+10
| | |/ / / | |/| | |
* | | | | Merge pull request #409 from scrapinghub/feature-allow-null-payloadDana Powers2015-12-021-3/+9
|\ \ \ \ \ | |_|_|_|/ |/| | | | Allow null payload for deletion feature
| * | | | Exclude (null,null) pair for producerViktor Shlapakov2015-06-171-3/+9
| | | | |
| * | | | Allow null payload for deletion featureViktor Shlapakov2015-06-161-1/+1
| | | | |
* | | | | Merge pull request #436 from mutability/async-catch-unavailable-errorDana Powers2015-10-071-6/+11
|\ \ \ \ \ | |_|_|_|/ |/| | | | Catch KafkaUnavailableError in _send_broker_aware_request
| * | | | Init responses before we use it.Oliver Jowett2015-07-241-1/+1
| | | | |
| * | | | Errors -> Error typoOliver Jowett2015-07-201-1/+1
| | | | |
| * | | | Treat KafkaUnavailableError like other errors.Oliver Jowett2015-07-191-5/+10
| | |/ / | |/| |
* | | | Use debug logging level for metadata requestEnrico Canzonieri2015-07-211-2/+2
|/ / /
* | | Merge pull request #412 from haosdent/seek_absolute_offsetDana Powers2015-06-201-17/+46
|\ \ \ | | | | | | | | fix #410 SimpleConsumer cannot seek to an absolute offset.
| * | | fix #410 SimpleConsumer cannot seek to an absolute offset.haosdent2015-06-201-17/+46
| | | |
* | | | Lower logging level on replica not available and commitEnrico Canzonieri2015-06-192-2/+2
|/ / /
* | | Set development version until next releaseDana Powers2015-06-121-1/+1
| |/ |/|
* | Release 0.9.4v0.9.4Dana Powers2015-06-121-1/+1
| |
* | Add KafkaClient.topics property to get list of known topicsDana Powers2015-06-111-0/+4
| |
View Lorry Controller Status