summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
...
* | Merge pull request #420 from toddpalino/masterDana Powers2015-12-023-6/+197
|\ \ | | | | | | Initial support for consumer coordinator
| * | Support consumer metadata requeststpalino2015-07-013-6/+197
| |/ | | | | | | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator
* | Fix python3 / python2 comments re queue/QueueDana Powers2015-12-022-10/+10
| |
* | Add Murmur2Partitioner to kafka __all__ imports - fix issue 471Dana Powers2015-12-021-1/+1
| |
* | Merge pull request #473 from ecanzonieri/use_unblocking_io_for_aware_requestsDana Powers2015-12-022-18/+35
|\ \ | | | | | | Use unblocking io for broker aware requests
| * | Add tests. Bug fix. Rename socket_conn dict.Enrico Canzonieri2015-11-101-7/+7
| | |
| * | Unblocking broker aware requestEnrico Canzonieri2015-11-102-18/+35
| | |
* | | Merge pull request #467 from bschopman/masterDana Powers2015-12-022-2/+9
|\ \ \ | | | | | | | | Prevents crashing communication thread of async producer
| * | | Prevents crashing communication thread of async producerBalthasar Schopman2015-10-222-2/+9
| |/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash.
* | | Merge pull request #457 from saaros/block-for-number-of-messagesDana Powers2015-12-022-11/+18
|\ \ \ | | | | | | | | Consumers get_messages: allow blocking until some messages are received
| * | | Consumers get_messages: allow blocking until some messages are receivedOskari Saarenmaa2015-09-182-11/+18
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Modified MultiProcessConsumer's and SimpleConsumer's `block` argument to allow integer value which defines the number of messages to block for. This allows callers to ask for a high number of messages and block only until some of them are received. Otherwise callers would have to request messages one by one or block for some time.
* | | | Merge pull request #446 from zackdever/consumer-class-configsDana Powers2015-12-021-2/+3
|\ \ \ \ | | | | | | | | | | Set default config on consumer class to support subclass config changes.
| * | | | set default config on consumer class to support subclass config changes.Zack Dever2015-08-131-2/+3
| | |_|/ | |/| |
* | | | Merge pull request #456 from barricadeio/mp-retryDana Powers2015-12-023-46/+63
|\ \ \ \ | | | | | | | | | | Support retry semantics in MultiProcessConsumer
| * | | | Support retry semantics in MultiProcessConsumerRoss Duggan2015-09-143-46/+63
| | |/ / | |/| |
* | | | Merge pull request #454 from trbs/gzip_compressionlevelDana Powers2015-12-023-10/+17
|\ \ \ \ | | | | | | | | | | allow to specify compression level for codecs which support this
| * | | | allow to specify compression level for codecs which support thistrbs2015-09-123-10/+17
| |/ / /
* | | | Merge pull request #439 from chrischamberlin/fix-murmurDana Powers2015-12-021-10/+12
|\ \ \ \ | | | | | | | | | | Fix translation of Java murmur2 code, fix byte encoding for Python 3.
| * | | | Fix translation of Java murmur2 code, fix byte encoding for Python 3.Chris Chamberlin2015-07-281-10/+12
| | |/ / | |/| | | | | | | | | | | | | | | | | | Avoid further type changes when Murmur2Partitioner is passed a byte array. Change leftover-bytes logic to match the Java switch statement, and add tests to verify that partition selection matches Java implementation.
* | | | Merge pull request #435 from docker-hub/fix-producer-cleanup-logicDana Powers2015-12-021-1/+1
|\ \ \ \ | | | | | | | | | | Reworked the if statement logic to only call stop() on not-stopped producer objects
| * | | | Fixing https://github.com/mumrah/kafka-python/issues/434toli2015-07-241-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | Reworked the if statement logic to only call stop() on not-stopped objects. added tests
* | | | | Merge pull request #418 from scrapinghub/mp_partition_infoDana Powers2015-12-023-8/+10
|\ \ \ \ \ | | | | | | | | | | | | allow to retrieve partition info in mp consumer
| * | | | | allow to retrieve partition info in mp consumerMartin Olveyra2015-06-293-8/+10
| | |/ / / | |/| | |
* | | | | Merge pull request #409 from scrapinghub/feature-allow-null-payloadDana Powers2015-12-021-3/+9
|\ \ \ \ \ | |_|_|_|/ |/| | | | Allow null payload for deletion feature
| * | | | Exclude (null,null) pair for producerViktor Shlapakov2015-06-171-3/+9
| | | | |
| * | | | Allow null payload for deletion featureViktor Shlapakov2015-06-161-1/+1
| | | | |
* | | | | Merge pull request #436 from mutability/async-catch-unavailable-errorDana Powers2015-10-071-6/+11
|\ \ \ \ \ | |_|_|_|/ |/| | | | Catch KafkaUnavailableError in _send_broker_aware_request
| * | | | Init responses before we use it.Oliver Jowett2015-07-241-1/+1
| | | | |
| * | | | Errors -> Error typoOliver Jowett2015-07-201-1/+1
| | | | |
| * | | | Treat KafkaUnavailableError like other errors.Oliver Jowett2015-07-191-5/+10
| | |/ / | |/| |
* | | | Use debug logging level for metadata requestEnrico Canzonieri2015-07-211-2/+2
|/ / /
* | | Merge pull request #412 from haosdent/seek_absolute_offsetDana Powers2015-06-201-17/+46
|\ \ \ | | | | | | | | fix #410 SimpleConsumer cannot seek to an absolute offset.
| * | | fix #410 SimpleConsumer cannot seek to an absolute offset.haosdent2015-06-201-17/+46
| | | |
* | | | Lower logging level on replica not available and commitEnrico Canzonieri2015-06-192-2/+2
|/ / /
* | | Set development version until next releaseDana Powers2015-06-121-1/+1
| |/ |/|
* | Release 0.9.4v0.9.4Dana Powers2015-06-121-1/+1
| |
* | Add KafkaClient.topics property to get list of known topicsDana Powers2015-06-111-0/+4
| |
* | Merge pull request #378 from dpkp/murmur2_hashed_partitionerDana Powers2015-06-102-3/+98
|\ \ | | | | | | Use MurmurHash2 for key partition hashing
| * | Use MurmurHash2 for key partition hashingDana Powers2015-06-102-3/+98
| | |
* | | Refactor SimpleConsumer get_messages and _fetchDana Powers2015-06-101-29/+33
| | | | | | | | | | | | | | | - attempt to make these easier to read - add marginal retry logic to internal _fetch loop
* | | Merge pull request #405 from dpkp/log_error_typeDana Powers2015-06-102-7/+11
|\ \ \ | | | | | | | | Log response error types in consumer and producer logs
| * | | Add error type to SimpleConsumer error loggingDana Powers2015-06-101-5/+8
| | | |
| * | | Log response error type in async producerDana Powers2015-06-101-2/+3
| |/ /
* | | Change SimpleConsumer.reset_partition_offset to return offset / None on ↵Dana Powers2015-06-101-5/+19
| | | | | | | | | | | | failure (dont raise exception)
* | | Change Consumer commit() to return True/False and log error; dont raise ↵Dana Powers2015-06-101-12/+18
|/ / | | | | | | client exceptions
* | Fix KafkaClient request / response orderingDana Powers2015-06-101-10/+20
|/
* Add send/receive debug logging to async producerDana Powers2015-06-091-8/+11
|
* KafkaClient log new broker and topic metadata received as INFODana Powers2015-06-091-2/+2
|
* KafkaClient: log responses by requestId for debuggingDana Powers2015-06-091-1/+4
|
* KafkaClient: log requestId on ConnectionError instead of hexdump of request ↵Dana Powers2015-06-091-6/+5
| | | | contents
View Lorry Controller Status