summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Improve KafkaClient connect and ready handlingnode_not_readyDana Powers2016-04-041-26/+19
| | | | | | - merge _initiate and _finish into _maybe_connect - add connected(node_id) method - only short-circuit send() when not connected
* Improve Coordinator Error handlingDana Powers2016-04-041-8/+14
| | | | | | | - coordinator_unknown() should not check ready(node_id) - dont mark coordinator dead on not-ready or inflight-requests errors - improve coordinator and heartbeat logging - dont gate group metadata requests on ready() check [conn handles now]
* Drop now-redundant ready() check in Fetcher._handle_offset_responseDana Powers2016-04-041-3/+0
|
* Improve Broker connection handling of not-ready nodesDana Powers2016-04-041-24/+26
| | | | | | | - simplify connect state logic - add connecting() method to check state - add BrokerConnection details to exceptions - return NodeNotReady as Future if still connecting
* Changed transltae to replace to support python 3Tim Evens2016-03-301-1/+2
|
* Kafka IPv6 Support.Tim Evens2016-03-303-18/+63
| | | | | | IPv6 address without port can be defined as the IPv6 address. If the address is a hostname or if a port is included, then the address MUST be wrapped in brackets [] (E.g. [somehost]:1234 or [fd00:1001::2]:1234).
* Merge pull request #603 from dpkp/windowsDana Powers2016-03-243-10/+71
|\ | | | | Updates to support Windows
| * Handle windows socket error codes in BrokerConnectionDana Powers2016-03-171-4/+6
| |
| * Use socketpair for KafkaClient wake pipe windows compatibilityDana Powers2016-03-172-6/+65
| |
* | catch all errors thrown by _get_leader_for_partition in SimpleClientZack Dever2016-03-171-1/+2
| |
* | Merge pull request #602 from zackdever/KAFKA-2698Dana Powers2016-03-172-0/+13
|\ \ | | | | | | KAFKA-2698: add paused API
| * | KAFKA-2698: add paused APIZack Dever2016-03-162-0/+13
| |/
* | Add default_offset_commit_callback to KafkaConsumer DEFAULT_CONFIGSDana Powers2016-03-171-0/+1
| |
* | Bump version for developmentDana Powers2016-03-171-1/+1
|/
* Release 1.0.21.0.2Dana Powers2016-03-141-1/+1
|
* Attempt to clarify error message on consumer subscribe/assign assert failureDana Powers2016-03-141-2/+5
|
* remove unused import. needed a change to kick travis.Zack Dever2016-03-141-1/+0
|
* make Sender._topics_to_add a set instead of a listZack Dever2016-03-141-3/+4
|
* only make a metadata event if we don't know the partitionsZack Dever2016-03-141-1/+4
|
* KafkaConsumer.poll should sleep to prevent tight-loopsconsumer_poll_sleepDana Powers2016-03-141-1/+1
|
* Merge pull request #587 from dpkp/topic_partition_type_errorDana Powers2016-03-141-0/+17
|\ | | | | Raise TypeError in KafkaConsumer when partition is not a TopicPartition
| * Raise TypeError in KafkaConsumer when partition is not a TopicPartitiontopic_partition_type_errorDana Powers2016-03-141-0/+17
| |
* | Merge pull request #588 from dpkp/none_least_loaded_nodeDana Powers2016-03-142-0/+8
|\ \ | | | | | | Improve handling of least_loaded_node failure
| * | Check for None returned from least_loaded_node when no brokers are availablenone_least_loaded_nodeDana Powers2016-03-132-0/+8
| |/
* | Fix producer threading bug that could crash sender (dict changing during ↵accumulator_bugfixDana Powers2016-03-141-2/+4
|/ | | | iteration)
* Always truncate deallocated produce message bufferstruncate_bufferDana Powers2016-03-131-12/+5
|
* Add ignore_leadernotavailable kwarg to SimpleClient.load_metadata_for_topicsDana Powers2016-03-133-11/+15
|
* Add optional timeout parameter to KafkaProducer.flush()Dana Powers2016-03-132-9/+13
|
* Fix for FutureProduceResult.await on python2.6Dana Powers2016-03-131-1/+2
|
* Consumer should timeout internal iterator if heartbeat ttl is expiredconsumer_heartbeat_fixesDana Powers2016-03-121-3/+15
|
* factor group checking logic to KafkaConsumer._use_consumer_group()Dana Powers2016-03-121-24/+37
|
* Log successful heartbeat as INFO; improve heartbeat response loggingDana Powers2016-03-121-11/+12
|
* HeartbeatTask should reschedule heartbeat on coordinator_unknown()Dana Powers2016-03-121-2/+6
|
* Merge pull request #567 from twm/patch-1Dana Powers2016-03-091-1/+1
|\ | | | | Silence suprious warnings
| * Update base.pyTom Most2016-02-261-1/+1
| | | | | | | | | | | | | | | | | | Our app uses `SimpleProducer` and logs lots of these warnings (from line 438): producer.stop() called, but producer is not async This destructor appears to be the cause. (Also, is it wise to do a thread join from a destructor?)
* | Bug fix: KafkaConsumer.position()Stefán Þorvarðarson2016-03-091-1/+1
| | | | | | | | | | Method KafkaConsumer.position() was not refreshing position correctly when calling self._update_fetch_positions().
* | Fix typo ifr.future.fail => ifr.future.failureMorten Lied Johansen2016-02-261-1/+1
|/
* Bump version for development of next releaseDana Powers2016-02-221-1/+1
|
* Release 1.0.11.0.1Dana Powers2016-02-191-1/+1
|
* Mock client.ready() call to test coordinator offset fetch requestDana Powers2016-02-191-1/+2
|
* Catch duplicate batch.done() calls -- this can happen if we maybe_expire ↵Dana Powers2016-02-181-1/+4
| | | | then process a response errback
* Warn if pending batches failed during flushDana Powers2016-02-181-0/+3
|
* Fix concurrency bug in RecordAccumulator.ready()Dana Powers2016-02-181-2/+6
|
* Some attributes may not exist in __del__ if we failed assertionsDana Powers2016-02-182-2/+2
|
* Fix bug in SimpleBufferPool memory condition waiting / timeoutDana Powers2016-02-181-4/+5
|
* More friendly warning when offset fetch request returns unknown topic / ↵Dana Powers2016-02-181-1/+2
| | | | partition
* Verify node ready before sending offset fetch request from coordinatorDana Powers2016-02-181-0/+5
|
* Merge pull request #558 from dpkp/batch_size_zeroDana Powers2016-02-182-5/+7
|\ | | | | Support batch_size = 0 in producer buffers
| * Support batch_size = 0 in producer buffersbatch_size_zeroDana Powers2016-02-172-5/+7
| |
* | Merge pull request #557 from dpkp/socket_buffer_size_optionalDana Powers2016-02-184-18/+26
|\ \ | | | | | | Dont override system rcvbuf or sndbuf unless user configures explicitly