summaryrefslogtreecommitdiff
path: root/kafka/client_async.py
Commit message (Collapse)AuthorAgeFilesLines
* Improve KafkaClient connect and ready handlingnode_not_readyDana Powers2016-04-041-26/+19
| | | | | | - merge _initiate and _finish into _maybe_connect - add connected(node_id) method - only short-circuit send() when not connected
* Kafka IPv6 Support.Tim Evens2016-03-301-4/+6
| | | | | | IPv6 address without port can be defined as the IPv6 address. If the address is a hostname or if a port is included, then the address MUST be wrapped in brackets [] (E.g. [somehost]:1234 or [fd00:1001::2]:1234).
* Use socketpair for KafkaClient wake pipe windows compatibilityDana Powers2016-03-171-6/+8
|
* Check for None returned from least_loaded_node when no brokers are availablenone_least_loaded_nodeDana Powers2016-03-131-0/+4
|
* Merge pull request #557 from dpkp/socket_buffer_size_optionalDana Powers2016-02-181-4/+6
|\ | | | | Dont override system rcvbuf or sndbuf unless user configures explicitly
| * Dont override system rcvbuf or sndbuf unless user configures explicitlysocket_buffer_size_optionalDana Powers2016-02-171-4/+6
| |
* | break up some circular references and close client wake pipe on __del__aisch2016-02-161-0/+4
|/
* bootstrap node should be last resort in least_loaded_node()Dana Powers2016-02-151-0/+7
|
* KafkaClient.connection_delay should return 0 when connecting to avoid ↵Dana Powers2016-02-151-4/+10
| | | | unnecessary sleep in poll
* Fixup RequestTimeoutError -> RequestTimedOutErrorDana Powers2016-02-151-1/+1
|
* Improve KafkaClient.check_version()Dana Powers2016-02-151-13/+27
| | | | | | | - only raise AssertionErrors if strict=True (default False) - connect timeout is configurable (default 2secs) - monkeypatch request_timeout_ms config and check for RequestTimeoutErrors - add assertion error message
* Implement KafkaConsumer.topics()Dana Powers2016-02-011-1/+5
| | | | | - add ClusterMetadata.need_all_topic_metadata attribute - client requests metadata for all topics if attribute True
* Add error 104 / Connection reset by peer to expected check_version errorsDana Powers2016-01-251-2/+2
|
* Small KafkaClient.check_version() improvementsDana Powers2016-01-251-3/+20
| | | | | - filter connection failure logging during version check - raise UnrecognizedBrokerVersion if we cant id broker
* Log new KafkaClient under kafka.client until files are mergedDana Powers2016-01-251-1/+1
|
* Write bytes to wake_fdDana Powers2016-01-241-1/+1
|
* KafkaClient.add_topic() -- for use by async producerDana Powers2016-01-231-0/+15
|
* Optionally sleep in KafkaClient.poll(), add KafkaClient.wakeup()Dana Powers2016-01-231-7/+37
|
* Add back connection_delay method to KafkaClient - used by KafkaProducerDana Powers2016-01-181-0/+20
| | | | This reverts commit 88cf1b5e4551cd96322aa812fa482bf0f978060a.
* Remove sleep call in client.poll -- expect callers to manage this and log ↵Dana Powers2016-01-121-6/+5
| | | | warning
* Receive all available responses in client._pollDana Powers2016-01-101-3/+4
|
* If a completed future is polled, do not blockDana Powers2016-01-101-6/+13
|
* Avoid CPU spinnning when there are no sockets to readDana Powers2016-01-101-0/+8
|
* Fix delayed_task timeout commit 45d26b6Dana Powers2016-01-101-5/+6
|
* Check delayed task timeout in client.poll()Dana Powers2016-01-101-2/+4
|
* Refresh metadata on failed connection attemptshandle_disconnectDana Powers2016-01-091-0/+5
|
* Add metadata_max_age_ms and retry_backoff_ms options to async clientDana Powers2016-01-071-0/+8
|
* Fix future redefine bug in client.pollDana Powers2016-01-041-3/+3
|
* Catch py3 ConnectionErrorsDana Powers2016-01-031-3/+9
|
* Add KafkaClient.check_version() to guess broker versionDana Powers2016-01-031-0/+52
|
* Fix bug in _initiate_connect preventing reconnect to 'bootstrap'Dana Powers2016-01-031-3/+3
|
* sys.maxint not supported in python3Dana Powers2016-01-011-4/+3
|
* Prefer assert or more-specific error to IllegalState / IllegalArgumentDana Powers2015-12-301-7/+7
|
* More Docstring ImprovementsDana Powers2015-12-301-60/+131
|
* Fix blacked_out typo in least_loaded_nodeDana Powers2015-12-301-1/+1
|
* Rename KafkaClient.connection_failed -> is_disconnectedDana Powers2015-12-301-1/+1
|
* Improve removed tasks handing in DelayedTaskQueue.pop_readyDana Powers2015-12-301-2/+5
|
* Remove unnecessary calls in KafkaClient._pollDana Powers2015-12-301-13/+13
| | | | | - Dont process connections; outer poll() loop does this now - Only recv connections that select says are readable
* Resolve delayed task futures in KafkaClient.pollDana Powers2015-12-301-3/+6
|
* Remove unused connection_delay method from KafkaClientDana Powers2015-12-301-18/+0
|
* Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-291-44/+29
|
* New async KafkaClient, based on java NetworkClient and ConsumerClientDana Powers2015-12-281-0/+502
- Support async client bootstrap retries after exponential backoff - Attempt to finish_connect if still connecting in KafkaClient.ready(node_id) - Run full async loop while waiting for futures in KafkaClient.poll() - Add more fallbacks to KafkaClient.least_loaded_node; worst case, retry boostrap