summaryrefslogtreecommitdiff
path: root/kafka/client.py
Commit message (Collapse)AuthorAgeFilesLines
* Remove SimpleClient, Producer, Consumer, Unittest (#1196)Jeff Widman2019-10-111-719/+0
| | | | | | | | | | | | | | | | | | In the 2.0 release, we're removing: * `SimpleClient` * `SimpleConsumer` * `SimpleProducer` * Old partitioners used by `SimpleProducer`; these are superceded by the `DefaultPartitioner` These have been deprecated for several years in favor of `KafkaClient` / `KafkaConsumer` / `KafkaProducer`. Since 2.0 allows breaking changes, we are removing the deprecated classes. Additionally, since the only usage of `unittest` was in tests for these old Simple* clients, this also drops `unittest` from the library. All tests now run under `pytest`.
* Be explicit with tuples for %s formattingJeff Widman2018-11-181-1/+1
| | | | Fix #1633
* Stop shadowing `ConnectionError`Jeff Widman2018-05-231-6/+6
| | | | | | | | | | In Python3, `ConnectionError` is a native exception. So rename our custom one to `KafkaConnectionError` to prevent accidentally shadowing the native one. Note that there are still valid uses of `ConnectionError` in this code. They already expect a native Python3 `ConnectionError`, and also already handle the Python2 compatibility issues.
* Add BrokerConnection.connect_blocking() (#1411)Dana Powers2018-03-091-11/+1
|
* Update string representation of SimpleClientAndre Araujo2018-02-211-1/+1
|
* Move callback processing from BrokerConnection to KafkaClientpending_completionsDana Powers2017-10-151-9/+13
|
* Merge pull request #1213 from ↵Taras Voinarovskyi2017-09-131-9/+9
|\ | | | | | | | | dpkp/1212-stop-using-mutable-types-for-default-arg-values Stop using mutable types for default arg values
| * Stop using mutable types for default arg values1212-stop-using-mutable-types-for-default-arg-valuesJeff Widman2017-09-121-9/+9
| | | | | | | | | | | | | | | | Using mutable types for default args is typically a no-no unless their surprising behavior is being explicitly abused, for an explanation see: http://effbot.org/zone/default-values.htm Fix #1212
* | Fix typoJeff Widman2017-09-121-1/+1
|/
* Derive all api classes from Request / Response base classes (#1030)Dana Powers2017-03-141-6/+2
|
* Add sphinx formatting to hyperlink methods (#898)Jeff Widman2017-03-031-7/+7
|
* Add send_list_offset_request for searching offset by timestamp (#1001)charsyam2017-03-021-0/+10
|
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-13/+12
|
* Use select to poll sockets for read to reduce CPU usage (#958)Jianbin Wei2017-02-031-0/+10
|
* Fix typosJeff Widman2016-11-141-1/+1
|
* Always absolute_importabsolute_importDana Powers2016-08-021-0/+2
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Delete KafkaConnection class (#769)Dana Powers2016-07-171-1/+2
|
* Add rack to BrokerMetadata - it is always None when using MetadataRequest v0Dana Powers2016-07-161-3/+3
|
* Raise ConnectionError immediately on disconnect in SimpleClient._get_connDana Powers2016-04-081-1/+8
|
* Refactor SimpleClient connect logic to support multiple connecting statesDana Powers2016-04-071-11/+26
|
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-7/+7
|
* Kafka IPv6 Support.Tim Evens2016-03-301-8/+15
| | | | | | IPv6 address without port can be defined as the IPv6 address. If the address is a hostname or if a port is included, then the address MUST be wrapped in brackets [] (E.g. [somehost]:1234 or [fd00:1001::2]:1234).
* catch all errors thrown by _get_leader_for_partition in SimpleClientZack Dever2016-03-171-1/+2
|
* Add ignore_leadernotavailable kwarg to SimpleClient.load_metadata_for_topicsDana Powers2016-03-131-9/+13
|
* Fixup SimpleClient.topic_partitions commentDana Powers2016-02-151-1/+1
|
* Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-121-1/+7
| | | | and KafkaConnection
* Docstring updatesDana Powers2016-01-071-21/+18
|
* Rename TopicAndPartition -> TopicPartitionDana Powers2015-12-281-4/+4
|
* Switch BrokerConnection to (mostly) non-blocking IO.Dana Powers2015-12-171-37/+53
| | | | | | - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion
* new 0.9 error codes plus descriptions.Zack Dever2015-12-151-2/+2
| | | | | reference: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-ErrorCodes
* Only log topic names (and broker metadata) in KafkaClient load_metadata ↵Dana Powers2015-12-101-1/+1
| | | | debug logging
* Move Request / Response logging from KafkaClient to BrokerConnectionDana Powers2015-12-101-2/+0
| | | | and reenable kafka.conn debug logging in tests
* Drop kafka_bytestringDana Powers2015-12-101-5/+2
|
* Refactor KafkaClient to use BrokerConnections and new Request/Response structsDana Powers2015-12-091-148/+131
|
* Revert broken send_produce_request try/except from PR 467 (resps=None)Dana Powers2015-12-051-5/+1
|
* Fix requestId handling in send_broker_aware_requestDana Powers2015-12-041-2/+2
|
* Merge pull request #420 from toddpalino/masterDana Powers2015-12-021-0/+128
|\ | | | | Initial support for consumer coordinator
| * Support consumer metadata requeststpalino2015-07-011-0/+128
| | | | | | | | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator
* | Merge pull request #473 from ecanzonieri/use_unblocking_io_for_aware_requestsDana Powers2015-12-021-18/+30
|\ \ | | | | | | Use unblocking io for broker aware requests
| * | Add tests. Bug fix. Rename socket_conn dict.Enrico Canzonieri2015-11-101-7/+7
| | |
| * | Unblocking broker aware requestEnrico Canzonieri2015-11-101-18/+30
| | |
* | | Prevents crashing communication thread of async producerBalthasar Schopman2015-10-221-1/+5
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash.
* | Merge pull request #436 from mutability/async-catch-unavailable-errorDana Powers2015-10-071-6/+11
|\ \ | | | | | | Catch KafkaUnavailableError in _send_broker_aware_request
| * | Init responses before we use it.Oliver Jowett2015-07-241-1/+1
| | |
| * | Errors -> Error typoOliver Jowett2015-07-201-1/+1
| | |
| * | Treat KafkaUnavailableError like other errors.Oliver Jowett2015-07-191-5/+10
| |/
* | Use debug logging level for metadata requestEnrico Canzonieri2015-07-211-2/+2
|/
* Lower logging level on replica not available and commitEnrico Canzonieri2015-06-191-1/+1
|
* Add KafkaClient.topics property to get list of known topicsDana Powers2015-06-111-0/+4
|
View Lorry Controller Status