Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warnings | Dana Powers | 2016-01-12 | 1 | -1/+7 |
| | | | | and KafkaConnection | ||||
* | Docstring updates | Dana Powers | 2016-01-07 | 1 | -21/+18 |
| | |||||
* | Rename TopicAndPartition -> TopicPartition | Dana Powers | 2015-12-28 | 1 | -4/+4 |
| | |||||
* | Switch BrokerConnection to (mostly) non-blocking IO. | Dana Powers | 2015-12-17 | 1 | -37/+53 |
| | | | | | | - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion | ||||
* | new 0.9 error codes plus descriptions. | Zack Dever | 2015-12-15 | 1 | -2/+2 |
| | | | | | reference: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-ErrorCodes | ||||
* | Only log topic names (and broker metadata) in KafkaClient load_metadata ↵ | Dana Powers | 2015-12-10 | 1 | -1/+1 |
| | | | | debug logging | ||||
* | Move Request / Response logging from KafkaClient to BrokerConnection | Dana Powers | 2015-12-10 | 1 | -2/+0 |
| | | | | and reenable kafka.conn debug logging in tests | ||||
* | Drop kafka_bytestring | Dana Powers | 2015-12-10 | 1 | -5/+2 |
| | |||||
* | Refactor KafkaClient to use BrokerConnections and new Request/Response structs | Dana Powers | 2015-12-09 | 1 | -148/+131 |
| | |||||
* | Revert broken send_produce_request try/except from PR 467 (resps=None) | Dana Powers | 2015-12-05 | 1 | -5/+1 |
| | |||||
* | Fix requestId handling in send_broker_aware_request | Dana Powers | 2015-12-04 | 1 | -2/+2 |
| | |||||
* | Merge pull request #420 from toddpalino/master | Dana Powers | 2015-12-02 | 1 | -0/+128 |
|\ | | | | | Initial support for consumer coordinator | ||||
| * | Support consumer metadata requests | tpalino | 2015-07-01 | 1 | -0/+128 |
| | | | | | | | | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator | ||||
* | | Merge pull request #473 from ecanzonieri/use_unblocking_io_for_aware_requests | Dana Powers | 2015-12-02 | 1 | -18/+30 |
|\ \ | | | | | | | Use unblocking io for broker aware requests | ||||
| * | | Add tests. Bug fix. Rename socket_conn dict. | Enrico Canzonieri | 2015-11-10 | 1 | -7/+7 |
| | | | |||||
| * | | Unblocking broker aware request | Enrico Canzonieri | 2015-11-10 | 1 | -18/+30 |
| | | | |||||
* | | | Prevents crashing communication thread of async producer | Balthasar Schopman | 2015-10-22 | 1 | -1/+5 |
|/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | If an uncaught exception occurs in _send_messages() the thread sending data to Kafka (asynchronously) will crash and the queue will never be emptied. To reproduce: 1) Run an Async producer. 2) Kill the Kafka server. 3) Restart the Kafka server. The communication thread dies shortly after step 2. After step 3 the communication does not resume without this commit. The changes in both files prevent an Exception from being thrown through to do main communication process, which could cause the crash. | ||||
* | | Merge pull request #436 from mutability/async-catch-unavailable-error | Dana Powers | 2015-10-07 | 1 | -6/+11 |
|\ \ | | | | | | | Catch KafkaUnavailableError in _send_broker_aware_request | ||||
| * | | Init responses before we use it. | Oliver Jowett | 2015-07-24 | 1 | -1/+1 |
| | | | |||||
| * | | Errors -> Error typo | Oliver Jowett | 2015-07-20 | 1 | -1/+1 |
| | | | |||||
| * | | Treat KafkaUnavailableError like other errors. | Oliver Jowett | 2015-07-19 | 1 | -5/+10 |
| |/ | |||||
* | | Use debug logging level for metadata request | Enrico Canzonieri | 2015-07-21 | 1 | -2/+2 |
|/ | |||||
* | Lower logging level on replica not available and commit | Enrico Canzonieri | 2015-06-19 | 1 | -1/+1 |
| | |||||
* | Add KafkaClient.topics property to get list of known topics | Dana Powers | 2015-06-11 | 1 | -0/+4 |
| | |||||
* | Fix KafkaClient request / response ordering | Dana Powers | 2015-06-10 | 1 | -10/+20 |
| | |||||
* | KafkaClient log new broker and topic metadata received as INFO | Dana Powers | 2015-06-09 | 1 | -2/+2 |
| | |||||
* | KafkaClient: log responses by requestId for debugging | Dana Powers | 2015-06-09 | 1 | -1/+4 |
| | |||||
* | KafkaClient: log requestId on ConnectionError instead of hexdump of request ↵ | Dana Powers | 2015-06-09 | 1 | -6/+5 |
| | | | | contents | ||||
* | Improve kafka client debug request/response logging | Dana Powers | 2015-06-08 | 1 | -5/+5 |
| | |||||
* | Prefer single quotes for strings | Dana Powers | 2015-06-08 | 1 | -14/+12 |
| | |||||
* | Add a few extra docstring comments about thread-safe clients/connections | Dana Powers | 2015-06-08 | 1 | -2/+5 |
| | |||||
* | Cleanup imports in kafka/client and kafka/consumer | Dana Powers | 2015-06-08 | 1 | -1/+1 |
| | |||||
* | KafkaClient should try/except ConnnectionError when calling _get_conn | Dana Powers | 2015-06-06 | 1 | -2/+2 |
| | |||||
* | Raise an error if we attempt to group duplicate topic-partition payloads | Dana Powers | 2015-06-06 | 1 | -0/+2 |
| | | | | - previously this would simply drop one of the payloads | ||||
* | Use separate module loggers instead of a single 'kafka' logger | Dana Powers | 2015-06-06 | 1 | -1/+2 |
| | |||||
* | Merge pull request #367 from dpkp/clean_metadata_refresh | Dana Powers | 2015-04-12 | 1 | -13/+14 |
|\ | | | | | Clear local metadata cache before refresh in client.load_metadata_for_topics() | ||||
| * | Update debug log messages in client.load_metadata_for_topics | Dana Powers | 2015-04-12 | 1 | -2/+2 |
| | | |||||
| * | clean local metadata before requesting refresh in load_metadata_for_topics() | Dana Powers | 2015-04-12 | 1 | -2/+7 |
| | | |||||
| * | Simplify client.reset_topic_metadata | Dana Powers | 2015-04-12 | 1 | -9/+5 |
| | | |||||
* | | Improve send_produce_request docstring | Dana Powers | 2015-04-06 | 1 | -6/+17 |
| | | |||||
* | | Add debug logging for all broker-aware requests/responses | Dana Powers | 2015-04-06 | 1 | -0/+3 |
| | | |||||
* | | Refactor KafkaClient._send_broker_aware_request to return a list of responses | Dana Powers | 2015-04-06 | 1 | -73/+57 |
|/ | | | | | | and include individual (unraised) FailedPayloadsError instances rather than always raising a FailedPayloadsError. This should allow producers to determine which payloads succeeded and which failed, specifically. | ||||
* | Make external API consistently support python3 strings for topic. | Space | 2015-04-03 | 1 | -0/+3 |
| | |||||
* | Rollover KafkaClient correlation ids at 2**31 to keep within int32 protocol ↵ | Dana Powers | 2015-03-29 | 1 | -7/+7 |
| | | | | encoding | ||||
* | KafkaClient.get_partition_ids_for_topic now returns empty list for unknown ↵ | Dana Powers | 2015-03-02 | 1 | -1/+1 |
| | | | | topics | ||||
* | Add comment about no server response case in _send_broker_aware_request | Dana Powers | 2015-03-02 | 1 | -0/+5 |
| | |||||
* | Avoid topic_partitions KeyError in KafkaClient | Dana Powers | 2015-03-02 | 1 | -1/+1 |
| | |||||
* | Accept KafkaClient client_id as string or bytes; encode string client_id as ↵ | Dana Powers | 2015-03-01 | 1 | -1/+2 |
| | | | | utf-8 bytes internally | ||||
* | Always return sorted partition ids in KafkaClient.get_partition_ids_for_topic() | Dana Powers | 2015-02-09 | 1 | -1/+1 |
| | |||||
* | Merge pull request #282 from wedaly/sphinx-api-docs | Dana Powers | 2015-01-23 | 1 | -24/+24 |
|\ | | | | | Add Sphinx API docs |