summaryrefslogtreecommitdiff
path: root/kafka/protocol.py
Commit message (Collapse)AuthorAgeFilesLines
* Rename kafka.protocol -> kafka.protocol.legacyDana Powers2015-12-041-646/+0
|
* Merge pull request #420 from toddpalino/masterDana Powers2015-12-021-6/+47
|\ | | | | Initial support for consumer coordinator
| * Support consumer metadata requeststpalino2015-07-011-6/+47
| | | | | | | | | | | | Support added for ConsumerMetadataRequest and ConsumerMetadataResponse Added consumer-aware request routine for supporting the consumer coordinator Added separate client method for fetching Kafka-committed offsets from the coordinator
* | allow to specify compression level for codecs which support thistrbs2015-09-121-4/+4
|/
* Fixup for loop vars in kafka/protocol.pyDana Powers2015-06-081-14/+14
|
* Use separate module loggers instead of a single 'kafka' loggerDana Powers2015-06-061-1/+2
|
* Correct message keys for async batching modeViktor Shlapakov2015-02-251-3/+3
|
* Add Sphinx API docsWill Daly2015-01-151-67/+58
|
* Added keys to compressed messages (both gzip and snappy).Eric Hewitt2015-01-021-2/+2
|
* Added optional argument key to create_message_set functionLou Marvin Caraig2014-11-261-4/+4
|
* Use b''.join([]) instead of += to speedup codeDana Powers2014-09-101-53/+71
|
* Merge pull request #223 from dpkp/metadata_refactorDana Powers2014-09-081-20/+25
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Metadata Refactor * add MetadataRequest and MetadataResponse namedtuples * add TopicMetadata namedtuple * add error codes to Topic and Partition Metadata * add KafkaClient.send_metadata_request() method * KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list] * raise server exceptions in load_metadata_for_topics(*topics) unless topics is null (full refresh) * Replace non-standard exceptions (LeaderUnavailable, PartitionUnavailable) with server standard exceptions (LeaderNotAvailableError, UnknownTopicOrPartitionError) Conflicts: kafka/client.py test/test_client.py test/test_producer_integration.py test/test_protocol.py
| * Improve metadata protocol handlingDana Powers2014-09-011-20/+25
| | | | | | | | | | | | | | | | | | | | - add MetadataRequest and MetadataResponse namedtuples - add TopicMetadata namedtuple - add error codes to Topic and Partition Metadata - add KafkaClient.send_metadata_request() method - KafkaProtocol.decode_metadata_response changed to return a MetadataResponse object so that it is consistent with server api: [broker_list, topic_list]
* | Update kafka.util.crc32 to unsigned everywhereMark Roberts2014-09-031-2/+2
| |
* | Make all unit tests pass on py3.3/3.4Bruno Renié2014-09-031-5/+8
|/
* Improve error handling and tests w.r.t. codecsPatrick Lucas2014-05-071-1/+18
| | | | | | | | | | Add function kafka.protocol.create_message_set() that takes a list of payloads and a codec and returns a message set with the desired encoding. Introduce kafka.common.UnsupportedCodecError, raised if an unknown codec is specified. Include a test for the new function.
* Merge branch 'teach_producers_about_compression' into producer_compressionMark Roberts2014-05-071-11/+12
|\ | | | | | | | | | | Conflicts: servers/0.8.0/kafka-src test/test_unit.py
| * Add 'codec' parameter to ProducerPatrick Lucas2014-05-031-11/+12
| | | | | | | | | | Adds a codec parameter to Producer.__init__ that lets the user choose a compression codec to use for all messages sent by it.
* | Reinstate test_integrate, make test_protocol more explicit, create testutilMark Roberts2014-04-081-1/+1
| |
* | Explicit testing of protocol errors. Make tests more explicit, and start ↵Mark Roberts2014-04-081-4/+3
|/ | | | working on intermittent failures in test_encode_fetch_request and test_encode_produc_request
* Merge pull request #98 from waliaashish85/devOmar2014-01-161-4/+2
|\ | | | | Changes for aligning code with offset fetch and commit APIs (Kafka 0.8.1)
| * Deleting client_id from offset commit and fetch response as per Kafka trunk codeAshish Walia2014-01-131-2/+0
| |
| * Syncing offset commit and fetch api keys with Kafka trunk codeAshish Walia2014-01-131-2/+2
| |
* | Add note about questionable error handling while decoding messages.Omar Ghishan2014-01-061-0/+8
| | | | | | | | Will remove once any error handling issues are resolved.
* | Add and fix comments to protocol.pyOmar Ghishan2014-01-061-6/+10
|/
* flake8 pass (pep8 and pyflakes)mrtheb2013-10-031-19/+19
|
* style: remove extra bracketsVetoshkin Nikita2013-10-031-1/+1
|
* style: fix camelCase variable namesVetoshkin Nikita2013-10-031-13/+13
| | | | | | Conflicts: kafka/util.py
* Fix #44 Add missing exception classv0.8.0David Arthur2013-09-241-3/+3
| | | | Also move the exceptions to common instead of util
* Auto-adjusting consumer fetch sizeDavid Arthur2013-09-091-6/+10
| | | | | | | | | | | | | | | Related to #42 Adds new ConsumerFetchSizeTooSmall exception that is thrown when `_decode_message_set_iter` gets a BufferUnderflowError but has not yet yielded a message In this event, SimpleConsumer will increase the fetch size by 1.5 and continue the fetching loop while _not_ increasing the offset (basically just retries the request with a larger fetch size) Once the consumer fetch size has been increased, it will remain increased while SimpleConsumer fetches from that partition
* PEP8-ify most of the filesMahendra M2013-05-291-65/+166
| | | | consumer.py and conn.py will be done later after pending merges
* A few fixes for offset APIs in 0.8.1David Arthur2013-04-021-2/+0
|
* Refactoring a bit, cleanup for 0.8David Arthur2013-04-021-1/+1
| | | | Marking some stuff as not compatible for 0.8 (will be added in 0.8.1)
* Big code re-orgDavid Arthur2013-04-021-0/+457
View Lorry Controller Status