Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Disable unit tests for 2.6, close #57 | David Arthur | 2013-10-03 | 1 | -0/+5 | |
| | ||||||
* | Cherry-pick mrtheb/kafka-python 8b9c7e51 | mrtheb | 2013-10-03 | 3 | -27/+30 | |
| | | | | | | | | | Sync tests and fixtures with kafka 0.8.0-beta1 tag Conflicts: README.md kafka-src | |||||
* | Auto-adjusting consumer fetch size | David Arthur | 2013-09-09 | 1 | -12/+6 | |
| | | | | | | | | | | | | | | | Related to #42 Adds new ConsumerFetchSizeTooSmall exception that is thrown when `_decode_message_set_iter` gets a BufferUnderflowError but has not yet yielded a message In this event, SimpleConsumer will increase the fetch size by 1.5 and continue the fetching loop while _not_ increasing the offset (basically just retries the request with a larger fetch size) Once the consumer fetch size has been increased, it will remain increased while SimpleConsumer fetches from that partition | |||||
* | Fixed #42, make fetch size configurable | David Arthur | 2013-09-08 | 1 | -0/+34 | |
| | | | | | | | | | | Was hard coded to 1024 bytes which meant that larger messages were unconsumable since they would always get split causing the consumer to stop. It would probably be best to automatically retry truncated messages with a larger request size so you don't have to know your max message size ahead of time | |||||
* | Merge branch 'issue-35' | David Arthur | 2013-07-26 | 1 | -9/+120 | |
|\ | | | | | | | | | | | | | Conflicts: kafka/__init__.py kafka/consumer.py test/test_integration.py | |||||
| * | Test cases for multi-process consumer and blocking APIs | Mahendra M | 2013-06-27 | 1 | -9/+120 | |
| | | ||||||
* | | Test cases for new producer | Mahendra M | 2013-06-27 | 1 | -3/+274 | |
|/ | ||||||
* | Use 127.0.0.1 instead of localhost | Ivan Pouzyrevsky | 2013-06-07 | 1 | -1/+1 | |
| | | | | This alleviates IPv4 -vs- IPv6 issues in ZK and Kafka. | |||||
* | toxify all the tests and use xfail marks | Ivan Pouzyrevsky | 2013-06-07 | 2 | -28/+69 | |
| | ||||||
* | Split fixtures out to a separate file | Ivan Pouzyrevsky | 2013-06-07 | 2 | -314/+316 | |
| | ||||||
* | Adhere to common python naming conventions | Ivan Pouzyrevsky | 2013-06-07 | 2 | -1/+1 | |
| | ||||||
* | Refactor and update integration tests | Ivan Pouzyrevsky | 2013-06-07 | 5 | -256/+401 | |
| | ||||||
* | Closes #22 | David Arthur | 2013-05-28 | 1 | -0/+21 | |
| | | | | Removed get_messages API, added test for get_pending | |||||
* | Update kafka-src to latest trunk, enable 0.8.1 features | David Arthur | 2013-04-02 | 1 | -2/+3 | |
| | ||||||
* | Update kafka-src to latest 0.8 | David Arthur | 2013-04-02 | 1 | -3/+14 | |
| | | | | Fix a broken test (100k was too much to send in one batch) | |||||
* | Bring acks and timeout down to the client | David Arthur | 2013-04-02 | 1 | -5/+6 | |
| | ||||||
* | Refactoring a bit, cleanup for 0.8 | David Arthur | 2013-04-02 | 1 | -13/+12 | |
| | | | | Marking some stuff as not compatible for 0.8 (will be added in 0.8.1) | |||||
* | Big code re-org | David Arthur | 2013-04-02 | 1 | -22/+43 | |
| | ||||||
* | Some work on a simple consumer | David Arthur | 2013-04-02 | 2 | -7/+59 | |
| | ||||||
* | Started on a simple producer and consumer | David Arthur | 2013-04-02 | 1 | -1/+26 | |
| | ||||||
* | Integration tests passing | David Arthur | 2013-04-02 | 2 | -9/+16 | |
| | ||||||
* | Protocol and low-level client done, adding tests | David Arthur | 2013-04-02 | 3 | -194/+278 | |
| | ||||||
* | Add some docs and KafkaQueue config | David Arthur | 2012-11-19 | 1 | -0/+1 | |
| | | | | Ref #8 | |||||
* | Add a Queue-like producer/consumer | David Arthur | 2012-11-19 | 1 | -0/+26 | |
| | | | | | | | | | | | | | | | | | Creates a producer process and one consumer process per partition. Uses `multiprocessing.Queue` for communication between the parent process and the producer/consumers. ```python kafka = KafkaClient("localhost", 9092) q = KafkaQueue(kafka, client="test-queue", partitions=[0,1]) q.put("test") q.get() q.close() kafka.close() ``` Ref #8 | |||||
* | Add Snappy support0.1-alpha | David Arthur | 2012-11-16 | 2 | -19/+71 | |
| | | | | Fixes #2 | |||||
* | Integration test writes to a file instead of stdout | David Arthur | 2012-10-30 | 1 | -5/+6 | |
| | ||||||
* | Adding a test for 10k messages | David Arthur | 2012-10-30 | 1 | -0/+10 | |
| | ||||||
* | Isn't it nice when tests actually find bugs | David Arthur | 2012-10-02 | 1 | -2/+48 | |
| | ||||||
* | Packaging improvments | David Arthur | 2012-10-02 | 1 | -0/+29 | |
| | | | | | | | | | | | | | | | | | | | | | | | Can now: ```python import kafka kafka.KafkaClient("localhost", 9092) ``` or ```python from kafka.client import KafkaClient KafkaClient("localhost", 9092) ``` or ```python import kafka.client kafka.client.KafkaClient("localhost", 9092) ``` | |||||
* | Renaming kafka.py to client.py | David Arthur | 2012-10-02 | 2 | -2/+2 | |
| | ||||||
* | Moved codec stuff into it's own module | David Arthur | 2012-10-02 | 1 | -2/+2 | |
| | | | | Snappy will go there when I get around to it | |||||
* | Start work on packaging issue #3 | David Arthur | 2012-10-02 | 3 | -3/+3 | |
| | ||||||
* | Integration test improvements | David Arthur | 2012-09-30 | 3 | -21/+53 | |
| | | | | | Call java directly instead of using start script. Fix synchronization problem with producing a message and it getting flushed. | |||||
* | Adding some integration tests | David Arthur | 2012-09-28 | 1 | -4/+41 | |
| | ||||||
* | Starting integration tests | David Arthur | 2012-09-28 | 4 | -0/+365 | |