Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | | Fix unit tests. | Omar Ghishan | 2014-01-06 | 1 | -150/+314 | |
|/ | | | | | | This is pretty much a rewrite. The tests that involve offset requests/responses are not implemented since that API is not supported in kafka 0.8 yet. Only kafka.codec and kafka.protocol are currently tested, so there is more work to be done here. | |||||
* | Set host and port in ExternalService test fixture | David Arthur | 2013-11-11 | 1 | -0/+2 | |
| | | | | | So we can run tests against an already running Kafka instance KAFKA_URI=tcp://localhost:9092 python -m test.test_integration | |||||
* | make changes to be more fault tolerant: clean up connections, brokers, ↵ | Jim Lim | 2013-10-04 | 3 | -11/+124 | |
| | | | | | | | | failed_messages - add integration tests for sync producer - add integration tests for async producer w. leadership election - use log.exception | |||||
* | Test fixes after flake8 run | mrtheb | 2013-10-03 | 1 | -2/+2 | |
| | ||||||
* | Revert "Disable unit tests for 2.6, close #57" | David Arthur | 2013-10-03 | 1 | -5/+0 | |
| | | | | This reverts commit e39e05f8a50b7528a22fed99dc67d561cbd79c41. | |||||
* | Disable unit tests for 2.6, close #57 | David Arthur | 2013-10-03 | 1 | -0/+5 | |
| | ||||||
* | Cherry-pick mrtheb/kafka-python 8b9c7e51 | mrtheb | 2013-10-03 | 3 | -27/+30 | |
| | | | | | | | | | Sync tests and fixtures with kafka 0.8.0-beta1 tag Conflicts: README.md kafka-src | |||||
* | Auto-adjusting consumer fetch size | David Arthur | 2013-09-09 | 1 | -12/+6 | |
| | | | | | | | | | | | | | | | Related to #42 Adds new ConsumerFetchSizeTooSmall exception that is thrown when `_decode_message_set_iter` gets a BufferUnderflowError but has not yet yielded a message In this event, SimpleConsumer will increase the fetch size by 1.5 and continue the fetching loop while _not_ increasing the offset (basically just retries the request with a larger fetch size) Once the consumer fetch size has been increased, it will remain increased while SimpleConsumer fetches from that partition | |||||
* | Fixed #42, make fetch size configurable | David Arthur | 2013-09-08 | 1 | -0/+34 | |
| | | | | | | | | | | Was hard coded to 1024 bytes which meant that larger messages were unconsumable since they would always get split causing the consumer to stop. It would probably be best to automatically retry truncated messages with a larger request size so you don't have to know your max message size ahead of time | |||||
* | Merge branch 'issue-35' | David Arthur | 2013-07-26 | 1 | -9/+120 | |
|\ | | | | | | | | | | | | | Conflicts: kafka/__init__.py kafka/consumer.py test/test_integration.py | |||||
| * | Test cases for multi-process consumer and blocking APIs | Mahendra M | 2013-06-27 | 1 | -9/+120 | |
| | | ||||||
* | | Test cases for new producer | Mahendra M | 2013-06-27 | 1 | -3/+274 | |
|/ | ||||||
* | Use 127.0.0.1 instead of localhost | Ivan Pouzyrevsky | 2013-06-07 | 1 | -1/+1 | |
| | | | | This alleviates IPv4 -vs- IPv6 issues in ZK and Kafka. | |||||
* | toxify all the tests and use xfail marks | Ivan Pouzyrevsky | 2013-06-07 | 2 | -28/+69 | |
| | ||||||
* | Split fixtures out to a separate file | Ivan Pouzyrevsky | 2013-06-07 | 2 | -314/+316 | |
| | ||||||
* | Adhere to common python naming conventions | Ivan Pouzyrevsky | 2013-06-07 | 2 | -1/+1 | |
| | ||||||
* | Refactor and update integration tests | Ivan Pouzyrevsky | 2013-06-07 | 5 | -256/+401 | |
| | ||||||
* | Closes #22 | David Arthur | 2013-05-28 | 1 | -0/+21 | |
| | | | | Removed get_messages API, added test for get_pending | |||||
* | Update kafka-src to latest trunk, enable 0.8.1 features | David Arthur | 2013-04-02 | 1 | -2/+3 | |
| | ||||||
* | Update kafka-src to latest 0.8 | David Arthur | 2013-04-02 | 1 | -3/+14 | |
| | | | | Fix a broken test (100k was too much to send in one batch) | |||||
* | Bring acks and timeout down to the client | David Arthur | 2013-04-02 | 1 | -5/+6 | |
| | ||||||
* | Refactoring a bit, cleanup for 0.8 | David Arthur | 2013-04-02 | 1 | -13/+12 | |
| | | | | Marking some stuff as not compatible for 0.8 (will be added in 0.8.1) | |||||
* | Big code re-org | David Arthur | 2013-04-02 | 1 | -22/+43 | |
| | ||||||
* | Some work on a simple consumer | David Arthur | 2013-04-02 | 2 | -7/+59 | |
| | ||||||
* | Started on a simple producer and consumer | David Arthur | 2013-04-02 | 1 | -1/+26 | |
| | ||||||
* | Integration tests passing | David Arthur | 2013-04-02 | 2 | -9/+16 | |
| | ||||||
* | Protocol and low-level client done, adding tests | David Arthur | 2013-04-02 | 3 | -194/+278 | |
| | ||||||
* | Add some docs and KafkaQueue config | David Arthur | 2012-11-19 | 1 | -0/+1 | |
| | | | | Ref #8 | |||||
* | Add a Queue-like producer/consumer | David Arthur | 2012-11-19 | 1 | -0/+26 | |
| | | | | | | | | | | | | | | | | | Creates a producer process and one consumer process per partition. Uses `multiprocessing.Queue` for communication between the parent process and the producer/consumers. ```python kafka = KafkaClient("localhost", 9092) q = KafkaQueue(kafka, client="test-queue", partitions=[0,1]) q.put("test") q.get() q.close() kafka.close() ``` Ref #8 | |||||
* | Add Snappy support0.1-alpha | David Arthur | 2012-11-16 | 2 | -19/+71 | |
| | | | | Fixes #2 | |||||
* | Integration test writes to a file instead of stdout | David Arthur | 2012-10-30 | 1 | -5/+6 | |
| | ||||||
* | Adding a test for 10k messages | David Arthur | 2012-10-30 | 1 | -0/+10 | |
| | ||||||
* | Isn't it nice when tests actually find bugs | David Arthur | 2012-10-02 | 1 | -2/+48 | |
| | ||||||
* | Packaging improvments | David Arthur | 2012-10-02 | 1 | -0/+29 | |
| | | | | | | | | | | | | | | | | | | | | | | | Can now: ```python import kafka kafka.KafkaClient("localhost", 9092) ``` or ```python from kafka.client import KafkaClient KafkaClient("localhost", 9092) ``` or ```python import kafka.client kafka.client.KafkaClient("localhost", 9092) ``` | |||||
* | Renaming kafka.py to client.py | David Arthur | 2012-10-02 | 2 | -2/+2 | |
| | ||||||
* | Moved codec stuff into it's own module | David Arthur | 2012-10-02 | 1 | -2/+2 | |
| | | | | Snappy will go there when I get around to it | |||||
* | Start work on packaging issue #3 | David Arthur | 2012-10-02 | 3 | -3/+3 | |
| | ||||||
* | Integration test improvements | David Arthur | 2012-09-30 | 3 | -21/+53 | |
| | | | | | Call java directly instead of using start script. Fix synchronization problem with producing a message and it getting flushed. | |||||
* | Adding some integration tests | David Arthur | 2012-09-28 | 1 | -4/+41 | |
| | ||||||
* | Starting integration tests | David Arthur | 2012-09-28 | 4 | -0/+365 | |