summaryrefslogtreecommitdiff
path: root/test
Commit message (Collapse)AuthorAgeFilesLines
...
* | Fix unit tests.Omar Ghishan2014-01-061-150/+314
|/ | | | | | This is pretty much a rewrite. The tests that involve offset requests/responses are not implemented since that API is not supported in kafka 0.8 yet. Only kafka.codec and kafka.protocol are currently tested, so there is more work to be done here.
* Set host and port in ExternalService test fixtureDavid Arthur2013-11-111-0/+2
| | | | | So we can run tests against an already running Kafka instance KAFKA_URI=tcp://localhost:9092 python -m test.test_integration
* make changes to be more fault tolerant: clean up connections, brokers, ↵Jim Lim2013-10-043-11/+124
| | | | | | | | failed_messages - add integration tests for sync producer - add integration tests for async producer w. leadership election - use log.exception
* Test fixes after flake8 runmrtheb2013-10-031-2/+2
|
* Revert "Disable unit tests for 2.6, close #57"David Arthur2013-10-031-5/+0
| | | | This reverts commit e39e05f8a50b7528a22fed99dc67d561cbd79c41.
* Disable unit tests for 2.6, close #57David Arthur2013-10-031-0/+5
|
* Cherry-pick mrtheb/kafka-python 8b9c7e51mrtheb2013-10-033-27/+30
| | | | | | | | | Sync tests and fixtures with kafka 0.8.0-beta1 tag Conflicts: README.md kafka-src
* Auto-adjusting consumer fetch sizeDavid Arthur2013-09-091-12/+6
| | | | | | | | | | | | | | | Related to #42 Adds new ConsumerFetchSizeTooSmall exception that is thrown when `_decode_message_set_iter` gets a BufferUnderflowError but has not yet yielded a message In this event, SimpleConsumer will increase the fetch size by 1.5 and continue the fetching loop while _not_ increasing the offset (basically just retries the request with a larger fetch size) Once the consumer fetch size has been increased, it will remain increased while SimpleConsumer fetches from that partition
* Fixed #42, make fetch size configurableDavid Arthur2013-09-081-0/+34
| | | | | | | | | | Was hard coded to 1024 bytes which meant that larger messages were unconsumable since they would always get split causing the consumer to stop. It would probably be best to automatically retry truncated messages with a larger request size so you don't have to know your max message size ahead of time
* Merge branch 'issue-35'David Arthur2013-07-261-9/+120
|\ | | | | | | | | | | | | Conflicts: kafka/__init__.py kafka/consumer.py test/test_integration.py
| * Test cases for multi-process consumer and blocking APIsMahendra M2013-06-271-9/+120
| |
* | Test cases for new producerMahendra M2013-06-271-3/+274
|/
* Use 127.0.0.1 instead of localhostIvan Pouzyrevsky2013-06-071-1/+1
| | | | This alleviates IPv4 -vs- IPv6 issues in ZK and Kafka.
* toxify all the tests and use xfail marksIvan Pouzyrevsky2013-06-072-28/+69
|
* Split fixtures out to a separate fileIvan Pouzyrevsky2013-06-072-314/+316
|
* Adhere to common python naming conventionsIvan Pouzyrevsky2013-06-072-1/+1
|
* Refactor and update integration testsIvan Pouzyrevsky2013-06-075-256/+401
|
* Closes #22David Arthur2013-05-281-0/+21
| | | | Removed get_messages API, added test for get_pending
* Update kafka-src to latest trunk, enable 0.8.1 featuresDavid Arthur2013-04-021-2/+3
|
* Update kafka-src to latest 0.8David Arthur2013-04-021-3/+14
| | | | Fix a broken test (100k was too much to send in one batch)
* Bring acks and timeout down to the clientDavid Arthur2013-04-021-5/+6
|
* Refactoring a bit, cleanup for 0.8David Arthur2013-04-021-13/+12
| | | | Marking some stuff as not compatible for 0.8 (will be added in 0.8.1)
* Big code re-orgDavid Arthur2013-04-021-22/+43
|
* Some work on a simple consumerDavid Arthur2013-04-022-7/+59
|
* Started on a simple producer and consumerDavid Arthur2013-04-021-1/+26
|
* Integration tests passingDavid Arthur2013-04-022-9/+16
|
* Protocol and low-level client done, adding testsDavid Arthur2013-04-023-194/+278
|
* Add some docs and KafkaQueue configDavid Arthur2012-11-191-0/+1
| | | | Ref #8
* Add a Queue-like producer/consumerDavid Arthur2012-11-191-0/+26
| | | | | | | | | | | | | | | | | Creates a producer process and one consumer process per partition. Uses `multiprocessing.Queue` for communication between the parent process and the producer/consumers. ```python kafka = KafkaClient("localhost", 9092) q = KafkaQueue(kafka, client="test-queue", partitions=[0,1]) q.put("test") q.get() q.close() kafka.close() ``` Ref #8
* Add Snappy support0.1-alphaDavid Arthur2012-11-162-19/+71
| | | | Fixes #2
* Integration test writes to a file instead of stdoutDavid Arthur2012-10-301-5/+6
|
* Adding a test for 10k messagesDavid Arthur2012-10-301-0/+10
|
* Isn't it nice when tests actually find bugsDavid Arthur2012-10-021-2/+48
|
* Packaging improvmentsDavid Arthur2012-10-021-0/+29
| | | | | | | | | | | | | | | | | | | | | | | Can now: ```python import kafka kafka.KafkaClient("localhost", 9092) ``` or ```python from kafka.client import KafkaClient KafkaClient("localhost", 9092) ``` or ```python import kafka.client kafka.client.KafkaClient("localhost", 9092) ```
* Renaming kafka.py to client.pyDavid Arthur2012-10-022-2/+2
|
* Moved codec stuff into it's own moduleDavid Arthur2012-10-021-2/+2
| | | | Snappy will go there when I get around to it
* Start work on packaging issue #3David Arthur2012-10-023-3/+3
|
* Integration test improvementsDavid Arthur2012-09-303-21/+53
| | | | | Call java directly instead of using start script. Fix synchronization problem with producing a message and it getting flushed.
* Adding some integration testsDavid Arthur2012-09-281-4/+41
|
* Starting integration testsDavid Arthur2012-09-284-0/+365