Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | | | Update README code examples to import from kafka not kafka.client, ↵ | Dana Powers | 2014-09-04 | 1 | -12/+9 | |
| | | | | | | | | | | | | | | | | kafka.consumer, etc | |||||
| * | | | Minor import cleanups | Dana Powers | 2014-09-04 | 2 | -7/+7 | |
| | | | | ||||||
| * | | | Change message type requirement from str to bytes for clarity and prep for ↵ | Dana Powers | 2014-09-04 | 1 | -5/+5 | |
| | | | | | | | | | | | | | | | | python3 | |||||
| * | | | Add trove classifiers for python 2.6, 2.7, and pypy to setup.py for PyPI | Dana Powers | 2014-09-04 | 1 | -0/+4 | |
|/ / / | ||||||
* | | | Merge pull request #222 from dpkp/fix_socket_timeout_test | Mark Roberts | 2014-09-04 | 2 | -12/+19 | |
|\ \ \ | |/ / |/| | | Fix socket timeout test -- mock the side_effect | |||||
| * | | Fix socket timeout test -- mock the side_effect | Dana Powers | 2014-09-01 | 2 | -12/+19 | |
| |/ | ||||||
* | | Merge pull request #216 from zever/nit-incorrect-except-format | Dana Powers | 2014-09-01 | 1 | -1/+1 | |
|\ \ | |/ |/| | Fix except clause error in test_failover_integration | |||||
| * | just fixing a silly except formatting mistake | Zack Dever | 2014-08-29 | 1 | -1/+1 | |
|/ | ||||||
* | Version to 0.9.2 and Changelog (with some backstory)v0.9.2 | Dana Powers | 2014-08-27 | 3 | -6/+41 | |
| | ||||||
* | Fixup producer failover tests to avoid consumer message count flap | Dana Powers | 2014-08-27 | 1 | -7/+8 | |
| | | | | | check message counts via consumer.pending() (OffsetRequest) rather than relying on consumer message iterator (FetchRequest) | |||||
* | Merge pull request #213 from dpkp/improve_failover_tests | Dana Powers | 2014-08-27 | 3 | -46/+76 | |
|\ | | | | | | | | | Warn users about async producer Refactor producer failover tests (5x speedup) Skip async producer failover test for now, because it is broken | |||||
| * | Add warnings to README, docstring, and logging that async producer does not ↵ | Dana Powers | 2014-08-26 | 2 | -1/+9 | |
| | | | | | | | | retry failed messages | |||||
| * | Improve leader failover tests; note that async produce failover is broken -- ↵ | Dana Powers | 2014-08-26 | 1 | -45/+67 | |
| | | | | | | | | so skip that test for now | |||||
* | | Add link to kafka-clients google-group on README | Dana Powers | 2014-08-26 | 1 | -1/+4 | |
| | | ||||||
* | | Merge pull request #136 from DataDog/fix-multifetch-buffer-size | Dana Powers | 2014-08-26 | 1 | -12/+14 | |
|\ \ | | | | | | | | | | | | | | | | | | | fix consumer retry logic (fixes #135) Conflicts: kafka/consumer.py | |||||
| * | | fix consumer retry logic (fixes #135) | Carlo Cabanilla | 2014-02-28 | 1 | -12/+14 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Fixes bug in the follow condition: * Starting buffer size is 1024, max buffer size is 2048, both set on an instance level * Fetch from p0, p1 and received response * p0 has more than 1024 bytes, consumer doubles buffer size to 2048 and marks p0 for retry * p1 has more than 1024 bytes, consumer tries to double buffer size, but sees that it's at the max and raises ConsumerFetchSizeTooSmall The fix changes the logic to the following: * Starting buffer size is 1024 set on a per-partition level, max buffer size is 2048 set on an instance level * Fetch from p0, p1 and received response * p0 has more than 1024 bytes, consumer doubles buffer size to 2048 for p0 and marks p0 for retry * p1 has more than 1024 bytes, consumer double buffer size to 2048 for p1 and marks p1 for retry * Consumer sees that there's partitions to retry, repeats parsing loop * p0 sent all the bytes this time, consumer yields these messages * p1 sent all the bytes this time, consumer yields these messages | |||||
* | | | Add a test for Issue #135 (Spurious ConsumerFetchSizeTooSmall error) | Dana Powers | 2014-08-26 | 1 | -0/+19 | |
| |/ |/| | ||||||
* | | Merge pull request #208 from dpkp/add_pylint_to_tox_ini | Dana Powers | 2014-08-26 | 10 | -58/+54 | |
|\ \ | | | | | | | Use PyLint for static error checking | |||||
| * | | Add pylint to tox.ini; test both kafka and test; default to error-checking ↵ | Dana Powers | 2014-08-25 | 10 | -58/+54 | |
| | | | | | | | | | | | | only; fixup errors; skip kafka/queue.py | |||||
* | | | Merge pull request #211 from dpkp/str_only_produce_msgs | Dana Powers | 2014-08-26 | 3 | -0/+59 | |
|\ \ \ | | | | | | | | | Strictly enforce str message type in producer.send_messages | |||||
| * | | | Add producer unit test (test/test_producer.py); check supported types in ↵ | Dana Powers | 2014-08-26 | 1 | -0/+31 | |
| | | | | | | | | | | | | | | | | send_messages | |||||
| * | | | Raise TypeError in kafka.producer.send_messages if any msg is not a str (or ↵ | Dana Powers | 2014-08-26 | 2 | -0/+28 | |
|/ / / | | | | | | | | | | subclass); document | |||||
* | | | Add test timers via nose-timer plugin; list the 10 slowest by default | Dana Powers | 2014-08-26 | 1 | -1/+2 | |
| | | | ||||||
* | | | Merge pull request #177 from zever/fetch-last-known-offsets | Dana Powers | 2014-08-25 | 1 | -10/+17 | |
|\ \ \ | |/ / |/| | | Move fetching last known offset logic to a stand alone function. | |||||
| * | | also reset `self.fetch_offsets` in `fetch_last_known_offsets` | Zack Dever | 2014-08-25 | 1 | -0/+1 | |
| | | | ||||||
| * | | Move fetching last known offset logic to a stand alone function. | Zack Dever | 2014-08-25 | 1 | -10/+16 | |
|/ / | | | | | | | | | | | | | | | | | | | The `Consumer` class fetches the last known offsets in `__init__` if `auto_commit` is enabled, but it would be nice to expose this behavior for consumers that aren't using auto_commit. This doesn't change existing behavior, just exposes the ability to easily fetch and set the last known offsets. Once #162 or something similar lands this may no longer be necessary, but it looks like that might take a while to make it through. | |||||
* | | Merge pull request #196 from dpkp/reinit_connection_error | Dana Powers | 2014-08-22 | 2 | -40/+177 | |
|\ \ | | | | | | | Improve KafkaConnection with more tests | |||||
| * | | Add a mock to sock.recv() in the test_conn setUp method. Returns 2 packet ↵ | Dana Powers | 2014-08-19 | 1 | -61/+25 | |
| | | | | | | | | | | | | payloads, then '', then error | |||||
| * | | Fix test_conn tests wrt _dirty / _sock | Dana Powers | 2014-08-19 | 1 | -9/+4 | |
| | | | ||||||
| * | | Improve docstrings in kafka.conn | Dana Powers | 2014-08-19 | 1 | -4/+14 | |
| | | | ||||||
| * | | Shutdown socket before closing in kafka.conn | Dana Powers | 2014-08-19 | 1 | -0/+9 | |
| | | | ||||||
| * | | Remove duplicate error handling blocks by moving empty response check into ↵ | Dana Powers | 2014-08-19 | 1 | -4/+8 | |
| | | | | | | | | | | | | try block in conn.recv | |||||
| * | | Remove self._dirty and check self._sock instead in kafka.conn | Dana Powers | 2014-08-19 | 1 | -6/+11 | |
| | | | ||||||
| * | | Remove unused imports from test/test_conn.py | Dana Powers | 2014-08-19 | 1 | -2/+0 | |
| | | | ||||||
| * | | Implement last of the skipped test_conn.py tests | Dana Powers | 2014-08-19 | 1 | -2/+18 | |
| | | | ||||||
| * | | Implement a few more skipped tests in test/test_conn.py | Dana Powers | 2014-08-19 | 1 | -4/+19 | |
| | | | ||||||
| * | | Move common connection testing code to setUp method | Dana Powers | 2014-08-19 | 1 | -98/+45 | |
| | | | ||||||
| * | | Implementing more skipped connection tests (send and recv) | Dana Powers | 2014-08-19 | 1 | -6/+82 | |
| | | | ||||||
| * | | Cleanup some connection tests in test/test_conn.py | Dana Powers | 2014-08-19 | 1 | -14/+11 | |
| | | | ||||||
| * | | socket.sendall should always raise an exception on error; remove extra ↵ | Dana Powers | 2014-08-19 | 1 | -6/+7 | |
| | | | | | | | | | | | | return val check in KafkaConnection.send() | |||||
| * | | Improve KafkaConnection testing: mock socket.create_connection; add tests ↵ | Dana Powers | 2014-08-19 | 1 | -8/+95 | |
| | | | | | | | | | | | | for __init__ and send | |||||
| * | | Add some more debug logging to KafkaConnection | Dana Powers | 2014-08-19 | 1 | -0/+7 | |
| | | | ||||||
| * | | Initialized _dirty in KafkaConnection __init__() and set _sock to None in ↵ | Dana Powers | 2014-08-17 | 1 | -2/+4 | |
| | | | | | | | | | | | | close() | |||||
| * | | Call _raise_connection_error in KafkaConnection.reinit() if socket ↵ | Dana Powers | 2014-08-17 | 1 | -2/+6 | |
| | | | | | | | | | | | | connection fails | |||||
* | | | Merge pull request #204 from mdaniel/better-type-errors | Dana Powers | 2014-08-22 | 3 | -15/+39 | |
|\ \ \ | | | | | | | | | Better type errors | |||||
| * | | | Fix write_int and write_short type validation | Matthew L Daniel | 2014-08-22 | 1 | -0/+6 | |
| | | | | | | | | | | | | | | | | It will still die, just as before, but it now includes a *helpful* error message | |||||
| * | | | PEP8 fixes | Matthew L Daniel | 2014-08-22 | 1 | -1/+2 | |
| | | | | ||||||
| * | | | Failing test for write_int and write_short | Matthew L Daniel | 2014-08-22 | 1 | -0/+16 | |
| | | | | ||||||
| * | | | PEP8 fixes | Matthew L Daniel | 2014-08-22 | 1 | -12/+11 | |
| | | | | ||||||
| * | | | Correctly declare unittest2 dependency | Matthew L Daniel | 2014-08-22 | 1 | -2/+4 | |
| | | | |