Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | nit: fixed misspelling | Zack Dever | 2014-03-03 | 1 | -1/+1 | |
| | | ||||||
* | | Merge branch 'master' into conn_refactor | Mark Roberts | 2014-02-26 | 1 | -1/+27 | |
|\ \ | |/ | | | | | | | Conflicts: example.py | |||||
| * | clean up after comments from @rdiomar | mrtheb | 2014-02-15 | 1 | -3/+5 | |
| | | ||||||
| * | Support list (or comma-separated) of hosts (replaces host and port arguments) | mrtheb | 2014-02-09 | 1 | -1/+4 | |
| | | ||||||
| * | Merge branch 'master' into multihosts | mrtheb | 2014-01-31 | 1 | -48/+45 | |
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: kafka/client.py kafka/conn.py setup.py test/test_integration.py test/test_unit.py | |||||
| * | | Allow KafkaClient to take in a list of brokers for bootstrapping | Marc Labbe | 2013-11-14 | 1 | -7/+26 | |
| | | | ||||||
* | | | Minor refactor in conn.py, update version in __init__.py, add ErrorString | Mark Roberts | 2014-02-25 | 1 | -8/+11 | |
| |/ |/| | ||||||
* | | Merge pull request #107 from rdiomar/fix_default_timeouts | Marc Labbé | 2014-01-16 | 1 | -1/+7 | |
|\ \ | | | | | | | Increase default connection timeout | |||||
| * | | Change default socket timeout to 120 seconds in both the client and connection | Omar Ghishan | 2014-01-16 | 1 | -3/+4 | |
| | | | ||||||
| * | | Make the default connection timeout None | Omar Ghishan | 2014-01-16 | 1 | -1/+6 | |
| | | | | | | | | | | | | This fixes the default behavior, which used to cause a socket timeout when waiting for 10 seconds for a message to be produced. | |||||
* | | | Merge branch 'repr' of https://github.com/mahendra/kafka-python into ↵ | mrtheb | 2014-01-14 | 1 | -1/+1 | |
|\ \ \ | |/ / |/| | | | | | | | | | | | | | | | | | mahendra-repr Conflicts: kafka/client.py kafka/consumer.py | |||||
| * | | Add proper string representations for each class | Mahendra M | 2013-10-08 | 1 | -1/+1 | |
| |/ | ||||||
* | | remove zero length field name in format string, to work in Python 2.6 | Vadim Graboys | 2014-01-13 | 1 | -1/+1 | |
| | | ||||||
* | | Change log.error() back to log.exception() | Omar Ghishan | 2014-01-08 | 1 | -3/+3 | |
| | | ||||||
* | | Change BufferUnderflowError to ConnectionError in conn._read_bytes() | Omar Ghishan | 2014-01-08 | 1 | -3/+2 | |
| | | | | | | Both errors are handled the same way when raised and caught, so this makes sense. | |||||
* | | Remove unnecessary method | Omar Ghishan | 2014-01-07 | 1 | -17/+8 | |
| | | ||||||
* | | Handle dirty flag in conn.recv() | Omar Ghishan | 2014-01-07 | 1 | -1/+3 | |
| | | | | | | | | | | * If the connection is dirty, reinit * If we get a BufferUnderflowError, the server could have gone away, so mark it dirty | |||||
* | | Use the same timeout when reinitializing a connection | Omar Ghishan | 2014-01-07 | 1 | -2/+3 | |
| | | ||||||
* | | Raise a ConnectionError when a socket.error is raised when receiving data | Omar Ghishan | 2014-01-06 | 1 | -7/+11 | |
| | | | | | | | | Also, log.exception() is unhelpfully noisy. Use log.error() with some error details in the message instead. | |||||
* | | * Guarantee reading the expected number of bytes from the socket every time | Omar Ghishan | 2014-01-06 | 1 | -26/+22 | |
| | | | | | | | | | | | | | | | | | | | | | | | | * Remove bufsize from client and conn, since they're not actually enforced Notes: This commit changes behavior a bit by raising a BufferUnderflowError when no data is received for the message size rather than a ConnectionError. Since bufsize in the socket is not actually enforced, but it is used by the consumer when creating requests, moving it there until a better solution is implemented. | |||||
* | | Read the correct number of bytes from kafka. | Omar Ghishan | 2014-01-06 | 1 | -3/+2 | |
| | | | | | | | | | | | | According to the protocol documentation, the 4 byte integer at the beginning of a response represents the size of the payload only, not including those bytes. See http://goo.gl/rg5uom | |||||
* | | Allow customizing socket timeouts. | Omar Ghishan | 2014-01-06 | 1 | -2/+2 | |
| | | | | | | | | | | | | Previously, if you try to consume a message with a timeout greater than 10 seconds, but you don't receive data in those 10 seconds, a socket.timeout exception is raised. This allows a higher socket timeout to be set, or even None for no timeout. | |||||
* | | reduce memory copies when consuming kafka responses | Evan Klitzke | 2013-12-25 | 1 | -5/+2 | |
|/ | ||||||
* | Merge branch 'master' into prod-windows | Mahendra M | 2013-10-08 | 1 | -10/+18 | |
|\ | | | | | | | | | Conflicts: kafka/producer.py | |||||
| * | make changes to be more fault tolerant: clean up connections, brokers, ↵ | Jim Lim | 2013-10-04 | 1 | -10/+18 | |
| | | | | | | | | | | | | | | | | failed_messages - add integration tests for sync producer - add integration tests for async producer w. leadership election - use log.exception | |||||
* | | Ensure that async producer works in windows. Fixes #46 | Mahendra M | 2013-10-07 | 1 | -2/+13 | |
|/ | | | | | | | | | | | | | | | As per the multiprocessing module's documentation, the objects passed to the Process() class must be pickle-able in Windows. So, the Async producer did not work in windows. To fix this we have to ensure that code which uses multiprocessing has to follow certain rules * The target=func should not be a member function * We cannot pass objects like socket() to multiprocessing This ticket fixes these issues. For KafkaClient and KafkaConnection objects, we make copies of the object and reinit() them inside the child processes. | |||||
* | flake8 pass (pep8 and pyflakes) | mrtheb | 2013-10-03 | 1 | -6/+14 | |
| | ||||||
* | don't forget to call superclass __init__ | Vetoshkin Nikita | 2013-10-03 | 1 | -0/+1 | |
| | ||||||
* | style: fix camelCase variable names again | Vetoshkin Nikita | 2013-10-03 | 1 | -2/+2 | |
| | ||||||
* | style: fix camelCase variable names once more | Vetoshkin Nikita | 2013-10-03 | 1 | -3/+3 | |
| | ||||||
* | style: fix camelCase variable names | Vetoshkin Nikita | 2013-10-03 | 1 | -2/+2 | |
| | | | | | | Conflicts: kafka/util.py | |||||
* | style: use triple quotes for docstrings | Vetoshkin Nikita | 2013-10-03 | 1 | -2/+6 | |
| | ||||||
* | style: fix whitespaces | Vetoshkin Nikita | 2013-10-03 | 1 | -0/+2 | |
| | ||||||
* | Merge branch 'issue-35' | David Arthur | 2013-07-26 | 1 | -0/+9 | |
|\ | | | | | | | | | | | | | Conflicts: kafka/__init__.py kafka/consumer.py test/test_integration.py | |||||
| * | Re-init the sockets in the new process | Mahendra M | 2013-06-27 | 1 | -0/+9 | |
| | | ||||||
* | | Make the default case as 'ack on local write' | Mahendra M | 2013-06-20 | 1 | -1/+1 | |
|/ | | | | | | | Also, ensure that the case of 'no-acks' works fine In conn.send(), do not wait for the response. Wait for it only on conn.recv(). This behaviour is fine now since the connection is not shared among consumer threads etc. | |||||
* | Fix auto-commit issues with multi-threading | Mahendra M | 2013-06-03 | 1 | -1/+2 | |
| | ||||||
* | Adding a debug statement | David Arthur | 2013-05-28 | 1 | -1/+2 | |
| | ||||||
* | Update kafka-src to latest 0.8 | David Arthur | 2013-04-02 | 1 | -1/+2 | |
| | | | | Fix a broken test (100k was too much to send in one batch) | |||||
* | Big code re-org | David Arthur | 2013-04-02 | 1 | -0/+85 | |