summaryrefslogtreecommitdiff
path: root/kafka/util.py
Commit message (Collapse)AuthorAgeFilesLines
* Remove unused importJeff Widman2020-02-051-1/+0
| | | | | Forgot to remove this in https://github.com/dpkp/kafka-python/pull/1925 / ca2d76304bfe3900f995e6f0e4377b2ef654997e
* Remove some dead codeJeff Widman2020-02-051-9/+0
|
* Remove SimpleClient, Producer, Consumer, Unittest (#1196)Jeff Widman2019-10-111-108/+0
| | | | | | | | | | | | | | | | | | In the 2.0 release, we're removing: * `SimpleClient` * `SimpleConsumer` * `SimpleProducer` * Old partitioners used by `SimpleProducer`; these are superceded by the `DefaultPartitioner` These have been deprecated for several years in favor of `KafkaClient` / `KafkaConsumer` / `KafkaProducer`. Since 2.0 allows breaking changes, we are removing the deprecated classes. Additionally, since the only usage of `unittest` was in tests for these old Simple* clients, this also drops `unittest` from the library. All tests now run under `pytest`.
* Update remote urls: snappy, https, etcJeff Widman2018-10-221-1/+1
| | | | | Snappy URL was outdated. Similarly, many of these sites now support https.
* Improve KafkaConsumer cleanup (#1339)Dana Powers2018-01-101-0/+8
|
* Followup cleanup to #1304Jeff Widman2017-12-081-2/+1
| | | https://github.com/dpkp/kafka-python/pull/1304/files#r155842880
* optimize util.crc32 (#1304)Ofek Lev2017-12-081-8/+15
|
* Remove dead code (#967)Jeff Widman2017-02-281-32/+0
|
* Always absolute_importabsolute_importDana Powers2016-08-021-0/+2
|
* Vendor six 1.10.0sixDana Powers2016-08-011-1/+1
|
* Use weakref when registering a producer.close atexit to fix normal gc (#728)Dana Powers2016-06-181-0/+10
| | | | * Use weakref when registering a producer.close atexit to fix normal gc * Test that del(producer) terminates async thread
* Update imports from kafka.common -> kafka.errors / kafka.structsDana Powers2016-04-051-1/+1
|
* break up some circular references and close client wake pipe on __del__aisch2016-02-161-0/+37
|
* Drop kafka_bytestringDana Powers2015-12-101-12/+0
|
* Switch crc32 back to signed integer -- this is consistent with protocol ↵Dana Powers2015-12-041-1/+7
| | | | encoding spec
* Raise an error if we attempt to group duplicate topic-partition payloadsDana Powers2015-06-061-0/+3
| | | | - previously this would simply drop one of the payloads
* Stopping daemonized threads when references to these threads are lostChristophe-Marie Duquesne2015-03-021-0/+3
|
* Fix python2.6 threading.Event bug in ReentrantTimerDana Powers2015-02-031-1/+5
|
* fix circle referencezhaopengzp2015-02-021-0/+1
|
* Add Sphinx API docsWill Daly2015-01-151-4/+6
|
* Use kafka.util.kafka_bytestring to encode utf-8 when necessaryDana Powers2014-12-151-0/+12
|
* Update kafka.util.crc32 to unsigned everywhereMark Roberts2014-09-031-11/+2
|
* Make all unit tests pass on py3.3/3.4Bruno Renié2014-09-031-5/+21
|
* Fix write_int and write_short type validationMatthew L Daniel2014-08-221-0/+6
| | | | It will still die, just as before, but it now includes a *helpful* error message
* PEP8 fixesMatthew L Daniel2014-08-221-1/+2
|
* Attempt to fix travis build. Decrease complexity of service.py in favor of ↵Mark Roberts2014-05-061-2/+2
| | | | in memory logging. Address code review concerns
* Various fixesMark Roberts2014-04-251-2/+6
| | | | | | | | Bump version number to 0.9.1 Update readme to show supported Kafka/Python versions Validate arguments in consumer.py, add initial consumer unit test Make service kill() child processes when startup fails Add tests for util.py, fix Python 2.6 specific bug.
* flake8 pass (pep8 and pyflakes)mrtheb2013-10-031-3/+3
|
* style: remove extra brackets one more timeVetoshkin Nikita2013-10-031-5/+5
|
* style: fix camelCase variable namesVetoshkin Nikita2013-10-031-12/+11
| | | | | | Conflicts: kafka/util.py
* Cherry-pick mrtheb/kafka-python 2b016b69mrtheb2013-10-031-3/+4
| | | | Set FetchRequest MaxBytes value to bufsize instead of fetchsize (=MinBytes)
* import bufferunderflow errorJim Lim2013-09-271-0/+2
|
* Fix #44 Add missing exception classv0.8.0David Arthur2013-09-241-9/+0
| | | | Also move the exceptions to common instead of util
* Auto-adjusting consumer fetch sizeDavid Arthur2013-09-091-0/+2
| | | | | | | | | | | | | | | Related to #42 Adds new ConsumerFetchSizeTooSmall exception that is thrown when `_decode_message_set_iter` gets a BufferUnderflowError but has not yet yielded a message In this event, SimpleConsumer will increase the fetch size by 1.5 and continue the fetching loop while _not_ increasing the offset (basically just retries the request with a larger fetch size) Once the consumer fetch size has been increased, it will remain increased while SimpleConsumer fetches from that partition
* Fix an issue with thread argumentMahendra M2013-06-121-1/+1
|
* Optimize auto-commit threadMahendra M2013-06-121-12/+31
| | | | | | | | | | | | | The previous commit optimized the commit thread such that the timer started only when there were messages to be consumed. This commit goes a step further and ensures the following: * Only one timer thread is created * The main app does not block on exit (waiting for timer thread to finish) This is ensured by having a single thread blocking on an event and keeps calling a function. We use events instead of time.sleep() so as to prevent the python interpreter from running every 50ms checking if the timer has expired (logic copied from threading.Timer)
* Spawn the commit thread only if necessaryMahendra M2013-06-111-0/+3
| | | | | | | If there are no messages being consumed, the timer keeps creating new threads at the specified intervals. This may not be necessary. We can control this behaviour such that the timer thread is started only when a message is consumed
* PEP8-ify most of the filesMahendra M2013-05-291-17/+34
| | | | consumer.py and conn.py will be done later after pending merges
* Auto commit timer is not periodicMahendra M2013-05-281-6/+5
| | | | | | | The auto commit timer is one-shot. After the first commit, it does not fire again. This ticket fixes the issue. Also, in util.ReentrantTimer(), some duplicate code was cleaned up
* Big code re-orgDavid Arthur2013-04-021-0/+25
|
* Integration tests passingDavid Arthur2013-04-021-2/+2
|
* Protocol and low-level client done, adding testsDavid Arthur2013-04-021-8/+8
|
* Fix a bunch of bugsDavid Arthur2013-04-021-3/+6
|
* First pass of cleanup/refactoringDavid Arthur2013-04-021-8/+25
| | | | Also added a bunch of docstrings
* Starting work on 0.8 compatDavid Arthur2013-04-021-0/+38
View Lorry Controller Status