summaryrefslogtreecommitdiff
path: root/kafka
Commit message (Collapse)AuthorAgeFilesLines
* Fix internal timeout / sleep handling in consumer iteratoriterator_timeoutDana Powers2016-01-291-15/+16
|
* Catch dns lookup errors when attempting to connect to nodesDana Powers2016-01-271-2/+8
|
* Merge pull request #523 from dpkp/null_loggerDana Powers2016-01-271-0/+12
|\ | | | | Add logging NullHandler to avoid No Handlers warnings
| * Add logging NullHandler to avoid No Handlers warningsnull_loggerDana Powers2016-01-271-0/+12
| |
* | Handle broken LZ4 framing; switch to lz4tools + xxhashlz4_fixupDana Powers2016-01-261-7/+51
|/
* Add error 104 / Connection reset by peer to expected check_version errorsDana Powers2016-01-251-2/+2
|
* Prefer module imports (io.BytesIO)Dana Powers2016-01-251-5/+5
|
* python-snappy does not like buffer-slices on pypy...Dana Powers2016-01-251-2/+12
|
* Ignore pylint errors on buffer/memoryviewDana Powers2016-01-251-0/+2
|
* Python3 does not support buffer -- use memoryview in snappy_decodeDana Powers2016-01-251-2/+8
|
* Fix Fetch._create_fetch_requests docstringDana Powers2016-01-251-1/+1
|
* Ok to sleep in blocking poll for metadata updateDana Powers2016-01-252-2/+2
|
* Small KafkaClient.check_version() improvementsDana Powers2016-01-252-3/+24
| | | | | - filter connection failure logging during version check - raise UnrecognizedBrokerVersion if we cant id broker
* Log new KafkaClient under kafka.client until files are mergedDana Powers2016-01-251-1/+1
|
* Dont need context manager for BytesIODana Powers2016-01-251-22/+18
|
* Write xerial-formatted snappy by default; use buffers to reduce copiesDana Powers2016-01-251-22/+16
|
* Add support for LZ4 compressed messages using python-lz4 moduleDana Powers2016-01-255-7/+30
|
* Disable offset commits and auto-partition-assignment when group_id is NoneDana Powers2016-01-242-28/+45
|
* Add KafkaProducer to kafka and kafka.producer module importsDana Powers2016-01-242-2/+5
|
* Implement new KafkaProducer, mimicing java client interface / designDana Powers2016-01-241-0/+496
|
* Sender class to manage background IO for KafkaProducerDana Powers2016-01-241-0/+272
|
* RecordAccumulator and RecordBatch, for use by async batching KafkaProducerDana Powers2016-01-241-0/+500
|
* Add thread-aware futures for use with KafkaProducerDana Powers2016-01-241-0/+66
|
* Add MessageSetBuffer and SimpleBufferPool to manage producer messagesDana Powers2016-01-241-0/+388
|
* DefaultPartitioner - implements java client logicDana Powers2016-01-241-0/+23
|
* Support encode and repr on raw BytesIO MessageSets (used in new producer)Dana Powers2016-01-241-0/+12
|
* Add Message and MessageSet HEADER_SIZE bytesDana Powers2016-01-241-0/+2
|
* Dont need to refresh metadata on GroupCoordinatorNotAvailableErrorsDana Powers2016-01-241-1/+4
|
* Write bytes to wake_fdDana Powers2016-01-241-1/+1
|
* Warn on 0.8.2 GroupCoordinator no-topic-quirk, dont raise exceptionDana Powers2016-01-231-2/+5
|
* Pylint ignores to fix weird 2.7 error in new pylint versionDana Powers2016-01-231-0/+3
|
* Add available_partitions_for_topic() and partitions_for_broker()Dana Powers2016-01-231-2/+23
|
* KafkaClient.add_topic() -- for use by async producerDana Powers2016-01-231-0/+15
|
* Optionally sleep in KafkaClient.poll(), add KafkaClient.wakeup()Dana Powers2016-01-231-7/+37
|
* Add back connection_delay method to KafkaClient - used by KafkaProducerDana Powers2016-01-181-0/+20
| | | | This reverts commit 88cf1b5e4551cd96322aa812fa482bf0f978060a.
* Merge pull request #507 from dpkp/deprecation_warningsDana Powers2016-01-126-5/+43
|\ | | | | Add DeprecationWarnings to legacy classes
| * Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-126-5/+43
| | | | | | | | and KafkaConnection
* | Sleep in KafkaConsumer iterator if no partition assignment; dont block in ↵iterator_fetchesDana Powers2016-01-121-4/+25
| | | | | | | | poll if no in-flight fetches
* | Remove sleep call in client.poll -- expect callers to manage this and log ↵Dana Powers2016-01-121-6/+5
| | | | | | | | warning
* | Move consumer_timeout handling to private methodDana Powers2016-01-121-5/+7
| |
* | Attempt to pipeline fetchrequests in iteratorDana Powers2016-01-121-1/+2
| |
* | Use private deque to track in-flight fetchrequestsDana Powers2016-01-121-0/+16
| |
* | Update docstring and comments in _create_fetch_requests re KAFKA-2978Dana Powers2016-01-101-5/+2
| |
* | Reorganize init_fetches calls during iterationDana Powers2016-01-102-7/+20
| | | | | | | | | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests.
* | Check for assignment changes before yielding new recordDana Powers2016-01-101-0/+9
| |
* | Fetcher logging should be debug or trace (left higher during testing)Dana Powers2016-01-102-9/+12
|/
* Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleepDana Powers2016-01-101-1/+4
| | | | iterating fetcher
* Fix sec / millisec unit bug in KafkaConsumer._poll_once()Dana Powers2016-01-101-1/+1
|
* Receive all available responses in client._pollDana Powers2016-01-101-3/+4
|
* If a completed future is polled, do not blockDana Powers2016-01-101-6/+13
|