summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * Implement new KafkaProducer, mimicing java client interface / designDana Powers2016-01-241-0/+496
| |
| * Sender class to manage background IO for KafkaProducerDana Powers2016-01-241-0/+272
| |
| * RecordAccumulator and RecordBatch, for use by async batching KafkaProducerDana Powers2016-01-241-0/+500
| |
| * Add thread-aware futures for use with KafkaProducerDana Powers2016-01-241-0/+66
| |
| * Add MessageSetBuffer and SimpleBufferPool to manage producer messagesDana Powers2016-01-241-0/+388
| |
| * DefaultPartitioner - implements java client logicDana Powers2016-01-241-0/+23
| |
| * Support encode and repr on raw BytesIO MessageSets (used in new producer)Dana Powers2016-01-241-0/+12
| |
| * Add Message and MessageSet HEADER_SIZE bytesDana Powers2016-01-241-0/+2
|/
* Dont need to refresh metadata on GroupCoordinatorNotAvailableErrorsDana Powers2016-01-241-1/+4
|
* Write bytes to wake_fdDana Powers2016-01-241-1/+1
|
* Warn on 0.8.2 GroupCoordinator no-topic-quirk, dont raise exceptionDana Powers2016-01-231-2/+5
|
* Ignore _socketobject errors in pylint -- v1.5.4 started throwing no-member ↵Dana Powers2016-01-231-1/+1
| | | | errors on python 2.7
* Pylint ignores to fix weird 2.7 error in new pylint versionDana Powers2016-01-231-0/+3
|
* Fix client poll tests (called with sleep=False)Dana Powers2016-01-231-4/+5
|
* Add available_partitions_for_topic() and partitions_for_broker()Dana Powers2016-01-231-2/+23
|
* KafkaClient.add_topic() -- for use by async producerDana Powers2016-01-231-0/+15
|
* Optionally sleep in KafkaClient.poll(), add KafkaClient.wakeup()Dana Powers2016-01-231-7/+37
|
* Add back connection_delay method to KafkaClient - used by KafkaProducerDana Powers2016-01-181-0/+20
| | | | This reverts commit 88cf1b5e4551cd96322aa812fa482bf0f978060a.
* Merge pull request #507 from dpkp/deprecation_warningsDana Powers2016-01-128-14/+51
|\ | | | | Add DeprecationWarnings to legacy classes
| * Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warningsDana Powers2016-01-128-14/+51
| | | | | | | | and KafkaConnection
* | Merge pull request #503 from dpkp/iterator_fetchesDana Powers2016-01-123-35/+96
|\ \ | |/ |/| Improve iterator fetch requests
| * Sleep in KafkaConsumer iterator if no partition assignment; dont block in ↵iterator_fetchesDana Powers2016-01-121-4/+25
| | | | | | | | poll if no in-flight fetches
| * Remove sleep call in client.poll -- expect callers to manage this and log ↵Dana Powers2016-01-121-6/+5
| | | | | | | | warning
| * Move consumer_timeout handling to private methodDana Powers2016-01-121-5/+7
| |
| * Attempt to pipeline fetchrequests in iteratorDana Powers2016-01-121-1/+2
| |
| * Use private deque to track in-flight fetchrequestsDana Powers2016-01-121-0/+16
| |
| * Update docstring and comments in _create_fetch_requests re KAFKA-2978Dana Powers2016-01-101-5/+2
| |
| * Reorganize init_fetches calls during iterationDana Powers2016-01-102-7/+20
| | | | | | | | | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests.
| * Check for assignment changes before yielding new recordDana Powers2016-01-101-0/+9
| |
| * Fetcher logging should be debug or trace (left higher during testing)Dana Powers2016-01-102-9/+12
| |
* | Add mocking to test_coordinator::test_close to fix random test failure (via ↵Dana Powers2016-01-111-0/+1
|/ | | | travis logs)
* Merge pull request #496 from dpkp/idle_sleepDana Powers2016-01-102-11/+30
|\ | | | | Prevent idle CPU spin by sleeping if there are no sockets to read
| * Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleepDana Powers2016-01-101-1/+4
| | | | | | | | iterating fetcher
| * Fix sec / millisec unit bug in KafkaConsumer._poll_once()Dana Powers2016-01-101-1/+1
| |
| * Receive all available responses in client._pollDana Powers2016-01-101-3/+4
| |
| * If a completed future is polled, do not blockDana Powers2016-01-101-6/+13
| |
| * Avoid CPU spinnning when there are no sockets to readDana Powers2016-01-101-0/+8
|/
* Fix delayed_task timeout commit 45d26b6Dana Powers2016-01-103-9/+10
|
* Merge pull request #502 from dpkp/task_poll_timeoutDana Powers2016-01-104-15/+47
|\ | | | | Add delayed task timeouts to _poll calls
| * Improve KafkaConsumer iterator loop timeoutstask_poll_timeoutDana Powers2016-01-101-8/+8
| | | | | | | | | | | | - Consider all delayed tasks, not just heartbeat - Include metadata update timeout - Fix second / millisecond bug calling client.poll()
| * Improve cluster.ttl() readabilityDana Powers2016-01-101-3/+7
| |
| * Check delayed task timeout in client.poll()Dana Powers2016-01-102-4/+32
| |
* | Log generation and member_id in threaded consumer group testDana Powers2016-01-101-1/+4
| |
* | Fix debug logging call in PR 500Dana Powers2016-01-101-1/+1
|/
* Remove old kafka.consumer.kafka moduleDana Powers2016-01-101-771/+0
|
* Merge pull request #500 from dpkp/kafka-2978Dana Powers2016-01-104-74/+53
|\ | | | | KAFKA-2978: consumer stops fetching when positions get out of sync
| * KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵Dana Powers2016-01-104-74/+53
|/ | | | out of sync
* Merge pull request #501 from dpkp/coordinator_testsDana Powers2016-01-104-13/+607
|\ | | | | ConsumerCoordinator cleanups and test coverage
| * Add ConsumerCoordinator unit testsDana Powers2016-01-101-0/+568
| |
| * ConsumerCoordinator cleanupsDana Powers2016-01-102-13/+36
| | | | | | | | | | | | | | | | | | | | | | | | | | | | - default assignors to RoundRobinPartitionAssignor - check offsets types in commit_offsets_* methods - succeed future in _send_offset_commit_request when no offsets - raise exception if no subscribed topics in group_protocols() - fix _subscription typo in metadata listener callbacks - short circuit if no partitions passed to fetch_committed_offsets - line-wrap comments - return future from commit_offsets_async - return future value from commit_offsets_sync - fix self._failed_request callback partial args - comment out metrics class for now