Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Write xerial-formatted snappy by default; use buffers to reduce copies | Dana Powers | 2016-01-25 | 1 | -22/+16 | |
| | ||||||
* | Add support for LZ4 compressed messages using python-lz4 module | Dana Powers | 2016-01-25 | 5 | -7/+30 | |
| | ||||||
* | Disable offset commits and auto-partition-assignment when group_id is None | Dana Powers | 2016-01-24 | 2 | -28/+45 | |
| | ||||||
* | Add KafkaProducer to kafka and kafka.producer module imports | Dana Powers | 2016-01-24 | 2 | -2/+5 | |
| | ||||||
* | Implement new KafkaProducer, mimicing java client interface / design | Dana Powers | 2016-01-24 | 1 | -0/+496 | |
| | ||||||
* | Sender class to manage background IO for KafkaProducer | Dana Powers | 2016-01-24 | 1 | -0/+272 | |
| | ||||||
* | RecordAccumulator and RecordBatch, for use by async batching KafkaProducer | Dana Powers | 2016-01-24 | 1 | -0/+500 | |
| | ||||||
* | Add thread-aware futures for use with KafkaProducer | Dana Powers | 2016-01-24 | 1 | -0/+66 | |
| | ||||||
* | Add MessageSetBuffer and SimpleBufferPool to manage producer messages | Dana Powers | 2016-01-24 | 1 | -0/+388 | |
| | ||||||
* | DefaultPartitioner - implements java client logic | Dana Powers | 2016-01-24 | 1 | -0/+23 | |
| | ||||||
* | Support encode and repr on raw BytesIO MessageSets (used in new producer) | Dana Powers | 2016-01-24 | 1 | -0/+12 | |
| | ||||||
* | Add Message and MessageSet HEADER_SIZE bytes | Dana Powers | 2016-01-24 | 1 | -0/+2 | |
| | ||||||
* | Dont need to refresh metadata on GroupCoordinatorNotAvailableErrors | Dana Powers | 2016-01-24 | 1 | -1/+4 | |
| | ||||||
* | Write bytes to wake_fd | Dana Powers | 2016-01-24 | 1 | -1/+1 | |
| | ||||||
* | Warn on 0.8.2 GroupCoordinator no-topic-quirk, dont raise exception | Dana Powers | 2016-01-23 | 1 | -2/+5 | |
| | ||||||
* | Pylint ignores to fix weird 2.7 error in new pylint version | Dana Powers | 2016-01-23 | 1 | -0/+3 | |
| | ||||||
* | Add available_partitions_for_topic() and partitions_for_broker() | Dana Powers | 2016-01-23 | 1 | -2/+23 | |
| | ||||||
* | KafkaClient.add_topic() -- for use by async producer | Dana Powers | 2016-01-23 | 1 | -0/+15 | |
| | ||||||
* | Optionally sleep in KafkaClient.poll(), add KafkaClient.wakeup() | Dana Powers | 2016-01-23 | 1 | -7/+37 | |
| | ||||||
* | Add back connection_delay method to KafkaClient - used by KafkaProducer | Dana Powers | 2016-01-18 | 1 | -0/+20 | |
| | | | | This reverts commit 88cf1b5e4551cd96322aa812fa482bf0f978060a. | |||||
* | Merge pull request #507 from dpkp/deprecation_warnings | Dana Powers | 2016-01-12 | 6 | -5/+43 | |
|\ | | | | | Add DeprecationWarnings to legacy classes | |||||
| * | Add DeprecationWarnings to legacy KafkaClient, Simple/MultiProcess/Consumer, ↵deprecation_warnings | Dana Powers | 2016-01-12 | 6 | -5/+43 | |
| | | | | | | | | and KafkaConnection | |||||
* | | Sleep in KafkaConsumer iterator if no partition assignment; dont block in ↵iterator_fetches | Dana Powers | 2016-01-12 | 1 | -4/+25 | |
| | | | | | | | | poll if no in-flight fetches | |||||
* | | Remove sleep call in client.poll -- expect callers to manage this and log ↵ | Dana Powers | 2016-01-12 | 1 | -6/+5 | |
| | | | | | | | | warning | |||||
* | | Move consumer_timeout handling to private method | Dana Powers | 2016-01-12 | 1 | -5/+7 | |
| | | ||||||
* | | Attempt to pipeline fetchrequests in iterator | Dana Powers | 2016-01-12 | 1 | -1/+2 | |
| | | ||||||
* | | Use private deque to track in-flight fetchrequests | Dana Powers | 2016-01-12 | 1 | -0/+16 | |
| | | ||||||
* | | Update docstring and comments in _create_fetch_requests re KAFKA-2978 | Dana Powers | 2016-01-10 | 1 | -5/+2 | |
| | | ||||||
* | | Reorganize init_fetches calls during iteration | Dana Powers | 2016-01-10 | 2 | -7/+20 | |
| | | | | | | | | | | | | | | Generally should not init_fetches while the generator has pending messages; this revision adds an explicit check / noop to the public interface, and uses a private method internally to attempt to pipeline fetch requests. | |||||
* | | Check for assignment changes before yielding new record | Dana Powers | 2016-01-10 | 1 | -0/+9 | |
| | | ||||||
* | | Fetcher logging should be debug or trace (left higher during testing) | Dana Powers | 2016-01-10 | 2 | -9/+12 | |
|/ | ||||||
* | Pass consumer timeout to client.poll() in iterator; check timeout before ↵idle_sleep | Dana Powers | 2016-01-10 | 1 | -1/+4 | |
| | | | | iterating fetcher | |||||
* | Fix sec / millisec unit bug in KafkaConsumer._poll_once() | Dana Powers | 2016-01-10 | 1 | -1/+1 | |
| | ||||||
* | Receive all available responses in client._poll | Dana Powers | 2016-01-10 | 1 | -3/+4 | |
| | ||||||
* | If a completed future is polled, do not block | Dana Powers | 2016-01-10 | 1 | -6/+13 | |
| | ||||||
* | Avoid CPU spinnning when there are no sockets to read | Dana Powers | 2016-01-10 | 1 | -0/+8 | |
| | ||||||
* | Fix delayed_task timeout commit 45d26b6 | Dana Powers | 2016-01-10 | 2 | -6/+7 | |
| | ||||||
* | Merge pull request #502 from dpkp/task_poll_timeout | Dana Powers | 2016-01-10 | 3 | -13/+19 | |
|\ | | | | | Add delayed task timeouts to _poll calls | |||||
| * | Improve KafkaConsumer iterator loop timeoutstask_poll_timeout | Dana Powers | 2016-01-10 | 1 | -8/+8 | |
| | | | | | | | | | | | | - Consider all delayed tasks, not just heartbeat - Include metadata update timeout - Fix second / millisecond bug calling client.poll() | |||||
| * | Improve cluster.ttl() readability | Dana Powers | 2016-01-10 | 1 | -3/+7 | |
| | | ||||||
| * | Check delayed task timeout in client.poll() | Dana Powers | 2016-01-10 | 1 | -2/+4 | |
| | | ||||||
* | | Fix debug logging call in PR 500 | Dana Powers | 2016-01-10 | 1 | -1/+1 | |
|/ | ||||||
* | Remove old kafka.consumer.kafka module | Dana Powers | 2016-01-10 | 1 | -771/+0 | |
| | ||||||
* | KAFKA-2978: consumer stops fetching when consumed and fetch positions get ↵ | Dana Powers | 2016-01-10 | 4 | -74/+53 | |
| | | | | out of sync | |||||
* | Merge pull request #501 from dpkp/coordinator_tests | Dana Powers | 2016-01-10 | 3 | -13/+39 | |
|\ | | | | | ConsumerCoordinator cleanups and test coverage | |||||
| * | ConsumerCoordinator cleanups | Dana Powers | 2016-01-10 | 2 | -13/+36 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | - default assignors to RoundRobinPartitionAssignor - check offsets types in commit_offsets_* methods - succeed future in _send_offset_commit_request when no offsets - raise exception if no subscribed topics in group_protocols() - fix _subscription typo in metadata listener callbacks - short circuit if no partitions passed to fetch_committed_offsets - line-wrap comments - return future from commit_offsets_async - return future value from commit_offsets_sync - fix self._failed_request callback partial args - comment out metrics class for now | |||||
| * | Add error checking to mark_for_reassignment | Dana Powers | 2016-01-10 | 1 | -0/+3 | |
| | | ||||||
* | | Merge pull request #499 from dpkp/handle_disconnect | Dana Powers | 2016-01-10 | 1 | -0/+5 | |
|\ \ | |/ |/| | Refresh metadata on failed connection attempts | |||||
| * | Refresh metadata on failed connection attemptshandle_disconnect | Dana Powers | 2016-01-09 | 1 | -0/+5 | |
| | | ||||||
* | | Move ConsumerProtocol definition to kafka.coordinator.protocol | Dana Powers | 2016-01-10 | 3 | -35/+44 | |
|/ |