Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | Add test for correlation_id rollover | Dana Powers | 2015-03-29 | 1 | -0/+8 | |
| | | ||||||
| * | Rollover KafkaClient correlation ids at 2**31 to keep within int32 protocol ↵ | Dana Powers | 2015-03-29 | 1 | -7/+7 | |
| | | | | | | | | encoding | |||||
* | | Merge pull request #357 from dpkp/del_consumer_stop | Dana Powers | 2015-03-30 | 1 | -0/+3 | |
|\ \ | | | | | | | Stop consumers on delete | |||||
| * | | Stop consumers on delete | Dana Powers | 2015-03-30 | 1 | -0/+3 | |
| |/ | ||||||
* | | Merge pull request #341 from dpkp/kafka_consumer_docs | Dana Powers | 2015-03-29 | 4 | -149/+185 | |
|\ \ | |/ |/| | KafkaConsumer documentation | |||||
| * | Use bootstrap_servers interface in tests | Dana Powers | 2015-03-29 | 1 | -1/+1 | |
| | | ||||||
| * | Add sphinx_rtd_theme to docs requirements.txt | Dana Powers | 2015-03-29 | 1 | -0/+1 | |
| | | ||||||
| * | Updates to KafkaConsumer usage docs | Dana Powers | 2015-03-29 | 1 | -42/+26 | |
| | | ||||||
| * | fixup kafka consumer docstring | Dana Powers | 2015-03-29 | 1 | -1/+1 | |
| | | ||||||
| * | Move KafkaConsumer usage examples to docs/usage; Put KeyedProducer usage ↵ | Dana Powers | 2015-03-29 | 1 | -14/+105 | |
| | | | | | | | | right after SimpleProducer | |||||
| * | Improve KafkaConsumer docstrings | Dana Powers | 2015-03-29 | 1 | -134/+94 | |
|/ | ||||||
* | Merge pull request #340 from dpkp/deprecate_metadata_broker_list | Dana Powers | 2015-03-29 | 1 | -8/+26 | |
|\ | | | | | Deprecate metadata_broker_list in favor of bootstrap_servers | |||||
| * | Deprecate KafkaConsumer config metadata_broker_list in favor of ↵ | Dana Powers | 2015-03-23 | 1 | -8/+26 | |
| | | | | | | | | bootstrap_servers | |||||
* | | Merge pull request #336 from scrapinghub/feature-mp-consumer-params | Dana Powers | 2015-03-29 | 5 | -38/+57 | |
|\ \ | | | | | | | Using additional params for MP consumer child process | |||||
| * | | Manageable queue.put() operation for MPConsumer processes | Viktor Shlapakov | 2015-03-25 | 2 | -4/+12 | |
| | | | ||||||
| * | | Added pylint.rc: ignoring SyncManager for pylint | Viktor Shlapakov | 2015-03-24 | 2 | -1/+3 | |
| | | | ||||||
| * | | Using mp.manager to solve the issue with join for MPConsumer | Viktor Shlapakov | 2015-03-24 | 1 | -6/+7 | |
| | | | ||||||
| * | | Moving to **kwargs for MPConsumer options | Viktor Shlapakov | 2015-03-24 | 2 | -6/+5 | |
| | | | ||||||
| * | | Using iter_timeout=0 for MP inner consumer in tests | Viktor Shlapakov | 2015-03-13 | 1 | -1/+4 | |
| | | | ||||||
| * | | Moved additional MP consumer options to **kwargs | Viktor Shlapakov | 2015-03-13 | 1 | -3/+3 | |
| | | | ||||||
| * | | Using additional params for MP consumer child process | Viktor Shlapakov | 2015-03-13 | 1 | -26/+32 | |
| | | | | | | | | | | | | | | | | | | | | | - Moved the events params to a separate param for consistency - Passing additional params to internal SimpleConsumer worker for multiprocessing high-level consumer. It allows to use non-default consumer settings (fetch_size_bytes, buffer_size, max_buffer_size). | |||||
* | | | Merge pull request #350 from ecanzonieri/enable_commit_on_seek | Dana Powers | 2015-03-29 | 1 | -1/+1 | |
|\ \ \ | | | | | | | | | Enable commit on seek | |||||
| * | | | Increase count_since_commit on seek | Enrico Canzonieri | 2015-03-20 | 1 | -1/+1 | |
| |/ / | | | | | | | | | | | | | | | | When auto_commit is False this change enables an explicit call to commit() to actually commit the offsets. Otherwise a consumer won't be able to commit until at least one message is read. | |||||
* | | | Merge pull request #338 from dpkp/structs_reorg | Dana Powers | 2015-03-29 | 1 | -23/+26 | |
|\ \ \ | | | | | | | | | Fixup indentation in kafka/common.py; add links to protocol definitions | |||||
| * | | | Fixup indentation in kafka/common.py; add links to protocol definitions | Dana Powers | 2015-03-08 | 1 | -23/+26 | |
| | |/ | |/| | ||||||
* | | | Merge pull request #337 from dpkp/gzip_context | Dana Powers | 2015-03-29 | 1 | -23/+32 | |
|\ \ \ | | | | | | | | | Use context managers in gzip_encode / gzip_decode | |||||
| * | | | Take the linter to kafka/codec.py | Dana Powers | 2015-03-09 | 1 | -11/+10 | |
| | | | | ||||||
| * | | | Gzip context manager not supported in py2.6, so use try/finally instead | Dana Powers | 2015-03-09 | 1 | -2/+17 | |
| | | | | ||||||
| * | | | Use context managers in gzip_encode / gzip_decode | Dana Powers | 2015-03-08 | 1 | -12/+7 | |
| |/ / | ||||||
* | | | Merge pull request #329 from vshlapakov/feature-batch-msg-keys | Dana Powers | 2015-03-29 | 4 | -16/+76 | |
|\ \ \ | |_|/ |/| | | Correct message keys for async batching mode | |||||
| * | | Correct message keys for async batching mode | Viktor Shlapakov | 2015-02-25 | 4 | -16/+76 | |
| | | | ||||||
* | | | Merge pull request #335 from scrapinghub/fix-mp-consumer-distribution | Dana Powers | 2015-03-12 | 1 | -10/+12 | |
|\ \ \ | |_|/ |/| | | Wrong partitions distribution logic for MP Consumer | |||||
| * | | Used thread-safe dict.copy().keys() for MP consumer partitions | Viktor Shlapakov | 2015-03-12 | 1 | -1/+4 | |
| | | | ||||||
| * | | Cleaned code for MP consumer chunking | Viktor Shlapakov | 2015-03-11 | 1 | -10/+9 | |
| | | | ||||||
| * | | Fixing distribution for MP Consumer | Viktor Shlapakov | 2015-03-03 | 1 | -1/+1 | |
| |/ | ||||||
* | | Merge branch 'vshlapakov-feature-async-threading' | Dana Powers | 2015-03-08 | 3 | -26/+73 | |
|\ \ | | | | | | | | | | | | | | | | | | | PR 330: Threading for async batching Conflicts: kafka/producer/base.py | |||||
| * | | Async producer stop() fix | Viktor Shlapakov | 2015-02-26 | 1 | -2/+2 | |
| | | | ||||||
| * | | Using threading.Event to stop async producer thread | Viktor Shlapakov | 2015-02-26 | 1 | -5/+10 | |
| | | | ||||||
| * | | Returned original tests, rm dirty flag, name fixes | Viktor Shlapakov | 2015-02-25 | 3 | -25/+61 | |
| | | | ||||||
| * | | Make KafkaConnection copies usable across threads | Alexey Borzenkov | 2015-02-25 | 1 | -0/+4 | |
| | | | ||||||
| * | | Trying to use threading for async batching | Viktor Shlapakov | 2015-02-25 | 1 | -3/+5 | |
| | | | ||||||
* | | | Merge branch 'jobevers-master' | Dana Powers | 2015-03-08 | 1 | -1/+3 | |
|\ \ \ | | | | | | | | | | | | | PR 302: Add failed_payloads attribute to FailedPayloadsError | |||||
| * | | | Add failed_payloads attribute to FailedPayloadsError | Job Evers | 2015-03-08 | 1 | -1/+3 | |
| | | | | ||||||
* | | | | Merge pull request #332 from dpkp/kafka_client_edits | Dana Powers | 2015-03-07 | 2 | -14/+11 | |
|\ \ \ \ | | | | | | | | | | | Kafka client edits | |||||
| * | | | | KafkaClient.get_partition_ids_for_topic now returns empty list for unknown ↵ | Dana Powers | 2015-03-02 | 1 | -1/+1 | |
| | | | | | | | | | | | | | | | | | | | | topics | |||||
| * | | | | Add comment about no server response case in _send_broker_aware_request | Dana Powers | 2015-03-02 | 1 | -0/+5 | |
| | | | | | ||||||
| * | | | | Avoid topic_partitions KeyError in KafkaClient | Dana Powers | 2015-03-02 | 1 | -1/+1 | |
| | | | | | ||||||
| * | | | | Remove KafkaConsumer.BYTES_CONFIGURATION_KEYS | Dana Powers | 2015-03-01 | 1 | -11/+2 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - rely on KafkaClient to handle client_id string/bytes encoding - accept either string or bytes for group_id - convert group_id string to utf-8 bytes internally | |||||
| * | | | | Accept KafkaClient client_id as string or bytes; encode string client_id as ↵ | Dana Powers | 2015-03-01 | 1 | -1/+2 | |
| | |_|/ | |/| | | | | | | | | | | utf-8 bytes internally | |||||
* | | | | Merge pull request #324 from chmduquesne/master | Dana Powers | 2015-03-02 | 2 | -0/+9 | |
|\ \ \ \ | | | | | | | | | | | Properly destroying the objects that contain daemonized threads |