Commit message (Collapse) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
| * | | Check response.error for async producer | Viktor Shlapakov | 2015-06-03 | 3 | -21/+27 | |
| | | | ||||||
| * | | Async producer: py2.6 backward compatibility fix | Viktor Shlapakov | 2015-06-03 | 1 | -2/+2 | |
| | | | ||||||
| * | | Improve async producer code: logic and style fixes | Viktor Shlapakov | 2015-06-03 | 5 | -76/+75 | |
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - send_producer_request with fail_on_error=False to retry failed reqs only - using an internal dict with with namedtuple keys for retry counters - refresh metadata on refresh_error irrespective to retries options - removed infinite retries (retry_options.limit=None) as an over-feature - separate producer init args for retries options (limit,backoff,on_timeouts) - AsyncProducerQueueFull returns a list of failed messages - producer tests improved thanks to @rogaha and @toli | |||||
| * | | Increase producer test timeout | Viktor Shlapakov | 2015-06-03 | 1 | -1/+1 | |
| | | | ||||||
| * | | Change backoff message log level | Viktor Shlapakov | 2015-06-03 | 1 | -1/+1 | |
| | | | ||||||
| * | | Fix async producer queue put arguments | Viktor Shlapakov | 2015-06-03 | 1 | -2/+4 | |
| | | | ||||||
| * | | Fix names for async retries opts, add timeout for put | Viktor Shlapakov | 2015-06-03 | 4 | -20/+34 | |
| | | | ||||||
| * | | Simplification of retry logic | Viktor Shlapakov | 2015-06-03 | 2 | -31/+29 | |
| | | | ||||||
| * | | Fix small issues with names/tests | Viktor Shlapakov | 2015-06-03 | 3 | -16/+16 | |
| | | | ||||||
| * | | async queue: refactored code; add one more test | Eduard Iskandarov | 2015-06-03 | 2 | -4/+23 | |
| | | | ||||||
| * | | add producer send batch queue overfilled test | Искандаров Эдуард | 2015-06-03 | 2 | -2/+24 | |
| | | | ||||||
| * | | Disable retry on timeouts by default (old behaviour) | Viktor Shlapakov | 2015-06-03 | 1 | -1/+1 | |
| | | | ||||||
| * | | Clean and simplify retry logic | Viktor Shlapakov | 2015-06-03 | 3 | -63/+54 | |
| | | | ||||||
| * | | Arg fixes for base/keyed producers | Viktor Shlapakov | 2015-06-03 | 2 | -4/+2 | |
| | | | ||||||
| * | | Improved retry logic | Viktor Shlapakov | 2015-06-03 | 5 | -34/+76 | |
| | | | ||||||
| * | | Fixed tests and other issues after rebase | Viktor Shlapakov | 2015-06-03 | 3 | -32/+20 | |
| | | | ||||||
| * | | Returned default behaviour with no retries | Viktor Shlapakov | 2015-06-03 | 1 | -1/+1 | |
| | | | ||||||
| * | | Fix: check failed reqs to retry only for positive limit | Viktor Shlapakov | 2015-06-03 | 1 | -3/+3 | |
| | | | ||||||
| * | | Fixed compatible issues with tests | Viktor Shlapakov | 2015-06-03 | 2 | -15/+16 | |
| | | | ||||||
| * | | Producer _send_upstream fixes, added tests for retries | Viktor Shlapakov | 2015-06-03 | 2 | -6/+157 | |
| | | | ||||||
| * | | Fixed base producer imports | Viktor Shlapakov | 2015-06-03 | 1 | -1/+2 | |
| | | | ||||||
| * | | Retries for async batching | Viktor Shlapakov | 2015-06-03 | 4 | -15/+50 | |
|/ / | ||||||
* | | Merge pull request #342 from wting/fix_consumer_falsiness | Dana Powers | 2015-05-17 | 1 | -4/+4 | |
|\ \ | |/ |/| | | | Remove Consumer falsiness. | |||||
| * | Check vs None directly. | William Ting | 2015-05-17 | 1 | -4/+4 | |
|/ | ||||||
* | Merge pull request #376 from hellais/fix/offset | Dana Powers | 2015-05-14 | 1 | -1/+1 | |
|\ | | | | | Fix calling of _offsets | |||||
| * | Fix calling of _offsets | Arturo Filastò | 2015-05-14 | 1 | -1/+1 | |
|/ | | | | | | | | Previously you would see this error: ``` self.offsets._fetch[(topic, partition)], AttributeError: 'function' object has no attribute '_fetch' ``` | |||||
* | Merge pull request #367 from dpkp/clean_metadata_refresh | Dana Powers | 2015-04-12 | 1 | -13/+14 | |
|\ | | | | | Clear local metadata cache before refresh in client.load_metadata_for_topics() | |||||
| * | Update debug log messages in client.load_metadata_for_topics | Dana Powers | 2015-04-12 | 1 | -2/+2 | |
| | | ||||||
| * | clean local metadata before requesting refresh in load_metadata_for_topics() | Dana Powers | 2015-04-12 | 1 | -2/+7 | |
| | | ||||||
| * | Simplify client.reset_topic_metadata | Dana Powers | 2015-04-12 | 1 | -9/+5 | |
| | | ||||||
* | | Merge pull request #366 from dpkp/failed_payloads | Dana Powers | 2015-04-12 | 1 | -79/+77 | |
|\ \ | |/ |/| | Refactor client request/response handling to support better retries | |||||
| * | Improve send_produce_request docstring | Dana Powers | 2015-04-06 | 1 | -6/+17 | |
| | | ||||||
| * | Add debug logging for all broker-aware requests/responses | Dana Powers | 2015-04-06 | 1 | -0/+3 | |
| | | ||||||
| * | Refactor KafkaClient._send_broker_aware_request to return a list of responses | Dana Powers | 2015-04-06 | 1 | -73/+57 | |
| | | | | | | | | | | | | and include individual (unraised) FailedPayloadsError instances rather than always raising a FailedPayloadsError. This should allow producers to determine which payloads succeeded and which failed, specifically. | |||||
* | | Merge pull request #365 from dpkp/kafka_consumer_fixup | Dana Powers | 2015-04-06 | 1 | -28/+32 | |
|\ \ | |/ |/| | KafkaConsumer topic/partition fixes | |||||
| * | Use kafka_bytestring when decoding message topics in ↵ | Dana Powers | 2015-04-04 | 1 | -18/+22 | |
| | | | | | | | | KafkaConsumer.fetch_messages | |||||
| * | Use list comprehension on _topics in KafkaConsumer.fetch_messages | Dana Powers | 2015-04-04 | 1 | -8/+8 | |
| | | ||||||
| * | call _consume_topic_partition() before storing offset | Dana Powers | 2015-04-04 | 1 | -1/+1 | |
| | | | | | | | | in KafkaConsumer.set_topic_partitions((topic, partition, offset)) | |||||
| * | Fix python3 str/bytes bug in KafkaConsumer.set_topic_partitions({(topic, ↵ | Dana Powers | 2015-04-04 | 1 | -1/+1 | |
|/ | | | | partition): offset, }) | |||||
* | Merge pull request #360 from dpkp/atexit_cleanup | Dana Powers | 2015-04-04 | 2 | -4/+51 | |
|\ | | | | | Register atexit handlers for consumer and producer thread/multiprocess cleanup | |||||
| * | Register atexit handlers for consumer and producer thread/multiprocess ↵ | Dana Powers | 2015-03-31 | 2 | -4/+51 | |
| | | | | | | | | cleanup (not __del__) | |||||
* | | Merge pull request #361 from kecaps/master | Dana Powers | 2015-04-04 | 11 | -49/+69 | |
|\ \ | |/ |/| | Make external API consistently support python3 strings for topic. | |||||
| * | Make external API consistently support python3 strings for topic. | Space | 2015-04-03 | 11 | -49/+69 | |
|/ | ||||||
* | Merge pull request #356 from dpkp/always_fetch_offsets | Dana Powers | 2015-03-30 | 5 | -14/+105 | |
|\ | | | | | fetch commit offsets in base consumer unless group is None | |||||
| * | Bulk fetch offset partitions in base consumer -- suggested by ecanzonieri | Dana Powers | 2015-03-30 | 1 | -8/+9 | |
| | | ||||||
| * | Fetch previously committed offsets in base consumer class so long as | Dana Powers | 2015-03-30 | 5 | -14/+34 | |
| | | | | | | | | | | | | | | | | a group is configured (but document that group must be None for old servers). This fixes multiprocessor consumer issue that prevented access to commit offsets if auto_commit is disabled. Also refactor fetch_last_known_offsets based on KafkaConsumer While still setting unknown offsets to 0 | |||||
| * | Skip these tests: no OffsetCommitRequest for 0.8.0 | Viktor Shlapakov | 2015-03-30 | 1 | -2/+2 | |
| | | ||||||
| * | Added basic tests for load_initial_offsets option | Viktor Shlapakov | 2015-03-30 | 1 | -0/+35 | |
| | | ||||||
| * | Add test case for MP Consumer auto commit | Ali-Akber Saifee | 2015-03-30 | 1 | -0/+35 | |
| | | | | | | | | Tweak MP Consumer test to use iterator | |||||
* | | Merge pull request #355 from dpkp/correlation_id_modulo | Dana Powers | 2015-03-30 | 2 | -7/+15 | |
|\ \ | |/ |/| | correlation_id modulo |