summaryrefslogtreecommitdiff
path: root/kafka/producer/kafka.py
Commit message (Collapse)AuthorAgeFilesLines
* Raise non-API exceptions (#1316)Jeff Widman2017-12-211-5/+1
| | | | | | | | | | | | | The original intent was to catch API exceptions (errors returned by the broker when trying to produce a message) and delegate them to the messages' futures. This is copied from the Java producer. However, we were accidentally catching all exceptions, thereby hiding exceptions from users unless they explicitly check the result of the future. Much better to raise client-side errors directly in the foreground so the user is immediately aware of them and can decide how to handle. Fix #1274
* use python standard max value (#1303)lukeWx2017-12-071-1/+1
|
* Add DefaultRecordBatch implementation aka V2 message format parser/builder. ↵Taras Voinarovskyi2017-10-251-4/+11
| | | | | (#1185) Added bytecode optimization for varint and append/read_msg functions. Mostly based on avoiding LOAD_GLOBAL calls.
* Fix overriding sasl_kerberos_service_name in KafkaConsumer / KafkaProducer ↵Nathanael Smith2017-10-171-0/+3
| | | | (#1264)
* Added minor fixes for PR reviewTaras2017-10-121-1/+1
|
* Remove the check for timestamp None in producer, as it's done in RecordBatch ↵Taras2017-10-121-2/+0
| | | | | | anyway. Minor abc doc fixes.
* Refactor MessageSet and Message into LegacyRecordBatch to later support v2 ↵Taras2017-10-111-9/+34
| | | | message format
* Expand metrics docs (#1243)Jeff Widman2017-10-081-6/+15
| | | | | | * Expand metrics docstrings * Document metrics interface in readme * Use six.iteritems(d) rather than d.items() * Use Sphinx warning syntax
* Add note, that `max_in_flight_requests_per_connection>1` may change order or ↵Taras Voinarovskyi2017-07-171-1/+4
| | | | messages (#1149)
* producer: fix produce timeout message (#1151)Mika Eloranta2017-07-171-1/+1
|
* producer: Set exit timeout to 0 for atexit handler to match __del__ (#1126)Hannu Valtonen2017-06-191-1/+1
| | | | | | | | Hit a problem with pytest hitting the atexit handler and waiting for close() timeout forever at teardown. This commit makes atexit close() equivalent to __del__ behavior, namely using timeout of 0 for close() completion. If you need a longer timeout you should be setting it explicitly.
* KIP-144: Exponential backoff for broker reconnections (#1124)Dana Powers2017-06-191-0/+9
|
* Update exception docstringAndrew Kowalik2017-06-161-1/+1
|
* raise KafkaTimeoutException when flush times outAndrew Kowalik2017-06-161-0/+4
|
* Follow-up to #1068: remove not-implemented commentsDana Powers2017-04-101-1/+1
|
* Timeout idle connections via connections_max_idle_ms (#1068)Dana Powers2017-04-101-1/+1
|
* Fixup :meth: sphinx documentation for use in KafkaConsumer.rst etcDana Powers2017-03-071-12/+14
|
* change default timeout of KafkaProducer.close() to threading.TIMEOUT_MAXgaosheng2017-03-061-2/+6
|
* Add sphinx formatting to hyperlink methods (#898)Jeff Widman2017-03-031-8/+8
|
* Replace %s with %r in producer debug log message (#973)Alex2017-03-031-1/+1
|
* Fix BrokerConnection api_version docs default (#909)Jeff Widman2017-02-281-4/+4
|
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-091-4/+4
|
* Add kafka.serializer interfaces (#912)Dana Powers2016-12-191-12/+13
|
* Sort partitions before calling partitioner (#905)ms7s2016-12-191-1/+1
|
* Fixup doc references to max_in_flight_requests_per_connectionDana Powers2016-12-171-1/+1
|
* DOC: Fix typo 'Defualt' -> 'Default'. (#895)Rolando (Max) Espinoza2016-11-301-1/+1
|
* Added ssl_password config option to KafkaProducer class, identical to… (#830)kierkegaard132016-09-151-0/+3
| | | | | | | | * Added ssl_password config option to KafkaProducer class, identical to option in KafkaConsumer class * removed non-ascii characters * changed - to : in comments
* Improve KafkaProducer docstring re retries configDana Powers2016-08-201-3/+5
|
* Instrument bufferpool-wait-ratio metric in KafkaProducerconn_metricsDana Powers2016-08-041-1/+1
|
* Fix misspelling of "password" (#793)Samuel Taylor2016-08-041-1/+1
|
* implement sasl PLAIN mechanismLars Jørgen Solberg2016-08-031-1/+12
|
* Clarify api_version=str deprecation warningDana Powers2016-08-021-1/+1
|
* Rename _DEFAULT_CONFIG -> DEFAULT_CONFIG in KafkaProducer (#788)Dana Powers2016-08-011-2/+2
| | | - also update internal classes RecordAccumulator and Sender
* Use socket_options configuration to setsockopts(). Default TCP_NODELAY (#783)Dana Powers2016-08-011-0/+5
|
* Add KafkaClient metricsmore_metricsDana Powers2016-07-171-1/+2
|
* KAFKA-3196: Add checksum and size to RecordMetadata and ConsumerRecord ↵Dana Powers2016-07-171-4/+6
| | | | (#770 / #594)
* Expose selector type as config option (#764)Dana Powers2016-07-161-1/+5
|
* Update kafka configuration links -> 0.10.0.0 docsDana Powers2016-07-161-1/+1
|
* First stab at public metrics() interface for KafkaConsumer / KafkaProducerDana Powers2016-07-161-0/+15
|
* Add initial producer-sender metricsDana Powers2016-07-161-2/+23
|
* Add api_version config to KafkaClient, deprecate str in favor of tuples (#761)Dana Powers2016-07-161-12/+18
|
* Avoid AttributeErrors in _unregister_cleanup (#747)Dana Powers2016-07-051-1/+1
|
* allow client.check_version timeout to be set in Producer and Consumer ↵eastlondoner2016-06-291-1/+5
| | | | | constructors (#647) * allow client.check_version timeout to be set in Producer and Consumer constructors
* Clarify timeout unit (#734)ms7s2016-06-211-1/+8
|
* Use weakref when registering a producer.close atexit to fix normal gc (#728)Dana Powers2016-06-181-3/+37
| | | | * Use weakref when registering a producer.close atexit to fix normal gc * Test that del(producer) terminates async thread
* KAFKA-3197: when max.in.flight.request.per.connection = 1, attempt to ↵Dana Powers2016-05-221-0/+2
| | | | guarantee ordering (#698)
* Use Fetch/Produce API v2 for brokers >= 0.10 (uses message format v1) (#694)Dana Powers2016-05-221-1/+2
|
* KAFKA-3025: Message v1 -- add timetamp and use relative offset in compressed ↵Dana Powers2016-05-221-4/+11
| | | | messagesets
* Add CRL support to SSL support (#683)Vincent Bernat2016-05-191-0/+6
| | | | A user can provide a CRL whose peer certificate will be checked against. This only works with Python 3.4+ and Python 2.7.9+.
* Add protocol support for ApiVersionRequest; identify 0.10 brokers in ↵check_version_0_10Dana Powers2016-05-021-1/+1
| | | | check_version