summaryrefslogtreecommitdiff
path: root/kafka/producer
Commit message (Collapse)AuthorAgeFilesLines
* Vendor `six` consistentlyJeff Widman2018-10-221-2/+2
| | | | Use vendored `six`, and also `six.moves.range` rather than `xrange`
* Update remote urls: snappy, https, etcJeff Widman2018-10-221-2/+2
| | | | | Snappy URL was outdated. Similarly, many of these sites now support https.
* Support produce with Kafka record headersHeikki Nousiainen2018-09-273-17/+27
|
* add kerberos domain name config for gssapi sasl mechanism handshake (#1542)the-sea2018-08-311-1/+4
|
* add support for smaller topic metadata fetch during bootstrap (#1541)Ning Xie2018-08-311-0/+1
|
* Document connections_max_idle_msJeff Widman2018-06-261-0/+5
| | | | | This was added in #1068 but never documented. Fix #1497
* Don't use `kafka.common` internally1.3.5Jeff Widman2018-06-053-8/+8
| | | | This finishes the split from `kafka.common` to `kafka.errors`/`kafka.structs`.
* Stop shadowing `ConnectionError`Jeff Widman2018-05-231-1/+0
| | | | | | | | | | In Python3, `ConnectionError` is a native exception. So rename our custom one to `KafkaConnectionError` to prevent accidentally shadowing the native one. Note that there are still valid uses of `ConnectionError` in this code. They already expect a native Python3 `ConnectionError`, and also already handle the Python2 compatibility issues.
* Change SimpleProducer to use async_send (async is reserved in py37) (#1454)Dana Powers2018-03-233-17/+25
|
* Validate that serializers generate bytes-like (or None) data (#1420)Dana Powers2018-03-101-2/+3
|
* Do not validate api_version against known versions (#1434)Dana Powers2018-03-101-2/+1
|
* Fix byte size estimation with kafka producer (#1393)Blake Embrey2018-02-241-1/+1
|
* use absolute imports everywhere (#1362)Kevin Tindall2018-02-068-33/+33
|
* fix reconnect_backoff_max_ms default config bug in KafkaProducer (#1352)C.YAO2018-01-231-1/+1
|
* Read all available socket bytes (#1332)Dana Powers2018-01-101-0/+2
| | | | * Recv all available network bytes before parsing * Add experimental support for configuring socket chunking parameters
* Raise non-API exceptions (#1316)Jeff Widman2017-12-211-5/+1
| | | | | | | | | | | | | The original intent was to catch API exceptions (errors returned by the broker when trying to produce a message) and delegate them to the messages' futures. This is copied from the Java producer. However, we were accidentally catching all exceptions, thereby hiding exceptions from users unless they explicitly check the result of the future. Much better to raise client-side errors directly in the foreground so the user is immediately aware of them and can decide how to handle. Fix #1274
* use python standard max value (#1303)lukeWx2017-12-072-2/+2
|
* Add DefaultRecordBatch implementation aka V2 message format parser/builder. ↵Taras Voinarovskyi2017-10-252-6/+18
| | | | | (#1185) Added bytecode optimization for varint and append/read_msg functions. Mostly based on avoiding LOAD_GLOBAL calls.
* Fix timestamp not passed to RecordMetadata (#1273)Taras Voinarovskyi2017-10-222-7/+8
| | | | | | | | * Fix timestamp not being passed to RecordMetadata properly * Add more tests for LegacyBatch * Fix producer test for recordmetadata
* Fix overriding sasl_kerberos_service_name in KafkaConsumer / KafkaProducer ↵Nathanael Smith2017-10-171-0/+3
| | | | (#1264)
* Added minor fixes for PR reviewTaras2017-10-122-16/+4
|
* Remove the check for timestamp None in producer, as it's done in RecordBatch ↵Taras2017-10-121-2/+0
| | | | | | anyway. Minor abc doc fixes.
* Refactor MessageSet and Message into LegacyRecordBatch to later support v2 ↵Taras2017-10-114-180/+90
| | | | message format
* Expand metrics docs (#1243)Jeff Widman2017-10-081-6/+15
| | | | | | * Expand metrics docstrings * Document metrics interface in readme * Use six.iteritems(d) rather than d.items() * Use Sphinx warning syntax
* Remove a few unused imports (#1188)James Lamb2017-08-291-1/+1
| | | | | * Removed a few unused imports * Added note on socketpair monkey-path
* Drop unused sleep kwarg to poll (#1177)Dana Powers2017-08-151-1/+1
|
* Fix batch expiry messages to state secondsDominic Evans2017-07-261-3/+3
| | | | | time.time() is seconds since epoch, and the deltas are also calculated in seconds
* Add note, that `max_in_flight_requests_per_connection>1` may change order or ↵Taras Voinarovskyi2017-07-171-1/+4
| | | | messages (#1149)
* producer: fix produce timeout message (#1151)Mika Eloranta2017-07-171-1/+1
|
* Use logging's built-in string interpolationJeff Widman2017-07-071-2/+1
|
* producer: Set exit timeout to 0 for atexit handler to match __del__ (#1126)Hannu Valtonen2017-06-191-1/+1
| | | | | | | | Hit a problem with pytest hitting the atexit handler and waiting for close() timeout forever at teardown. This commit makes atexit close() equivalent to __del__ behavior, namely using timeout of 0 for close() completion. If you need a longer timeout you should be setting it explicitly.
* KIP-144: Exponential backoff for broker reconnections (#1124)Dana Powers2017-06-191-0/+9
|
* Update exception docstringAndrew Kowalik2017-06-161-1/+1
|
* raise KafkaTimeoutException when flush times outAndrew Kowalik2017-06-162-2/+9
|
* Improve error message when expiring batches in KafkaProducer (#1077)Dana Powers2017-05-031-7/+11
|
* Follow-up to #1068: remove not-implemented commentsDana Powers2017-04-101-1/+1
|
* Timeout idle connections via connections_max_idle_ms (#1068)Dana Powers2017-04-101-1/+1
|
* Fixup :meth: sphinx documentation for use in KafkaConsumer.rst etcDana Powers2017-03-071-12/+14
|
* change default timeout of KafkaProducer.close() to threading.TIMEOUT_MAXgaosheng2017-03-061-2/+6
|
* Add sphinx formatting to hyperlink methods (#898)Jeff Widman2017-03-032-11/+13
|
* Replace %s with %r in producer debug log message (#973)Alex2017-03-031-1/+1
|
* Issue 985: Clear memory wait condition before raising Exception (#999)Dana Powers2017-03-021-0/+1
|
* Fix BrokerConnection api_version docs default (#909)Jeff Widman2017-02-281-4/+4
|
* PEP-8: Spacing & removed unused imports (#899)Jeff Widman2017-02-092-6/+6
|
* Add kafka.serializer interfaces (#912)Dana Powers2016-12-191-12/+13
|
* Sort partitions before calling partitioner (#905)ms7s2016-12-191-1/+1
|
* Fixup doc references to max_in_flight_requests_per_connectionDana Powers2016-12-172-2/+2
|
* DOC: Fix typo 'Defualt' -> 'Default'. (#895)Rolando (Max) Espinoza2016-11-301-1/+1
|
* :wPass timestamp into Message, not just mimic it (#875)Taras Voinarovskyi2016-11-181-2/+6
|
* Fix typosJeff Widman2016-11-141-1/+1
|