summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * BrokerConnection: wrap socket errors in retriable ConnectionErrorDana Powers2015-12-301-3/+3
| |
| * Rename KafkaClient.connection_failed -> is_disconnectedDana Powers2015-12-302-2/+2
| |
| * Drop unused KafkaConsumer._ensure_not_closed methodDana Powers2015-12-301-4/+0
| |
| * Make group_id a Coordinator kwarg (not arg) for consistencyDana Powers2015-12-303-8/+6
| |
| * Improve removed tasks handing in DelayedTaskQueue.pop_readyDana Powers2015-12-301-2/+5
| |
| * Remove unnecessary calls in KafkaClient._pollDana Powers2015-12-301-13/+13
| | | | | | | | | | - Dont process connections; outer poll() loop does this now - Only recv connections that select says are readable
| * Resolve delayed task futures in KafkaClient.pollDana Powers2015-12-301-3/+6
| |
| * Remove unused connection_delay method from KafkaClientDana Powers2015-12-301-18/+0
| |
| * Switch configs from attributes to dict to make passing / inspecting easierDana Powers2015-12-298-211/+211
| |
| * Use _next_correlation_id() method to avoid int overflowsDana Powers2015-12-291-4/+8
| |
| * Fix log statement bug (via pylint)Dana Powers2015-12-291-1/+1
| |
| * Clean more ConsumerCoordinator docstringsDana Powers2015-12-291-16/+19
| |
| * Catch and retry on RequestTimedOutError in producer failover testDana Powers2015-12-291-2/+4
| |
| * Use ConnectionError rather than new DisconnectErrorDana Powers2015-12-292-8/+4
| |
| * Dont warn in AutoCommitTask.disable if not previously scheduledDana Powers2015-12-291-1/+1
| |
| * Improve OffsetCommit error loggingDana Powers2015-12-291-23/+33
| | | | | | | | | | | | Avoid printing full errors because they currently include long descriptions that are generally duplicative of our local error message.
| * Log request failures in AbstractCoordinator._failed_requestDana Powers2015-12-291-5/+10
| |
| * _handle_group_coordinator_response should resolve future with the coordinator idDana Powers2015-12-291-1/+1
| |
| * Improve heartbeat loggingDana Powers2015-12-291-14/+13
| |
| * Log as INFO: group join, leader election, partition assignmentsDana Powers2015-12-292-1/+5
| |
| * Improve various docstringsDana Powers2015-12-293-22/+43
| |
| * Remove extra raise and old TODO comment in coordinatorsDana Powers2015-12-292-2/+1
| |
| * Make add_assigned_partition private(ish) in SubscriptionStateDana Powers2015-12-291-3/+3
| |
| * Make more methods private(ish) in AbstractCoordinatorDana Powers2015-12-291-13/+13
| |
| * Remove recursive client.poll call in ConsumerCoordinatorDana Powers2015-12-291-2/+3
| |
| * Pass auto commit parameters from KafkaConsumer to ConsumerCoordinatorDana Powers2015-12-292-1/+3
| |
| * Fix broken SubscriptionState.is_assigned callDana Powers2015-12-291-1/+1
| |
| * Fix HeartbeatTask request_in_flight handlingDana Powers2015-12-291-1/+1
| |
| * kafka.consumer.group.KafkaConsumer: 0.9 coordinator-aware consumerDana Powers2015-12-281-797/+480
| | | | | | | | | | | | | | - use ConsumerCoordinator to manage group membership - dynamically assign partitions via group using topic subscription - use upstream configuration parameters as __init__ kwargs - metrics and SSL are still TODO
| * ConsumerCoordinator (based on upstream Java client)Dana Powers2015-12-284-0/+703
| | | | | | | | | | | | - Use RoundRobinPartitionAssignor by default - Define AbstractPartitionAssignor for custom assignors - metrics still TODO
| * AbstractCoordinator (modelled after upstream Java class)Dana Powers2015-12-284-0/+690
| | | | | | | | | | - Heartbeat class manages HeartbeatRequest / Response state - metrics are still TODO
| * Define ConsumerRebalanceListener abstract classDana Powers2015-12-281-0/+84
| |
| * Add UNKNOWN_MEMBER_ID to JoinGroupRequestDana Powers2015-12-281-0/+1
| |
| * Add DEFAULT_GENERATION_ID and DEFAULT_RETENTION_TIME to OffsetCommitRequest_v2Dana Powers2015-12-281-0/+2
| |
| * New class: kafka.consumer.fetcher.FetcherDana Powers2015-12-281-0/+523
| | | | | | | | | | - manages fetch requests via async client and subscription_state - based on upstream java client
| * Improvements to kafka.future.FutureDana Powers2015-12-281-8/+37
| | | | | | | | | | | | | | | | - log exceptions in callbacks/errors - dont raise - guarantee future.exception is an instance, not a class/type - *args, **kwargs in add_callback / errback (functools.partial) - add_both(f, *args, **kwargs) to add same f as callback and errback - chain(new_future) to trigger new_future on success / failure of this
| * New class SubscriptionState, based on upstream Java clientDana Powers2015-12-281-0/+304
| |
| * Add OffsetAndMetadata namedtupleDana Powers2015-12-281-0/+3
| |
| * Add Message.validate_crc() methodDana Powers2015-12-281-0/+7
| |
| * Add OffsetResetStrategy enum class to kafka.protocol.offsetDana Powers2015-12-281-0/+5
| |
| * Use attributes on exception classes to signal retriable and invalid metadata ↵Dana Powers2015-12-282-13/+33
| | | | | | | | errors
| * Rename TopicAndPartition -> TopicPartitionDana Powers2015-12-288-26/+26
| |
| * New async KafkaClient, based on java NetworkClient and ConsumerClientDana Powers2015-12-282-0/+510
| | | | | | | | | | | | | | - Support async client bootstrap retries after exponential backoff - Attempt to finish_connect if still connecting in KafkaClient.ready(node_id) - Run full async loop while waiting for futures in KafkaClient.poll() - Add more fallbacks to KafkaClient.least_loaded_node; worst case, retry boostrap
| * Update BrokerConnection for use with async clientDana Powers2015-12-282-39/+78
| | | | | | | | | | | | | | | | | | - use descriptive names for ConnectionStates enum values - Change default send_buffer_bytes config to 131072 - add can_send_more() and max_in_flight_requests_per_connection config - add blacked_out() and reconnect_backoff_ms config - last_attempt and last_failure are now public attributes - raise TooManyInFlightRequests in conn.send() if cant send more
| * Add ClusterMetadata.add_group_coordinator()Dana Powers2015-12-281-0/+39
| |
| * Rename Cluster -> ClusterMetadata; align with upstream Metadata classDana Powers2015-12-282-66/+125
| |
| * Remove old kafka-bin directory and verify kafka-run-class.sh exists when ↵Dana Powers2015-12-181-0/+6
| | | | | | | | installing server artifacts
| * Only download/install server artifacts if bin/kafka-run-class.sh not foundDana Powers2015-12-181-5/+6
| |
| * Switch BrokerConnection to (mostly) non-blocking IO.Dana Powers2015-12-176-154/+386
| | | | | | | | | | | | - return kafka.Future on send() - recv is now non-blocking call that completes futures when possible - update KafkaClient to block on future completion
| * new 0.9 error codes plus descriptions.Zack Dever2015-12-152-10/+172
| | | | | | | | | | reference: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-ErrorCodes
View Lorry Controller Status