Skip to content
代码片段 群组 项目
  1. 10月 16, 2020
  2. 10月 09, 2020
    • Ismael Juma's avatar
      CONFLUENT: Sync from apache/kafka (8 October 2020) · 83f1575a
      Ismael Juma 创作于
      * commit '2804257f': (67 commits)
        KAFKA-10562: Properly invoke new StateStoreContext init (#9388)
        MINOR: trivial cleanups, javadoc errors, omitted StateStore tests, etc. (#8130)
        KAFKA-10564: only process non-empty task directories when internally cleaning obsolete state stores (#9373)
        KAFKA-9274: fix incorrect default value for `task.timeout.ms` config (#9385)
        KAFKA-10362: When resuming Streams active task with EOS, the checkpoint file is deleted (#9247)
        KAFKA-10028: Implement write path for feature versioning system (KIP-584) (#9001)
        KAFKA-10402: Upgrade system tests to python3 (#9196)
        KAFKA-10186; Abort transaction with pending data with TransactionAbortedException (#9280)
        MINOR: Remove `TargetVoters` from `DescribeQuorum` (#9376)
        Revert "KAFKA-10469: Resolve logger levels hierarchically (#9266)"
        MINOR: Don't publish javadocs for raft module (#9336)
        KAFKA-9929: fix: add missing default implementations (#9321)
        KAFKA-10188: Prevent SinkTask::preCommit from being called after SinkTask::stop (#8910)
        KAFKA-10338; Support PEM format for SSL key and trust stores (KIP-651) (#9345)
        KAFKA-10527; Voters should not reinitialize as leader in same epoch (#9348)
        MINOR: Refactor unit tests around RocksDBConfigSetter (#9358)
        KAFKA-6733: Printing additional ConsumerRecord fields in DefaultMessageFormatter (#9099)
        MINOR: Annotate test BlockingConnectorTest as integration test (#9379)
        MINOR: Fix failing test due to KAFKA-10556 PR (#9372)
        KAFKA-10439: Connect's Values to parse BigInteger as Decimal with zero scale. (#9320)
        ...
      83f1575a
  3. 10月 08, 2020
    • John Roesler's avatar
      KAFKA-10562: Properly invoke new StateStoreContext init (#9388) · 2804257f
      John Roesler 创作于
      * all wrapping stores should pass StateStoreContext init through to the same
        method on the wrapped store and not translate it to ProcessorContext init
      * base-level stores should handle StateStoreContext init so that callers passing
        a non-InternalProcessorContext implementation will be able to initialize the store
      * extra tests are added to verify the desired behavior
      
      Reviewers: Guozhang Wang <guozhang@apache.org>
      2804257f
    • Lee Dongjin's avatar
      MINOR: trivial cleanups, javadoc errors, omitted StateStore tests, etc. (#8130) · 8d4bbf22
      Lee Dongjin 创作于
      Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>, Guozhang Wang <guozhang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
      8d4bbf22
    • Michael Bingham's avatar
      KAFKA-10564: only process non-empty task directories when internally cleaning... · 250c71b5
      Michael Bingham 创作于
      KAFKA-10564: only process non-empty task directories when internally cleaning obsolete state stores (#9373)
      
      Avoid continuous repeated logging by not trying to clean empty task directories, which are longer fully deleted during internal cleanup as of https://issues.apache.org/jira/browse/KAFKA-6647.
      
      Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
      250c71b5
    • Matthias J. Sax's avatar
      KAFKA-9274: fix incorrect default value for `task.timeout.ms` config (#9385) · 65c29a9d
      Matthias J. Sax 创作于
       - part of KIP-572
       - also add handler method to trigger/reset the timeout on a task
      
      Reviewer: John Roesler <john@confluent.io>
      65c29a9d
    • Sharath Bhat's avatar
      KAFKA-10362: When resuming Streams active task with EOS, the checkpoint file is deleted (#9247) · a8b5f5a4
      Sharath Bhat 创作于
      Deleted the checkpoint file before the transition from SUSPENDED state to RESTORING state
      
      Reviewers: Guozhang Wang <wangguoz@gmail.com>
      a8b5f5a4
    • Kowshik Prakasam's avatar
      KAFKA-10028: Implement write path for feature versioning system (KIP-584) (#9001) · fb4f2972
      Kowshik Prakasam 创作于
      Summary:
      In this PR, I have implemented the write path of the feature versioning system (KIP-584). Here is a summary of what's in this PR:
      
      New APIs in org.apache.kafka.clients.admin.Admin interface, and their client and server implementations. These APIs can be used to describe features and update finalized features. These APIs are: Admin#describeFeatures and Admin#updateFeatures.
      The write path is provided by the Admin#updateFeatures API. The corresponding server-side implementation is provided in KafkaApis and KafkaController classes. This can be a good place to start the code review.
      The write path is supplemented by Admin#describeFeatures client API. This does not translate 1:1 to a server-side API. Instead, under the hood the API makes an explicit ApiVersionsRequest to the Broker to fetch the supported and finalized features.
      Implemented a suite of integration tests in UpdateFeaturesTest.scala that thoroughly exercises the various cases in the write path.
      
      Other changes:
      
      The data type of the FinalizedFeaturesEpoch field in ApiVersionsResponse has been modified from int32 to int64. This change is to conform with the latest changes to the KIP explained in the voting thread.
      Along the way, the class SupportedFeatures has been renamed to be called BrokerFeatures, and, it now holds both supported features as well as default minimum version levels.
      For the purpose of testing, both the BrokerFeatures and FinalizedFeatureCache classes have been changed to be no longer singleton in implementation. Instead, these are now instantiated once and maintained in KafkaServer. The singleton instances are passed around to various classes, as needed.
      
      Reviewers: Boyang Chen <boyang@confluent.io>, Jun Rao <junrao@gmail.com>
      fb4f2972
    • Nikolay's avatar
      KAFKA-10402: Upgrade system tests to python3 (#9196) · 4e65030e
      Nikolay 创作于
      For now, Kafka system tests use python2 which is outdated and not supported.
      This PR upgrades python to the third version.
      
      Reviewers: Ivan Daschinskiy, Mickael Maison <mickael.maison@gmail.com>, Magnus Edenhill <magnus@edenhill.se>, Guozhang Wang <wangguoz@gmail.com>
      4e65030e
    • Gokul Srinivas's avatar
      KAFKA-10186; Abort transaction with pending data with TransactionAbortedException (#9280) · 40a23cc0
      Gokul Srinivas 创作于
      If a transaction is aborted with no underlying exception, throw a new kind of exception - `TransactionAbortedException` to
      distinguish this from other fatal exceptions.
      
      This API change is documented in KIP-654: https://cwiki.apache.org/confluence/display/KAFKA/KIP-654:+Aborted+transaction+with+non-flushed+data+should+throw+a+non-fatal+exception.
      
      Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Jason Gustafson <jason@confluent.io>
      40a23cc0
    • Jason Gustafson's avatar
      MINOR: Remove `TargetVoters` from `DescribeQuorum` (#9376) · 218135a4
      Jason Gustafson 创作于
      This field is leftover from the early days of the KIP when it covered reassignment. The API is not exposed yet, so there is no harm updating the first version.
      
      Reviewers: Ismael Juma <ismael@juma.me.uk>
      218135a4
  4. 10月 07, 2020
  5. 10月 06, 2020
  6. 10月 03, 2020
  7. 10月 02, 2020
    • Shaik Zakir Hussain's avatar
      KAFKA-10477: Fix JsonConverter regression to treat MISSING nodes as NULL nodes (#9306) · ca559a2d
      Shaik Zakir Hussain 创作于
      Fixes a regression introduced in `JsonConverter` with previous upgrades from Jackson Databind 2.9.x to 2.10.x. Jackson Databind version 2.10.0 included a backward-incompatible behavioral change to use `JsonNodeType.MISSING` (and `MissingNode`, the subclass of `JsonNode` that has a type of `MISSING`) instead of `JsonNodeType.NULL` / `NullNode`. See https://github.com/FasterXML/jackson-databind/issues/2211 for details of this change.
      
      This change makes recovers the older `JsonConverter` behavior of returning null on empty input.
      
      Added two unit tests for this change. Both unit tests were independently tested with earlier released versions and passed on all versions that used Jackson 2.9.x and earlier, and failed on all versions that used 2.10.x and that did not have the fixed included in the PR. Both of the new unit tests pass with this fix to `JsonConverter`.
      
      Author: Shaik Zakir Hussain <zhussain@confluent.io>
      Reviewer: Randall Hauch <rhauch@gmail.com>
      ca559a2d
    • Edoardo Comar's avatar
      KAFKA-10557: Missing docs when describing topic configs including (#9360) · 3edb94eb
      Edoardo Comar 创作于
      
      
      Reviewers: Rajini Sivaram <rajinisivaram@gmail.com>
      
      Co-authored-by: default avatarEdoardo Comar <ecomar@uk.ibm.com>
      Co-authored-by: default avatarMickael Maison <mickael.maison@gmail.com>
      3edb94eb
    • Andre Araujo's avatar
      KAFKA-10478: Allow duplicated ports in advertised.listeners (#9281) · 57c22168
      Andre Araujo 创作于
      Remove the requirement for unique port numbers for the advertised.listener parameters.
      This restriction makes for the listeners parameter but there's not reason to apply the
      same logic for advertised.listeners.
      
      Being able to do this opens possibilities for some practical applications when using
      Kerberos authentication. For example, when configuring Kafka using Kerberos authentication
      and a Load Balancer we need to have two SASL_SSL listeners: (A) one running with the
      kafka/hostname principal and (B) another using kafka/lb_name, which is necessary for
      proper authentication when using the LB FQDN. After bootstrap, though, the client receives
      the brokers' addresses with the actual host FQDNs advertised by the brokers. To connect
      to the brokerd using the hostnames the client must connect to the listener A to be able to
      authenticate successfully with Kerberos.
      
      Author: Andre Araujo <asdaraujo@gmail.com>
      
      Reviewers: Mickael Maison <mickael.maison@gmail.com>, Viktor Somogyi-Vass <viktorsomogyi@gmail.com>, Tom Bentley <tbentley@redhat.com>
      57c22168
    • Guozhang Wang's avatar
      KAFKA-10134 Follow-up: Set the re-join flag in heartbeat failure (#9354) · 3bc2df76
      Guozhang Wang 创作于
      Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Boyang Chen <boyang@confluent.io>
      3bc2df76
  8. 10月 01, 2020
加载中