- 10月 16, 2020
- 10月 09, 2020
-
-
由 Ismael Juma 创作于
* commit '2804257f': (67 commits) KAFKA-10562: Properly invoke new StateStoreContext init (#9388) MINOR: trivial cleanups, javadoc errors, omitted StateStore tests, etc. (#8130) KAFKA-10564: only process non-empty task directories when internally cleaning obsolete state stores (#9373) KAFKA-9274: fix incorrect default value for `task.timeout.ms` config (#9385) KAFKA-10362: When resuming Streams active task with EOS, the checkpoint file is deleted (#9247) KAFKA-10028: Implement write path for feature versioning system (KIP-584) (#9001) KAFKA-10402: Upgrade system tests to python3 (#9196) KAFKA-10186; Abort transaction with pending data with TransactionAbortedException (#9280) MINOR: Remove `TargetVoters` from `DescribeQuorum` (#9376) Revert "KAFKA-10469: Resolve logger levels hierarchically (#9266)" MINOR: Don't publish javadocs for raft module (#9336) KAFKA-9929: fix: add missing default implementations (#9321) KAFKA-10188: Prevent SinkTask::preCommit from being called after SinkTask::stop (#8910) KAFKA-10338; Support PEM format for SSL key and trust stores (KIP-651) (#9345) KAFKA-10527; Voters should not reinitialize as leader in same epoch (#9348) MINOR: Refactor unit tests around RocksDBConfigSetter (#9358) KAFKA-6733: Printing additional ConsumerRecord fields in DefaultMessageFormatter (#9099) MINOR: Annotate test BlockingConnectorTest as integration test (#9379) MINOR: Fix failing test due to KAFKA-10556 PR (#9372) KAFKA-10439: Connect's Values to parse BigInteger as Decimal with zero scale. (#9320) ...
-
- 10月 08, 2020
-
-
由 John Roesler 创作于
* all wrapping stores should pass StateStoreContext init through to the same method on the wrapped store and not translate it to ProcessorContext init * base-level stores should handle StateStoreContext init so that callers passing a non-InternalProcessorContext implementation will be able to initialize the store * extra tests are added to verify the desired behavior Reviewers: Guozhang Wang <guozhang@apache.org>
-
由 Lee Dongjin 创作于
Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>, Guozhang Wang <guozhang@confluent.io>, Matthias J. Sax <matthias@confluent.io>
-
由 Michael Bingham 创作于
KAFKA-10564: only process non-empty task directories when internally cleaning obsolete state stores (#9373) Avoid continuous repeated logging by not trying to clean empty task directories, which are longer fully deleted during internal cleanup as of https://issues.apache.org/jira/browse/KAFKA-6647. Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
-
由 Matthias J. Sax 创作于
- part of KIP-572 - also add handler method to trigger/reset the timeout on a task Reviewer: John Roesler <john@confluent.io>
-
由 Sharath Bhat 创作于
Deleted the checkpoint file before the transition from SUSPENDED state to RESTORING state Reviewers: Guozhang Wang <wangguoz@gmail.com>
-
由 Kowshik Prakasam 创作于
Summary: In this PR, I have implemented the write path of the feature versioning system (KIP-584). Here is a summary of what's in this PR: New APIs in org.apache.kafka.clients.admin.Admin interface, and their client and server implementations. These APIs can be used to describe features and update finalized features. These APIs are: Admin#describeFeatures and Admin#updateFeatures. The write path is provided by the Admin#updateFeatures API. The corresponding server-side implementation is provided in KafkaApis and KafkaController classes. This can be a good place to start the code review. The write path is supplemented by Admin#describeFeatures client API. This does not translate 1:1 to a server-side API. Instead, under the hood the API makes an explicit ApiVersionsRequest to the Broker to fetch the supported and finalized features. Implemented a suite of integration tests in UpdateFeaturesTest.scala that thoroughly exercises the various cases in the write path. Other changes: The data type of the FinalizedFeaturesEpoch field in ApiVersionsResponse has been modified from int32 to int64. This change is to conform with the latest changes to the KIP explained in the voting thread. Along the way, the class SupportedFeatures has been renamed to be called BrokerFeatures, and, it now holds both supported features as well as default minimum version levels. For the purpose of testing, both the BrokerFeatures and FinalizedFeatureCache classes have been changed to be no longer singleton in implementation. Instead, these are now instantiated once and maintained in KafkaServer. The singleton instances are passed around to various classes, as needed. Reviewers: Boyang Chen <boyang@confluent.io>, Jun Rao <junrao@gmail.com>
-
由 Nikolay 创作于
For now, Kafka system tests use python2 which is outdated and not supported. This PR upgrades python to the third version. Reviewers: Ivan Daschinskiy, Mickael Maison <mickael.maison@gmail.com>, Magnus Edenhill <magnus@edenhill.se>, Guozhang Wang <wangguoz@gmail.com>
-
由 Gokul Srinivas 创作于
If a transaction is aborted with no underlying exception, throw a new kind of exception - `TransactionAbortedException` to distinguish this from other fatal exceptions. This API change is documented in KIP-654: https://cwiki.apache.org/confluence/display/KAFKA/KIP-654:+Aborted+transaction+with+non-flushed+data+should+throw+a+non-fatal+exception. Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Jason Gustafson <jason@confluent.io>
-
由 Jason Gustafson 创作于
This field is leftover from the early days of the KIP when it covered reassignment. The API is not exposed yet, so there is no harm updating the first version. Reviewers: Ismael Juma <ismael@juma.me.uk>
-
- 10月 07, 2020
-
-
由 Ismael Juma 创作于
This reverts commit fda67018. It includes changes in the specified behavior, so a KIP must be submitted and approved before we can make the change.
-
由 Ismael Juma 创作于
Reviewers: Jason Gustafson <jason@confluent.io>
-
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
-
由 Chris Egerton 创作于
-
由 Rajini Sivaram 创作于
Adds support for SSL key and trust stores to be specified in PEM format either as files or directly as configuration values. Reviewers: Manikumar Reddy <manikumar.reddy@gmail.com>
-
由 Jason Gustafson 创作于
One of the invariants that the raft replication protocol relies on is that each record is uniquely identified by leader epoch and offset. This can be violated if a leader remains elected with the same epoch between restarts since unflushed data could be lost. Reviewers: Guozhang Wang <wangguoz@gmail.com>
-
由 Guozhang Wang 创作于
* Extract the mock RocksDBConfigSetter into a separate class. * De-dup unit tests covering RocksDBConfigSetter. Reviewers: Boyang Chen <boyang@confluent.io>
-
- 10月 06, 2020
-
-
由 Badai Aqrandista 创作于
Implementation of KIP-431 - Support of printing additional ConsumerRecord fields in DefaultMessageFormatter https://cwiki.apache.org/confluence/display/KAFKA/KIP-431%3A+Support+of+printing+additional+ConsumerRecord+fields+in+DefaultMessageFormatter Reviewers: David Jacot <djacot@confluent.io>, Bill Bejeck <bbejeck@gmail.com>
-
由 Konstantine Karantasis 创作于
`BlockingConnectorTest` was incorrectly running as a unit test. Categorize this test correctly as integration test by adding the appropriate annotation Reviewer: Randall Hauch <rhauch@gmail.com>
-
由 Ron Dagostino 创作于
Reviewers: Chia-Ping Tsai <chia7712@gmail.com>, Rajini Sivaram <rajinisivaram@googlemail.com>
-
由 Alex Diachenko 创作于
The `org.apache.kafka.connect.data.Values#parse` method parses integers, which are larger than `Long.MAX_VALUE` as `double` with `Schema.FLOAT64_SCHEMA`. That means we are losing precision for these larger integers. For example: `SchemaAndValue schemaAndValue = Values.parseString("9223372036854775808");` returns: `SchemaAndValue{schema=Schema{FLOAT64}, value=9.223372036854776E18}` Also, this method parses values that can be parsed as `FLOAT32` to `FLOAT64`. This PR changes parsing logic, to use `FLOAT32`/`FLOAT64` for numbers that don't have fraction part(`decimal.scale()!=0`) only, and use an arbitrary-precision `org.apache.kafka.connect.data.Decimal` otherwise. Also, it updates the method to parse numbers, that can be represented as `float` to `FLOAT64`. Added unit tests, that cover parsing `BigInteger`, `Byte`, `Short`, `Integer`, `Long`, `Float`, `Double` types. Reviewers: Konstantine Karantasis <k.karantasis@gmail.com>
-
由 Jason Gustafson 创作于
To avoid confusion since it is only used by `TestRaftServer`, this PR moves `RaftRequestHandler` to the `tools` package and renames it to `TestRaftRequestHandler`. Reviewers: Guozhang Wang <wangguoz@gmail.com>
-
由 Guozhang Wang 创作于
Reviewers: Jason Gustafson <jason@confluent.io>
-
由 Chia-Ping Tsai 创作于
Add following checks to `KafkaConsumer.groupMetadata`: 1. null check of coordinator (replace NPE by `InvalidGroupIdException` which is same to other methods) 2. concurrent check (`groupMetadata` is not thread-safe so concurrent check is necessary) Reviewers: Jason Gustafson <jason@confluent.io>
-
由 Vikas Singh 创作于
System.currentTimeMillis() is not monotonic, so using that to calculate time to sleep can result in negative values. That will throw IllegalArgumentException. This change checks for that and sleeps for a second (to avoid tight loop) if the value returned is negative. Author: Shaik Zakir Hussain <zhussain@confluent.io> Reviewer: Randall Hauch <rhauch@gmail.com>
-
- 10月 03, 2020
-
-
由 John Roesler 创作于
Migrate different components of the old ProcessorContext interface into separate interfaces that are more appropriate for their usages. See KIP-478 for the details. Reviewers: Guozhang Wang <guozhang@apache.org>, Paul Whalen <pgwhalen@gmail.com>
-
由 Ivan Yurchenko 创作于
In `setup()`, `primary` was checked to be running twice, instead of `backup`. Reviewers: Mickael Maison <mickael.maison@gmail.com>
-
由 Andre Araujo 创作于
Ensure that the MM2 checkpoint mirror task replicates consumer offsets even when they are zero to avoid issues with consumers after failovers. Author: Andre Araujo <asdaraujo@gmail.com> Reviewers: Mickael Maison <mickael.maison@gmail.com>, Ryanne Dolan <ryannedolan@gmail.com>, Edoardo Comar <ecomar@uk.ibm.com>, heritamas
-
- 10月 02, 2020
-
-
由 Shaik Zakir Hussain 创作于
Fixes a regression introduced in `JsonConverter` with previous upgrades from Jackson Databind 2.9.x to 2.10.x. Jackson Databind version 2.10.0 included a backward-incompatible behavioral change to use `JsonNodeType.MISSING` (and `MissingNode`, the subclass of `JsonNode` that has a type of `MISSING`) instead of `JsonNodeType.NULL` / `NullNode`. See https://github.com/FasterXML/jackson-databind/issues/2211 for details of this change. This change makes recovers the older `JsonConverter` behavior of returning null on empty input. Added two unit tests for this change. Both unit tests were independently tested with earlier released versions and passed on all versions that used Jackson 2.9.x and earlier, and failed on all versions that used 2.10.x and that did not have the fixed included in the PR. Both of the new unit tests pass with this fix to `JsonConverter`. Author: Shaik Zakir Hussain <zhussain@confluent.io> Reviewer: Randall Hauch <rhauch@gmail.com>
-
由 Edoardo Comar 创作于
Reviewers: Rajini Sivaram <rajinisivaram@gmail.com> Co-authored-by: Edoardo Comar <ecomar@uk.ibm.com> Co-authored-by: Mickael Maison <mickael.maison@gmail.com>
-
由 Andre Araujo 创作于
Remove the requirement for unique port numbers for the advertised.listener parameters. This restriction makes for the listeners parameter but there's not reason to apply the same logic for advertised.listeners. Being able to do this opens possibilities for some practical applications when using Kerberos authentication. For example, when configuring Kafka using Kerberos authentication and a Load Balancer we need to have two SASL_SSL listeners: (A) one running with the kafka/hostname principal and (B) another using kafka/lb_name, which is necessary for proper authentication when using the LB FQDN. After bootstrap, though, the client receives the brokers' addresses with the actual host FQDNs advertised by the brokers. To connect to the brokerd using the hostnames the client must connect to the listener A to be able to authenticate successfully with Kerberos. Author: Andre Araujo <asdaraujo@gmail.com> Reviewers: Mickael Maison <mickael.maison@gmail.com>, Viktor Somogyi-Vass <viktorsomogyi@gmail.com>, Tom Bentley <tbentley@redhat.com>
-
由 Guozhang Wang 创作于
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Boyang Chen <boyang@confluent.io>
-
- 10月 01, 2020
-
-
由 Ron Dagostino 创作于
Reviewers: Rajini Sivaram <rajinisivaram@googlemail.com>
-
由 Gonzalo Muñoz 创作于
KAFKA-10503: MockProducer doesn't throw ClassCastException when no partition for topic exists (#9309) Reviewer: Matthias J. Sax <matthias@confluent.io>
-
由 Chia-Ping Tsai 创作于
Reviewers: Boyang Chen <boyang@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
-
由 leah 创作于
Reviewers: Matthias J. Sax <matthias@confluent.io>, Guozhang Wang <wangguoz@gmail.com>
-
由 Matthias J. Sax 创作于
Reviewer: John Roesler <john@confluent.io>
-
由 Igor Soarez 创作于
Reviewers: John Roesler <john@confluent.io>, Matthias J. Sax <matthias@confluent.io>
-
由 JoelWee 创作于
Reviewers: A. Sophie Blee-Goldman <sophie@confluent.io>, Matthias J. Sax <matthias@confluent.io>
-