- 9月 29, 2022
-
-
由 alysha 创作于
-
由 kpatelatwork 创作于
* KGLOBAL-1578 validate that security protocol of a cloud to cloud link during create/alter should be SSL * added tests for update config * added check for update clusterlink in kraft mode and added missing listenername validate * added end to end validation for security protocol minor reformatting * rewrote to validate in plugin to simplify the code removed whitespace to make the commit clean minor cleanups * resolved minor review comments * minor review comments
-
由 Aishwarya Gune 创作于
* Fix reading goals configs from static configs - originals, add integration test for dynamic updates - adding configs, deleting configs. Testing path include - fetch static config on dynamic deletion and fetching default configs from KCCConfig on dynamic config deletion and no static configs present.
-
由 Akhilesh C 创作于
* KGLOBAL-2218: Eliminate stronger validation on ACL sync enable and filter flags. When ACL sync enable filter is enabled, and filters are not provided, we fail the cluster link. We do not follow the same approach for other background tasks. Removed this extra validation to ensure we don't fail cluster link under such circumstances and just log a warning message about the wrong link configuration.
- 9月 28, 2022
-
-
由 Aneesh Garg 创作于
This adds a new configuration `sasl.server.max.receive.size` that sets the maximum receive size for requests before and during authentication. Reviewers: Tom Bentley <tbentley@redhat.com>, Mickael Maison <mickael.maison@gmail.com> Co-authored-by: Manikumar Reddy <manikumar.reddy@gmail.com> Co-authored-by: Mickael Maison <mickael.maison@gmail.com> Co-authored-by: Manikumar Reddy <manikumar.reddy@gmail.com> Co-authored-by: Mickael Maison <mickael.maison@gmail.com>
-
由 Feng Min 创作于
-
由 Feng Min 创作于
Sync ccs/master into ce-kafka/master up to 08/30/2022 Fairly easy conflict to resolve as most of PR has been cherry-picked. Conflicts to be solved: both modified: core/src/main/scala/kafka/admin/FeatureCommand.scala both modified: core/src/main/scala/kafka/server/ControllerServer.scala both modified: core/src/test/java/kafka/testkit/KafkaClusterTestKit.java both modified: core/src/test/scala/integration/kafka/server/MetadataVersionIntegrationTest.scala both modified: core/src/test/scala/integration/kafka/server/QuorumTestHarness.scala both modified: core/src/test/scala/other/kafka/StressTestLog.scala both modified: core/src/test/scala/other/kafka/TestLinearWriteSpeed.scala both modified: core/src/test/scala/unit/kafka/admin/FeatureCommandTest.scala both modified: core/src/test/scala/unit/kafka/coordinator/group/GroupCoordinatorTest.scala both modified: core/src/test/scala/unit/kafka/coordinator/group/GroupMetadataManagerTest.scala both modified: core/src/test/scala/unit/kafka/log/AbstractLogCleanerIntegrationTest.scala both modified: core/src/test/scala/unit/kafka/log/BrokerCompressionTest.scala both modified: core/src/test/scala/unit/kafka/log/LogCleanerManagerTest.scala both modified: core/src/test/scala/unit/kafka/log/LogCleanerTest.scala both modified: core/src/test/scala/unit/kafka/log/LogConcurrencyTest.scala both modified: core/src/test/scala/unit/kafka/log/LogLoaderTest.scala both modified: core/src/test/scala/unit/kafka/log/LogManagerTest.scala both modified: core/src/test/scala/unit/kafka/log/LogTestUtils.scala deleted by us: core/src/test/scala/unit/kafka/log/UnifiedLogTest.scala both modified: core/src/test/scala/unit/kafka/server/metadata/BrokerMetadataListenerTest.scala both modified: core/src/test/scala/unit/kafka/tools/DumpLogSegmentsTest.scala both modified: core/src/test/scala/unit/kafka/tools/StorageToolTest.scala both modified: core/src/test/scala/unit/kafka/utils/SchedulerTest.scala both modified: core/src/test/scala/unit/kafka/utils/TestUtils.scala both modified: docs/upgrade.html both modified: metadata/src/main/java/org/apache/kafka/controller/ClusterControlManager.java both modified: metadata/src/main/java/org/apache/kafka/controller/FeatureControlManager.java both modified: metadata/src/main/java/org/apache/kafka/controller/QuorumController.java both modified: metadata/src/main/java/org/apache/kafka/image/FeaturesImage.java both added: metadata/src/main/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadata.java both modified: metadata/src/test/java/org/apache/kafka/controller/ClusterControlManagerTest.java both modified: metadata/src/test/java/org/apache/kafka/controller/FeatureControlManagerTest.java both modified: metadata/src/test/java/org/apache/kafka/controller/QuorumControllerTest.java both added: metadata/src/test/java/org/apache/kafka/metadata/bootstrap/BootstrapDirectoryTest.java both added: metadata/src/test/java/org/apache/kafka/metadata/bootstrap/BootstrapMetadataTest.java both modified: server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java both modified: server-common/src/test/java/org/apache/kafka/server/common/MetadataVersionTest.java both modified: shell/src/main/java/org/apache/kafka/shell/MetadataNodeManager.java both modified: shell/src/test/java/org/apache/kafka/shell/MetadataNodeManagerTest.java both modified: tests/kafkatest/services/kafka/kafka.py * commit '28d5a059': (13 commits) KAFKA-14187: kafka-features.sh: add support for --metadata (#12571) KAFKA-13036: Replace EasyMock and PowerMock with Mockito for RocksDBMetricsRecorderTest (#12459) MINOR: Add KRaft broker api to protocol docs (#11786) MINOR: Displaying default entity name in MetadataShell (#12053) MINOR: MINOR: Remove redundant error log in ChannelBuilder (#12539) KAFKA-10199: Remove tasks from state updater on shutdown (#12562) KAFKA-10199: Handle restored tasks output by state updater (#12554) MINOR: Small code cleanups in GroupCoordinator (#12563) MINOR: Small javadoc/code cleanups in connect api and transforms (#12558) KAFKA-14183; Cluster metadata bootstrap file should use header/footer (#12565) ...
- 9月 27, 2022
-
-
由 Jeff Kim 创作于
-
由 andymg3 创作于
-
由 Alok Thatikunta 创作于
This PR moves the Durability audits test suite from `unit.kafka` to `kafka` as all the tests already have the same package name `kafka.durability`
-
由 Alok Thatikunta 创作于
This PR simply makes the `versionId` field private in the `VersionInformation` class reviewer: @RamanVerma
-
由 Stanislav Kozlovski 创作于
The aggregate method in RawMetricValues was a bit too complex, this refactors it into a smaller method which focuses on deciding the value/extrapolation method for a particular metric.
-
由 ssumit33 创作于
- Reducing the build pipeline timeout from 3 to 2 hours so to reduce unnecessary waiting and building up of jenkins build queue.
-
由 Feng Min 创作于
-
由 Ashish Malgawa 创作于
* Added control Plane role bindings * Added operator control Plane role SR bindings * Updated unit tests * Added Ability to see other users and service account to ResourceOwner
-
由 Feng Min 创作于
-
由 Cong Ding 创作于
We have seen partial upload in GCP because of the following events in order: 1. putSegment function is called and uploads the segment to GCS 2. The upload in event 1 throws an exception and only partial data has been uploaded 3. WriteChannel.close() is called and run in the background 4. The tier archiver state machine retries upload and calls putSegment 5. Event 4 succeeded and UploadComplete metadata is written 6. The close function in line 3 finished and overwrites the file uploaded in events 4 and 5 7. Future reads see partial segment uploaded in event 6 The fix in this function uses Storage.BlobWriteOption.doesNotExist() flag to address the above issue because event 6 will fail the doesNotExist check. In another situation, if event 6 happens before event 5, event 6 will succeed while event 5 will fail and throw an exception. Note that the success of event 6 will not trigger an UploadComplete metadata. The failure of event 5 will trigger a call of storage.delete which deletes the file created in event 6 then the state machine will retry again with the doesNotExist flag.
-
由 Colin P. McCabe 创作于
Confluent's CreateTopicPolicy tries to limit the number of partitions that can be created per tenant and also globally per cluster. Unfortunately, prior to this PR, those limits could be sidestepped when in KRaft mode by creating a batch with several operations inside of it. The limit would be applied as if each element in the batch were the only operation that was pending. So, for example, if the tenant had 5 partitions left, they could create a batch creating topics foo, bar, and baz, each with 5 partitions. This would let them exceed the limit by 10 partitions in this example. This PR fixes the bug by adding "pending" update state, which is updated as the quorum controller works its way through the batch. This pending state tracks how many partitions per tenant (and so forth) were created by operations earlier in the batch, so that they can be counted against the current operation being processed. The reason for add the concept of pending state rather than simply updating the hard state immediately is that topic and partition creations are not durable until the metadata has been committed to the log. So updating the hard state immediately could allow them to get out of sync. The pending state used here avoids this problem, since it is cleared at the beginning of each createTopics or createPartitions operation. This PR also fixes a performance regression introduced by KCFUN-386, which added some code that iterates over every partition in the cluster owned by a tenant, on each create operation. We need to avoid O(num_partitions) operations. In QuorumController#renounce, fix a divergence from AK that arose from an earlier cherry-pick. Co-authored-by: Sanjana Kaundinya <skaundinya@confluent.io> Co-authored-by: Ron Dagostino <rdagostino@confluent.io>
-
由 Sanjana Kaundinya 创作于
-
由 Feng Min 创作于
-
由 David Arthur 创作于
-
由 Niket 创作于
This commit adds KRaft monitoring related metrics to the Kafka docs (docs/ops.html). Reviewers: Jason Gustafson <jason@confluent.io>, Luke Chen <showuon@gmail.com>
-
由 Colin Patrick McCabe 创作于
Previously, BrokerRegistration#toString sould throw an exception, terminating metadata replay, because the sorted() method is used on an entry set rather than a key set. Reviewers: David Arthur <mumrah@gmail.com>
-
由 dengziming 创作于
This test was removed in #11667 since UpdateFeatures is not properly handled in KRaft mode, now we can bring it back since UpdateFeatures is properly handled after #12036. Reviewers: Luke Chen <showuon@gmail.com>
-
The boostrap.checkpoint files should include a control record batch for the SnapshotHeaderRecord at the start of the file. It should also include a control record batch for the SnapshotFooterRecord at the end of the file. The snapshot header record is important because it versions the rest of the bootstrap file. Reviewers: David Arthur <mumrah@gmail.com>