KDATA-484: Adding stateBeforeDeletion field (#6966)
This PR adds the `stateBeforeDeletion` field to FileTierPartitionState entries. This field will be important for backup and restore functionality for compacted topics. The default value for this field is a new INVALID state. It shouldn't get updated until the object transitions into the SEGMENT_DELETE_INITIATE state, at which point the field is mutated to store the value of the state before. We do not have interest in the value of this field prior to the object transitioning to SEGMENT_DELETE_INITIATE state. It will be backfilled to earlier FTPS files on clusters through the migrateFormat strategy used for FTPSCleanUp https://confluentinc.atlassian.net/wiki/spaces/KSTORAGE/pages/2789510112/One-Pager+Restore+FTPS+for+Compacted+Topics This PR also increases the TierObjectMetadata.INITIAL_BUFFER_SIZE to 136 There will be a follow up PR to add the `parentObjectIds` field.
显示
- core/src/main/java/kafka/restore/schedulers/DryrunAsyncTaskScheduler.java 1 个添加, 0 个删除...va/kafka/restore/schedulers/DryrunAsyncTaskScheduler.java
- core/src/main/java/kafka/tier/domain/TierObjectMetadata.java 35 个添加, 8 个删除core/src/main/java/kafka/tier/domain/TierObjectMetadata.java
- core/src/main/java/kafka/tier/state/FileTierPartitionState.java 2 个添加, 2 个删除...rc/main/java/kafka/tier/state/FileTierPartitionState.java
- core/src/main/java/kafka/tier/state/SegmentState.java 19 个添加, 1 个删除core/src/main/java/kafka/tier/state/SegmentState.java
- core/src/main/java/kafka/tier/state/TierUtils.java 7 个添加, 0 个删除core/src/main/java/kafka/tier/state/TierUtils.java
- core/src/main/resources/serde/tier-metadata/mutable/tier_partition_state_entry.fbs 3 个添加, 0 个删除...erde/tier-metadata/mutable/tier_partition_state_entry.fbs
- core/src/main/scala/kafka/durability/audit/AuditJob.scala 2 个添加, 1 个删除core/src/main/scala/kafka/durability/audit/AuditJob.scala
- core/src/test/java/kafka/tier/domain/TierObjectMetadataTest.java 26 个添加, 0 个删除...c/test/java/kafka/tier/domain/TierObjectMetadataTest.java
- core/src/test/scala/kafka/tier/domain/TierTopicSerDeTest.scala 2 个添加, 1 个删除...src/test/scala/kafka/tier/domain/TierTopicSerDeTest.scala
- core/src/test/scala/kafka/tier/state/FileTierPartitionStateCompactEnabledTest.scala 38 个添加, 1 个删除...tier/state/FileTierPartitionStateCompactEnabledTest.scala
- core/src/test/scala/kafka/tier/store/TierObjectStoreUtilsTest.scala 2 个添加, 2 个删除...est/scala/kafka/tier/store/TierObjectStoreUtilsTest.scala
- core/src/test/scala/kafka/tier/tasks/compaction/TierCompactionTaskTest.scala 1 个添加, 1 个删除.../kafka/tier/tasks/compaction/TierCompactionTaskTest.scala
- core/src/test/scala/kafka/tier/tasks/delete/DeletionTaskQueueTest.scala 1 个添加, 1 个删除...scala/kafka/tier/tasks/delete/DeletionTaskQueueTest.scala
- core/src/test/scala/kafka/tier/tasks/delete/DeletionTaskTest.scala 3 个添加, 3 个删除...test/scala/kafka/tier/tasks/delete/DeletionTaskTest.scala
- core/src/test/scala/unit/kafka/durability/audit/AuditJobTest.scala 1 个添加, 1 个删除...test/scala/unit/kafka/durability/audit/AuditJobTest.scala
- core/src/test/scala/unit/kafka/durability/materialization/DurabilityEventsMaterializeTest.scala 2 个添加, 2 个删除...ity/materialization/DurabilityEventsMaterializeTest.scala
- core/src/test/scala/unit/kafka/log/LogTestUtils.scala 3 个添加, 2 个删除core/src/test/scala/unit/kafka/log/LogTestUtils.scala
- core/src/test/scala/unit/kafka/log/MergedLogTest.scala 1 个添加, 0 个删除core/src/test/scala/unit/kafka/log/MergedLogTest.scala
- core/src/test/scala/unit/kafka/server/AbstractFetcherThreadTest.scala 4 个添加, 4 个删除...t/scala/unit/kafka/server/AbstractFetcherThreadTest.scala
加载中
想要评论请 注册 或 登录