* upgrade gradle 8,3 -> 8.4

* Use temurin 21 base image as its available now

* Setup Java21 JPMS postcommits

* Setup Java21 Example PostCommit on DataflowV2

* Fix kotlin test

* adding metrics report

* change concurrency group

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

* misc fixes

* Update .github/workflows/beam_Metrics_Report.yml

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

---------

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

Merge pull request #29102: [flink] Flush buffer during drain operation for requiresStableInput operator

Yaml's Create will now always create schema'd data.
For non-row elements, this will be a single Row with an element field.

Co-authored-by: Shunping Huang <133698626+shunping-google@users.noreply.github.com>

* Adding examples to post messages hl7 messages to HCAPI Hl7v2 store

Adding beam example on consuming HL7 message file from GCS bucket , transform it and post HL7 messages to HCAPI Hl7v2 store for further ingestion and consumption

* Created using Colaboratory

* Update examples/notebooks/healthcare/beam_post_hl7_messages_to_hcapi.ipynb

Co-authored-by: Svetak Sundhar <svetaksundhar@google.com>

* Update examples/notebooks/healthcare/beam_post_hl7_messages_to_hcapi.ipynb

Co-authored-by: Svetak Sundhar <svetaksundhar@google.com>

* Update examples/notebooks/healthcare/beam_post_hl7_messages_to_hcapi.ipynb

Co-authored-by: Svetak Sundhar <svetaksundhar@google.com>

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

* Created using Colaboratory

---------

Co-authored-by: Svetak Sundhar <svetaksundhar@google.com>

* Implement gRPC service with transcoder

* WIP: defer integration tests for later

* Make service executables

* remove grpc gateway

* Clean up and add messy integration test

* Delete flakey integration tests that depend on Docker

* Generate java proto

* Generate python proto

* Python is too much trouble for now

* Finalize README

* Fix rat and whitespace

* Fix whitespace

* Clean up per PR comments

* Fix gcp logging not capturing severity

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

The provided API to fetch covid data from has changed to:
https://api.covidtracking.com/v1/states/current.json

* python test results publish

* add postcommit python test publish step

In order to aid debugging of lulls.

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.7.0...v0.17.0

)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [cloud.google.com/go/spanner](https://github.com/googleapis/google-cloud-go) from 1.50.0 to 1.51.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.50.0...spanner/v1.51.0

)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/spanner
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Add readme for PerformanceTests TextIOIT, JDBC, Kafka IO, SpannerIO, SQLBigQueryIO and BiqQueryIO Python

* Update readme

* PRs 28582 28584 28606 28581

* PR 28738 LoadTests_Java_GBK_Dataflow

* Add readme for PostCommit Java Examples Dataflow V2

* Add readme for LoadTests Java CoGBK

* Add readme for LoadTests Python CoGBK Dataflow

* Add readme for LoadTests Python ParDo and SideInput

* Add readme for LoadTests Smoke Python and Java

* Update Readme

* Update Readme

* updated README

* Update readme for Performance Tests BigQueryIO Write Python Batch

* Remove Trigger Phrases for Load Tests and Performance tests

* PR 28846 28730 28827 28861 28897

* update readme

---------

Co-authored-by: aleksandr-dudko <aleksandr.dudko@akvelon.com>
Co-authored-by: vitaly.terentyev <vitaly.terentyev@akvelon.com>
Co-authored-by: magicgoody <magzhan.kulatayev@akvelon.com>

Slightly stricter definitions for catching more errors, as well as avoding the use of
anyOf which often makes it difficult to deduce what the true error is.

This does mean a pipeline must have a transform (or source/sink) block rather than simply
be itself a list of transforms.

* Refactor prepare arguments step

* Rename perf/load/ pipeline options folders

* Fix GZIP compression in HttpEventPublisher.

* Add checks to make sure the provided URL is valid.

* Fix issue with DefaultCoder in AutoValue generated classes.

* Add support for Splunk `fields` metadata.

Also fix Coder issues for SplunkEvent.

* Address comments.

* Setup Java 21 container (#28833)

* Add Java21 container

* fix spotless

* Update website

* Fix jamm

* align configs in recent change

* incremental fixes

* add more comments for when jpms test enabled

* beam_performance_singlestoreio

* Update .github/workflows/beam_PerformanceTests_SingleStoreIO.yml

Add coment about the test-argumets-action

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

* remove fail-fast and remove comment line in config

* config cleanup

* influx creds and move to main pool

---------

Co-authored-by: Andrey Devyatkin <andrey.9evyatkin@gmail.com>

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.147.0 to 0.148.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.147.0...v0.148.0

)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Refactor and cleanup of StateFetcher in preparation for future changes

make BeamKafkaTable.createKafkaRead to be protected, and we can override it appending options to KafkaIO.Read (#29051)

As well as good practice, not doing so may result in much more
obscure errors (e.g. during encoding) downstream.