* Updates the Beam model protos to be housed in a namespaced directory structure. This is so that the proto files require usage of a org/apache/beam/model namespace in their imports and so that the generated files also include this namespace in their source file metadata.

* Updates session.proto to use the new namespaced import

* Adds a generic proto generated script that can be used to correctly generate all proto files for the go sdk. This new tool will add any necessary options to the proto compiler and generate the proto files relative to the go sdk root to ensure that the generated files have a namespaced file path in their metadata. If you want to generate a proto file in the go sdk, simply use this script in the go:generate directive, the rest will be taken care of by the script.

* Updates the go sdk to use the new genproto script to correctly generate proto bindings. Updates the README for how to generate the model proto bindings into the SDK

* Regenerates all go sdk proto bindings

* Updates to the python build system. gen_protos.py now supports the new namespaced structure of the Beam model. It does this by supporting arbitrary directory structures of proto files by calculating and replacing the generated imports with relative imports with the generated source. Additionally, it will generate bindings that allow for imports of the form `from apache_beam.portability.api import beam_runner_api_pb2` so that the SDK is not dependent on the potentially changing structure of the generated bindings within `api`. Imports of the form `from apache_beam.portability.api.org.apache.beam.model import beam_runner_api_pb2` are still supported. setup.py now attempts to generate the proto bindings on invocation since the package structure must exist before the wheel can be created.

* Updates to various build, ignore, and linting tooling for python in order to support the new python output structure

* Updates to the python SDK to use the new import structure created by gen_protos

* Factors enable_prime flag in when checking use_unified_worker conditions

* Address comments

[BEAM-14104] Support shard aware aggregation in Kinesis writer.

* [BEAM-14144] Run JFR profiles when GC thrashing is detected

* Apply suggestions from code review

Co-authored-by: Lukasz Cwik <lcwik@google.com>

* review comments

* spotless

Co-authored-by: Lukasz Cwik <lcwik@google.com>

[BEAM-13015] Lookup the container for the step once when registering instead of on each execution. (#17281)

Merge pull request #17262: [BEAM-14244] Use the supplied output timestamp for processing time timers rather than the input watermark

* [BEAM-10556] Fix rawtypes warnings in SnowflakeIO

* fixup! [BEAM-10556] Fix rawtypes warnings in SnowflakeIO

[BEAM-14262] Update plugins for Dockerized Jenkins.

* playground add meta tags

* playground fix meta tags

Without them, the seed job prints warnings:

Warning: (CommonJobProperties.groovy, line 107) plugin 'ansicolor' needs to be installed
Warning: (CommonJobProperties.groovy, line 113) plugin 'ws-cleanup' needs to be installed

I copied the list from the cwiki and removed all of the ones that failed to install. https://cwiki.apache.org/confluence/display/INFRA/ci-beam.apache.org

* Prefer registered schema in SQL docs

* address review comments

[BEAM-14222] Fix the error of SpannerReadIT

* Fix markdown indent issue in Development Setup section

* Update parquetio.py

* Update CHANGES.md

* Fix import order

[BEAM-14258] Fix metrics report dependency issue

[BEAM-9649] Add region option to Mongo Dataflow test.

* [BEAM-13015] Disable retries for grpc channels which otherwise default to true.

Since the channel is to the local runner process, retries are not expected to
help. This simplifies the grpc stream stack to not involve a RetryStream object.

* fixup comment

* Update sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/channel/ManagedChannelFactory.java

* Update sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/channel/ManagedChannelFactory.java

Co-authored-by: Lukasz Cwik <lcwik@google.com>

Co-authored-by: Andy Ye <andyye333@gmail.com>

Until all runners are portable and we can get rid of all round trips
between Pipeline and proto representatons, register types in __main__
according to their string representations as pickling does not
preserve identity.

[BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240)

* [BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes.

The issue was that the InboundObserver can be invoked before outboundObserverFactory#outboundObserverFor returns meaning that
the server is waiting for a response for cache.remove but cache.computeIfAbsent is being invoked at the same time.

Another issue was that the outstandingRequests map could be updated with another request within GrpcStateClient during closeAndCleanup meaning that the CompleteableFuture would never be completed exceptionally.

Passes 1000 times locally now without getting stuck or failing.

* [BEAM-14157] GrpcWindmillServer: Use stream specific boolean to do client closed check

This is a follow up to #17162. An AbstractWindmillStream can have more than one grpc stream during its lifetime, new streams can be created after client closed for sending pending requests. So it is not correct to check `if(clientClosed)` in `send()`, this PR adds a new grpc stream level boolean to do the closed check in `send()`.

* [BEAM-14157] Add unit test testing CommitWorkStream retries around stream closing

* [BEAM-14157] review comments

* [BEAM-14157] review comments

* [BEAM-14157] review comments

* [BEAM-14157] fix test

* [BEAM-14157] fix test

Co-authored-by: Arun Pandian <pandiana@google.com>