* Feat: Adding composite and base job (#215)

* Added python_release_candidate job.

* Testing pr from rc_tag.

* Adding GH_TOKEN env var

* Set PR head as WORKING_BRANCH

* Removed unused code.

* Adding Run RC Validation job in CI.md doc file.

* Removed Set Environment Variables step. Setting variables in env property.

* Removed composite rc-validation action.

* Rc validation workflow for Dataflow Taxi, Python Cross Validation and Runners (#227)

* RC Validation Workflow (#228)

Adding the following jobs:
* sql_taxi_with_dataflow
* python_cross_validation
* generate_shared_pubsub
* java_injector
* direct_runner_leaderboard
* dataflow_runner_leaderboard
* direct_runner_gamestats
* dataflow_runner_gamestats
* remove_shared_pubsub

* Adding extras jobs to CI.MD (#230)

* Fixing workflow linter error (#231)

* Using inputs in composite action (#235)

* Using inputs in composite action

Co-authored-by: Elias Segundo <elias.segundo@luisrazo.local>

* Added Verify Working Branch step.

* Adding extras jobs to CI.MD (#230)

Co-authored-by: Elias Segundo Antonio <eliassegundo.segundo@gmail.com>
Co-authored-by: Elias Segundo <elias.segundo@luisrazo.local>

Update scopes to match the existing set and update test to clear credentials during failure (#23677)

* Update test to clear credentials when test raises an error

* Fix set of requested scopes to match original list

Co-authored-by: tvalentyn <tvalentyn@users.noreply.github.com>

* Suppress a FloatingPointLiteralPrecision error

* Update sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/TableRowToStorageApiProtoIT.java

Co-authored-by: Lukasz Cwik <lcwik@google.com>

* Adds a Java RunInference example

* Fixes lint

* Fix spotless

* Fix Java PreCommit

* Address reviewer comments

* Addresses reviewer comments

Unreviewed change for release blog post.

* Docs for state in go

* example + wording improvements

* Fix PubsubIOIT Python Streaming

* Fix gradle build script

* Fix test

* Increase timeout

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.98.0 to 0.99.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.98.0...v0.99.0

)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Merge pull request #23639: [Jenkins,Spark] Stop running Nexmark suite for deprecated Spark 2 runners

* README

* indexes

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* space

* WIP workflow

* WIP

* aio

* subdirs

* fix

* WF fix

* WF tmp

* TO REMOVE

* Update playground_deploy_examples.yml

* Update playground_deploy_examples.yml

* GA workflow

* TO REMOVE

* WIP

* wf

* to remove

* Revert "to remove"

This reverts commit c33aeb708bc9d7f1f515d59d184add6a7264a8d9.

* revert

* CI workflows

* fix

* fix1

* fix3

* concurrency

* nits

* concurrency2

* no concurrency

* lock

* seq

* beam_concurr

* debug

* debug

* ci_cd GRPC timeout

* dirt

* wait_for_ready

* parent concurrency

* Revert "debug"

This reverts commit 0d08a0c80ef6424829a47c01dbfe52ea0e3f0d93.

* BEAM_CONC: 4

* origin required

* tob ci

* +backend

* -dump

* reduce scope

* nit

* checker_v2

* workflows

* fix

* fix

* fix1

* fix2

* fix3

* fix4

* fix5

* fix6

* py38

* debug

* fix8

* fix9

* fix0

* fix1

* fix2

* fix3

* fix4

* fix5

* tmp

* Revert "tmp"

This reverts commit 26afa6d7d4b292f941eda23ec0ff9b2ac5045331.

* allowlist

* -debug

* nit

Co-authored-by: MakarkinSAkvelon <67736809+MakarkinSAkvelon@users.noreply.github.com>

* Added verify_release_build.yml file with check_environment an create_pr test steps.

* Fixing typo issue in checkout step in yml.

* Removing blank spaces

* Adding RELEASE_BRANCH env as GITHUB_ENV variable.

* Fixed ref RELASE_BRANCH

* Added RELEASE_ENV as step env var. Set github config user

* Fixed RELEASE_VER env var.

* Added write pull_request permission.

* Added write contents permission. Print RELEASE_BRANCH for confirmation only.

* Adding base and header in hub pull-request command.

* Using env.VAR_NAME convention.

* Print variables

* Fixing env var syntaxis issue issue

* Adding missing GITHUB_TOKEN env var in create PR job.

* Moved set RELEASE_BRANCH to create PR job.

* Print both env.RB and $RB.

* Print both RELASE_BRANCH env var

* Adding RELEASE_VER env var in create_release_ir step.

* Adding RELEASE_VER env var in create_release_ir step.

* Cleaned code

* Adding run set_version script before creating the new PR.

* Run the script using bash to fix the ubuntu issue. Removed unused print step.

* Updating gradle.properties path

* Updating gradle.properties path.

* Passing GITHUB_WORKSPACE to set_version script.

* Removing working-directory in workflow and update set_version path instead.

* Set new GITHUB_PR as env variable.

* Get the GH_PR_NUMBER and set it as env variable. Create PR comment via GH cli.

* Fixing yml issue.

* Fixing yml format issue.

* comment_trigger_phrases step needs create_release_pr to run.

* Fixed set GITHUB_PR_NUMBER GITHUB_ENV var.

* Adding PR Number as an output.

* Fixed lint yml issue

* Passing GH_TOKEN to hub.

* Fixed env vars in comment step.

* Added command to comment new pr

* Updated gh pr command and passing the whole PR URL.

* Adding pull-requests write permission to comment_trigger_phrases job.

* Run the comment_pr_trigger_phrases.sh script to comment the PR with the Jenkins Trigger Phrases.

* List the files in working-directory for testing

* Fixing linter issue in working-directory

* Moved comment_trigger_Phrases job into the update_create_release_pr job.

* Added checkout step in comment_trigger_phrases job.

* Check out code from RELEASE_BRANCH in Commenting Trigger Phrases.

* Adding, Install hub cli tool step

* Print gh actions variables

* Print gh actions config

* Using hub in GH-hosted runner.

* Testing pr creation in apache repo. Commented code.

* Create the PR in testing org.

* Removing workflow permissions

* Removed owner from head branch.

* Adding setup-gh-cli as an composite action.

* Created a setup-gh-cli-linux composite action. Updated verify_release workflow ti runs on slef-hosted an using gh cli.

* Updated sh file to comment the real trigger phrases insted of the example file. Updated PR body text.

* Updated jenkins_trigger_phrases.txt file using the Jobs that have not been migrated by the team. Also, included the mass_comment Trigger Phrases file if needed.

* Added Verify Release Build workflow in CI.md doc.

* Updated comment_pr_trigger_phrases file to point to mass_comment file.

* Commented with Apache License in verify_release_build.yml and comment_pr_trigger_phrases.sh files.

* Removed unused code in inputs vars in verify_release_build.yml

* Added blank line at the end of txt files to remove RAT issue.

* Moved trigger_phrases txt files into /test/resources folder.

* Update CI.md, removing Jenkins word to make it generic.

Co-authored-by: Danny McCormick <dannymccormick@google.com>

* Adding script for branch validation.

* Removing unused word.

Co-authored-by: Danny McCormick <dannymccormick@google.com>

* Update to a single scheduled executor service to mitigate thread propogation

* run spotless

* run spotless

* Provide separate scheduled executor

* try scheduled thread pool again

* Attempt to mimic Bigquery default scheduled thread pool

* run spotless

* update docs

* Refactor Scheduled executor service to its own options file

* clean up comments, don't accidentally create two scheduled executor services

* clean up comments

* run spotless

* Configure scheduled executor to spin up and down core threads to mimic a dynamic thread pool

* Run spotless

* add . for checkstyle

* Update ExecutorOptions to use @lukecwik's unbounded scheduled executor

* revert change to runners/google-cloud-dataflow-java/build.gradle

* Update comments on options files

* Update sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/options/GcsOptions.java

Co-authored-by: Lukasz Cwik <lcwik@google.com>

* Make GCP OAuth scopes configurable via pipeline options.

This allows users to limit scopes dependent on their pipeline.

fixes #23290

* Fix usages of get credentials where no pipeline options was being used to pass in a default instance

* Address review comments

Drop the non pipelineoptions routes in _add_impersonation_...

Merge pull request #23638: [Spark dataset runner] Add direct translation of Reshuffle and Reshuffle.ViaRandomKey transforms.

[Jenkins,Spark] Stop running Nexmark suite for deprecated Spark 2 runner and ensure consistent version of Spark is used for Nexmark tests (fixes #23634)

This will include auto-generated notes appended after the "body" that we pass in.

Automatically open module/packages for Java 11+

* Adding About Data Science beam article info to the Community page

* Changed title to Blog posts and link to Medium

Added content: The direct runner is not suited to production pipelines

Co-authored-by: Lukasz Cwik <lcwik@google.com>