* Add flag to do a docker system prune between docker push steps

* Push to my docker image

* order/prune python container pushes

* Prune docker between pushes

* Consolidate to loop

* Temporarily point to my dockerhub to test/confirm

* restore apache as dockerhub repo root

* whitespace

Merge pull request #27277: Use requirements file as a constraint when building the expansion service container

* Update multi model notebook to remove workarounds

* Clean up + add conclusion

* first batch: schematransform API, sql, debezium, fileIO, bigquery, bigtable, jdbc, singlestore

* second batch: pubsub, pubsublite, spanner

* third batch: kafka

* fixes

* fix missing override

* bigtable write

* spotless

Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.30.1 to 1.31.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.30.1...pubsub/v1.31.0

)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/storage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.11.70 to 1.11.71.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/feature/s3/manager/v1.11.70...feature/s3/manager/v1.11.71

)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Python exception sampling implementation

* add to cython def

* add more cython defs

* address comments

* fix circular imports

* linter

* fix tests

* remove print

* Add traceback to exception

* fix tests

---------

Co-authored-by: Sam Rohde <srohde@google.com>

Bumps [cloud.google.com/go/datastore](https://github.com/googleapis/google-cloud-go) from 1.11.0 to 1.12.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/kms/v1.11.0...kms/v1.12.0

)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/datastore
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* add note for tf2 models

* Update examples/notebooks/beam-ml/run_inference_with_tensorflow_hub.ipynb

Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>

* Update examples/notebooks/beam-ml/run_inference_with_tensorflow_hub.ipynb

Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>

---------

Co-authored-by: Rebecca Szper <98840847+rszper@users.noreply.github.com>

* Finish Java Exception Sampling

* wrong param name in comment

* run tests

* run tests

* run tests

* Increase target Beam version for Automated Expansion Service testing

* Automate selection of target JAR version

Bumps [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) from 1.31.0 to 1.32.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/pubsub/v1.31.0...pubsub/v1.32.0

)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/pubsub
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* [Security] Upgrade guava to 32.0.1-jre

* Update j2objc-annotations reference to match Guava's

* python wrapper

* schematransform; started some tests

* schematransform and tests done

* python wrapper and tests done

* add tests for _DirectRowMutationsToBeamRow DoFn

* use expansion service

* style fix

* style fix

* use secrets token in instance name to prevent race condition between py37 & py311 tests

* use typing typehints

* style fix

* add missing import

* test fix

* resolve merge issues

* style fix

* raise timeout of dataflow tests

* fix setting timeout

* address reviewer comments

* address reviewer comments

* trivial change

* remove unused imports; lint fixes

* add unittest main call

Decrease severity of messages which come from child processes as they usually indicate error in user-submitted code

This includes a series of small changes to release the connector:
- Remove option for users to override heartbeat duration
- Add option to skip creating metadata table and standalone utility to create metadata table
- Add hard timeout to mutateRow requests as workaround for hanging requests
- Remove excessive RCSP logging for debugging during preview
- Increase read rows timeout to better accomodate large tables
- Remove side effects from InitializeDoFn
- Lower ReadChangeStream deadline to closer align with checkpoint duration
- Add release note to CHANGES.md

Bumps [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) from 1.51.2 to 1.52.0.
- [Release notes](https://github.com/googleapis/google-cloud-go/releases)
- [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-cloud-go/compare/bigquery/v1.51.2...bigquery/v1.52.0

)

---
updated-dependencies:
- dependency-name: cloud.google.com/go/bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: Julian Berzborn <julian.berzborn@vodafone.com>

Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.128.0 to 0.129.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.128.0...v0.129.0

)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix tests

* Don't publish data when running analyzer in PR

* Update .github/workflows/run_perf_alert_tool.yml

* Run perf analysis tests during schedules

* Don't authenticate during pull_request

* Disable FirestoreIT tests on Dataflow

* Fix spotless

* init

* fixing

* fixed avro schema transform

* json error metrics

* parquet error metric

* xml error metrics

* fix comments

* spotless

* add tests

* spotless

* Change name of ErrorCounterFn

* add generic test for BeamRowMapperWithDlq

* Add notebook for image processing using beam

* Delete image_processing_tensorflow.ipynb

* add image processing use case using tensorflow

* Delete image_processing_tensorflow.ipynb

* Add image processing use case after suggestions

* Delete image_processing_beam.ipynb

* Add image processing with implemented suggestions

Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>