[Playground] support for Kafka-enabled examples (#24459)
* [Playground][Backend]updated python scripts to process datasets * [Playground] [Backend] updated tests for a helper * [Playground] [Backend] resolved comments after review * [Playground] [Backend] minor fixes * [Playground] [Backend] removed a transaction for a datastore client * [Playground] [Backend] updated endpoints to get precompiled objects * [Playground] [Backend] updated tests for a pc mapper * [Playground] [Backend] edited a response * [Playground] [Backend] edited datasets field as an embeded entity * [Playground] [Backend] edited pc response with datasets * [Playground] [Backend] changed variable names * [Playground] [Backend] updated requirements txt file * [Playground] [Backend] updated python scripts after review * -ast * [Playground] [Backend] updated python scripts after a second review * [Playground] [Backend] added additional validation * [Playground] [Backend] added dataset bucket name variable to github workflows * [Playground] [Backend] removed cloud storage client * [Playground] [Backend] removed unused env variable * [Playground] [Backend] renamed link field to path * [Playground] [Backend] updated the method to run code to process examples with an emulator * [Playground] [Backend] updated python scripts to handle examples with emulators * [Playground] [Backend] updated unit tests * [Playground] [Backend] refactoring * [Playground] [Backend] updated contribute md file * [Playground] [Backend] removed cloud storage * [Playground] [Backend] fixed test data generation * Fixes after merge * FIx for Java docker container * fix * fixes * rat * debug show logs * debug * optimize router Dockerfile * fixed image * checker self-check * -storage client * go.mod * snippet * generateProto * -licenses * adjust checker * java Dockerfile * infrastructure/GCS -> local * examples * nit * nit * controller_test * Java classes renamed * Resolved compilation warnings for java Kafka examples * nit * nit * recover * DEBUG * Revert "DEBUG" This reverts commit 87c62f0e93a185a44d0e605af6183ecdf5639bda. * revert * revert * revert * spotless * datastore_transaction * nits * example * Examples amended * spotless Co-authored-by:Vladislav Chunikhin <vladislav.chunikhin@akvelon.com> Co-authored-by:
Ruslan Shamyunov <ruslan.shamunov@akvelon.com>
显示
- .github/workflows/playground_examples_ci.yml 1 个添加, 1 个删除.github/workflows/playground_examples_ci.yml
- .github/workflows/playground_examples_ci_reusable.yml 14 个添加, 4 个删除.github/workflows/playground_examples_ci_reusable.yml
- .github/workflows/tour_of_beam_backend_integration.yml 1 个添加, 1 个删除.github/workflows/tour_of_beam_backend_integration.yml
- build.gradle.kts 4 个添加, 0 个删除build.gradle.kts
- examples/java/src/main/java/org/apache/beam/examples/KafkaWordCountAvro.java 120 个添加, 0 个删除...ain/java/org/apache/beam/examples/KafkaWordCountAvro.java
- examples/java/src/main/java/org/apache/beam/examples/KafkaWordCountJson.java 120 个添加, 0 个删除...ain/java/org/apache/beam/examples/KafkaWordCountJson.java
- playground/api/v1/api.proto 13 个添加, 0 个删除playground/api/v1/api.proto
- playground/backend/CONTRIBUTE.md 29 个添加, 1 个删除playground/backend/CONTRIBUTE.md
- playground/backend/cmd/server/controller.go 23 个添加, 7 个删除playground/backend/cmd/server/controller.go
- playground/backend/cmd/server/controller_test.go 68 个添加, 17 个删除playground/backend/cmd/server/controller_test.go
- playground/backend/containers/java/Dockerfile 24 个添加, 2 个删除playground/backend/containers/java/Dockerfile
- playground/backend/containers/router/Dockerfile 3 个添加, 16 个删除playground/backend/containers/router/Dockerfile
- playground/backend/datasets/CountWords.avro 0 个添加, 0 个删除playground/backend/datasets/CountWords.avro
- playground/backend/datasets/CountWords.json 22 个添加, 0 个删除playground/backend/datasets/CountWords.json
- playground/backend/go.mod 29 个添加, 24 个删除playground/backend/go.mod
- playground/backend/go.sum 279 个添加, 71 个删除playground/backend/go.sum
- playground/backend/internal/api/v1/api.pb.go 694 个添加, 527 个删除playground/backend/internal/api/v1/api.pb.go
- playground/backend/internal/api/v1/api_grpc.pb.go 0 个添加, 17 个删除playground/backend/internal/api/v1/api_grpc.pb.go
- playground/backend/internal/code_processing/code_processing.go 15 个添加, 10 个删除...round/backend/internal/code_processing/code_processing.go
- playground/backend/internal/code_processing/code_processing_test.go 5 个添加, 5 个删除.../backend/internal/code_processing/code_processing_test.go
加载中
想要评论请 注册 或 登录