Skip to content
代码片段 群组 项目
未验证 提交 73fa1356 编辑于 作者: Dariusz Aniszewski's avatar Dariusz Aniszewski 提交者: GitHub
浏览文件

[BEAM-9722] added SnowflakeIO with Read operation (#11360)


* [BEAM-9722] added SnowflakeIO with Read operation

* [BEAM-9722] Added SnowflakeCloudProvider to enable use various clouds with Snowflake

* [BEAM-9722] added docstrings for public methods

* [BEAM-9722] Added changed cleanup staged GCS files to Beam FileSystems

* [BEAM-9722] Added javadocs for public methods in DataSourceConfiguration

* add testing p8 file to RAT exclude
refactor SnowflakeCredentials
add information about possibly left files on cloud storage
small docs changes

* documentation changes

* [BEAM-9722] Added TestRule and changed Unit tests to use pipeline.run

* [BEAM-9722] Renamed Snowflake Read unit test and applied spotless

* [BEAM-9722] remove SnowflakeCloudProvider interface

* [BEAM-9722] doc changes

* [BEAM-9722] add `withoutValidation` to disable verifying connection to Snowflake during pipeline construction

* [BEAM-9722] added MoveOption and removed leftover file

* [BEAM-9722] fixed tests. Add tests for `withQuery`

* [BEAM-9722] make `CopyIntoStageFn` retryable

* [BEAM-9722] added `Reshuffle` step after `CopyIntoStageFn`

Co-authored-by: default avatarKasia Kucharczyk <katarzyna.kucharczyk@polidea.com>
Co-authored-by: default avatarpawel.urbanowicz <pawel.urbanowicz@polidea.com>
上级 105f2657
No related branches found
No related tags found
加载中
显示
1867 个添加0 个删除
加载中
0% 加载中 .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册