Skip to content
代码片段 群组 项目
该项目从 https://github.com/apache/beam.git 镜像。 拉取镜像更新于
  1. 5月 28, 2022
    • David Huntsperger's avatar
      cleaned up TypeScript in coders.ts (#17689) · 0fb68863
      David Huntsperger 创作于
      * cleaned up TypeScript in coders.ts
      
      * run prettier again
      
      * exporting HackedWriter interface
      
      * fixed type and linting issues left after resolving merge conflict
      0fb68863
    • Ahmet Altay's avatar
      db4d2cb3
    • Moritz Mack's avatar
      [BEAM-14166] Push logic in RowWithGetters down into getters and use TreeMap to... · 7c47893d
      Moritz Mack 创作于
      [BEAM-14166] Push logic in RowWithGetters down into getters and use TreeMap to reduce memory footprint of field value cache. (#17172)
      
      7c47893d
    • Danny McCormick's avatar
    • Heejong Lee's avatar
      Merge pull request #17774 from ihji/fix_none_exception · 668e0506
      Heejong Lee 创作于
      Fix NonType error when importing google.api_core fails
      668e0506
    • Ryan Thompson's avatar
      [BEAM-14218] Add resource location hints to base inference runner. (#17448) · 128d5989
      Ryan Thompson 创作于
      * added docs and location hints
      
      * simplified model hints to come from the loader
      
      * yapf
      
      * added optional clock
      
      * moved clock
      
      * fixed typo'
      
      * keep clock in right space
      
      * fixed bad hints
      128d5989
    • Kiley Sok's avatar
      Merge pull request #17760 from kileys/beam-master · ffef8de0
      Kiley Sok 创作于
      Update beam-master version for legacy
      ffef8de0
    • Diego Gomez's avatar
      [BEAM-14502] Fix: Splitting scans into smaller chunks to buffer reads (#16939) · ed59b147
      Diego Gomez 创作于
      * Fix: Spliting scans into smaller chunks to buffer reads
      
      * Nit: removing unused imports
      
      * Small clean up, iteration 1
      
      * Splitting duplicate logic into helper function
      
      * Splitting logic for rows
      
      * Test for below batch size and fixing up internal logic
      
      * Adding SingleRange test above the mini batch limit
      
      * Fixing nits
      
      * Adding multiple range test with non-overlapping ranges
      
      * Added multiple range test with overlapping keys
      
      * Temp commit for easier meeting. Will clean up after and commit again
      
      * First Async change with tests working. Multiple ranges needs to be checked for proper advancing and the ArgumentCaptor test must be created
      
      * Fixed tests, still need to implement Captor test
      
      * Created ArgumentCaptor test and fixed test errors
      
      * Fixed the failing emulator tests
      
      * Spotless fix
      
      * Cleaning up code
      
      * Fixing nits and added test comments
      
      * Fixing spotless
      
      * Fixing comments
      
      * Spotless
      
      * Fixing build issues
      
      * There is one error with using a non-vendered dependency. Working on it but PR is good otherwise
      
      * Fixing build error
      
      * Fixing part of the first round of comments, still need to work on a few
      
      * Removed nesting from advance
      
      * Added configurable batch limit
      
      * Fixed tests
      
      * Fixed tests for new implementation
      
      * Added Byte Limit test and responded to half of the new comments
      
      * Testing build errors, due to IDE issues
      
      * Implemented Runtime usage which caused ByteBuffer test to fail. Cleaned up some code based on comments.
      
      * Working on the byte buffer test, having issues with mocking Runtime values which would result in flakiness. Going to try to push for review
      
      * Fixed the byte buffer test and should use the machine's memory when testing
      
      * Attempting to fix ByteBufferTest
      
      * Applying Spotless and keeping debug statements to make sure test is OK
      
      * Reduced percentage of memory and removed print statements
      
      * Apply spotless
      
      * Apply spotless again
      
      * Fixing nits
      
      * Fixing up nits and comments
      
      * Refactoring multiple states into cleaning flow, provided factory method and removed default segementSize behavior
      
      * Fixing import
      
      * Fixed tests for refactor and cleaned up implementation
      
      * Refactored tests, added an exception test and Byte test needs to be tested manually
      
      * Responding to comments, removed some error handling
      
      * Responding to comments, fixed error handling and cleaned tests
      
      * Fixing warnings
      
      * Removed factory method inside of test and removed source dependencies. Waiting to fix CallMetric for error handling
      
      * Fixed error handling test
      
      * Responding to nits
      
      * Fixed error handling
      
      * Responding to nits
      
      * Apply Spotless
      ed59b147
    • Ryan Thompson's avatar
      [BEAM-13972] Update documentation for run inference (#17508) · 76356acd
      Ryan Thompson 创作于
      * added comment about runiference being under development
      
      * removed date
      76356acd
  2. 5月 27, 2022
  3. 5月 26, 2022
  4. 5月 25, 2022
    • Luke Cwik's avatar
    • dpcollins-google's avatar
      [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer apply (#17169) · d50f1b17
      dpcollins-google 创作于
      
      * [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer apply
      
      Also remove explicit blocking on data delivery- yield to the runtime instead if no data is available since reading from Pub/Sub Lite is now performed in the background
      
      * [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer apply
      
      Also remove explicit blocking on data delivery- yield to the runtime instead if no data is available since reading from Pub/Sub Lite is now performed in the background
      
      * [BEAM-14129] Clean up PubsubLiteIO by removing options that no longer apply
      
      Also remove explicit blocking on data delivery- yield to the runtime instead if no data is available since reading from Pub/Sub Lite is now performed in the background
      
      * [BEAM-14129] Perform all file writes in WriteFiles in the background
      
      This should allow bundles which write to multiple files to write to each of them in parallel, instead of blocking when any of their buffers fill up.
      
      * Fix python formatting issues
      
      Co-authored-by: default avatarLukasz Cwik <lcwik@google.com>
      d50f1b17
    • Heejong Lee's avatar
      Merge pull request #17674 from ihji/BEAM-14471 · 5bb31275
      Heejong Lee 创作于
      [BEAM-14471] Adding testcases and examples for xlang Python DataframeTransform
      5bb31275
加载中