This repository was archived by the owner on Nov 11, 2022. It is now read-only.
Version 0.3.20150326
Pre-release
Pre-release
·
2012 commits
to master
since this release
- Added support for accessing
PipelineOptionsin the Dataflow worker. - Removed one of the type parameters in
PCollectionView, which may require simple changes to user's code that usesPCollectionView. - Changed side input API to apply per window. Calls to
sideInput()now return values only in the specific window corresponding to the window of the main input element, and not the whole side inputPCollectionView. Consequently,sideInput()can no longer be called fromstartBundleandfinishBundleof aDoFn. - Added support for viewing a
PCollectionas aMapwhen used as a side input. SeeView.asMap(). - Renamed custom source API to use term "bundle" instead of "shard" in all names. Additionally, term "fork" is replaced with "dynamic split".
- Custom source
Readernow requires implementing new methodstart(). Existing code can be fixed by simply adding this method that just callsadvance()and returns its value. Additionally, code that uses theReadershould be updated to use bothstart()andadvance(), instead ofadvance()only.