Class FileIO.Match
- java.lang.Object
-
- org.apache.beam.sdk.transforms.PTransform<PBegin,PCollection<MatchResult.Metadata>>
-
- org.apache.beam.sdk.io.FileIO.Match
-
- All Implemented Interfaces:
java.io.Serializable
,HasDisplayData
- Enclosing class:
- FileIO
public abstract static class FileIO.Match extends PTransform<PBegin,PCollection<MatchResult.Metadata>>
Implementation ofFileIO.match()
.- See Also:
- Serialized Form
-
-
Field Summary
-
Fields inherited from class org.apache.beam.sdk.transforms.PTransform
name, resourceHints
-
-
Constructor Summary
Constructors Constructor Description Match()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description FileIO.Match
continuously(org.joda.time.Duration pollInterval, Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition)
FileIO.Match
continuously(org.joda.time.Duration pollInterval, Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition, boolean matchUpdatedFiles)
PCollection<MatchResult.Metadata>
expand(PBegin input)
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.FileIO.Match
filepattern(java.lang.String filepattern)
Matches the given filepattern.FileIO.Match
filepattern(ValueProvider<java.lang.String> filepattern)
Likefilepattern(String)
but using aValueProvider
.void
populateDisplayData(DisplayData.Builder builder)
Register display data for the given transform or component.FileIO.Match
withConfiguration(FileIO.MatchConfiguration configuration)
Sets theFileIO.MatchConfiguration
.FileIO.Match
withEmptyMatchTreatment(EmptyMatchTreatment treatment)
-
Methods inherited from class org.apache.beam.sdk.transforms.PTransform
compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, setResourceHints, toString, validate, validate
-
-
-
-
Method Detail
-
filepattern
public FileIO.Match filepattern(java.lang.String filepattern)
Matches the given filepattern.
-
filepattern
public FileIO.Match filepattern(ValueProvider<java.lang.String> filepattern)
Likefilepattern(String)
but using aValueProvider
.
-
withConfiguration
public FileIO.Match withConfiguration(FileIO.MatchConfiguration configuration)
Sets theFileIO.MatchConfiguration
.
-
withEmptyMatchTreatment
public FileIO.Match withEmptyMatchTreatment(EmptyMatchTreatment treatment)
-
continuously
public FileIO.Match continuously(org.joda.time.Duration pollInterval, Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition, boolean matchUpdatedFiles)
SeeFileIO.MatchConfiguration.continuously(org.joda.time.Duration, org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String, ?>, boolean)
. The returnedPCollection
is unbounded.This works only in runners supporting splittable
DoFn
.
-
continuously
public FileIO.Match continuously(org.joda.time.Duration pollInterval, Watch.Growth.TerminationCondition<java.lang.String,?> terminationCondition)
SeeFileIO.MatchConfiguration.continuously(org.joda.time.Duration, org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition<java.lang.String, ?>, boolean)
. The returnedPCollection
is unbounded.This works only in runners supporting splittable
DoFn
.
-
expand
public PCollection<MatchResult.Metadata> expand(PBegin input)
Description copied from class:PTransform
Override this method to specify how thisPTransform
should be expanded on the givenInputT
.NOTE: This method should not be called directly. Instead apply the
PTransform
should be applied to theInputT
using theapply
method.Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
- Specified by:
expand
in classPTransform<PBegin,PCollection<MatchResult.Metadata>>
-
populateDisplayData
public void populateDisplayData(DisplayData.Builder builder)
Description copied from class:PTransform
Register display data for the given transform or component.populateDisplayData(DisplayData.Builder)
is invoked by Pipeline runners to collect display data viaDisplayData.from(HasDisplayData)
. Implementations may callsuper.populateDisplayData(builder)
in order to register display data in the current namespace, but should otherwise usesubcomponent.populateDisplayData(builder)
to use the namespace of the subcomponent.By default, does not register any display data. Implementors may override this method to provide their own display data.
- Specified by:
populateDisplayData
in interfaceHasDisplayData
- Overrides:
populateDisplayData
in classPTransform<PBegin,PCollection<MatchResult.Metadata>>
- Parameters:
builder
- The builder to populate with display data.- See Also:
HasDisplayData
-
-