public final class DataLoadingRequestBuilder extends Object implements Builder<Configuration>
Modifier and Type | Class and Description |
---|---|
static class |
DataLoadingRequestBuilder.LoadDataIntoMemory |
static class |
DataLoadingRequestBuilder.NumberOfDesiredSplits |
Constructor and Description |
---|
DataLoadingRequestBuilder() |
Modifier and Type | Method and Description |
---|---|
DataLoadingRequestBuilder |
addComputeRequest(EvaluatorRequest computeRequest)
Adds a single request to the compute requests list.
|
DataLoadingRequestBuilder |
addComputeRequests(List<EvaluatorRequest> computeRequests)
Adds the requests to the compute requests list.
|
DataLoadingRequestBuilder |
addDataRequest(EvaluatorRequest dataRequest)
Adds a single request to the data requests list.
|
DataLoadingRequestBuilder |
addDataRequests(List<EvaluatorRequest> dataRequests)
Adds the requests to the data requests list.
|
Configuration |
build()
Builds a fresh instance of the object.
|
DataLoadingRequestBuilder |
loadIntoMemory(boolean inMemory) |
DataLoadingRequestBuilder |
renewFailedEvaluators(boolean renewFailedEvaluators) |
DataLoadingRequestBuilder |
setDistributedDataSet(DistributedDataSet distributedDataSet)
Sets the distributed data set.
|
DataLoadingRequestBuilder |
setDriverConfigurationModule(ConfigurationModule driverConfigurationModule) |
DataLoadingRequestBuilder |
setInputFormatClass(Class<? extends org.apache.hadoop.mapred.InputFormat> inputFormatClass) |
DataLoadingRequestBuilder |
setInputPath(String inputPath)
Sets the path of the folder where the data is.
|
DataLoadingRequestBuilder |
setNumberOfDesiredSplits(int numberOfDesiredSplits) |
public DataLoadingRequestBuilder()
public DataLoadingRequestBuilder setNumberOfDesiredSplits(int numberOfDesiredSplits)
public DataLoadingRequestBuilder addComputeRequests(List<EvaluatorRequest> computeRequests)
computeRequests
- the compute requests to addpublic DataLoadingRequestBuilder addDataRequests(List<EvaluatorRequest> dataRequests)
dataRequests
- the data requests to addpublic DataLoadingRequestBuilder addComputeRequest(EvaluatorRequest computeRequest)
computeRequest
- the compute request to addpublic DataLoadingRequestBuilder addDataRequest(EvaluatorRequest dataRequest)
dataRequest
- the data request to addpublic DataLoadingRequestBuilder loadIntoMemory(boolean inMemory)
public DataLoadingRequestBuilder renewFailedEvaluators(boolean renewFailedEvaluators)
public DataLoadingRequestBuilder setDriverConfigurationModule(ConfigurationModule driverConfigurationModule)
public DataLoadingRequestBuilder setInputFormatClass(Class<? extends org.apache.hadoop.mapred.InputFormat> inputFormatClass)
public DataLoadingRequestBuilder setInputPath(String inputPath)
SingleDataCenterEvaluatorToPartitionStrategy
is binded.inputPath
- the input pathpublic DataLoadingRequestBuilder setDistributedDataSet(DistributedDataSet distributedDataSet)
MultiDataCenterEvaluatorToPartitionStrategy
is binded.distributedDataSet
- the distributed data setpublic Configuration build() throws BindException
Builder
build
in interface Builder<Configuration>
BindException
Copyright © 2017 The Apache Software Foundation. All rights reserved.