org.apache.reef.io.data.loading.api

Class DataLoadingRequestBuilder

java.lang.Object

org.apache.reef.io.data.loading.api.DataLoadingRequestBuilder

All Implemented Interfaces:

Builder<Configuration>

public final class DataLoadingRequestBuilder
extends Object
implements Builder<Configuration>

Builder to create a request to the DataLoadingService.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataLoadingRequestBuilder.LoadDataIntoMemory
static class	DataLoadingRequestBuilder.NumberOfDesiredSplits

Constructor Summary

Constructors

Constructor and Description
DataLoadingRequestBuilder()

Method Summary

Methods

Modifier and Type	Method and Description
DataLoadingRequestBuilder	addComputeRequest(EvaluatorRequest computeRequest) Adds a single request to the compute requests list.
DataLoadingRequestBuilder	addComputeRequests(List<EvaluatorRequest> computeRequests) Adds the requests to the compute requests list.
DataLoadingRequestBuilder	addDataRequest(EvaluatorRequest dataRequest) Adds a single request to the data requests list.
DataLoadingRequestBuilder	addDataRequests(List<EvaluatorRequest> dataRequests) Adds the requests to the data requests list.
Configuration	build() Builds a fresh instance of the object.
DataLoadingRequestBuilder	loadIntoMemory(boolean inMemory)
DataLoadingRequestBuilder	renewFailedEvaluators(boolean renewFailedEvaluators)
DataLoadingRequestBuilder	setDistributedDataSet(DistributedDataSet distributedDataSet) Sets the distributed data set.
DataLoadingRequestBuilder	setDriverConfigurationModule(ConfigurationModule driverConfigurationModule)
DataLoadingRequestBuilder	setInputFormatClass(Class<? extends org.apache.hadoop.mapred.InputFormat> inputFormatClass)
DataLoadingRequestBuilder	setInputPath(String inputPath) Sets the path of the folder where the data is.
DataLoadingRequestBuilder	setNumberOfDesiredSplits(int numberOfDesiredSplits)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataLoadingRequestBuilder

public DataLoadingRequestBuilder()

Method Detail

setNumberOfDesiredSplits

public DataLoadingRequestBuilder setNumberOfDesiredSplits(int numberOfDesiredSplits)

addComputeRequests

public DataLoadingRequestBuilder addComputeRequests(List<EvaluatorRequest> computeRequests)

Adds the requests to the compute requests list.

Parameters:

computeRequests - the compute requests to add

Returns:

this

addDataRequests

public DataLoadingRequestBuilder addDataRequests(List<EvaluatorRequest> dataRequests)

Adds the requests to the data requests list.

Parameters:

dataRequests - the data requests to add

Returns:

this

addComputeRequest

public DataLoadingRequestBuilder addComputeRequest(EvaluatorRequest computeRequest)

Adds a single request to the compute requests list.

Parameters:

computeRequest - the compute request to add

Returns:

this

addDataRequest

public DataLoadingRequestBuilder addDataRequest(EvaluatorRequest dataRequest)

Adds a single request to the data requests list.

Parameters:

dataRequest - the data request to add

Returns:

this

loadIntoMemory

public DataLoadingRequestBuilder loadIntoMemory(boolean inMemory)

renewFailedEvaluators

public DataLoadingRequestBuilder renewFailedEvaluators(boolean renewFailedEvaluators)

setDriverConfigurationModule

public DataLoadingRequestBuilder setDriverConfigurationModule(ConfigurationModule driverConfigurationModule)

setInputFormatClass

public DataLoadingRequestBuilder setInputFormatClass(Class<? extends org.apache.hadoop.mapred.InputFormat> inputFormatClass)

setInputPath

public DataLoadingRequestBuilder setInputPath(String inputPath)

Sets the path of the folder where the data is. Internally, a distributed dataset with a unique partition is created, and SingleDataCenterEvaluatorToPartitionStrategy is binded.

Parameters:

inputPath - the input path

Returns:

this

setDistributedDataSet

public DataLoadingRequestBuilder setDistributedDataSet(DistributedDataSet distributedDataSet)

Sets the distributed data set. Internally, a MultiDataCenterEvaluatorToPartitionStrategy is binded.

Parameters:

distributedDataSet - the distributed data set

Returns:

this

build

public Configuration build()
                    throws BindException

Description copied from interface: Builder

Builds a fresh instance of the object. This can be invoked several times, each of which return a new instance.

Specified by:

build in interface Builder<Configuration>

Returns:

a fresh instance of the object.

Throws:

BindException