This project has retired. For details please refer to its Attic page.
Apache REEF: Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder Class Reference
Apache REEF  0.15.0
Retainable Evaluator Execution Framework
Public Member Functions | List of all members
Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder Class Reference

Use this class to create an IMRU Job Definition. More...

Public Member Functions

 IMRUJobDefinitionBuilder ()
 Constructor More...
 
IMRUJobDefinitionBuilder SetJobName (string name)
 Set the name of the job. More...
 
IMRUJobDefinitionBuilder SetMapFunctionConfiguration (IConfiguration mapFunctionConfiguration)
 Sets configuration of map function More...
 
IMRUJobDefinitionBuilder SetMapInputCodecConfiguration (IConfiguration mapInputCodecConfiguration)
 Sets configuration of codec for TMapInput More...
 
IMRUJobDefinitionBuilder SetUpdateFunctionCodecsConfiguration (IConfiguration updateFunctionCodecsConfiguration)
 Sets configuration of codecs needed by Update function More...
 
IMRUJobDefinitionBuilder SetReduceFunctionConfiguration (IConfiguration reduceFunctionConfiguration)
 Sets configuration of reduce function More...
 
IMRUJobDefinitionBuilder SetUpdateFunctionConfiguration (IConfiguration updateFunctionConfiguration)
 Sets configuration of update function More...
 
IMRUJobDefinitionBuilder SetMapOutputPipelineDataConverterConfiguration (IConfiguration mapOutputPipelineDataConverterConfiguration)
 Sets configuration of PipelineDataConverter for Map output More...
 
IMRUJobDefinitionBuilder SetMapInputPipelineDataConverterConfiguration (IConfiguration mapInputPipelineDataConverterConfiguration)
 Sets configuration of PipelineDataConverter for Map Input More...
 
IMRUJobDefinitionBuilder SetPartitionedDatasetConfiguration (IConfiguration partitionedDatasetConfiguration)
 Sets configuration of partitioned dataset More...
 
IMRUJobDefinitionBuilder SetNumberOfMappers (int numberOfMappers)
 Sets Number of mappers More...
 
IMRUJobDefinitionBuilder SetMapperMemory (int memory)
 Sets mapper memory More...
 
IMRUJobDefinitionBuilder SetUpdateTaskMemory (int memory)
 Set update task memory More...
 
IMRUJobDefinitionBuilder SetMapTaskCores (int cores)
 Sets cores for map tasks More...
 
IMRUJobDefinitionBuilder SetUpdateTaskCores (int cores)
 Set update task cores More...
 
IMRUJobDefinitionBuilder SetPerMapConfigurations (IConfiguration perMapperConfig)
 Sets Per Map Configuration More...
 
IMRUJobDefinitionBuilder SetResultHandlerConfiguration (IConfiguration resultHandlerConfig)
 Sets Result handler Configuration More...
 
IMRUJobDefinitionBuilder InvokeGarbageCollectorAfterIteration (bool invokeGC)
 Whether to invoke Garbage Collector after each IMRU iteration More...
 
IMRUJobDefinition Build ()
 Instantiate the IMRUJobDefinition. More...
 

Detailed Description

Use this class to create an IMRU Job Definition.

See also
IMRUJobDefinition

Constructor & Destructor Documentation

Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.IMRUJobDefinitionBuilder ( )
inline

Constructor

Member Function Documentation

IMRUJobDefinition Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.Build ( )
inline

Instantiate the IMRUJobDefinition.

Returns
The IMRUJobDefintion configured.
Exceptions
NullReferenceExceptionIf any of the required parameters is not set.
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.InvokeGarbageCollectorAfterIteration ( bool  invokeGC)
inline

Whether to invoke Garbage Collector after each IMRU iteration

Parameters
invokeGCvariable telling whether to invoke or not
Returns
The modified definition builder
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetJobName ( string  name)
inline

Set the name of the job.

Parameters
namethe name of the job
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapFunctionConfiguration ( IConfiguration  mapFunctionConfiguration)
inline

Sets configuration of map function

Parameters
mapFunctionConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapInputCodecConfiguration ( IConfiguration  mapInputCodecConfiguration)
inline

Sets configuration of codec for TMapInput

Parameters
mapInputCodecConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapInputPipelineDataConverterConfiguration ( IConfiguration  mapInputPipelineDataConverterConfiguration)
inline

Sets configuration of PipelineDataConverter for Map Input

Parameters
mapInputPipelineDataConverterConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapOutputPipelineDataConverterConfiguration ( IConfiguration  mapOutputPipelineDataConverterConfiguration)
inline

Sets configuration of PipelineDataConverter for Map output

Parameters
mapOutputPipelineDataConverterConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapperMemory ( int  memory)
inline

Sets mapper memory

Parameters
memorymemory in MB
Returns
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetMapTaskCores ( int  cores)
inline

Sets cores for map tasks

Parameters
coresnumber of cores
Returns
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetNumberOfMappers ( int  numberOfMappers)
inline

Sets Number of mappers

Parameters
numberOfMappersNumber of mappers
Returns
this

TODO: This is duplicate in a sense that it can be determined TODO: automatically from IPartitionedDataset. However, right now TODO: GroupComm. instantiated in IMRUDriver needs this parameter TODO: in constructor. This will be removed once we remove it from GroupComm.

IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetPartitionedDatasetConfiguration ( IConfiguration  partitionedDatasetConfiguration)
inline

Sets configuration of partitioned dataset

Parameters
partitionedDatasetConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetPerMapConfigurations ( IConfiguration  perMapperConfig)
inline

Sets Per Map Configuration

Parameters
perMapperConfigMapper configs
Returns
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetReduceFunctionConfiguration ( IConfiguration  reduceFunctionConfiguration)
inline

Sets configuration of reduce function

Parameters
reduceFunctionConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetResultHandlerConfiguration ( IConfiguration  resultHandlerConfig)
inline

Sets Result handler Configuration

Parameters
resultHandlerConfigResult handler config
Returns
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetUpdateFunctionCodecsConfiguration ( IConfiguration  updateFunctionCodecsConfiguration)
inline

Sets configuration of codecs needed by Update function

Parameters
updateFunctionCodecsConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetUpdateFunctionConfiguration ( IConfiguration  updateFunctionConfiguration)
inline

Sets configuration of update function

Parameters
updateFunctionConfigurationConfiguration
Returns
this
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetUpdateTaskCores ( int  cores)
inline

Set update task cores

Parameters
coresnumber of cores
Returns
IMRUJobDefinitionBuilder Org.Apache.REEF.IMRU.API.IMRUJobDefinitionBuilder.SetUpdateTaskMemory ( int  memory)
inline

Set update task memory

Parameters
memorymemory in MB
Returns

The documentation for this class was generated from the following file: