org.apache.reef.io.data.loading.api

Interface EvaluatorToPartitionStrategy<V extends org.apache.hadoop.mapred.InputSplit>

Type Parameters:

V -

All Known Implementing Classes:

AbstractEvaluatorToPartitionStrategy, MultiDataCenterEvaluatorToPartitionStrategy, SingleDataCenterEvaluatorToPartitionStrategy

public interface EvaluatorToPartitionStrategy<V extends org.apache.hadoop.mapred.InputSplit>

Interface that tracks the mapping between evaluators and the data partitions assigned to those evaluators. Its part of the implementation of a DataLoadingService that uses the Hadoop InputFormat to partition the data and request resources accordingly

Method Summary

Methods

Modifier and Type	Method and Description
NumberedSplit<V>	getInputSplit(NodeDescriptor nodeDescriptor, String evalId) Returns an input split for the given evaluator.
int	getNumberOfSplits() Returns the total number of splits computed in this strategy.

Method Detail

getInputSplit

NumberedSplit<V> getInputSplit(NodeDescriptor nodeDescriptor,
                             String evalId)

Returns an input split for the given evaluator.

Parameters:

nodeDescriptor - the node descriptor where the evaluator is running on

evalId - the evaluator id

Returns:

the numberedSplit

Throws:

RuntimeException - if no split could be allocated

getNumberOfSplits

int getNumberOfSplits()

Returns the total number of splits computed in this strategy.

Returns:

the number of splits