org.apache.reef.io.data.loading.impl

Class EvaluatorToPartitionMapper<V extends org.apache.hadoop.mapred.InputSplit>

java.lang.Object

org.apache.reef.io.data.loading.impl.EvaluatorToPartitionMapper<V>

Type Parameters:

V -

public class EvaluatorToPartitionMapper<V extends org.apache.hadoop.mapred.InputSplit>
extends Object

Class that tracks the mapping between evaluators & the data partition assigned to those evaluators. Its part of the implementation of a DataLoadingService that uses the Hadoop InputFormat to partition the data and request resources accordingly

This is an online version which satisfies requests in a greedy way.

Constructor Summary

Constructors

Constructor and Description
EvaluatorToPartitionMapper(V[] splits) Initializes the locations of splits mapping

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.reef.io.data.loading.impl.NumberedSplit<V>	getInputSplit(String hostName, String evaluatorId) Get an input split to be assigned to this evaluator Allocates one if its not already allocated

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EvaluatorToPartitionMapper

public EvaluatorToPartitionMapper(V[] splits)

Initializes the locations of splits mapping

Parameters:

splits -

Method Detail

getInputSplit

public org.apache.reef.io.data.loading.impl.NumberedSplit<V> getInputSplit(String hostName,
                                                                  String evaluatorId)

Get an input split to be assigned to this evaluator

Allocates one if its not already allocated

Parameters:

evaluatorId -

Returns: