org.apache.reef.io.data.loading.api

Class DataLoader

java.lang.Object

org.apache.reef.io.data.loading.api.DataLoader

public class DataLoader
extends Object

The driver component for the DataLoadingService Also acts as the central point for resource requests All the allocated evaluators pass through this and the ones that need data loading have a context stacked that enables a task to get access to Data via the DataSet.

TODO: Add timeouts

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	DataLoader.EvaluatorAllocatedHandler
class	DataLoader.EvaluatorFailedHandler
class	DataLoader.StartHandler

Constructor Summary

Constructors

Constructor and Description
DataLoader(Clock clock, EvaluatorRequestor requestor, DataLoadingService dataLoadingService, Set<String> serializedComputeRequests, Set<String> serializedDataRequests) Allows to specify compute and data evaluator requests in particular locations.

Method Summary

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataLoader

@Inject
public DataLoader(Clock clock,
                 EvaluatorRequestor requestor,
                 DataLoadingService dataLoadingService,
                 Set<String> serializedComputeRequests,
                 Set<String> serializedDataRequests)

Allows to specify compute and data evaluator requests in particular locations.

Parameters:

clock - the clock

requestor - the evaluator requestor

dataLoadingService - the data loading service

serializedComputeRequests - serialized compute requests (evaluators that will not load data)

serializedDataRequests - serialized data requests (evaluators that will load data). It cannot be empty (to maintain previous functionality)