com.soteradefense.dga.io.formats

Class DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader<E extends Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,Writable,E>

org.apache.giraph.io.EdgeReader<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReader

org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<RawEdge>

com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader<E>

Type Parameters:

E - Writable class to be stated in the implementing class.

All Implemented Interfaces:

AggregatorUsage, ImmutableClassesGiraphConfigurable<Text,Writable,E>, WorkerAggregatorUsage

Direct Known Subclasses:

DGALongEdgeValueInputFormat.DGALongEdgeValueReader, DGATextEdgeValueInputFormat.DGATextEdgeValueReader

Enclosing class:

DGAAbstractEdgeInputFormat<E extends Writable>

public abstract class DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader<E extends Writable>
extends TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<RawEdge>

Simple implementation that offloads work of parsing to the RawEdge class and the work of casting our edgeValue as a Writable class of choice to the implementing subclasses.

Constructor Summary

Constructors

Constructor and Description
DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader()

Method Summary

Methods

Modifier and Type	Method and Description
protected abstract String	getDefaultEdgeValue()
protected Text	getSourceVertexId(RawEdge edge)
protected Text	getTargetVertexId(RawEdge edge)
void	initialize(InputSplit inputSplit, TaskAttemptContext context)
protected RawEdge	preprocessLine(Text line)
protected abstract void	validateEdgeValue(RawEdge edge)

Methods inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed

getCurrentEdge, getCurrentSourceId, getValue, nextEdge

Methods inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat.TextEdgeReader

close, createLineRecordReader, getContext, getProgress, getRecordReader

Methods inherited from class org.apache.giraph.io.EdgeReader

aggregate, getAggregatedValue, setWorkerAggregatorUse

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader

public DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader()

Method Detail

initialize

public void initialize(InputSplit inputSplit,
              TaskAttemptContext context)
                throws IOException,
                       InterruptedException

Overrides:

initialize in class TextEdgeInputFormat.TextEdgeReader

Throws:

IOException

InterruptedException

preprocessLine

protected RawEdge preprocessLine(Text line)
                          throws IOException

Specified by:

preprocessLine in class TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<RawEdge>

Throws:

IOException

getDefaultEdgeValue

protected abstract String getDefaultEdgeValue()

validateEdgeValue

protected abstract void validateEdgeValue(RawEdge edge)
                                   throws IOException

Throws:

IOException

getTargetVertexId

protected Text getTargetVertexId(RawEdge edge)
                          throws IOException

Specified by:

getTargetVertexId in class TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<RawEdge>

Throws:

IOException

getSourceVertexId

protected Text getSourceVertexId(RawEdge edge)
                          throws IOException

Specified by:

getSourceVertexId in class TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<RawEdge>

Throws:

IOException