com.soteradefense.dga.io.formats

Class DGAAbstractEdgeInputFormat<E extends Writable>

java.lang.Object

org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable<I,V,E>

org.apache.giraph.io.GiraphInputFormat<I,Writable,E>

org.apache.giraph.io.EdgeInputFormat<I,E>

org.apache.giraph.io.formats.TextEdgeInputFormat<Text,E>

com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat<E>

Type Parameters:

E -

All Implemented Interfaces:

ImmutableClassesGiraphConfigurable<Text,Writable,E>

Direct Known Subclasses:

DGALongEdgeValueInputFormat, DGATextEdgeValueInputFormat

public abstract class DGAAbstractEdgeInputFormat<E extends Writable>
extends TextEdgeInputFormat<Text,E>

Abstract class that simplifies the setup of our EdgeInputFormat subclasses. All DGA analytics require data to be specified in roughly the same way, while some algorithms may require a 3rd column with a weight and others may not care. The only duty of this class is to set up the edge reverse duplicator, and extract defaults or overrides from the GiraphConfiguration

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader<E extends Writable> Simple implementation that offloads work of parsing to the RawEdge class and the work of casting our edgeValue as a Writable class of choice to the implementing subclasses.

Nested classes/interfaces inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat

TextEdgeInputFormat.TextEdgeReader, TextEdgeInputFormat.TextEdgeReaderFromEachLine, TextEdgeInputFormat.TextEdgeReaderFromEachLineProcessed<T>

Field Summary

Fields

Modifier and Type	Field and Description
static String	EDGE_VALUE Key we use in the GiraphConfiguration to denote our default edge edgeValue
static String	IO_EDGE_REVERSE_DUPLICATOR Configuration Identifier to use a reverse edge.
static String	IO_EDGE_REVERSE_DUPLICATOR_DEFAULT Default Value for the reverse edge duplicator.
static String	LINE_TOKENIZE_VALUE Key we use in the GiraphConfiguration to denote our field delimiter
static String	LINE_TOKENIZE_VALUE_DEFAULT Default value used if no field delimiter is specified via the GiraphConfiguration

Fields inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat

textInputFormat

Constructor Summary

Constructors

Constructor and Description
DGAAbstractEdgeInputFormat()

Method Summary

Methods inherited from class org.apache.giraph.io.formats.TextEdgeInputFormat

checkInputSpecs, getSplits

Methods inherited from class org.apache.giraph.io.EdgeInputFormat

createEdgeReader

Methods inherited from class org.apache.giraph.io.GiraphInputFormat

readInputSplit, writeInputSplit

Methods inherited from class org.apache.giraph.conf.DefaultImmutableClassesGiraphConfigurable

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LINE_TOKENIZE_VALUE

public static final String LINE_TOKENIZE_VALUE

Key we use in the GiraphConfiguration to denote our field delimiter

See Also:

Constant Field Values

LINE_TOKENIZE_VALUE_DEFAULT

public static final String LINE_TOKENIZE_VALUE_DEFAULT

Default value used if no field delimiter is specified via the GiraphConfiguration

See Also:

Constant Field Values

EDGE_VALUE

public static final String EDGE_VALUE

Key we use in the GiraphConfiguration to denote our default edge edgeValue

See Also:

Constant Field Values

IO_EDGE_REVERSE_DUPLICATOR

public static final String IO_EDGE_REVERSE_DUPLICATOR

Configuration Identifier to use a reverse edge.

See Also:

Constant Field Values

IO_EDGE_REVERSE_DUPLICATOR_DEFAULT

public static final String IO_EDGE_REVERSE_DUPLICATOR_DEFAULT

Default Value for the reverse edge duplicator.

See Also:

Constant Field Values

Constructor Detail

DGAAbstractEdgeInputFormat

public DGAAbstractEdgeInputFormat()