A B C D E F G H I L M N P R S T U V W 

A

ACTUAL_Q_AGG - Static variable in class com.soteradefense.dga.louvain.giraph.LouvainComputation
 
addDependency(double) - Method in class com.soteradefense.dga.hbse.PartialDependency
Add to the accumulated dependency value by a delta
addPartialDep(String, double, int) - Method in class com.soteradefense.dga.hbse.VertexData
Updates pair dependency data
addPathData(PathData) - Method in class com.soteradefense.dga.hbse.VertexData
Add the new path to the list of shortest paths, if it is indeed a shortest path
addSuccessors(int) - Method in class com.soteradefense.dga.hbse.PartialDependency
Update the successor count by a delta
addToSigmaTotal(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
aggregate(HighBetweennessList) - Method in class com.soteradefense.dga.hbse.HighBetweennessList
Add items from other to this.
aggregate(HighBetweennessList) - Method in class com.soteradefense.dga.hbse.HighBetweennessListAggregator
Takes the old aggregated value and compares it to a new value wanting to be aggregated.

B

BETWEENNESS_OUTPUT_DIR - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the directory to output the highbetweenness set.
BETWEENNESS_SET_MAX_SIZE - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the maximum number of nodes in the betweenness set.
BETWEENNESS_SET_STABILITY - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the set stability cut off point (margin of error).
BETWEENNESS_SET_STABILITY_COUNTER - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the set stability counter cut off point (margin of error).
BETWEENNESS_SHORTEST_PATH_PHASES - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the number of shortest path phases to run through.

C

CHANGE_AGG - Static variable in class com.soteradefense.dga.louvain.giraph.LouvainComputation
 
coalesce(DGAConfiguration...) - Static method in class com.soteradefense.dga.DGAConfiguration
This method returns a new DGAConfiguration object containing the resulting coalescing activity of all provided DGAConfigurations The order of the configurations is important -- the configuration with the lowest priority will be added first, then the second, and so on.
com.soteradefense.dga - package com.soteradefense.dga
 
com.soteradefense.dga.hbse - package com.soteradefense.dga.hbse
 
com.soteradefense.dga.io.formats - package com.soteradefense.dga.io.formats
 
com.soteradefense.dga.lc - package com.soteradefense.dga.lc
 
com.soteradefense.dga.louvain.giraph - package com.soteradefense.dga.louvain.giraph
 
com.soteradefense.dga.louvain.mapreduce - package com.soteradefense.dga.louvain.mapreduce
 
com.soteradefense.dga.pr - package com.soteradefense.dga.pr
 
com.soteradefense.dga.wcc - package com.soteradefense.dga.wcc
 
CommunityCompression - Class in com.soteradefense.dga.louvain.mapreduce
Map reduce job to compress a graph in such a way that each community is represented by a single node.
CommunityCompression() - Constructor for class com.soteradefense.dga.louvain.mapreduce.CommunityCompression
 
CommunityCompression.Map - Class in com.soteradefense.dga.louvain.mapreduce
 
CommunityCompression.Map() - Constructor for class com.soteradefense.dga.louvain.mapreduce.CommunityCompression.Map
 
CommunityCompression.Reduce - Class in com.soteradefense.dga.louvain.mapreduce
 
CommunityCompression.Reduce() - Constructor for class com.soteradefense.dga.louvain.mapreduce.CommunityCompression.Reduce
 
comparator - Static variable in class com.soteradefense.dga.hbse.HighBetweennessList
BcTuple Comparator Used to order based on value.
compute(Vertex<Text, VertexData, Text>, Iterable<PathData>) - Method in class com.soteradefense.dga.hbse.HBSEComputation
Works in two major stages which are repeated and coordinated by the setting of a global state (set by the master compute class)

Stage 1: Discover shortest paths, and shortest path counts for each source vertex in a globally set pivot batch to each node in the graph. Stage 2: Accumulate pair dependencies.

compute() - Method in class com.soteradefense.dga.hbse.HBSEMasterCompute
Coordinates the computation phases of SBVertex by monitoring for the completion of each state and moving to the next state.
compute(Vertex<Text, Text, Text>, Iterable<Text>) - Method in class com.soteradefense.dga.lc.LeafCompressionComputation
 
compute(Vertex<Text, LouvainNodeState, LongWritable>, Iterable<LouvainMessage>) - Method in class com.soteradefense.dga.louvain.giraph.LouvainComputation
 
compute() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMasterCompute
 
compute(Vertex<Text, DoubleWritable, Text>, Iterable<DoubleWritable>) - Method in class com.soteradefense.dga.pr.PageRankComputation
 
compute() - Method in class com.soteradefense.dga.pr.PageRankMasterCompute
 
compute(Vertex<Text, Text, Text>, Iterable<Text>) - Method in class com.soteradefense.dga.wcc.WeaklyConnectedComponentComputation
 
convertEdgeToLine(I, V, Edge<I, E>) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter
 
convertToCommandLineArguments(String) - Method in class com.soteradefense.dga.DGAConfiguration
 
createEdgeReader(InputSplit, TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat
The create edge reader first determines if we should reverse each edge; some data sets are undirected graphs and need the input format to reverse their connected nature.
createEdgeReader(InputSplit, TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat
The create edge reader first determines if we should reverse each edge; some data sets are undirected graphs and need the input format to reverse their connected nature.
createEdgeWriter(TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTDTOutputFormat
 
createEdgeWriter(TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTTTOutputFormat
 
createInitialValue() - Method in class com.soteradefense.dga.hbse.HighBetweennessListAggregator
Creates an Initial HighBetweennessList
createVertexReader(InputSplit, TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.LouvainVertexInputFormat
 
createVertexWriter(TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.HBSEOutputFormat
 
createVertexWriter(TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.LouvainVertexOutputFormat
 

D

DAMPING_FACTOR - Static variable in class com.soteradefense.dga.pr.PageRankComputation
 
DAMPING_FACTOR_DEFAULT_VALUE - Static variable in class com.soteradefense.dga.pr.PageRankComputation
 
decideToHalt(List<Long>, Configuration) - Static method in class com.soteradefense.dga.louvain.giraph.LouvainMasterCompute
Determine if progress is still being made or if the computation should halt.
DGA_LOG_LEVEL - Static variable in class com.soteradefense.dga.DGALoggingUtil
 
DGAAbstractEdgeInputFormat<E extends Writable> - Class in com.soteradefense.dga.io.formats
Abstract class that simplifies the setup of our EdgeInputFormat subclasses.
DGAAbstractEdgeInputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
 
DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader<E extends Writable> - Class in com.soteradefense.dga.io.formats
Simple implementation that offloads work of parsing to the RawEdge class and the work of casting our edgeValue as a Writable class of choice to the implementing subclasses.
DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader() - Constructor for class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
DGAAbstractEdgeOutputFormat<I extends WritableComparable,V extends Writable,E extends Writable> - Class in com.soteradefense.dga.io.formats
The EdgeTDTOutputFormat outputs the edges that make up our graph.

DGAAbstractEdgeOutputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
 
DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter<I extends WritableComparable,V extends Writable,E extends Writable> - Class in com.soteradefense.dga.io.formats
A Edge Writer that writes each edge into a file on HDFS.
DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter() - Constructor for class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter
 
DGACommandLineUtil - Class in com.soteradefense.dga
 
DGACommandLineUtil() - Constructor for class com.soteradefense.dga.DGACommandLineUtil
 
DGAConfiguration - Class in com.soteradefense.dga
 
DGAConfiguration() - Constructor for class com.soteradefense.dga.DGAConfiguration
 
DGAEdgeTDTOutputFormat - Class in com.soteradefense.dga.io.formats
 
DGAEdgeTDTOutputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGAEdgeTDTOutputFormat
 
DGAEdgeTDTOutputFormat.TDTEdgeWriter - Class in com.soteradefense.dga.io.formats
A Simple Edge Writer that writes each edge into a file on HDFS.
DGAEdgeTDTOutputFormat.TDTEdgeWriter() - Constructor for class com.soteradefense.dga.io.formats.DGAEdgeTDTOutputFormat.TDTEdgeWriter
 
DGAEdgeTTTOutputFormat - Class in com.soteradefense.dga.io.formats
 
DGAEdgeTTTOutputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGAEdgeTTTOutputFormat
 
DGAEdgeTTTOutputFormat.TTTEdgeWriter - Class in com.soteradefense.dga.io.formats
A Simple Edge Writer that writes each edge into a file on HDFS.
DGAEdgeTTTOutputFormat.TTTEdgeWriter() - Constructor for class com.soteradefense.dga.io.formats.DGAEdgeTTTOutputFormat.TTTEdgeWriter
 
DGALoggingUtil - Class in com.soteradefense.dga
 
DGALoggingUtil() - Constructor for class com.soteradefense.dga.DGALoggingUtil
 
DGALongEdgeValueInputFormat - Class in com.soteradefense.dga.io.formats
Implementation of the DGAAbstractEdgeInputFormat for LongWritables as the edgeValue Will throw an IOException if our edgeValue can't be parsed to Long, then returns a LongWritable in the getValue(RawEdge) method.
DGALongEdgeValueInputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat
 
DGALongEdgeValueInputFormat.DGALongEdgeValueReader - Class in com.soteradefense.dga.io.formats
 
DGALongEdgeValueInputFormat.DGALongEdgeValueReader() - Constructor for class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat.DGALongEdgeValueReader
 
DGARunner - Class in com.soteradefense.dga
 
DGARunner() - Constructor for class com.soteradefense.dga.DGARunner
 
DGATextEdgeValueInputFormat - Class in com.soteradefense.dga.io.formats
Implementation of the DGAAbstractEdgeInputFormat for Text as the edgeValue Does no verification of the edgeValue and simply returns the third value as a Text
DGATextEdgeValueInputFormat() - Constructor for class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat
 
DGATextEdgeValueInputFormat.DGATextEdgeValueReader - Class in com.soteradefense.dga.io.formats
 
DGATextEdgeValueInputFormat.DGATextEdgeValueReader() - Constructor for class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat.DGATextEdgeValueReader
 
DGAXMLConfigurationParser - Class in com.soteradefense.dga
 
DGAXMLConfigurationParser() - Constructor for class com.soteradefense.dga.DGAXMLConfigurationParser
 

E

EDGE_VALUE - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
Key we use in the GiraphConfiguration to denote our default edge edgeValue
EPSILON - Static variable in class com.soteradefense.dga.pr.PageRankMasterCompute
 

F

FIELD_DELIMITER - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
Configuration Identifier for the file delimiter.
FIELD_DELIMITER_DEFAULT - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
The default value for the file delimiter.
FINAL_SET_CSV - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
This is the filename for the final highbetweenness set
fromText(Text) - Method in class com.soteradefense.dga.io.formats.RawEdge
 
fromTokens(String, String) - Static method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
FS_DEFAULT_FS - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the default file system.
FS_DEFAULT_NAME - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the default name.

G

generateOptions() - Static method in class com.soteradefense.dga.DGACommandLineUtil
 
getApproxBetweenness() - Method in class com.soteradefense.dga.hbse.VertexData
Gets the Approx Betweenness Value
getChanged() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getChangeHistory() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getCommunity() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getCommunityId() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
getCommunitySigmaTotal() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
getCommunitySigmaTotal() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getCurrentVertex() - Method in class com.soteradefense.dga.io.formats.LouvainVertexInputFormat.LouvainVertexReader
 
getCustomArgumentProperties() - Method in class com.soteradefense.dga.DGAConfiguration
 
getDefaultEdgeValue() - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
getDefaultEdgeValue() - Method in class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat.DGALongEdgeValueReader
 
getDefaultEdgeValue() - Method in class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat.DGATextEdgeValueReader
 
getDependency() - Method in class com.soteradefense.dga.hbse.PartialDependency
Gets the dependency.
getDependency() - Method in class com.soteradefense.dga.hbse.PathData
Gets the dependency value.
getDependencyMessage(String, double, long) - Static method in class com.soteradefense.dga.hbse.PathData
Get a new PathData message for accumulating pair dependency values
getDistance() - Method in class com.soteradefense.dga.hbse.PathData
Gets the distance from source to a predecessor.
getDistance() - Method in class com.soteradefense.dga.hbse.ShortestPathList
 
getEdges() - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
getEdgeValue() - Method in class com.soteradefense.dga.io.formats.RawEdge
 
getEdgeValueAsString(E) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter
The implementing classes must convert their Writable object into a String that can be appended to the String of text that will become our Text output
getEdgeValueAsString(Text) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTDTOutputFormat.TDTEdgeWriter
 
getEdgeValueAsString(Text) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTTTOutputFormat.TTTEdgeWriter
 
getEdgeWeight() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
getFrom() - Method in class com.soteradefense.dga.hbse.PathData
Gets the predecessor/successor value.
getGiraphProperties() - Method in class com.soteradefense.dga.DGAConfiguration
 
getHighBetweennessSet() - Method in class com.soteradefense.dga.hbse.HighBetweennessList
 
getInternalWeight() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getMaxSize() - Method in class com.soteradefense.dga.hbse.HighBetweennessList
 
getNewHighBetweennessList(String, double) - Method in class com.soteradefense.dga.hbse.HBSEComputation
Get a new HighBetweennessList object, configured with the betweenness.set.maxSize option from the job conf.
getNodeWeight() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
getNumPaths() - Method in class com.soteradefense.dga.hbse.PathData
Gets the number of shortest paths.
getPartialDependencyMap() - Method in class com.soteradefense.dga.hbse.VertexData
Gets the Partial Dependency Map
getPathDataMap() - Method in class com.soteradefense.dga.hbse.VertexData
Gets the Path Data Map.
getPingMessage(String) - Static method in class com.soteradefense.dga.hbse.PathData
Get a new PathData message for sending successor / predecessor information to neighbors
getPredecessorPathCountMap() - Method in class com.soteradefense.dga.hbse.ShortestPathList
Gets the Predecessor Count Map.
getQueue() - Method in class com.soteradefense.dga.hbse.HighBetweennessList
 
getShortestPathCount() - Method in class com.soteradefense.dga.hbse.ShortestPathList
 
getShortestPathMessage(String, String, long, long) - Static method in class com.soteradefense.dga.hbse.PathData
Get a new PathData message for shortest path computation.
getSource() - Method in class com.soteradefense.dga.hbse.PathData
Gets the source value.
getSourceId() - Method in class com.soteradefense.dga.io.formats.RawEdge
 
getSourceId() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
getSourceVertexId(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
getSuccessors() - Method in class com.soteradefense.dga.hbse.PartialDependency
Gets the number of successors that need to be processed.
getSystemProperties() - Method in class com.soteradefense.dga.DGAConfiguration
 
getTargetId() - Method in class com.soteradefense.dga.io.formats.RawEdge
 
getTargetVertexId(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
getValue(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat.DGALongEdgeValueReader
 
getValue(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat.DGATextEdgeValueReader
 
getVertexValueAsString(V) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter
The implementing classes must convert their Writable object into a String that can be appended to the String of text that will become our Text output
getVertexValueAsString(DoubleWritable) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTDTOutputFormat.TDTEdgeWriter
 
getVertexValueAsString(Text) - Method in class com.soteradefense.dga.io.formats.DGAEdgeTTTOutputFormat.TTTEdgeWriter
 
getWasPivotPoint() - Method in class com.soteradefense.dga.hbse.VertexData
 
getWeight() - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 

H

HBSEComputation - Class in com.soteradefense.dga.hbse
Calculates Shortest paths, and accumulates pair dependency information.
HBSEComputation() - Constructor for class com.soteradefense.dga.hbse.HBSEComputation
 
HBSEMasterCompute - Class in com.soteradefense.dga.hbse
Coordinates Global state for the SBVertex to calculate shortest paths, accumulates pair dependency information, and monitor high betweenness set stability.
HBSEMasterCompute() - Constructor for class com.soteradefense.dga.hbse.HBSEMasterCompute
 
HBSEOutputFormat - Class in com.soteradefense.dga.io.formats
Writes the approximated betweenness value for each vertex
HBSEOutputFormat() - Constructor for class com.soteradefense.dga.io.formats.HBSEOutputFormat
 
HBSEOutputFormat.SBVertexWriter - Class in com.soteradefense.dga.io.formats
A simple vertex writer that writes the Vertex and it's HighBetweenness Value.
HBSEOutputFormat.SBVertexWriter() - Constructor for class com.soteradefense.dga.io.formats.HBSEOutputFormat.SBVertexWriter
 
HIGH_BC_SET_AGG - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Identifier for the saved highbetweenness set.
HighBetweennessList - Class in com.soteradefense.dga.hbse
Maintains a list of the top N items(an item is defined as an int id, and double value), ranked by a double value.
HighBetweennessList() - Constructor for class com.soteradefense.dga.hbse.HighBetweennessList
Creates a new HighBetweennessList with Max size 1.
HighBetweennessList(int) - Constructor for class com.soteradefense.dga.hbse.HighBetweennessList
Creates a new HighBetweennessList with a Custom MaxSize
HighBetweennessList(String, double) - Constructor for class com.soteradefense.dga.hbse.HighBetweennessList
Creates a new HighBetweennessList with maxSize 1 and Adds a Value.
HighBetweennessList(int, String, double) - Constructor for class com.soteradefense.dga.hbse.HighBetweennessList
Creates a new HighBetweennessList with a custom size and initial value.
HighBetweennessListAggregator - Class in com.soteradefense.dga.hbse
Aggregator to accumulate a list of the top N vertices, ranked by approximated betweenness value.
HighBetweennessListAggregator() - Constructor for class com.soteradefense.dga.hbse.HighBetweennessListAggregator
 

I

INITIAL_PIVOT_PERCENT - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Identifier that stores the percentage of initial pivots to choose per batch.
initialize(GraphState, WorkerClientRequestProcessor<Text, VertexData, Text>, GraphTaskManager<Text, VertexData, Text>, WorkerAggregatorUsage, WorkerContext) - Method in class com.soteradefense.dga.hbse.HBSEComputation
 
initialize() - Method in class com.soteradefense.dga.hbse.HBSEMasterCompute
Read options from configuration file and set up aggregators (global communication)
initialize(InputSplit, TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
initialize(TaskAttemptContext) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat.DGAAbstractEdgeWriter
Upon intialization, determines the field separator and default weight to use from the GiraphConfiguration
initialize(GraphState, WorkerClientRequestProcessor<Text, Text, Text>, GraphTaskManager<Text, Text, Text>, WorkerAggregatorUsage, WorkerContext) - Method in class com.soteradefense.dga.lc.LeafCompressionComputation
 
initialize(GraphState, WorkerClientRequestProcessor<Text, LouvainNodeState, LongWritable>, GraphTaskManager<Text, LouvainNodeState, LongWritable>, WorkerAggregatorUsage, WorkerContext) - Method in class com.soteradefense.dga.louvain.giraph.LouvainComputation
 
initialize() - Method in class com.soteradefense.dga.louvain.giraph.LouvainMasterCompute
 
initialize() - Method in class com.soteradefense.dga.pr.PageRankMasterCompute
 
IO_EDGE_REVERSE_DUPLICATOR - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
Configuration Identifier to use a reverse edge.
IO_EDGE_REVERSE_DUPLICATOR_DEFAULT - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
Default Value for the reverse edge duplicator.
isFromLouvainVertexReader() - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 

L

LeafCompressionComputation - Class in com.soteradefense.dga.lc
Leaf Compression is an analytic used to compress a graph; nodes on the periphery of the graph that do not show an extensive network of connections from them will inform the nodes connected to them to remove them from the graph

This cycle continues until all leaves have been pruned.

LeafCompressionComputation() - Constructor for class com.soteradefense.dga.lc.LeafCompressionComputation
 
LINE_TOKENIZE_VALUE - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
Key we use in the GiraphConfiguration to denote our field delimiter
LINE_TOKENIZE_VALUE_DEFAULT - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat
Default value used if no field delimiter is specified via the GiraphConfiguration
LouvainComputation - Class in com.soteradefense.dga.louvain.giraph
Performs the BSP portion of the distributed louvain algorithm.
LouvainComputation() - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainComputation
 
LouvainMasterCompute - Class in com.soteradefense.dga.louvain.giraph
Master compute class.
LouvainMasterCompute() - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainMasterCompute
 
LouvainMessage - Class in com.soteradefense.dga.louvain.giraph
messages sent between vertices.
LouvainMessage(String, long, long, String) - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
LouvainMessage() - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
LouvainMessage(LouvainMessage) - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
LouvainNodeState - Class in com.soteradefense.dga.louvain.giraph
The state of a vertex.
LouvainNodeState() - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
LouvainRunner - Class in com.soteradefense.dga
 
LouvainRunner() - Constructor for class com.soteradefense.dga.LouvainRunner
 
LouvainVertexInputFormat - Class in com.soteradefense.dga.io.formats
Reads in a graph from text file in hdfs.
LouvainVertexInputFormat() - Constructor for class com.soteradefense.dga.io.formats.LouvainVertexInputFormat
 
LouvainVertexInputFormat.LouvainVertexReader - Class in com.soteradefense.dga.io.formats
 
LouvainVertexInputFormat.LouvainVertexReader() - Constructor for class com.soteradefense.dga.io.formats.LouvainVertexInputFormat.LouvainVertexReader
 
LouvainVertexOutputFormat - Class in com.soteradefense.dga.io.formats
Outputs the graph as text in hdfs:

Format is a tab seperated file with id community id internal weight community edge list

the edge list is a comma seperated list of edges of the form id:weight

LouvainVertexOutputFormat() - Constructor for class com.soteradefense.dga.io.formats.LouvainVertexOutputFormat
 
LouvainVertexOutputFormat.LouvainVertexWriter - Class in com.soteradefense.dga.io.formats
 
LouvainVertexOutputFormat.LouvainVertexWriter() - Constructor for class com.soteradefense.dga.io.formats.LouvainVertexOutputFormat.LouvainVertexWriter
 
LouvainVertexWritable - Class in com.soteradefense.dga.louvain.giraph
Writable class to represent community information for compressing a graph by its communities.
LouvainVertexWritable() - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
LouvainVertexWritable(long, Map<String, Long>) - Constructor for class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 

M

main(String[]) - Static method in class com.soteradefense.dga.DGARunner
 
map(LongWritable, Text, Mapper<LongWritable, Text, Text, LouvainVertexWritable>.Context) - Method in class com.soteradefense.dga.louvain.mapreduce.CommunityCompression.Map
 
MAX_EPSILON - Static variable in class com.soteradefense.dga.pr.PageRankComputation
 

N

nextVertex() - Method in class com.soteradefense.dga.io.formats.LouvainVertexInputFormat.LouvainVertexReader
 

P

PageRankComputation - Class in com.soteradefense.dga.pr
 
PageRankComputation() - Constructor for class com.soteradefense.dga.pr.PageRankComputation
 
PageRankMasterCompute - Class in com.soteradefense.dga.pr
 
PageRankMasterCompute() - Constructor for class com.soteradefense.dga.pr.PageRankMasterCompute
 
parse(InputStream) - Static method in class com.soteradefense.dga.DGAXMLConfigurationParser
 
parseCommandLine(String[], Options) - Static method in class com.soteradefense.dga.DGACommandLineUtil
 
PartialDependency - Class in com.soteradefense.dga.hbse
Represents a source vertex's dependency on a specific target vertex.
PartialDependency() - Constructor for class com.soteradefense.dga.hbse.PartialDependency
Default Constructor for a PartialDependency.
PartialDependency(int, double) - Constructor for class com.soteradefense.dga.hbse.PartialDependency
Constructor that accepts successors and dependency for initialization.
PathData - Class in com.soteradefense.dga.hbse
Message that can be passed between vertices.
PathData() - Constructor for class com.soteradefense.dga.hbse.PathData
The Default Constructor for PathData: Sets Distance to the Max long value. Sets source to -1. Sets from to -1. Sets dependency to -1. Sets numPaths to -1.
PIVOT_AGG - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Sum for the total number of pivots selected.
PIVOT_BATCH_RANDOM_SEED - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the random seed value when choosing new pivot points.
PIVOT_BATCH_SIZE - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the pivot point batch size as a percent integer.
PIVOT_BATCH_SIZE_INITIAL - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the initial pivot point batch size as a percent integer.
PIVOT_PERCENT - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Identifier that stores the percentage of pivots to choose per batch.
preprocessLine(Text) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
printUsageAndExit(Options) - Static method in class com.soteradefense.dga.DGACommandLineUtil
 
printUsageAndExit(Options, int) - Static method in class com.soteradefense.dga.DGACommandLineUtil
 

R

RawEdge - Class in com.soteradefense.dga.io.formats
 
RawEdge(String, String) - Constructor for class com.soteradefense.dga.io.formats.RawEdge
 
readFields(DataInput) - Method in class com.soteradefense.dga.hbse.HighBetweennessList
Read fields
readFields(DataInput) - Method in class com.soteradefense.dga.hbse.PartialDependency
 
readFields(DataInput) - Method in class com.soteradefense.dga.hbse.PathData
 
readFields(DataInput) - Method in class com.soteradefense.dga.hbse.ShortestPathList
 
readFields(DataInput) - Method in class com.soteradefense.dga.hbse.VertexData
 
readFields(DataInput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
readFields(DataInput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
readFields(DataInput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
reduce(Text, Iterable<LouvainVertexWritable>, Reducer<Text, LouvainVertexWritable, Text, Text>.Context) - Method in class com.soteradefense.dga.louvain.mapreduce.CommunityCompression.Reduce
 
runUntilComplete(String, String, DGAConfiguration) - Method in class com.soteradefense.dga.LouvainRunner
 

S

setApproxBetweenness(double) - Method in class com.soteradefense.dga.hbse.VertexData
Sets the Approx.
setChanged(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setCommunity(String) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setCommunityId(String) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
setCommunitySigmaTotal(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
setCommunitySigmaTotal(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setCustomProperty(String, String) - Method in class com.soteradefense.dga.DGAConfiguration
 
setDependency(double) - Method in class com.soteradefense.dga.hbse.PartialDependency
Sets the dependency value.
setDependency(double) - Method in class com.soteradefense.dga.hbse.PathData
Sets the dependency value.
setDGALogLevel(Configuration) - Static method in class com.soteradefense.dga.DGALoggingUtil
 
setDGALogLevel(String) - Static method in class com.soteradefense.dga.DGALoggingUtil
 
setDistance(long) - Method in class com.soteradefense.dga.hbse.PathData
Sets the distance from a source to a predecessor.
setDistance(long) - Method in class com.soteradefense.dga.hbse.ShortestPathList
Sets the distance from a source to this vertex.
setEdges(Map<String, Long>) - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
setEdgeWeight(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
setFrom(String) - Method in class com.soteradefense.dga.hbse.PathData
Sets the value of from.
setFromLouvainVertexReader(boolean) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setGiraphProperty(String, String) - Method in class com.soteradefense.dga.DGAConfiguration
 
setInternalWeight(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setMaxSize(int) - Method in class com.soteradefense.dga.hbse.HighBetweennessList
Set the maxSize of this list
setNodeWeight(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
setNumPaths(long) - Method in class com.soteradefense.dga.hbse.PathData
Set the number of paths.
setPartialDepMap(Map<String, PartialDependency>) - Method in class com.soteradefense.dga.hbse.VertexData
Sets the Partial Dependency Map
setPathDataMap(Map<String, ShortestPathList>) - Method in class com.soteradefense.dga.hbse.VertexData
Sets the path data map.
setPredecessorPathCountMap(Map<String, Long>) - Method in class com.soteradefense.dga.hbse.ShortestPathList
Sets the Predecessor Path Count Map.
setSource(String) - Method in class com.soteradefense.dga.hbse.PathData
Sets the source value.
setSourceId(String) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
setSuccessors(int) - Method in class com.soteradefense.dga.hbse.PartialDependency
Sets the number of successors.
setSystemProperty(String, String) - Method in class com.soteradefense.dga.DGAConfiguration
 
setWasPivotPoint(boolean) - Method in class com.soteradefense.dga.hbse.VertexData
 
setWeight(long) - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
ShortestPathList - Class in com.soteradefense.dga.hbse
Keeps Shortest path data for a single source vertex to a single target vertex.
ShortestPathList() - Constructor for class com.soteradefense.dga.hbse.ShortestPathList
Create a new shortest empty Path List
ShortestPathList(PathData) - Constructor for class com.soteradefense.dga.hbse.ShortestPathList
Create a new shortest path list based on a shortest path message.
State - Enum in com.soteradefense.dga.hbse
Global States that direct certain computation.
STATE_AGG - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Identifier that gets the state of the computation.
STATS_CSV - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
The filename where the stats are written

T

toString() - Method in class com.soteradefense.dga.DGAConfiguration
 
toString() - Method in class com.soteradefense.dga.hbse.HighBetweennessList
Return a string representation of the list.
TOTAL_EDGE_WEIGHT_AGG - Static variable in class com.soteradefense.dga.louvain.giraph.LouvainComputation
 

U

update(PathData) - Method in class com.soteradefense.dga.hbse.ShortestPathList
Update This shortest path list based on a new shortest path message
UPDATE_COUNT_AGG - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Aggregator Identifier for the number of nodes changed in the highbetweenness list comparison.

V

validateEdgeValue(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGAAbstractEdgeInputFormat.DGAAbstractEdgeReader
 
validateEdgeValue(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGALongEdgeValueInputFormat.DGALongEdgeValueReader
 
validateEdgeValue(RawEdge) - Method in class com.soteradefense.dga.io.formats.DGATextEdgeValueInputFormat.DGATextEdgeValueReader
 
valueOf(String) - Static method in enum com.soteradefense.dga.hbse.State
Returns the enum constant of this type with the specified name.
values() - Static method in enum com.soteradefense.dga.hbse.State
Returns an array containing the constants of this enum type, in the order they are declared.
VERTEX_COUNT - Static variable in class com.soteradefense.dga.hbse.HBSEMasterCompute
Configuration Identifier for the number of vertices to perform the operation on.
VertexData - Class in com.soteradefense.dga.hbse
Stores all required data for a vertex Map of Sources to ShortestPathLists (for shortest path phase) Map of Sources to PartialDependency (for pair dependency phase) approximated betweenness value
VertexData() - Constructor for class com.soteradefense.dga.hbse.VertexData
 

W

WeaklyConnectedComponentComputation - Class in com.soteradefense.dga.wcc
WeaklyConnectedComponents is the concept of finding how many uniquely connected nodes there are in a specific data set.
WeaklyConnectedComponentComputation() - Constructor for class com.soteradefense.dga.wcc.WeaklyConnectedComponentComputation
 
write(DataOutput) - Method in class com.soteradefense.dga.hbse.HighBetweennessList
Write fields
write(DataOutput) - Method in class com.soteradefense.dga.hbse.PartialDependency
 
write(DataOutput) - Method in class com.soteradefense.dga.hbse.PathData
 
write(DataOutput) - Method in class com.soteradefense.dga.hbse.ShortestPathList
 
write(DataOutput) - Method in class com.soteradefense.dga.hbse.VertexData
 
write(DataOutput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainMessage
 
write(DataOutput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainNodeState
 
write(DataOutput) - Method in class com.soteradefense.dga.louvain.giraph.LouvainVertexWritable
 
WRITE_EDGE_VALUE - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
Configuration Identifier to use the source value when outputting.
WRITE_EDGE_VALUE_DEFAULT - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
The default value for the Use Source Value Configuration.
WRITE_VERTEX_VALUE - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
Configuration Identifier to use the source value when outputting.
WRITE_VERTEX_VALUE_DEFAULT - Static variable in class com.soteradefense.dga.io.formats.DGAAbstractEdgeOutputFormat
The default value for the Use Source Value Configuration.
writeVertex(Vertex<Text, VertexData, Text>) - Method in class com.soteradefense.dga.io.formats.HBSEOutputFormat.SBVertexWriter
Writes a Vertex
writeVertex(Vertex<Text, LouvainNodeState, LongWritable>) - Method in class com.soteradefense.dga.io.formats.LouvainVertexOutputFormat.LouvainVertexWriter
 
A B C D E F G H I L M N P R S T U V W