Home/ Questions/Q 7768695
In Process

The Archive Base Latest Questions

Editorial Team
  • 0
Asked: 2026-06-01T15:58:48+00:00

Sorry if this question seems a bit complex but I think its all related

  • 0

Sorry if this question seems a bit complex but I think its all related so I wanted try to get the answer in one shot. Basically I have a layered graph*, that has various sets of data that are connected to only the next set of data(so set1 has vertexes that have edges to set2, and so on but set1 has nothing connecting to set3 or anything other than set2. It might be relevant not sure). Generally, you can think of my data as one massive family tree(every set I add about a billion nodes) that I keep loading new generations with every new set(families create new families and no edges go backwards).

I have an Hbase/hadoop system running and I know how to use java to add columns and values, but what I don’t know how to do is:

  1. add data to hbase in a graph type format(since its hbase, I want to load it in a way that I can add a ton of data and it’ll scale..unlike other databases that limit graphs to the size of the system). I know how to add data but don’t understand how to do it in a scalable graph way.
  2. Once the graph is loaded I want to know how to apply some kind of analytics to it. Pagerank is popular so I thought I would say it, but pretty much anything that is based on processing a graph.

I guess the simplified way of asking the question is how to do I specifically get a graph into hbase and once its there how do I analyze it? Is there a tutorial? There’s a lot of hbase information on the internet(I read the hbase book) but I could not find anything specific to graphs. I found, giraph, but I don’t think it can connect to hbase(yet). Seeing how hadoop/hbase are versions of mapreduce/bigtables I suspect there is a way to process graphs I’m just not having luck finding anything.

*A layered graph is a directed graph with a level for different set of vertex’s, like so: http://en.wikipedia.org/wiki/Layered_graph_drawing

Share

Leave an answer

You must login to add an answer.

Need An Account,

1 Answer

  1. Editorial Team

    I think this question on SO could help:

    https://stackoverflow.com/questions/9865738/is-it-possible-to-store-graphs-hbase-if-so-how-do-you-model-the-database-to-sup/9867563#9867563

    This part of my answer to this question might be of use.

    Using HBase/Accumulo as input to giraph has been submitted recently (7
    Mar 2012) as a new feature request to Giraph: HBase/Accumulo Input
    and Output formats     (GIRAPH-153)

    • 0