JanusGraph 使用

JanusGraph 使用
展开查看详情

1.Community-Driven Graphs with JanusGraph Jing Chen He • jinghe@us.ibm.com • Apache HBase PMC • JanusGraph TSC Jason Plurad • pluradj@us.ibm.com • Apache TinkerPop PMC • JanusGraph TSC HBaseCon West 2017 • June 12, 2017

2.Agenda Property Graphs Graph Community Introduction to JanusGraph JanusGraph with HBase 2 #HBaseCon

3.Graph  Born for relationship!  Intuitive modeling  Expressive querying  Native analysis https://tinkerpop.apache.org/docs/3.2.4/reference/#intro 3 #HBaseCon

4.Graph Data Use Cases  Social network analysis  Configuration management database  Master data management  Recommendation engines  Knowledge graphs  Internet of things  Cybersecurity attack analysis 4 #HBaseCon

5.Apache TinkerPop  Open source, vendor-agnostic, graph computing framework  Gremlin graph traversal language Apache TinkerPop™ Maintainer Apache Software Foundation License Apache Latest Release 3.2.4 February 2017 https://tinkerpop.apache.org 5 #HBaseCon

6.Gremlin Graph Traversal Language https://tinkerpop.apache.org/gremlin.html 6 #HBaseCon

7.TinkerPop Stack https://tinkerpop.apache.org/docs/3.2.4/reference/#_graph_system_integration 7 #HBaseCon

8.Graph Landscape https://tinkerpop.apache.org/gremlin.html#oltp-and-olap-traversals 8 #HBaseCon

9. Scalable graph database distributed on multi-machine clusters with pluggable storage and indexing  Fully-compliant with Apache TinkerPop graph computing framework JanusGraph™  Vendor-neutral, open community with Maintainer Linux open governance Foundation – Founding members: Expero, Google, GRAKN.AI, Hortonworks, IBM License Apache – Latest members: Amazon, Netflix, Orchestral Latest 0.1.0 Developments, Uber Release April 2017 https://janusgraph.org 9 #HBaseCon

10. Architecture Google Cloud Bigtable 10 #HBaseCon http://docs.janusgraph.org/latest/arch-overview.html

11. Storage Model http://docs.janusgraph.org/latest/data-model.html#_janusgraph_data_layout 11 #HBaseCon

12. Storage Model http://docs.janusgraph.org/latest/data-model.html#_individual_edge_layout 12 #HBaseCon

13. with HBase  HBase – Perfect Storage Backend for JanusGraph  Big enough for your biggest graph!  The storage model  Read and write speed  Scalability and partitioning  Strong consistency  Tight integration with Hadoop Ecosystem  Great open community! http://docs.janusgraph.org/latest/hbase.html 13 #HBaseCon

14. with HBase  HBase – Perfect Storage Backend for JanusGraph  Simple configuration!  conf/janusgraph-hbase-solr.properties  storage.backend=hbase  storage.hostname=zookeeper-host1,zookeeper-host2,zookeeper-host3  storage.hbase.table=janusgraph  storage.hbase.ext.zookeeper.znode.parent=/hbase Optional  storage.hbase.ext.hbase.zookeeper.property.clientPort=2181 Optional  Just open your graph!  graph=JanusGraphFactory.open('conf/janusgraph-hbase-solr.properties') 14 #HBaseCon

15. with HBase  HBase – Perfect Storage Backend for JanusGraph  Throw in an Index Backend for better performance  conf/janusgraph-hbase-solr.properties  index.search.backend=solr  index.search.solr.mode=cloud  index.search.solr.zookeeper-url=zookeeper-host1:2181/solr,zookeeper- host2:2181/solr,zookeeper-host3:2181/solr  index.search.solr.configset=janusgraph 15 #HBaseCon

16. with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details  Stores to Column Families  Edge store  e  Index store  g  ID store  i  Transaction log store  l  System property store  s  CF attributes can be set. E.g. compression, TTL. 16 #HBaseCon

17. with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details g.V().has("name", "Alice").out("knows").out("knows").values("name") Query Plan to Backend Store and Index Edge Store Index Index Store provider 17 #HBaseCon

18. with HBase  HBase – Perfect Storage Backend for JanusGraph  Look into more details  A store (column family) is always specified.  Get or Multi Get  Batch to mutate Edge Store  Key range scan  ColumnRangeFilter Index Store  ColumnPaginationFilter  HBase tuning 18 #HBaseCon

19. with Google Cloud Bigtable  Bigtable implements the HBase 1.0 client API  Need the latest version of the bigtable-hbase-1.0 artifact.  storage.backend=hbase  storage.hbase.ext.hbase.client.connection.impl= com.google.cloud.bigtable.hbase1_0.BigtableConnection  storage.hbase.ext.google.bigtable.project.id= <Google Cloud Platform project id>  storage.hbase.ext.google.bigtable.instance.id=<Bigtable instance id> 19 #HBaseCon

20.Thank you!

为了让众多HBase相关从业人员及爱好者有一个自由交流HBase相关技术的社区,阿里巴巴、小米、华为、网易、京东、滴滴、知乎等公司的HBase技术研究人员共同发起了组建中国HBase技术社区。