Git Product home page Git Product logo

liunaijie / incubator-hugegraph-computer Goto Github PK

View Code? Open in Web Editor NEW

This project forked from apache/incubator-hugegraph-computer

0.0 0.0 0.0 10.84 MB

HugeGraph Computer - A distributed graph processing system for hugegraph (OLAP)

Home Page: https://hugegraph.apache.org/docs/quickstart/hugegraph-computer/

License: Apache License 2.0

Shell 0.98% Java 96.25% Groovy 1.32% Go 0.92% Makefile 0.35% Dockerfile 0.18%

incubator-hugegraph-computer's Introduction

Apache HugeGraph-Computer

License Build Status codecov Docker Pulls

The hugegraph-computer is a distributed graph processing system for hugegraph. It is an implementation of Pregel. It runs on Kubernetes or YARN framework.

Features

  • Support distributed MPP graph computing, and integrates with HugeGraph as graph input/output storage.
  • Based on BSP(Bulk Synchronous Parallel) model, an algorithm performs computing through multiple parallel iterations, every iteration is a superstep.
  • Auto memory management. The framework will never be OOM(Out of Memory) since it will split some data to disk if it doesn't have enough memory to hold all the data.
  • The part of edges or the messages of super node can be in memory, so you will never lose it.
  • You can load the data from HDFS or HugeGraph, output the results to HDFS or HugeGraph, or adapt any other systems manually as needed.
  • Easy to develop a new algorithm. You just need to focus on a vertex only processing just like as in a single server, without worrying about message transfer and memory/storage management.

Learn More

The project homepage contains more information about hugegraph-computer.

And here are links of other repositories:

  1. hugegraph-server (graph's core component - OLTP server)
  2. hugegraph-toolchain (include loader/dashboard/tool/client)
  3. hugegraph-commons (include common & rpc module)
  4. hugegraph-website (include doc & website code)

Note

  • If some classes under computer-k8s cannot be found, you need to execute mvn clean install in advance to generate corresponding classes.

Contributing

Welcome to contribute, please see How to Contribute for more information

Note: It's recommended to use GitHub Desktop to greatly simplify the PR and commit process.

License

hugegraph-computer is licensed under Apache 2.0 License.

Contact Us


  • GitHub Issues: Feedback on usage issues and functional requirements (quick response)
  • Feedback Email: [email protected] (subscriber only)
  • WeChat public account: Apache HugeGraph, welcome to scan this QR code to follow us.

QR png

incubator-hugegraph-computer's People

Contributors

coderzc avatar houzhizhen avatar linary avatar corgiboygsj avatar javeme avatar imbajin avatar radeity avatar seagle-yuan avatar zyxxoo avatar z7658329 avatar simon824 avatar diaohancai avatar msgui avatar jackyyangpassion avatar conghuhu avatar zhoney avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.