Git Product home page Git Product logo

awz / arvados Goto Github PK

View Code? Open in Web Editor NEW

This project forked from arvados/arvados

0.0 0.0 0.0 55.24 MB

An open source platform for managing and analyzing biomedical big data

Home Page: https://arvados.org

License: Other

Shell 3.87% JavaScript 4.45% Ruby 23.57% Python 18.55% C 0.01% Java 2.12% R 3.03% Go 35.88% CSS 0.12% Makefile 0.06% HTML 3.53% PLpgSQL 0.98% SaltStack 1.50% HCL 0.29% Dockerfile 0.32% SCSS 0.31% Common Workflow Language 1.39% Jinja 0.02%

arvados's Introduction

Join the chat at https://gitter.im/arvados/community | Installing Arvados | Installing Client SDKs | Report a bug | Development and Contributing

Arvados is an open source platform for managing, processing, and sharing genomic and other large scientific and biomedical data. With Arvados, bioinformaticians run and scale compute-intensive workflows, developers create biomedical applications, and IT administrators manage large compute and storage resources.

The key components of Arvados are:

  • Keep: Keep is the Arvados storage system for managing and storing large collections of files. Keep combines content addressing and a distributed storage architecture resulting in both high reliability and high throughput. Every file stored in Keep can be accurately verified every time it is retrieved. Keep supports the creation of collections as a flexible way to define data sets without having to re-organize or needlessly copy data. Keep works on a wide range of underlying filesystems and object stores.

  • Crunch: Crunch is the orchestration system for running Common Workflow Language workflows. It is designed to maintain data provenance and workflow reproducibility. Crunch automatically tracks data inputs and outputs through Keep and executes workflow processes in Docker containers. In a cloud environment, Crunch optimizes costs by scaling compute on demand.

  • Workbench: The Workbench web application allows users to interactively access Arvados functionality. It is especially helpful for querying and browsing data, visualizing provenance, and tracking the progress of workflows.

  • Command Line tools: The command line interface (CLI) provides convenient access to Arvados functionality in the Arvados platform from the command line.

  • API and SDKs: Arvados is designed to be integrated with existing infrastructure. All the services in Arvados are accessed through a RESTful API. SDKs are available for Python, Go, R, Perl, Ruby, and Java.

Quick start

To try out Arvados on your local workstation, you can use Arvbox, which provides Arvados components pre-installed in a Docker container (requires Docker 1.9+). After cloning the Arvados git repository:

$ cd arvados/tools/arvbox/bin
$ ./arvbox start localdemo

In this mode you will only be able to connect to Arvbox from the same host. To configure Arvbox to be accessible over a network and for other options see http://doc.arvados.org/install/arvbox.html for details.

Documentation

Complete documentation, including the User Guide, Installation documentation, Administrator documentation and API documentation is available at http://doc.arvados.org/

If you wish to build the Arvados documentation from a local git clone, see doc/README.textile for instructions.

Community

Join the chat at https://gitter.im/arvados/community

The Arvados community channel channel at gitter.im is available for live discussion and support.

The Arvados developement channel channel at gitter.im is used to coordinate development.

The Arvados user mailing list is used to announce new versions and other news.

All participants are expected to abide by the Arvados Code of Conduct.

Reporting bugs

Report a bug on dev.arvados.org.

Development and Contributing

See CONTRIBUTING for information about Arvados development and how to contribute to the Arvados project.

The development road map outlines some of the project priorities over the next twelve months.

Licensing

Arvados is Free Software. See COPYING for information about the open source licenses used in Arvados.

arvados's People

Contributors

tomclegg avatar ldipenti avatar cure avatar tetron avatar ericbiagiotti avatar fmuhic avatar gitaway avatar mzats avatar fmonserrat avatar jrandall avatar jonam33 avatar nicocesar avatar nouyang-curoverse avatar bcosc avatar qwrrty avatar zoe-translates avatar brettcs avatar dependabot[bot] avatar daftano avatar stephen304 avatar anetasta22 avatar mr-c avatar sguthrie avatar chapmanb avatar samshapiro avatar pjotrp avatar pvanheus avatar klmr avatar adambom avatar medcelerate avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.