Git Product home page Git Product logo

plex's Introduction

PLEX ๐Ÿงซร—๐Ÿงฌโ†’๐Ÿ’Š

โšก Build highly reproducible container workflows on top of a decentralised compute network. โšก

total download follow on Twitter

PLEX is a simple client for distributed computation.

  • ๐ŸŒŽ Build once, run anywhere at any scale: PLEX is using distributed compute and storage to run containers on a public network. Need GPUs? We got you covered.
  • ๐Ÿ”— Strictly composable: Every tool in PLEX has declared inputs and outputs. Plugging together tools by other authors should be easy.
  • ๐Ÿ” Content-addressed by default: Every file processed by PLEX has a deterministic address based on its content. Keep track of your files and always share the right results with other scientists.

PLEX is based on Bacalhau, IPFS, and inspired by Pydantic and the Common Workflow Language.

๐Ÿš€ PLEX in one minute

Install the client and adjust permissions.

source <(curl -sSL https://raw.githubusercontent.com/labdao/plex/main/install.sh)
chmod +x ./plex

Claim an access token and submit an example.

./plex -tool tools/equibind.json -input-dir ./testdata/binding/abl

Getting Started

๐Ÿ’ก Use-Cases

  • ๐Ÿงฌ run PLEX to design proteins with colabfold and RFDiffusion
  • ๐Ÿ’Š run PLEX to run small molecule docking with equibind and diffdock
  • ๐Ÿ‹ configure your containerised tool to run on PLEX

๐Ÿง‘โ€๐Ÿ’ป Developer Guide

Building PLEX from source

git clone https://github.com/labdao/plex
cd plex
go build

Running a compute node

This is a script for setting up a compute instance to run LabDAO jobs. Requires linux OS with Nvidia GPU.

Tested on Ubuntu 20.04 LTS with Nvidia T4, V100, and A10 GPUs (AWS G4, P3, and G5 instance types)

The install script sets up Docker, Nvidia Drivers, Nvidia Container Toolkit, and IPFS

curl -sL https://raw.githubusercontent.com/labdao/plex/main/scripts/provide-compute.sh | bash && newgrp docker

After the script run the following command in a separate terminal to start a Bacalhau server to accept jobs.

ipfs daemon

Once the daemon is running, configure the Bacalhau node based on the addresses used by the IFPS node.

ipfs id

# copy the ip4 tcp output and change port 4001 to 5001 then export
export IPFS_CONNECT=/ip4/127.0.0.1/tcp/5001/p2p/<your id goes here>

# example: export IPFS_CONNECT=/ip4/127.0.0.1/tcp/5001/p2p/12D3KooWPH1BpPfNXwkf778GMP2H5z7pwjKVQFnA5NS3DngU7pxG

LOG_LEVEL=debug bacalhau serve --job-selection-accept-networked --limit-total-gpu 1 --limit-total-memory 12gb --ipfs-connect $IPFS_CONNECT

To download large bacalhau results the below command may need ran

sudo sysctl -w net.core.rmem_max=2500000

๐Ÿ’ Contributing

PRs are welcome! Please consider our Contribute Guidelines when joining.

From time to time, we also post help-wanted bounty issues - please consider our Bounty Policy when engaging with LabDAO.

plex's People

Contributors

niklastr avatar thetechnocrat-dev avatar acashmoney avatar winternewt avatar developerfred avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.