Topic: distributed-computing Goto Github

👇 Here are 1676 public repositories matching this topic...

alpa-projects / alpa
distributed-computing,Training and serving large-scale neural networks with auto parallelization.
Organization: alpa-projects
Home Page: https://alpa.ai
deep-learning machine-learning compiler distributed-training high-performance-computing alpa jax distributed-computing llm auto-parallelization

ashwinrj / federated-learning-pytorch
distributed-computing,Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data
User: ashwinrj
deep-learning distributed-computing federated-learning python pytorch

asynkron / protoactor-dotnet
distributed-computing,Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
Organization: asynkron
Home Page: http://proto.actor
actors clustering proto-actor akka distributed-systems distributed-computing

asynkron / protoactor-go
distributed-computing,Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
Organization: asynkron
Home Page: http://proto.actor
grpc actor-model actors cross-platform protobuf akka clustering distributed-computing go distributed-systems

b4rtaz / distributed-llama
distributed-computing,Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
User: b4rtaz
distributed-computing llama2 llm llm-inference neural-network llms open-llm distributed-llm llama3

baguasys / bagua
distributed-computing,Bagua Speeds up PyTorch
Organization: baguasys
Home Page: https://tutorials-8ro.pages.dev/
distributed pytorch rust-lang deep-learning distributed-systems distributed-computing machine-learning bagua

boinc / boinc
distributed-computing,Open-source software for volunteer computing and grid computing.
Organization: boinc
Home Page: https://boinc.berkeley.edu
boinc distributed-computing volunteer-computing high-performance-computing citizen-science scientific-computing grid-computing science high-throughput-computing php

catalyst-team / catalyst
distributed-computing,Accelerated deep learning R&D
Organization: catalyst-team
Home Page: https://catalyst-team.com
deep-learning reinforcement-learning machine-learning computer-vision pytorch python distributed-computing infrastructure research reproducibility

chrislusf / gleam
distributed-computing,Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
User: chrislusf
distributed-computing distributed-systems golang map-reduce

couler-proj / couler
distributed-computing,Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
Organization: couler-proj
Home Page: https://couler-proj.github.io/couler/index.html
apache-airflow argo-workflows cloud-native distributed-computing kubeflow kubernetes machine-learning python scheduler tekton-pipelines unified-api unified-interface workflow-automation workflow-engine workflow-management

dask / distributed
distributed-computing,A distributed task scheduler for Dask
Organization: dask
Home Page: https://distributed.dask.org
pydata dask distributed-computing python hacktoberfest

dotnetcore / smartsql
distributed-computing,SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics
Organization: dotnetcore
Home Page: https://smartsql.net/
orm dotnet-core cross-platform high-performance distributed-computing redis zookeeper read-write-separation cache sql

eclipse-zenoh / zenoh
distributed-computing,zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.
Organization: eclipse-zenoh
Home Page: https://zenoh.io
networking protocol messaging storage edge-computing iot robotics embedded ros2 zenoh rust distributed-computing distributed-storage distributed-systems geo-distributed-storages network-programming rust-lang

eventual-inc / daft
distributed-computing,Distributed DataFrame for Python designed for the cloud, powered by Rust
Organization: eventual-inc
Home Page: https://getdaft.io
machine-learning python data-engineering data-science dataframe distributed-computing rust big-data

fugue-project / fugue
distributed-computing,A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
Organization: fugue-project
Home Page: https://fugue-tutorials.readthedocs.io/
spark dask data-practitioners machine-learning distributed-systems distributed-computing distributed sql pandas

fyoorer / shadowclone
distributed-computing,Unleash the power of cloud
User: fyoorer
distributed-computing cloud lambda-functions recon bugbounty aws serverless

gojek / awesome-distributed-systems
distributed-computing,Awesome list of distributed systems resources
Organization: gojek
awesome awesome-list computer-engineering computer-science distributed distributed-computing distributed-database distributed-storage distributed-systems

google / vizier
distributed-computing,Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
Organization: google
Home Page: https://oss-vizier.readthedocs.io
vizier hyperparameter-optimization tuning tuning-parameters blackbox-optimization hyperparameter-tuning bayesian-optimization evolutionary-algorithms distributed-systems distributed-computing grpc open-source google algorithm deep-learning machine-learning optimization

haidra-org / ai-horde
distributed-computing,A crowdsourced distributed cluster for AI art and text generation
Organization: haidra-org
ai distributed-computing flask-api gpt opt stable-diffusion volunteer-computing

hazelcast / hazelcast
distributed-computing,Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Organization: hazelcast
Home Page: https://www.hazelcast.com
java hazelcast in-memory big-data scalability distributed caching hacktoberfest stream-processing low-latency

hdi-project / atm
distributed-computing,Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).
Organization: hdi-project
Home Page: https://hdi-project.github.io/ATM/
automl data-science distributed-computing hyperparameter-optimization machine-learning

heidihoward / distributed-consensus-reading-list
distributed-computing,A list of papers about distributed consensus.
User: heidihoward
Home Page: https://heidihoward.github.io/distributed-consensus-reading-list/
distributed-systems paxos atomic-broadcast-protocol zookeeper fault-tolerance distributed-computing consensus-algorithms quorum-systems state-machine-replication consistency replication

henrikbengtsson / future
distributed-computing,:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone
User: henrikbengtsson
Home Page: https://future.futureverse.org
r cran parallel-processing parallel-computing distributed-computing hpc-clusters hpc promises futures asynchronous programming parallelization

holochain / holochain
distributed-computing,The current, performant & industrial strength version of Holochain on Rust.
Organization: holochain
Home Page: https://holochain.org
holochain holochain-rust p2p blockchain dapps-development distributed-computing dapps rust web3

hpcaitech / colossalai
distributed-computing,Making large AI models cheaper, faster and more accessible
Organization: hpcaitech
Home Page: https://www.colossalai.org
deep-learning hpc large-scale data-parallelism pipeline-parallelism model-parallelism ai big-model distributed-computing inference

innovation-cat / awesome-federated-machine-learning
distributed-computing,Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond
User: innovation-cat
federated-learning machine-learning deep-learning privacy-preserving-machine-learning computer-vision distributed-computing edge-computing security differential-privacy

jostmey / nakedtensor
distributed-computing,Bare bone examples of machine learning in TensorFlow
User: jostmey
tensorflow tensorflow-tutorials distributed-computing simple big-data linear-regression tensorflow-examples tensorflow-exercises

lablup / backend.ai
distributed-computing,Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, TPU, IPU and other NPUs.
Organization: lablup
Home Page: https://www.backend.ai
python docker distributed-computing api documentation cloud-computing backendai containers hpc monitoring

lensacom / sparkit-learn
distributed-computing,PySpark + Scikit-learn = Sparkit-learn
Organization: lensacom
scikit-learn apache-spark machine-learning distributed-computing python

lichess-org / fishnet
distributed-computing,Distributed Stockfish analysis for lichess.org
Organization: lichess-org
Home Page: https://lichess.org/get-fishnet
lichess chess stockfish distributed-computing volunteer-computing

lizardfs / lizardfs
distributed-computing,LizardFS is an Open Source Distributed File System licensed under GPLv3.
Organization: lizardfs
Home Page: http://lizardfs.com
c-plus-plus distributed-computing distributed-systems erasure-coding fault-tolerance geo-replication gplv3 hierarchical-storage high-availability high-performance hsm linux lizardfs macosx nas posix qos replicas replication software-defined-storage

mahmoudparsian / data-algorithms-book
distributed-computing, MapReduce, Spark, Java, and Scala for Data Algorithms Book
User: mahmoudparsian
Home Page: http://mapreduce4hackers.com
hadoop-mapreduce java distributed-computing scala mapreduce data-algorithms python machine-learning pyspark distributed-algorithms

maxpumperla / elephas
distributed-computing,Distributed Deep learning with Keras & Spark
User: maxpumperla
Home Page: http://maxpumperla.com/elephas/
spark keras neural-networks deep-learning distributed-computing

microsoft / graphengine
distributed-computing,Microsoft Graph Engine
Organization: microsoft
Home Page: http://www.graphengine.io/
graph-engine graph-query-language in-memory-storage in-memory-computations distributed-computing dotnet

moosefs / moosefs
distributed-computing,MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Organization: moosefs
Home Page: https://moosefs.com
software-defined-storage posix filesystem file-system distributed-file-system clustering distributed-storage distributed-computing fuse big-data

pnxtech / hydra
distributed-computing,A light-weight library for building distributed applications such as microservices
Organization: pnxtech
Home Page: https://www.hydramicroservice.com
microservices distributed-computing hydra redis services backend

pytorch / rl
distributed-computing,A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
Organization: pytorch
Home Page: https://pytorch.org/rl
ai control decision-making distributed-computing machine-learning marl model-based-reinforcement-learning multi-agent-reinforcement-learning pytorch reinforcement-learning

s8sg / goflow
distributed-computing,A Golang based high performance, scalable and distributed workflow framework
User: s8sg
workflow-engine workload-automation framework golang workflow distributed-computing

securefederatedai / openfl
distributed-computing,An open framework for Federated Learning.
Organization: securefederatedai
Home Page: https://openfl.readthedocs.io/en/latest/index.html
federated-learning secure-computation openfl distributed-computing deep-learning collaborative-learning privacy-preserving-machine-learning machine-learning fedprox fedavg federated-analytics python federated-learning-framework federated-deep-learning pytorch-federated-learning tensorflow-federated-learning keras-federated-learning distributed-learning fedcurv fedopt

substantic / rain
distributed-computing,Framework for large distributed pipelines
Organization: substantic
Home Page: https://substantic.github.io/rain/docs/
pipelines distributed-computing python-api rust workflows

taskflow / awesome-parallel-computing
distributed-computing,A curated list of awesome parallel computing resources
Organization: taskflow
parallel-computing parallel-programming distributed-computing heterogeneous-parallel-programming heterogeneous-computing distributed-systems

thrill / thrill
distributed-computing,Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++
Organization: thrill
Home Page: http://project-thrill.org
thrill big-data c-plus-plus distributed-computing

tidwall / finn
distributed-computing,Fast Raft framework using the Redis protocol for Go
User: tidwall
raft redis golang distributed-computing

transient-haskell / transient
distributed-computing,A full stack, reactive architecture for general purpose programming. Algebraic and monadically composable primitives for concurrency, parallelism, event handling, transactions, multithreading, Web, and distributed computing with complete de-inversion of control (No callbacks, no blocking, pure state)
Organization: transient-haskell
backtracking composability composition concurrency distributed-computing events haskell threading transaction web

tsingz0 / pfllib
distributed-computing,We expose this user-friendly algorithm library (with an integrated evaluation platform) for beginners who intend to start federated learning (FL) study
User: tsingz0
non-iid federated-learning personalization pytorch python distributed-computing heterogeneity differential-privacy privacy imagenet

ty4z2008 / qix
distributed-computing,Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang
User: ty4z2008
Home Page: http://ty4z2008.github.io/Qix
awesome deep-learning distributed-computing distributed-database distributed-systems go machine-learning postgresql

uber / fiber
distributed-computing,Distributed Computing for AI Made Simple
Organization: uber
Home Page: https://uber.github.io/fiber/
python distributed-computing multiprocessing sandbox machine-learning

wwzzz / easyfl
distributed-computing,An experimental platform for federated learning.
User: wwzzz
pytorch federated-learning distributed-computing deep-learning fairness machine-learning

wx-chevalier / distributedsystem-notes
distributed-computing,:books: 深入浅出分布式基础架构，Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇
User: wx-chevalier
Home Page: https://ng-tech.icu/books/DistributedSystem-Series
operatingsystem distributed-computing distributed-systems maintainance storage virtualization network

yotpoltd / metorikku
distributed-computing,A simplified, lightweight ETL Framework based on Apache Spark
Organization: yotpoltd
Home Page: https://yotpoltd.github.io/metorikku/
big-data spark scala etl-framework distributed-computing sql etl etl-pipeline