wyonghui Goto Github PK

rdmachannel

RDMA Channel: A Channel-Oriented RDMA Java Communication Framework. More high-level abstract Channel API on top of RDMA verbs.

readfile

测试并行tranferTo的性能

rgraph

RGraph is an RDMA-assisted asynchronous distributed graph processing system. RGraph distributes edges into two parts to isolate master and mirror vertices. RGraph exploits the asymmetry of RDMA to accelerate the one-to-many communication between master and mirror vertices.

server

PanDownload的个人维护版本

shadowsocksr

Python port of ShadowsocksR

spark

Mirror of Apache Spark

sparkbenchmark

spark性能测试

sparkrdma

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

sparktest

research Spark

spring-framework

Spring Framework

springboot-guide

SpringBoot2.0+从入门到实战！

storm

Mirror of Apache Storm

telescope

Telescope is a novel job scheduling scheme in RDMA-assisted big data processing system.

telescope-1

testnio

测试transferTo性能

tmp

temporary data

tpcds-for-spark

tpch-for-spark

evaluate spark with tpch

whale

Whale, a novel mechanism for efficient serialization and transferring stream data between processes for one-to-many communication in DSPSs. Whale serializes messages before they are encapsulated into tuples in order to reduce serialize computation and transfers only once to each process to greatly improve the communication efficiency.

whale-1

Whale, a novel mechanism for efficient serialization and transferring stream data between processes for one-to-many communication in DSPSs. Whale adapts the instance-oriented communication mechanism in popular DSPSs and implements an efficient worker-oriented communication mechanism for one-to-many partitioning. Whale elaborates a novel RDMA-assisted stream multicast model to alleviate the CPU workloads of an upstream instance; We implement Whale on top of Apache Storm. Experiment results show that Whale significantly improves the performance of the existing design in terms of system throughput and process latency.