Git Product home page Git Product logo
  • I’m the author of ICNP'18 & SC'21 & ICDE'23 CCF-A computer conference paper author.
    • INCP'18: Ares: A High Performance and Fault-Tolerant Distributed Stream Processing System.
    • SC'21: Whale: efficient one-to-many data partitioning in RDMA-assisted distributed stream processing systems.
    • ICDE'23: Cougar: A General Framework for Jobs Optimization In Cloud.
  • I'm experienced at:
    • distributed frameworks: Flink/Spark/Alluxio/Ray/Hadoop/HDFS.
    • computing patterns: streaming/batch computing and cloud native computing.
    • computing format: Arrow/Parquent/ORC.
  • Currrently I'm focusing on bigdata, streaming processing system.
  • 📫 How to reach me:

Master.TJ's Projects

activemqaction icon activemqaction

ActiveMQ是由Apache出品的,一款最流行的,能力强劲的开源消息总线。它是一个消息中间件,本项目是一个ActiveMQ的学习项目。包括ActiveMQ的API的使用以及生产者消费者模型 ActiveMQ的负载均衡 Publish-Subscribe消息订阅发布模型 点对点通信模型

algorithm icon algorithm

算法分析:提升算法能力(动态规划、递归等)

ares icon ares

Ares, a high performance and fault tolerant DSPS. Ares considers both system performance and fault tolerant capability during task allocation. In the design of Ares, we formalize the problem of Fault Tolerant Scheduler (FTS) for finding an optimal task allocation which maximizes the system utility. We treat the FTS problem as a game and propose Nirvana, an algorithm based on best-response dynamics scheduling strategy.

auth icon auth

这是从慕课网中学习的Java权限管理系统

bigdataanalysisweb icon bigdataanalysisweb

Big data performance test analysis platform (including WebUI display)。 BigDataAnalysisWeb Analyze storm, spark, and flink throughput changes in the form of charts.

blog icon blog

GitHub Master.TJ 我的个人博客主页

busstation icon busstation

公交线路GIS系统,包括公交换乘算法(最短路径算法)

countminsketch icon countminsketch

基于计数最小堆的 预测HotKey的Sketch项目 CountMinSketchAnalyzer用来预测热词统计词频

dockeraction icon dockeraction

DockerAction Docker使用包括DockerFile的使用 以及Docker容器和镜像的创建

dstream icon dstream

DStream is a popularity-aware differentiated distributed stream processing system, which identifies the popularity of keys in the stream data and uses a differentiated partitioning scheme. DStream greatly outperforms Storm on skew distributed data in terms of throughput and processing latency.

dubboaction icon dubboaction

Dubbo是一个分布式服务框架,致力于提供高性能和透明化的RPC远程服务框架,以及SOA的服务治理方案。简单的说duboo就是一个服务框架。本项目是一个Dubbo的学习Action项目,包括Dubbo构建一个服务治理、负载均衡、集群容错等特性

dubboxaction icon dubboxaction

Dubbox是一个Dubbo的扩展实现。它在Dbubbo中实现了REST风格的远程调用。并且采用Kryo高效序列化机制,为Dubbo默认的RPC协议提供了新的序列化实现,并且整体优化了序列化机制。本项目是对Dubbox的学习使用项目,包括Dubbox的REST服务接口的使用和嵌入式的基于容器的体系。包括Kyro序列化机制....

elasticsearchaction icon elasticsearchaction

ElasticSearchAction 学习项目.ElasticSearch是一个基于Lucene的搜索服务器。它提供了一个分布式多用户能力的全文搜索引擎,基于RESTful web接口。其中包括对elasticSearchAction javaAPI的基本操作以及查询操作, 以及包括Smartcn中文分词器的操作

fengruotjblog icon fengruotjblog

GitHub Master.TJ 我的个人博客主页 源码(Source Code)

flinktest icon flinktest

Flink BenchMark 针对strom 吞吐量和延迟 做的BenchMark集群测试

gpsanalysis icon gpsanalysis

这是大学最后一个实习项目,认真对待。感觉结果还满意

hadoopaction icon hadoopaction

hadoop 深入学习 HDFS-API以及MapReduce相关操作,同步Bolg更新

hadooptest icon hadooptest

Hadoop学习项目 包括HDFSOperitionUtil工具包

hbaseaction icon hbaseaction

HBaseAction 学习工程(Mavne) 内置HbaseUtil类

hdfsanalysis icon hdfsanalysis

针对HDFS分布式文件系统读写性能进行性能测试以及性能测试WebUI(测试HDFS读写文件聚合吞吐率性能)

hdfscachepool icon hdfscachepool

Hadoop Distributed File System (HDFS) has slow serial read speed of the log stream file, it cannot meet the requirements of the stream processing system and can not fully exert the processing capability of the stream processing system, thus restricting the stream processing system. Improve performance. On the basis of HDFS, this software adopts parallel data transmission methods to fully utilize network bandwidth and effectively improve the throughput of distributed file system and meet the demand of stream processing system for data source throughput. At the same time, with respect to the highly ordered nature of the log stream, the software controls the timing of the data to ensure the timing of the log file and provides high-speed and orderly data input for the stream processing system.

hiveaction icon hiveaction

Hive Action 学习工程(Mavne) 内置HiveUtil类

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.