Git Product home page Git Product logo

cmp's Introduction

cmp

cloud foundary operation system .based on a big data structure .
工程总体目标为搭建一个分布式的运维系统。搭建过程分为如下几个阶段:

1.搭建一套单机的日志采集环境,该环境中包含的功能模块有:日志生产模块(先自己写一个模拟桩),日志采集模块(flume),消息中间件(kafka),实时日志处理模块(延时1s内,storm),日志存储模块(hbase和elastic),低延时日志处理模块(spark)
2.写程序从hbase和elastic里面读取相应的日志
3.完成分布式环境的安装
4.将各个组件转移到docker上面去
5.完成跟踪任务下发的功能
~

cmp's People

Contributors

wuqingfeng234 avatar

Watchers

 avatar

cmp's Issues

学习目标

1.掌握相应系统和功能模块的设计能力
2.结合相应模块的梳理和设计过程,将操作系统和算法基础知识梳理一遍。加深对对应公共基础能力的理解和掌握。
3.利用现有资源,最大化的增强编码能力。
4.加深对大数据相关开源组件的理解,提高其应用能力。包括单组件配置的知识和和利用其组建系统的能力。

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.