Git Product home page Git Product logo

doppler's Introduction

doppler

doppler是一款日志监控系统,能有效对基于dubbo的分布式服务做监控,统计,日志检索等;系统本身也是dubbo服务,所以能很容易和dubbo项目对接;
讨论QQ群:163240643 (不限于doppler,包括SOA设计、互联网技术等等兴趣交流)

#主要功能 doppler系统是在开源软件jd-hydra的基础上二次开发形成的日志监控系统,主要功能有,调用链跟踪,服务监控,异常监控,日志检索,业务打点日志记录及查询等;可以替代dubbo的监控;

#适合场景

  • 适合基于dubbo开发的分布式服务项目的监控;
  • 每天请求量不超过6000万的中小型项目;
  • 对日志需要检索的场景

#整体架构图 整体架构图

#日志收集步骤介绍

  • Hydra-client异步发送异常/日志到hydra-collector/hydra-manager
  • hydra-collector/hydra-manager异步发送异常/日志到mysql
  • Doppler-servermysql读取日志
  • doppler-web展示日志

#日志收集架构优点

  • 对应用层透明;对业务零侵入(利用dubbofilter)
  • 高可靠,即使日志系统挂了,也不影响业务系统
  • 实时数据统计,能对日志进行关键字检索(使用mysqlfulltext index
  • 本身是分布式架构,可线性扩展
  • 低消耗;100并发以下的服务调用情况下,性损率都在10%以内

#对项目的要求 dubbo项目的项目信息(container,日志,注册中心地址,项目名称,端口)必须配置在dubbo.properties中(这也是dubbo的标准配置);如果项目信息是配置在springxml文件中(这是dubbo的另外一种配置方式),系统将无法工作(日志系统无法获取zk地址等信息)

#性能 系统每天能支持的请求数在6千万左右,具体参见 docs/《多普勒(Dopper)3.0压测报告》

#效果图 具体参见 docs/《多普勒(Dopper)3.0效果图》

#如何使用doppler监控 参看部署文档 docs/《多普勒(Dopper)3.0部署使用文档》

#规划 后续会针对大数据量日志/请求做部分架构调整,使用ES+Hbase做大数据存储及海量数据检索

doppler's People

Contributors

fxltsbl3855 avatar

Watchers

James Cloos avatar Josean Luo avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.