This is an monitor system and monitor your kafka clusters, and visual consumer thread,offsets,owners etc.
When you install Kafka Eagle, you can see the current consumer group,for each group the topics that they are consuming and the offsets, lag, logsize position of the group in each topic. This is useful to understand how fast you are consuming from a message queue and how quick the message queue is increase. This will help you debuging kafka producers and consumers or just to have an idea of what is going on in your system.
The system shows the trend of consumer and producer trends on the same day, so you can see what happened that day.
Here are a few Kafka Eagle system screenshots:
Kafka is designed to be flexible on how the offsets are managed. Consumer can choose arbitrary storage and format to persist kafka offsets. Kafka Eagle currently support following popular storage format:
- Zookeeper. Old version of Kafka (0.8.2 before) default storage in Zookeeper.
- Kafka. New version of Kafka (0.10.0 in the future) default recommend storage in Kafka Topic(__consumer_offsets).
Each runtime instance of Kafka Eagle can only support a single type of storage format.
Use the SQL statement to query the topic message log, and visualize the results, you can read Kafka SQL to view the syntax.
Please read Kafka Eagle Install for setting up and running Kafka Eagle. It is worth noting that, please use chrome
to access Kafka Eagle.
The project is a maven project that uses the Maven command to pack the deployment as follows:
mvn clean && mvn package
Please see the Kafka Eagle Manual for for more information including:
- System environment settings and installation instructions.
- Information about how to use script command.
- Visual group,topic,offset metadata information etc.
- Metadata collection and log change information.
The Kafka Eagle is released under the Apache License and we welcome any contributions within this license. Any pull request is welcome and will be reviewed and merged as quickly as possible.
Since this is an open source tool, please comply with the relevant laws and regulations, the use of civilization.
Thanks to the following members for maintaining the project.
Alias | Github | |
---|---|---|
smartloli | smartloli | [email protected] |
hexiang | hexian55 | [email protected] |
======= |
spring boot 实践学习案例,是 spring boot 初学者及核心技术巩固的最佳实践。
spring cloud 实践学习案例
https://github.com/JeffLi1993/springcloud-learning-example
Spring For All 社区是新组建的关于 Spring 的纯技术交流社区(涵盖 Spring Boot、Spring Cloud 等内容),集诸多开源爱好者和技术大牛贡献内容和交流问题。我们不夸大、不装逼、做最纯粹的技术分享!!!
看看我们超强的群众基础,欢迎有兴趣的朋友加入QQ群分享与交流:
Spring For All 社区 ① 365234583(满)
Spring For All 社区 ② 123013854(满)
Spring For All 社区 ③ 290714704(满)
Spring For All 社区 ④ 112133511(满)
Spring For All 社区 ⑤ 157525002(满)
Spring For All 社区 ⑥ 564840207
Spring For All 社区 ⑦ 470962790(满)
Spring For All 社区 ⑧ 613456104(满)
Spring For All 社区 ⑨ 534583667
Spring For All 社区 ⑩ 210742970 (满)
Spring For All 社区 ⑪ 517395240
Spring For All 社区 ⑫ 498098401
博主微信:139-5868-6678
源码地址:我的GitHub地址、OSCGit地址
作者:泥瓦匠BYSocket
关注微信公众号【泥瓦匠BYSokcet】,及时得到技术文章推送
「Spring Boot 那些事」:传送门
- springboot-helloworld
《Spring Boot 之 HelloWorld 详解》 - springboot-properties
《Spring Boot 之配置文件详解》
- springboot-restful
《Springboot 实现 Restful 服务,基于 HTTP / JSON 传输》
《Spring Boot 之 RESRful API 权限控制》 - springboot-freemarker
《Spring Boot 集成 FreeMarker 详解案例》 - springboot-validation-over-json
《Spring Boot HTTP over JSON 的错误码异常处理》
- springboot-mybatis
《Springboot 整合 Mybatis 的完整 Web 案例》 - springboot-mybatis-annotation
《Spring Boot 整合 Mybatis Annotation 注解的完整 Web 案例》 - springboot-mybatis-mutil-datasource
《Spring Boot 整合 Mybatis 实现 Druid 多数据源详解》
- springboot-mybatis-redis
《Spring Boot 整合 Redis 实现缓存操作》 - springboot-mybatis-redis-annotation
《Spring Boot 注解实现整合 Redis 作为缓存》
- springboot-elasticsearch
《Spring Boot 整合 Elasticsearch,实现 function score query 权重分查询》 - springboot-dubbo-server
- springboot-dubbo-client
Dubbo 服务提供者工程和 Dubbo 服务消费者工程
《Springboot 整合 Dubbo/ZooKeeper 详解 SOA 案例》
《Spring Boot 中如何使用 Dubbo Activate 扩展点》
- spring-data-elasticsearch-crud
《Spring Data Elasticsearch - 基本案例》 - spring-data-elasticsearch-query
spring-data-elasticsearch - 实战案例详解
在 MySQL 中,创建数据库 springbootdb:
CREATE DATABASE springbootdb;
创建表 city 城市 (因为我喜欢徒步)
DROP TABLE IF EXISTS `city`;
CREATE TABLE `city` (
`id` int(10) unsigned NOT NULL AUTO_INCREMENT COMMENT '城市编号',
`province_id` int(10) unsigned NOT NULL COMMENT '省份编号',
`city_name` varchar(25) DEFAULT NULL COMMENT '城市名称',
`description` varchar(25) DEFAULT NULL COMMENT '描述',
PRIMARY KEY (`id`)
) ENGINE=InnoDB AUTO_INCREMENT=1 DEFAULT CHARSET=utf8;
插入基础数据
INSERT city VALUES (1 ,1,'温岭市','BYSocket 的家在温岭。');
首先 check 基本环境配置完成,创建好数据库和表。
配置文件地址:springboot-mybatis/src/main/resources/application.properties 修改相应的数据源配置,比如账号、密码等
在项目根目录 springboot-learning-example
,运行 maven 指令:
mvn clean install
右键运行工程包中 org.spring.springboot.Application
Spring Boot 应用启动类的 main 函数,然后在浏览器访问:
http://localhost:8080/api/city?cityName=温岭市
可以看到返回的 JSON 结果:
{
"id": 1,
"provinceId": 1,
"cityName": "温岭市",
"description": "我的家在温岭。"
}
最后,
推荐
《Spring Boot教程与Spring Cloud教程》
branch 'master' of https://github.com/greenstar2017/springboot.git