quickmsg / smqtt Goto Github PK
View Code? Open in Web Editor NEW开源 MQTT 服务器(基于reactor-netty实现高性能的、可扩展、支持千万级设备接入集群）支持 mqtt 3.1.1、mqtt 5等协议
Home Page: https://www.smqtt.cc
License: Apache License 2.0
smqtt's People
Contributors
Stargazers
Watchers
Forkers
andy521 tiankong0310 gaojunjun2016 jieke360 czd326 wangenlu jianzhikj milcos-dj sxh-netizen dlsyaim keanet coomia weigl348 quiter2013 cdz1129 goldencolor lizejiao yunshitiger zhanglei youbooks veekchu laceymovingon xgx-style 1ssqq1lxr maple-hzy grx253 gaojunhello fanhuafeng zhaord jileiadmin dongrongsong makmap sanwanliu caojian258 antonechiger initial517 aboluo-gy johnzheng-1991 wujiaai ossworker beckoned zhangjun1998 jackyc1976 yunluo123 zhuifengjiann leafseelight shineer heibaifu newlysoft linuxsky zydcherry noahsarkzhang-ts chenruoyu0319 misselvexu panxuedian rikun zhuzhengdl walksnake lstarby mingw12 jiwenfei jackfromcn wadreamer kerasking pangyannan klutz-he supermecasino bears852 feimenggo technoboy- pascalming luckydtf smallminggg bradydreamer bggmjxh dxmcu liuchun2000 llxy317 wangscript007 hrony shamoshuisheng endlessc liangruuu floodboad liononon liujw881995 leixiangjian xrq1995 yjaal qinqoushui m3125069 xucw anbo225 shifa2008 wakafff jayzhou1314 phial3 fuqingfeng ysma1987 buqiansmqtt's Issues
cluster集群创建问题
cluster集群属性配置：
cluster: # 集群配置
enable: ${CLUSTER_ENABLE:true} # 集群开关
url: ${CLUSTER_URL:192.168.26.123:7771,192.168.26.124:7771,192.168.25.100:7771} # 启动节点
port: ${CLUSTER_PORT:7771} # 端口 7772
node: ${CLUSTER_NODE:node-1} # 集群节点名称 唯一，123：node-2，124：node-3
namespace: ${CLUSTER_NAMESPACE:topband} # 集群空间,需要一致才能通信
集群以docker方式启动（--net host）,192.168.25.100为本机节点IP，DEBUG日志可以看到与123、124建立了连接：
DEBUG r.n.resources.NewConnectionProvider - [id:43e77142, L:/192.168.25.100:55297 - R:/192.168.26.123:7771] Connected new channel
DEBUG r.n.resources.NewConnectionProvider - [id:43e77142, L:/192.168.25.100:55297 - R:/192.168.26.123:7771] onStateChange([connected], SimpleConnection{channel=[id: 0x43e77142, L:/192.168.25.100:55297 - R:/192.168.26.123:7771]})
DEBUG r.n.resources.NewConnectionProvider - [id:43e77142, L:/192.168.25.100:55297 - R:/192.168.26.123:7771] onStateChange([configured], ChannelOperations{SimpleConnection{channel=[id: 0x43e77142, L:/192.168.25.100:55297 - R:/192.168.26.123:7771]}})
DEBUG r.n.resources.NewConnectionProvider - [id:46eb97b2, L:/192.168.25.100:55298 - R:/192.168.26.124:7771] Connected new channel
DEBUG r.n.resources.NewConnectionProvider - [id:46eb97b2, L:/192.168.25.100:55298 - R:/192.168.26.124:7771] onStateChange([connected], SimpleConnection{channel=[id: 0x46eb97b2, L:/192.168.25.100:55298 - R:/192.168.26.124:7771]})
DEBUG r.n.resources.NewConnectionProvider - [id:46eb97b2, L:/192.168.25.100:55298 - R:/192.168.26.124:7771] onStateChange([configured], ChannelOperations{SimpleConnection{channel=[id: 0x46eb97b2, L:/192.168.25.100:55298 - R:/192.168.26.124:7771]}})
本地机器ScubeClusterRegistry类的spreadMessage()方法向集群传播消息时，打印cluster.otherMembers()：
INFO i.g.q.registry.ScubeClusterRegistry - cluster: [topband:[email protected]:7771]
而124机器上打印cluster.otherMembers()：[]，为空
请问这是怎么回事？
拦截器问题
1.ConnectionCounterInterceptor类根据CONNECT拦截，但ChannelRegistry.counts()执行通常发生在registry()之前，所以得到的count不是最新的。
2.尝试通过CONNACK拦截进行计数，发现CONNACK拦截不成功
遇到空指针异常
12:13:48.153 [business-io-1262] ERROR i.g.q.core.protocol.PublishProtocol - error
java.lang.NullPointerException: null
at java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1693)
at io.github.quickmsg.core.spi.DefaultMessageRegistry.saveSessionMessage(DefaultMessageRegistry.java:32)
at io.github.quickmsg.core.protocol.PublishProtocol.filterOfflineSession(PublishProtocol.java:128)
at io.github.quickmsg.core.protocol.PublishProtocol.lambda$send$0(PublishProtocol.java:102)
at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:178)
at java.base/java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1707)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
at io.github.quickmsg.core.protocol.PublishProtocol.send(PublishProtocol.java:109)
at io.github.quickmsg.core.protocol.PublishProtocol.parseProtocol(PublishProtocol.java:68)
at io.github.quickmsg.common.protocol.Protocol.lambda$doParseProtocol$0(Protocol.java:27)
at reactor.core.publisher.MonoDeferContextual.subscribe(MonoDeferContextual.java:47)
at reactor.core.publisher.Mono.subscribe(Mono.java:4338)
at reactor.core.publisher.MonoSubscribeOn$SubscribeOnSubscriber.run(MonoSubscribeOn.java:126)
at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:84)
at reactor.core.scheduler.WorkerTask.call(WorkerTask.java:37)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
maven打包ui模块失败
当我进行maven打包的时候 出现了以下错误
maven版本3.5.2 idea版本2020.2
您好，我想问一下数据持久化保存数据的问题
我注意到关联了数据库后（我用的是mysql），发送的消息如果带retain，那么是可以保存到数据库的。我想问一下如果是不带retain的消息，目前的框架内有办法能将数据保存到数据库中么？或者保存到内存通过外部接口获取到这个数据么？
多谢。
支持双向SSL
支持双向SSL么？
Qos为2，连接数为10，每个链接发送3000条消息就会收不到消息
生产环境下，发现运行一段时间后，就有消息无法收到的现象，经排查和脚本测试，在Qos=2的情况下，broker收到3w条消息后，就没办法将PUBREC消息发送出去，从日志上看，应该是没有收到PUBREC消息，其他的MQTT-Broker 正常。
mqtt over websocket的8999的端口如何连接？
大佬您好，1883mqtt的可以连接发送消息，mqtt over websocket 的有什么客户端可以测试么？网上找的mqtt over websocket连接界面，可以连接其他人的mqtt over websocket，连接123.57.69.210:8999的会失败，请问知道是哪块配置错了吗？或者这块有什么注意事项或者推荐吗
smqtt收到的iot数据如何添加个性化处理
smqtt收到的iot数据在保存到内存/DB前如果想进行一些自定义的业务处理应该怎么弄？比如把iot数据做一些过滤，比如iot数据放在rocketmq或者kafka
OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 3724541959, max: 3739746304)
MQTT客户端按照每秒100条发送数据到服务端，正常接收一个多小时后服务端报错。
Dependency io.netty:netty-common leading to CVE problem
Hi, In /smqtt-core，there is a dependency io.netty:netty-common:4.1.66.Final that calls the risk method.
The scope of this CVE affected version is [4.0.0.Final,4.1.77.Final)
After further analysis, in this project, the main Api called is io.netty.util.internal.PlatformDependent: createTempFile(java.lang.String,java.lang.String,java.io.File)Ljava.io.File;
Risk method repair link : GitHub
CVE Bug Invocation Path--
Path Length : 8
CVE Bug Invocation Path :
io.github.quickmsg.core.ssl.AbstractSslHandler: secure(reactor.netty.tcp.SslProvider$SslContextSpec,io.github.quickmsg.common.config.Configuration)V /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.SelfSignedCertificate: init()V /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.SelfSignedCertificate: init(java.util.Date,java.util.Date,java.lang.String,int)V /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.SelfSignedCertificate: init(java.lang.String,java.util.Date,java.util.Date,java.lang.String,int)V /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.SelfSignedCertificate: init(java.lang.String,java.security.SecureRandom,int,java.util.Date,java.util.Date,java.lang.String)V /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.BouncyCastleSelfSignedCertGenerator: generate(java.lang.String,java.security.KeyPair,java.security.SecureRandom,java.util.Date,java.util.Date,java.lang.String)[Ljava.lang.String; /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.handler.ssl.util.SelfSignedCertificate: newSelfSignedCertificate(java.lang.String,java.security.PrivateKey,java.security.cert.X509Certificate)[Ljava.lang.String; /download/apache-maven-3.6.3/repository_mount/org/casbin/jdbc-adapter/2.1.3/jdbc-adapter-2.1.3.jar
io.netty.util.internal.PlatformDependent: createTempFile(java.lang.String,java.lang.String,java.io.File)Ljava.io.File;
Dependency tree--
[INFO] io.github.quickmsg:smqtt-core:jar:1.1.7
[INFO] +- io.github.quickmsg:smqtt-common:jar:1.1.7:compile
[INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.12.4:compile
[INFO] | | \- org.yaml:snakeyaml:jar:1.27:compile
[INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-properties:jar:2.12.4:compile
[INFO] | +- io.projectreactor.netty:reactor-netty:jar:1.0.10:compile
[INFO] | | +- io.projectreactor.netty:reactor-netty-core:jar:1.0.10:compile
[INFO] | | | +- io.netty:netty-handler:jar:4.1.66.Final:compile
[INFO] | | | +- io.netty:netty-handler-proxy:jar:4.1.66.Final:compile
[INFO] | | | | \- io.netty:netty-codec-socks:jar:4.1.66.Final:compile
[INFO] | | | +- io.netty:netty-resolver-dns:jar:4.1.66.Final:compile
[INFO] | | | | \- io.netty:netty-codec-dns:jar:4.1.66.Final:compile
[INFO] | | | +- io.netty:netty-resolver-dns-native-macos:jar:osx-x86_64:4.1.66.Final:compile
[INFO] | | | | \- io.netty:netty-transport-native-unix-common:jar:4.1.66.Final:compile
[INFO] | | | +- io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.66.Final:compile
[INFO] | | | \- io.projectreactor:reactor-core:jar:3.4.9:compile
[INFO] | | | \- org.reactivestreams:reactive-streams:jar:1.0.3:compile
[INFO] | | +- io.projectreactor.netty:reactor-netty-http:jar:1.0.10:compile
[INFO] | | | +- io.netty:netty-codec-http:jar:4.1.66.Final:compile
[INFO] | | | \- io.netty:netty-codec-http2:jar:4.1.66.Final:compile
[INFO] | | \- io.projectreactor.netty:reactor-netty-http-brave:jar:1.0.10:runtime
[INFO] | | \- io.zipkin.brave:brave-instrumentation-http:jar:5.13.3:runtime
[INFO] | | \- io.zipkin.brave:brave:jar:5.13.3:runtime
[INFO] | | \- io.zipkin.reporter2:zipkin-reporter-brave:jar:2.16.3:runtime
[INFO] | | \- io.zipkin.reporter2:zipkin-reporter:jar:2.16.3:runtime
[INFO] | | \- io.zipkin.zipkin2:zipkin:jar:2.23.2:runtime
[INFO] | +- io.netty:netty-codec-mqtt:jar:4.1.66.Final:compile
[INFO] | | +- io.netty:netty-common:jar:4.1.66.Final:compile
[INFO] | | +- io.netty:netty-buffer:jar:4.1.66.Final:compile
[INFO] | | +- io.netty:netty-transport:jar:4.1.66.Final:compile
[INFO] | | | \- io.netty:netty-resolver:jar:4.1.66.Final:compile
[INFO] | | \- io.netty:netty-codec:jar:4.1.66.Final:compile
[INFO] | +- org.projectlombok:lombok:jar:1.18.20:compile
[INFO] | +- org.slf4j:slf4j-api:jar:1.7.30:compile
[INFO] | +- ch.qos.logback:logback-core:jar:1.1.11:compile
[INFO] | +- ch.qos.logback:logback-classic:jar:1.1.11:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-core:jar:2.12.4:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-databind:jar:2.11.0:compile
[INFO] | | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.11.0:compile
[INFO] | +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.11.0:compile
[INFO] | +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:jar:2.11.0:compile
[INFO] | +- io.micrometer:micrometer-core:jar:1.8.0:compile
[INFO] | | +- org.hdrhistogram:HdrHistogram:jar:2.1.12:compile
[INFO] | | \- org.latencyutils:LatencyUtils:jar:2.0.3:runtime
[INFO] | +- com.github.oshi:oshi-core:jar:5.3.6:compile
[INFO] | | +- net.java.dev.jna:jna:jar:5.6.0:compile
[INFO] | | \- net.java.dev.jna:jna-platform:jar:5.6.0:compile
[INFO] | +- io.micrometer:micrometer-registry-prometheus:jar:1.8.0:compile
[INFO] | | \- io.prometheus:simpleclient_common:jar:0.12.0:compile
[INFO] | | \- io.prometheus:simpleclient:jar:0.12.0:compile
[INFO] | | +- io.prometheus:simpleclient_tracer_otel:jar:0.12.0:compile
[INFO] | | | \- io.prometheus:simpleclient_tracer_common:jar:0.12.0:compile
[INFO] | | \- io.prometheus:simpleclient_tracer_otel_agent:jar:0.12.0:compile
[INFO] | +- io.micrometer:micrometer-registry-influx:jar:1.8.0:compile
[INFO] | +- org.casbin:jcasbin:jar:1.22.1:compile
[INFO] | | +- com.googlecode.aviator:aviator:jar:5.3.0-beta2:compile
[INFO] | | +- com.github.seancfoley:ipaddress:jar:4.2.0:compile
[INFO] | | +- commons-io:commons-io:jar:2.7:compile
[INFO] | | +- org.apache.commons:commons-csv:jar:1.8:compile
[INFO] | | \- com.google.code.gson:gson:jar:2.8.9:compile
[INFO] | \- org.casbin:jdbc-adapter:jar:2.1.3:compile
[INFO] | +- com.oracle.database.jdbc:ojdbc6:jar:11.2.0.4:compile
[INFO] | | +- com.oracle.database.jdbc:ucp:jar:11.2.0.4:compile
[INFO] | | +- com.oracle.database.security:oraclepki:jar:11.2.0.4:compile
[INFO] | | +- com.oracle.database.security:osdt_cert:jar:11.2.0.4:compile
[INFO] | | +- com.oracle.database.security:osdt_core:jar:11.2.0.4:compile
[INFO] | | +- com.oracle.database.ha:simplefan:jar:11.2.0.4:compile
[INFO] | | \- com.oracle.database.ha:ons:jar:11.2.0.4:compile
[INFO] | +- org.postgresql:postgresql:jar:42.2.12:compile
[INFO] | +- com.microsoft.sqlserver:mssql-jdbc:jar:8.2.2.jre8:compile
[INFO] | \- dev.failsafe:failsafe:jar:3.0.0:compile
[INFO] +- io.github.quickmsg:smqtt-rule-dsl:jar:1.1.7:compile
[INFO] | \- io.github.quickmsg:smqtt-rule-engine:jar:1.1.7:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-kafka:jar:1.1.7:compile
[INFO] | | \- org.apache.kafka:kafka-clients:jar:2.8.0:compile
[INFO] | | +- com.github.luben:zstd-jni:jar:1.4.9-1:compile
[INFO] | | +- org.lz4:lz4-java:jar:1.7.1:compile
[INFO] | | \- org.xerial.snappy:snappy-java:jar:1.1.8.1:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-http:jar:1.1.7:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-rocketmq:jar:1.1.7:compile
[INFO] | | \- org.apache.rocketmq:rocketmq-client:jar:4.9.1:compile
[INFO] | | +- org.apache.rocketmq:rocketmq-common:jar:4.9.1:compile
[INFO] | | | +- org.apache.rocketmq:rocketmq-remoting:jar:4.9.1:compile
[INFO] | | | | +- com.alibaba:fastjson:jar:1.2.76:compile
[INFO] | | | | \- org.apache.rocketmq:rocketmq-logging:jar:4.9.1:compile
[INFO] | | | \- commons-validator:commons-validator:jar:1.7:compile
[INFO] | | | +- commons-beanutils:commons-beanutils:jar:1.9.4:compile
[INFO] | | | +- commons-digester:commons-digester:jar:2.1:compile
[INFO] | | | \- commons-collections:commons-collections:jar:3.2.2:compile
[INFO] | | +- org.apache.commons:commons-lang3:jar:3.4:compile
[INFO] | | \- commons-codec:commons-codec:jar:1.9:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-rabbitmq:jar:1.1.7:compile
[INFO] | | \- com.rabbitmq:amqp-client:jar:3.6.5:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-db:jar:1.1.7:compile
[INFO] | | +- org.jooq:jooq:jar:3.14.11:compile
[INFO] | | | \- javax.xml.bind:jaxb-api:jar:2.3.1:compile
[INFO] | | | \- javax.activation:javax.activation-api:jar:1.2.0:compile
[INFO] | | +- org.jooq:jooq-meta:jar:3.14.11:compile
[INFO] | | +- org.jooq:jooq-codegen:jar:3.14.11:compile
[INFO] | | +- com.zaxxer:HikariCP:jar:4.0.3:compile
[INFO] | | \- mysql:mysql-connector-java:jar:5.1.35:compile
[INFO] | +- io.github.quickmsg:smqtt-rule-source-mqtt:jar:1.1.7:compile
[INFO] | | \- com.hivemq:hivemq-mqtt-client:jar:1.2.2:compile
[INFO] | | +- io.reactivex.rxjava2:rxjava:jar:2.2.19:compile
[INFO] | | +- org.jctools:jctools-core:jar:2.1.2:runtime
[INFO] | | +- org.jetbrains:annotations:jar:16.0.3:runtime
[INFO] | | \- com.google.dagger:dagger:jar:2.27:runtime
[INFO] | | \- javax.inject:javax.inject:jar:1:runtime
[INFO] | \- org.apache.commons:commons-jexl3:jar:3.2.1:compile
[INFO] | \- commons-logging:commons-logging:jar:1.2:compile
[INFO] +- io.github.quickmsg:smqtt-metric-influxdb:jar:1.1.7:compile
[INFO] \- io.github.quickmsg:smqtt-metric-prometheus:jar:1.1.7:compile
Suggested solutions:
Update dependency version
Thank you very much.
您好，想问一下docker启动怎么进管理界面啊，我没太搞懂
如题，万分感谢
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.