Comments (10)
Canon88
commented on June 26, 2024
1
@Canon88 can you test against the latest version of
zeek-kafka? We just did av1.1.0-rc1prerelease
No problem, on the way!
from zeek-kafka.
Canon88
commented on June 26, 2024
1
I think I know what the problem is. This error is coming from my Kafka cluster. I use a Kafka cluster built by Docker. I tried to test it in a production environment and it worked fine.
It works fine in Zeek 4.2.2.
from zeek-kafka.
Canon88
commented on June 26, 2024
I see that the last updated support version is 4.0.5, is this because of the Zeek version?
from zeek-kafka.
ottobackwards
commented on June 26, 2024
I have tested up to zeek 4.2.2 against main. I think we need to do a release, else you can try to install main instead of 1.0.0 in the mean time
from zeek-kafka.
JonZeolla
commented on June 26, 2024
@Canon88 can you test against the latest version of zeek-kafka? We just did a v1.1.0-rc1 prerelease
from zeek-kafka.
Canon88
commented on June 26, 2024
@Canon88 can you test against the latest version of
zeek-kafka? We just did av1.1.0-rc1prerelease
Can't specify the version to install, am I wrong somewhere? Please correct me?
$ zkg install seisollc/zeek-kafka --version 1.1.0-rc1
error: invalid package "seisollc/zeek-kafka": no such commit, branch, or version tag: "1.1.0-rc1"
The installation of 1.1.0-rc1 worked, but when I use the command to check the version, it is version 0.3.0.
$ zkg install seisollc/zeek-kafka
The following packages will be INSTALLED:
zeek/seisollc/zeek-kafka (v1.1.0-rc1)
Verify the following REQUIRED external dependencies:
(Ensure their installation on all relevant systems before proceeding):
from zeek/seisollc/zeek-kafka (v1.1.0-rc1):
librdkafka ~1.4.2
Proceed? [Y/n]
"zeek/seisollc/zeek-kafka" requires a "LIBRDKAFKA_ROOT" value (Path to librdkafka installation tree root):
LIBRDKAFKA_ROOT: /usr/local
Saved answers to config file: /usr/local/zeek/etc/zkg/config
Running unit tests for "zeek/seisollc/zeek-kafka"
Installing "zeek/seisollc/zeek-kafka"......................
Installed "zeek/seisollc/zeek-kafka" (v1.1.0-rc1)
Loaded "zeek/seisollc/zeek-kafka"
$ zeek -N Seiso::Kafka
Seiso::Kafka - Writes logs to Kafka (dynamic, version 0.3.0)
from zeek-kafka.
Canon88
commented on June 26, 2024
Can't specify the version to install, am I wrong somewhere? Please correct me?
$ zkg install seisollc/zeek-kafka --version 1.1.0-rc1
error: invalid package "seisollc/zeek-kafka": no such commit, branch, or version tag: "1.1.0-rc1"
from zeek-kafka.
Canon88
commented on June 26, 2024
feedback
I set kafka.zeek, but it's not work. Kafka server address(192.168.199.98) is not valid, why connect 127.0.0.1:9092?
kafka.zeek
@load packages/zeek-kafka
redef Kafka::send_all_active_logs = T;
redef Kafka::tag_json = T;
#redef Kafka::logs_to_exclude = set(Conn::LOG);
redef Kafka::topic_name = "zeek";
redef Kafka::kafka_conf = table(
["metadata.broker.list"] = "192.168.199.98:9092"
);
error.log
%3|1656089601.790|FAIL|rdkafka#producer-4| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|ERROR|rdkafka#producer-4| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|FAIL|rdkafka#producer-2| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|ERROR|rdkafka#producer-2| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|FAIL|rdkafka#producer-5| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|ERROR|rdkafka#producer-5| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.790|FAIL|rdkafka#producer-1| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.791|ERROR|rdkafka#producer-1| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.792|FAIL|rdkafka#producer-3| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.792|ERROR|rdkafka#producer-3| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.793|FAIL|rdkafka#producer-6| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1656089601.793|ERROR|rdkafka#producer-6| [thrd:127.0.0.1:9092/1001]: 127.0.0.1:9092/1001: Connect to ipv4#127.0.0.1:9092 failed: Connection refused (after 0ms in state CONNECT)
from zeek-kafka.
ottobackwards
commented on June 26, 2024
you should not be changing kafka.zeek
you should be setting things in the local.zeek
from zeek-kafka.
Canon88
commented on June 26, 2024
you should not be changing kafka.zeek you should be setting things in the local.zeek
yes, this my config. but i don't know why not work.
$ more kafka.zeek
@load packages/zeek-kafka
redef Kafka::send_all_active_logs = T;
redef Kafka::tag_json = T;
#redef Kafka::logs_to_exclude = set(Conn::LOG);
redef Kafka::topic_name = "zeek";
redef Kafka::kafka_conf = table(
["metadata.broker.list"] = "192.168.199.98:9092"
);
$ more local.zeek
@load kafka
from zeek-kafka.
Related Issues (20)
- Support for zeek 4.2 HOT 1
- support for zeek 5.0
- Fix README instructions to not include sasl HOT 1
- Update MAINTAINERS.md release instructions
- Release automation doesn't wait for PR merge
- How to add Partition in local.zeek configuration HOT 2
- SEISO-KAFKA.linux-x86_64.so can not link librdkafka.so.1 HOT 13
- zeek log send to kafka with differnet topic per module HOT 1
- e2e should have a matrix for 5x zeek builds as well as 4.2
- [Requirements] zeek-kafka supports compression
- Update documentation to show log filtering configuration for Zeek 5.x
- Update copyright to fix linting errors
- Pipfile and lock do not work HOT 1
- I had installed zeek-kafka zeek-kafka-1.1.0,but I got (dynamic, version 0.3.0) when I show version HOT 3
- The build parameter for zeek-6.0.1 does not have --with-librdkafka, so how do I install the zeek-kafka plugin? HOT 4
- @load package/zeek-kafka can‘t find
- @load packages/zeek-kafka can't find HOT 5
- zeek-kafka installation causes zeek startup failure HOT 1
- Installation failure in all ways HOT 19
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zeek-kafka.