Comments (1)
CSi-CJ
commented on August 26, 2024
@PettitWesley Can you give me some advice to help me solve this problem?
I tried the small sample configuration to test fluent-bit and OpenSearch communication, but still got the same error.
[SERVICE]
Flush 1
Daemon Off
Log_Level debug
[INPUT]
name tail
path /fluent-bit/test.log
[OUTPUT]
name stdout
match *
[OUTPUT]
Name es
Match *
Host ${OPENSEARCH_HOST}
Port 443
Logstash_Format On
Logstash_Prefix test
tls.verify Off
Index test-index
Type _doc
tls On
AWS_Auth On
AWS_Region ${AWS_REGION}
error log:
[2024/05/24 05:34:58] [debug] [upstream] KA connection #49 to aos-xxxxxxxxxx-qut34njbolfjttfezukhresuwu.us-west-2.es.amazonaws.com:443 is now available
[2024/05/24 05:34:58] [debug] [out flush] cb_destroy coro_id=32
[2024/05/24 05:34:58] [debug] [retry] new retry created for task_id=0 attempts=1
[2024/05/24 05:34:58] [ warn] [engine] failed to flush chunk '697-1716528898.139281660.flb', retry in 11 seconds: task_id=0, input=tail.0 > output=opensearch.1 (out_id=1)
[2024/05/24 05:35:08] [debug] [input:tail:tail.0] inode=9444188, /fluent-bit/test.log, events: IN_MODIFY
[2024/05/24 05:35:08] [debug] [input chunk] update output instances with new chunk size diff=58, records=1, input=tail.0
[2024/05/24 05:35:08] [debug] [task] created task=0x7fc61fda0ca0 id=1 OK
[2024/05/24 05:35:08] [debug] [output:stdout:stdout.0] task_id=1 assigned to thread #0
[0] tail.0: [1716528908.140517765, {"log"=>"{"name": "hello", "test": "hello world"}"}]
[2024/05/24 05:35:08] [debug] [upstream] KA connection #48 to aos-xxxxxxxxxx-qut34njbolfjttfezukhresuwu.us-west-2.es.amazonaws.com:443 has been assigned (recycled)
[2024/05/24 05:35:08] [debug] [http_client] not using http_proxy for header
[2024/05/24 05:35:08] [debug] [output:opensearch:opensearch.1] Signing request with AWS Sigv4
[2024/05/24 05:35:08] [debug] [out flush] cb_destroy coro_id=17
[2024/05/24 05:35:08] [debug] [aws_credentials] Requesting credentials from the env provider..
[2024/05/24 05:35:08] [debug] [output:opensearch:opensearch.1] HTTP Status=400 URI=/_bulk
[2024/05/24 05:35:08] [error] [output:opensearch:opensearch.1] HTTP status=400 URI=/_bulk, response:
<html><body><h1>400 Bad request</h1>
Your browser sent an invalid request.
</body></html>
from aws-for-fluent-bit.
Related Issues (20)
- Logging to multiple destination works only when Log_Level is set to debug
- Set Log Rotation Dinamically
- AWS_CONTAINER_CREDENTIALS_FULL_URI environment variable is not respected when set HOT 3
- Fluentbit not parsing my json logs as needed and sending to Opensearch
- consistent error: caught signal (SIGSEGV) HOT 1
- readOnlyFilesystem not supported by init image HOT 1
- Non-English character got UNICODE-escaped when getting logs from EKS to Cloudwatch logs
- CVE-2024-4323 (tracing http monitoring api) does NOT impact aws-for-fluent-bit HOT 5
- ECS fluentbit crashes with SIGSEGV when using HTTP output
- aws-for-fluent-bit image migration to AL2023 HOT 3
- [upstream] connection #-1 to vpc-es-abn-opensearch-xxxxxxxxx.es.amazonaws.com:443 timed out after 10 seconds
- Occasional bad log routing and malformed messages get to s3 output
- fluent-bit init uses `cloudwatch` plugin not specified in the config
- caught signal (SIGSEGV)
- Cannot open s3 fluentbit config file when using init container
- ECS Fargate fluent-bit side-car container exit with code 139
- EFS Persistent Volume Errors
- Upgrade Golang version to 1.22.4 or higher
- Fluentbit pod in CrashLoopBackOff state after failing Liveness probe
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aws-for-fluent-bit.