fluent / fluentd-docs-gitbook Goto Github PK

Fluentd documentation project in Gitbook format

JavaScript 100.00%

fluentd-docs-gitbook's Introduction

Introduction

Fluentd is an open-source data collector for a unified logging layer. Fluentd allows you to unify data collection and consumption for better use and understanding of data.

Fluentd is licensed under the terms of the Apache License v2.0. This project is made and sponsored by Treasure Data.

fluentd-docs-gitbook's People

Contributors

Stargazers

Watchers

Forkers

fujimotos dalavancloud torfun jordo1138 kevinkirkup nc-ruth i burningalchemist saisameerb ganmacs staniklukasz athom summerwind tk3fftk g-harmon shou10152208 elecay schnitzel candlerb happymedium harshshekhar15 nokute78 tvarsis jshen28 jadencodes sriramana cosmo0920 kiddpt crazycoder4carrot roamergu prabhumarappan nanaones rj0222 lucasbasquerotto ashie guowenjin yusong-shen tiamat-azure danielzepp itmecho jihyunsong nvtkaszpir xuliang482 miwakooe mehonoshin joestrouth1 alexheylin eliasnorrby hbceylan jpreynat eredi93 trantor clacsinarx-m montac wreulicke ezra-at-lumedic kir4h adnanrahic seungrokoh marojor funkfunk igorpeshansky dobesv kenhys like-inspur dvcanton anorlondo448 leewalter shubhamkjha gtseres ppshein pure-zero omerlh harryge00 agup006 chrsmark hatsu38 abicky mfalhi konmoron ehershey jazzdan homebysix daipom toru-takahashi digikin isabella232 mickeey2525 ychen-sps ekmixon jamiees2 chandrasekharpatra ktarow sibucan wind0r pranjal-gupta2 mishina2228 hisa-tanaka ffuentes vincent-senseon

fluentd-docs-gitbook's Issues

Maximum size of output file

I have been searching for a while now, but unable to find this information:

If I use out_file plugin in match section, what is the maximum file size that it can grow to (not the buffer, but the actual persistent output file), and what happens if it hits the limit?

Fluentd rereading the whole log files

I need to read a log file and separate its content based on a date it has(date is a PART of a field in a log line). I managed to separate the log files based on date. But the problem is that log lines are written to the same file causing log duplication. When I set append parameter to true, and add a new log line, It keeps adding logs to the same file. If I set it to false, multiple files will be created _0,_1 which aren't needed. I used pos_file parameter but it keeps reading from the beginning.
I made the read_from_head parameter to false but it still read from head of the file "WHEN I SAVE a new log line to the file".
Here is the configuration I used.

<source>
  @type tail
  format multiline
  format_firstline /TID:/
  format1 /(?<TenantID>TID: \[-1\].*)$/
  multiline_flush_interval 1s
  path /home/charith/Documents/fdConfig/wso2testlog.log
  pos_file /home/charith/Documents/fdConfig/fluentd_test1.pos
  tag test
  rotate_wait 5
  read_from_head false
  refresh_interval 60
</source>

<filter test>
  @type record_modifier
  #enable_ruby true
  #auto_typecast true
  <record>
    datefield ${record['TenantID'].scan(/(^(?!(TID: \\[-1\\]\\[\\] \[)))*(?<date>([0-9]{4})-([0-9]{1,2})-([0-9]{1,2}))/)}
  </record>
</filter>
<match test>
  @type file
  path /home/charith/Documents/fdConfig/TestEnv/${datefield}
  format single_value
  message_key TenantID
  <buffer datefield>
    @type memory
    flush_mode immediate
    ##flush_interval 3s
  </buffer>
  append true
</match>

Following are the example log line I used.
TID: [-1] [] [2019-07-14 20:68:38,334] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected {org.wso2.carbon.databridge.core.DataBridge}
TID: [-1] [] [2019-07-15 20:70:38,334] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected {org.wso2.carbon.databridge.core.DataBridge}
TID: [-1] [] [2019-07-15 20:71:38,334] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected {org.wso2.carbon.databridge.core.DataBridge}
TID: [-1] [] [2019-07-15 20:72:38,334] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected {org.wso2.carbon.databridge.core.DataBridge}
TID: [-1] [] [2019-07-15 20:73:38,334] INFO {org.wso2.carbon.databridge.core.DataBridge} - user admin connected {org.wso2.carbon.databridge.core.DataBridge}

Broken link in documentation

This section of documentation:

https://docs.fluentd.org/output#difference-between-v-1-0-and-v-0-12

Refers to the "Compat Parameters Plugin Helper API", which links to this missing page:

https://github.com/fluent/fluentd-docs-gitbook/tree/8c505a3608b9b2032813b00c9b5750f4ca29ddcd/plugin-helper-overview/api-plugin-helper-compat_parameters.md

It probably wants to link to this page:

https://docs.fluentd.org/plugin-helper-overview/api-plugin-helper-compat_parameters

"Docker Logging" contains incorrect commands

The guide on docker logging needs to be updated, because many commands don't give the expected output. Problems I've found so far:

The in_docker.conf contents of Step 1 don't match the contents shown in the logs of Step 2.
Using the contents of Step 1 with the docker run command in Step 3 will give an error like

2020-04-06 18:47:33 +0200 [warn]: #0 no patterns matched tag="docker.{.ID}}"
2020-04-06 18:47:33.481204978 +0200 fluent.warn: {"tag":"docker.{.ID}}","message":"no patterns matched tag=\"docker.{.ID}}\""}

The docker run command in Step 3 doesn't match the command shown in the image for Step 3.
The docker run command should have a --rm flag to avoid polluting the container list with testing entries.
When running the "Additional Step 1", the JSON key-value pair is not appended to the log line JSON object, but the output looks the same as if the JSON filter doesn't exist.

I've given up at that stage, because I'm new to Fluentd. The quality of the source code is very nice though :)

Copy Container Deployment section in v0.12.0 document to v1.0 document

ref: #75

There isn't Container Deployment in v1.0 doc. but 0.12.0 document has it https://docs.fluentd.org/v/0.12/container-deployment

On "Free Alternative To Splunk", the Fluentd Architecture link is broken

page: https://docs.fluentd.org/how-to-guides/free-alternative-to-splunk-by-fluentd
At the bottom in the Learn More Section, the link to "fluentd architecture" points to https://github.com/fluent/fluentd-docs-gitbook/tree/159b4cb7cc0f9e0d33d3a3abbc13754c2c8ee64d/www.fluentd.org/architecture/README.md which is not found.

Maybe it means to point to https://www.fluentd.org/architecture ?

Fluentd homepage broken!

I was browsing the Fluentd documentation when, a few minutes back, something happened that broke the website.

Specifically:

As of now, the Fluentd homepage has lost all the sections to the left -- only 'Introduction' is available.
All URLs making use of those missing sections (eg. https://docs.fluentd.org/input/monitor_agent) either do not work (gives a 'Page Not Found' error) or only briefly go to the correct page before immediately redirecting to the homepage.

I have verified this on both Chrome and Opera. This seems to affect only the v1.0 documentation.

GitHub links are broken

https://docs.fluentd.org/container-deployment/install-by-docker

Links which are broken:
Docker Logging Driver and Fluentd - https://github.com/fluent/fluentd-docs-gitbook/tree/f5f5f45fd170a81e4f34226d168621bcd4eb7e48/articles/docker-logging.md
Docker Logging via EFK (Elasticsearch + Fluentd + Kibana) Stack with Docker Compose - https://github.com/fluent/fluentd-docs-gitbook/tree/f5f5f45fd170a81e4f34226d168621bcd4eb7e48/articles/docker-logging-efk-compose.md

On "Install by RPM Package (Redhat Linux)" , The differences between Fluentd and td-agent link is gone

In page https://docs.fluentd.org/installation/install-by-rpm, the link for " differences between Fluentd and td-agent can be found here." is gone.

That's why Treasure Data, Inc is providing the stable distribution of Fluentd, called td-agent. The differences between Fluentd and td-agent can be found here.

Install Docker fluentd conf file path not same across/confusing

In the Install by docker doc page, in "Step2" section, the line "To make the test simple, create the example config below at /tmp/fluentd.conf" is contradicting/confusing with the next 'docker run command'. The line says to create the fluentd.conf in the root tmp folder but in the next line the docker run command expect the conf file to be present in the $(pwd)/tmp folder. and thus fails when run.
"docker run -p 9880:9880 -v $(pwd)/tmp:/fluentd/etc -e FLUENTD_CONF=fluentd.conf fluent/fluentd:v1.6-debian-1"

Doc path:
https://github.com/fluent/fluentd-docs-gitbook/blob/1.0/container-deployment/install-by-docker.md

Can't find contribution instructions

Hey!

I want to contribute to writing documentation but I can't find any instructions on how to contribute or what I need to do in order to contribute.

Could you point me in the right direction?

Thanks!

label @FLUENT_LOG needs more description and examples

It's not clear how to integrate <label @FLUENT_LOG> with other match commands.

For example I want K8s logs from my namespace and Fluentd to go to one elastic index.

Currently

<match {kubernetes.var.log.containers.**my-namespace**.log,fluent.**}>
@type elastcisearch
</match>

Should do it. What's the equivalent when using <label @FLUENT_LOG>??????

AWS Kinesis output plugin

Is this plugin suitable to use over to Internet to send logs in hybrid data center deployments? In other words, are there any security controls to prevent MITM attacks when sending logs to AWS Kinesis over the Internet?

"Parser Plugin Overview" link is broken

Returns 404.

Restric td-agent logs to warn, error and critical type only

I used "<match fluent.{warn,error,fatal}> @type stdout "to filter the td-agent logs but it didn't work as per thought whereas < system >log_level warn " woks but i don't it for system. I want it to be specific to td-agaent. But not for all other plugins or whatever.

How can i suppress other logs and log only warn,error,fatal.
Also, while filtering <match fluent.{warn,error,fatal}> , do I need to set <match fluent.{info,trace,debug}> to @type null?

Note: I tried above scenarios from documentation page of fluentd.

Incomplete documentation regarding service discovery and server plugin requirement

As mentioned in the documentation at
https://docs.fluentd.org/service_discovery

I configured the output forward plugin with the same config, but when I start td-agent, I get the following error

[error]: config error file="/etc/td-agent/td-agent.conf" error_class=Fluent::ConfigError error="forward output plugin requires at least one <server> is required"

If I am required to add server helper in output forward plugin then what is the use of service discovery. This is contradicting. Either the documentation is wrong or the td-agent that I am working with is wrong.

I am using td-agent version 1.7.4

exclude_path us causing ConfigParseError

Whenever I use exclude_path config parameter I get ConfigParseError. Everything works fine without exclude_path. Here is my configuration:

td-agent.conf

@include conf.d/jboss.conf

  <match jboss.**>
    @type gelf
    host "glog.mydomain.com"
    port "12104"
    flush_interval 5s
    buffer_chunk_limit 2M
    buffer_queue_limit 32
    max_retry_wait 30
    disable_retry_limit
    num_threads 8
  </match>

conf.d/jboss.conf

<source>
  @type tail
  format multiline
  format_firstline /^\d{2}:\d{2}:\d{2},\d{3}/
  format1 /^(?<fluentd_time_jboss>\d{2}:\d{2}:\d{2},\d{3}) (?<fluentd_log_level>[^\s]+)(?<message>.*)/
  path /usr/java/jboss/standalone/log/server.log
  exclude_path ["/usr/java/jboss/standalone/log/server.log.zip"]
  pos_file /var/log/td-agent/server.log.pos
  tag jboss.*
  multiline_flush_interval 5s
  read_from_head true
</source>

error log:

Sep 02 19:01:48 default-centos-76.vagrantup.com systemd[1]: Starting td-agent: Fluentd based data collector for Treasure Data...
Sep 02 19:01:48 default-centos-76.vagrantup.com fluentd[4380]: /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluentd-1.7.0/lib/fluent/config/basic_parser.rb:92:in `parse_error!': expected end of line at jboss.conf line 9,17 (Fluent::ConfigParseError)
Sep 02 19:01:48 default-centos-76.vagrantup.com fluentd[4380]: 8:   path /usr/java/jboss/standalone/log/server.log
Sep 02 19:01:48 default-centos-76.vagrantup.com fluentd[4380]: 9:   exclude_path ["/usr/java/jboss/standalone/log/server.log.zip"]
Sep 02 19:01:48 default-centos-76.vagrantup.com fluentd[4380]: -----------------^
Sep 02 19:01:48 default-centos-76.vagrantup.com fluentd[4380]: 10:   pos_file /var/log/td-agent/server.log.pos

td-agent version 3.5.0-0.el7
CentOS Linux release 7.6.1810 (Core)

Need clarification on behavior of total_limit_size and overflow_action parameters

I was reading through the Config: Buffer Section page and I needed to clarify the behavrior of two parameters.

overflow_action - How output plugin behaves when its buffer queue is full

total_limit_size - The size limitation of this buffer plugin instance. Once the total size of stored buffer reached this threshold, all append operations will fail with error (and data will be lost)

If I set overflow action to block, will append operations fail if total_limit_size is reached?

When I looked through the code I noticed it throws a BufferOverflowError if the stage and queue size exceeds the configured total_limit_size

Does the overflow_action only apply to the queue (and not stage)?

Extract Monitoring from Deployment

Monitoring should have own category.

Can not use "file" plugin as secondary for "elasticsearch"

As mentioned in the docs the user can specify with any output plugin in . There is an example:

<match my.logs>
  @type elasticsearch
  host localhost
  port 9200
  logstash_format true
  <buffer>
    @type file
    path /var/log/td-agent/buffer/elasticsearch
  </buffer>
  <secondary>
    @type file
    path /var/log/td-agent/error/my.logs
  </secondary>
</match>

But this example config follows with this warn message:

[warn]: #0 secondary type should be same with primary one primary="Fluent::Plugin::ElasticsearchOutput" secondary="Fluent::Plugin::FileOutput"

Nothing is delegated to file plugin as expected.

Posting the complete log:


2019-12-24 15:17:29 +0000 [info]: parsing config file is succeeded path="/etc/td-agent/td-agent.conf"
2019-12-24 15:17:36 +0000 [warn]: secondary type should be same with primary one primary="Fluent::Plugin::ElasticsearchOutput" secondary="Fluent::Plugin::FileOutput"
2019-12-24 15:17:36 +0000 [warn]: To prevent events traffic jam, you should specify 2 or more 'flush_thread_count'.
2019-12-24 15:17:36 +0000 [info]: using configuration file: <ROOT>
  <source>
    @type forward
    tag "direct.*"
    port 24224
  </source>
  <match fluent.**>
    @type null
  </match>
  <source>
    @type tail
    path "/var/log/containers/*.log"
    pos_file "/var/lib/fluentd/es-containers.log.pos"
    time_format %Y-%m-%dT%H:%M:%S.%NZ
    tag "kubernetes.*"
    format json
    read_from_head true
    <parse>
      time_format %Y-%m-%dT%H:%M:%S.%NZ
      @type json
      time_type string
    </parse>
  </source>
  <filter kubernetes.**>
    @type kubernetes_metadata
  </filter>
  <match *.**>
    @type elasticsearch
    host "localhost"
    port 9200
    logstash_format true
    <buffer>
      @type "file"
      path "/var/log/td-agent/buffer/elasticsearch"
    </buffer>
    <secondary>
      @type "file"
      path "/var/log/td-agent/error/my.logs"
      <buffer time>
        path /var/log/td-agent/error/my.logs
      </buffer>
    </secondary>
  </match>
</ROOT>
2019-12-24 15:17:36 +0000 [info]: starting fluentd-1.7.4 pid=1 ruby="2.4.9"
2019-12-24 15:17:36 +0000 [info]: spawn command to main:  cmdline=["/opt/td-agent/embedded/bin/ruby", "-Eascii-8bit:ascii-8bit", "/usr/sbin/td-agent", "-c", "/etc/td-agent/td-agent.conf", "--under-supervisor"]
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '3.5.5'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-kafka' version '0.12.1'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-kubernetes_metadata_filter' version '2.4.0'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.7.0'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-record-modifier' version '2.0.1'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.2.0'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-s3' version '1.2.0'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-td' version '1.0.0'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.4'
2019-12-24 15:17:39 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.2.4'
2019-12-24 15:17:39 +0000 [info]: gem 'fluentd' version '1.7.4'
2019-12-24 15:17:39 +0000 [info]: adding match pattern="fluent.**" type="null"
2019-12-24 15:17:39 +0000 [info]: adding filter pattern="kubernetes.**" type="kubernetes_metadata"
2019-12-24 15:17:43 +0000 [info]: adding match pattern="*.**" type="elasticsearch"
2019-12-24 15:17:47 +0000 [warn]: #0 secondary type should be same with primary one primary="Fluent::Plugin::ElasticsearchOutput" secondary="Fluent::Plugin::FileOutput"
2019-12-24 15:17:49 +0000 [warn]: #0 Could not communicate to Elasticsearch, resetting connection and trying again. Cannot assign requested address - connect(2) for [::1]:9200 (Errno::EADDRNOTAVAIL)

EFK docker compose example

https://docs.fluentd.org/v/0.12/articles/docker-logging-efk-compose

This example doesn't work. Elasticsearch have removed latest from Kibana and Elasticsearch which breaks the example.

Also pulling the latest images (elasticsearch:6.5.0, kibana:7.7.1) various java.lang.ClassCastException errors seem to relate to JVM environment issues not provided for in the example. Also getting errors with the fluentD container in line with this issue: uken/fluent-plugin-elasticsearch#699

Broken style

https://docs.fluentd.org/plugin-development/api-plugin-output#how-fluentd-chooses-modes

Wrong information about output frequency in "Send Apache Logs to S3" howto

In the page, the following warning is displayed:

WARNING: By default, files are created on an hourly basis (around xx:10). This means that when you first import records using the plugin, no file is created immediately. The file will be created when the time_slice_format condition has been met. To change the output frequency, please modify the time_slice_format value. To write files every minute, please use %Y%m%d%H%M for the time_slice_format.

The output frequency was not changed when time_slice_format was changed to %Y%m%d%H%M. However, changing the timekey parameter for the buffer worked.

Incorrent documentation for out_http

https://docs.fluentd.org/output/http states:

<match pattern>
  @type http

  endpoint http://logserver.com:9000/api
  open_timeout 2

where in fact endpoint_url is the corrent parameter.

Formatter Plugins

not found introduction of the tsv plugin in the Formatter Plugins page.

URL links not up-to-date

https://docs.fluentd.org/output/elasticsearch#plugin-helpers

The links available under the section of above URL show 404 NOT FOUND.

docker-compose.yml and conf file are out of date

Description

I just started with fluentd but while attempting to use docker-compose and found that your documentation contains a lot of out dated information.

Page to be updated - https://docs.fluentd.org/v/0.12/container-deployment/docker-compose#step-0-prepare-docker-compose-yml

Issues

Fluentd build image contained depreceated fluent-plugin-elasticsearch command --no-rdoc --no-ri and gem file.
The docker image for elasticsearch will return an error if latest is used.
No user configured resulting in permission denied when installing the plugin.
No environment configured for elasticsearch resulting in Kibana error
Unable to revive connection: http://elasticsearch:9200/
No living connections

Corrections

./fluentd/Dockerfile

FROM fluent/fluentd:v1.6-debian-1
USER root
RUN ["gem", "install", "fluent-plugin-elasticsearch", "--no-document", "--version", "3.5.2"]
USER fluent

docker-compose.yml

version: '3'
services:
  web:
    image: httpd
    ports:
      - "80:80"
    links:
      - fluentd
    logging:
      driver: "fluentd"
      options:
        fluentd-address: localhost:24224
        tag: httpd.access

  fluentd:
    build: ./fluentd
    volumes:
      - ./fluentd/conf:/fluentd/etc
    links:
      - "elasticsearch"
    ports:
      - "24224:24224"
      - "24224:24224/udp"

  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:7.2.0
    environment:
      - "discovery.type=single-node"
    expose:
      - "9200"
    ports:
      - "9200:9200"

  kibana:
    image: kibana:7.2.0
    links:
      - "elasticsearch"
    ports:
      - "5601:5601"

Deprecated repo links

There are many links to deprecated document repo. (https://github.com/fluent/fluentd-docs/*)
I checked with $ grep -r 'fluent/fluentd-docs' |grep -v gitbook

V1.0

plugins/output/kafka.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
overview/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)
overview/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)
overview/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.svg)
overview/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)
overview/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)
overview/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.svg)
overview/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)
overview/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)
overview/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.svg)
overview/logo.md:-   [Fluentd.ai](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd.ai)
overview/logo.md:-   [Full list of files](https://github.com/fluent/fluentd-docs/tree/master/public/logo)

V0.12

container-deployment/docker-compose.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
container-deployment/install-by-docker.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
container-deployment/kubernetes.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
container-deployment/docker-logging-driver.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
configuration/routing-examples.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
configuration/config-file.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-nginx-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-by-rpm.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-apache-logs-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-json-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/apache-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/python.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/kinesis-stream.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/cep-norikra.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/quickstart.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-csv-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/php.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/common-log-formats.md:[GitHub](https://github.com/fluent/fluentd-docs/issues?state=open),
articles/common-log-formats.md:always welcome a [pull request](https://github.com/fluent/fluentd-docs/pulls)!
articles/common-log-formats.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/monitoring-rest-api.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-by-chef.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/performance-tuning-single-process.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-http-rest-api-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-from-source.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-syslog-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/java.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-syslog-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/filter-modify-apache.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-syslog-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-http-rest-api-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/performance-tuning-multi-process.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-tsv-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-by-gem.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/splunk-like-grep-and-alert-email.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/nodejs.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-cloudstack-to-mongodb.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-tsv-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-by-deb.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/http-to-td.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-json-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/perl.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/docker-logging.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/ruby.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-on-heroku.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-nginx-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/scala.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-json-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/forwarding-over-ssl.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/http-to-hdfs.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-apache-logs-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/apache-to-riak.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-by-dmg.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/kubernetes-fluentd.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-nginx-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/free-alternative-to-splunk-by-fluentd.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/install-on-beanstalk.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-syslog-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/apache-to-mongodb.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-csv-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/collect-glusterfs-logs.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-tsv-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/raspberrypi-cloud-data-logger.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/monitoring-prometheus.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/docker-logging-efk-compose.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-http-rest-api-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-csv-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-json-to-elasticsearch.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-apache-logs-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-tsv-to-mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/before-install.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-nginx-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-apache-logs-to-treasure-data.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-http-rest-api-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
articles/recipe-csv-to-s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/bug-tracking.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/changelog.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/plugin-development.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/mailing-list.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/source-code.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)
developer/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.png)
developer/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_square.svg)
developer/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)
developer/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.png)
developer/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_horizontal.svg)
developer/logo.md:[![](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)
developer/logo.md:[\[PNG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.png)
developer/logo.md:[\[SVG\]](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd_icon.svg)
developer/logo.md:-   [Fluentd.ai](https://raw.githubusercontent.com/fluent/fluentd-docs/master/public/logo/Fluentd.ai)
developer/logo.md:-   [Full list of files](https://github.com/fluent/fluentd-docs/tree/master/public/logo)
developer/logo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
developer/community.md:-   [Documentation Source Code](http://github.com/fluent/fluentd-docs)
developer/community.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/filter/parser.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/filter/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/filter/stdout.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/filter/record_transformer.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/filter/grep.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/tcp.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/dummy.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/multiprocess.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/tail.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/udp.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/scribe.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/exec.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/syslog.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/unix.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/secure_forward.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/others.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/http.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/input/forward.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/buffer/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/buffer/memory.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/buffer/file.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/multiline.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/ltsv.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/regexp.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/syslog.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/none.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/csv.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/json.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/tsv.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/apache2.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/nginx.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/parser/apache_error.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/ltsv.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/msgpack.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/out_file.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/csv.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/json.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/hash.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/formatter/single_value.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/mongo.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/kafka.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/exec_filter.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/copy.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/README.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/rewrite_tag_filter.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/stdout.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/s3.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/relabel.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/null.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/exec.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/secure_forward.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/roundrobin.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/mongo_replset.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/splunk.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/others.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/file.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/webhdfs.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/geoip.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
plugins/output/forward.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/high-availability.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/rpc.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/trouble-shooting.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/secure-forwarder.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/command-line-option.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/monitoring.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/signals.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/fluentd-ui.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/logging.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/failure-scenarios.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
deployment/plugin-management.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
overview/getting-started.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
overview/support.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
overview/faq.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
overview/life-of-a-fluentd-event.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
use-cases/iot.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).
use-cases/windows.md:If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs/issues?state=open).

The "* Plugins" sections are missing from the 0.12 docs

There seem to be entire sections on plugins missing from the 0.12 documentation at https://docs.fluentd.org/v/0.12/.

You can see an example of such disabled internal links in "We will use the in_http and the out_stdout plugins as examples" on the https://docs.fluentd.org/v/0.12/quickstart/life-of-a-fluentd-event page.

json_parser can't parse time from nginx.json ($time_local)

For example {"time": "14/May/2020:13:41:20 +0300", but json_parses parses as 1970-01-01 03:33:40 UTC - {
"time": "1970-01-01 03:33:40 UTC",
"remote": null,

format deprecated

Hi there,

In this page, and other places, you specify that format is deprecated : https://docs.fluentd.org/input/http#format-deprecated

But you don't mention anything on this page :
https://docs.fluentd.org/configuration/format-section

It's a little bit confusing as I'm trying to resolve a problem of format.... Is it possible to do something? Is it deprecated or not?

Thanks a lot

"Email Alerting like Splunk" doesn't work

Hello,
there is nothing wrong with the Documentation (https://docs.fluentd.org/how-to-guides/splunk-like-grep-and-alert-email) but I just can't get it to work with the notifier plugin instead of the grepcounter, that you used in your article.

So my alert-email.conf looks like this:

<source>
  @type tail
  path /var/log/pods/.log # Set the location of your log file
  <parse>
    @type json
    time_key nil
  </parse>
  tag cm.log
</source>

<match cm.log>
  @type copy
  <store>
    @type stdout
  </store>
</match>

<match cm.log>
  @type notifier
  @label @notifications
  <def>
    pattern search_cmlog
    check string_find
    warn_regexp .*WARN.*
    crit_regexp .*INFO.*
    target_key_pattern .*WARN.*|.*INFO.*
  </def>
</match>

<label @notifications>
  <match **>
    @type copy
    <store>
      @type stdout  # Print to stdout for debugging
    </store>
    <store>
      @type mail
      host x        # Change this to your SMTP server host
      port x                    # Normally 25/587/465 are used for submission
      user x           # Use your username to log in
      password x              # Use your login password
      enable_starttls_auto true   # Use this option to enable STARTTLS
      from x         # Set the sender address
      to x         # Set the recipient address
      subject 'ERROR'
      out_keys target_tag, pattern, value, message_time
    </store>
  </match>
</label>

It works up until adding the @notifications label. For debug purposes I added the @copy stdout part.
In the log it looks like this:

2020-07-02 13:12:24.728443702 +0000 cm.log: {"log":"2020-07-02 15:12:24,309 WARN [.thread.FileSystemPollerThread] [--] Polling folder doesn't exist\n","stream":"stdout","time":"2020-07-02T13:12:24.309399034Z"}

So why doesn't my regex and adding the new label work? Would be really grateful for any help.

Best regards,
qwertyMUC

connection_string of out_mongo isn't documented

README of fluent-plugin-mongo https://github.com/fluent/fluent-plugin-mongo#label-Configuration introduces connection_string parameter first, but gitbook https://docs.fluentd.org/output/mongo#parameters doesn't document it.

I think connection_string is more useful to use because it supports "mongodb+srv" scheme https://docs.mongodb.com/manual/reference/connection-string/#dns-seedlist-connection-format .

Link is broken in stdout filter plugin

In the documentation of stdout filter plugin at the section <inject> I have found the link broken of the title Inject section configurations. I have provided the link below.

Link: https://docs.fluentd.org/filter/stdout#less-than-inject-greater-than-section

0.12 Plugin links cannot be accessed from 0.12 Overview page

The links to the plugin pages in the body of the v0.12 overview page cannot be clicked.

If this is a bug, I'd be happy to post a pull request.

Not able to install Flunetd on Amazon linux , throwing 404 Not Found (The specified key does not exist)

Hi Team,
i tried to install fluentd on Amazon Linux , using below command

Amazon Linux 2

$ curl -L https://toolbelt.treasuredata.com/sh/install-amazon2-td-agent3.sh | sh

installation process is failing with below error message

** 404 Not Found
Code: NoSuchKey
Message: The specified key does not exist.
Key: 3/amazon/2/7Server/x86_64/repodata/repomd.xml

An Error Occurred While Attempting to Retrieve a Custom Error Document
Code: NoSuchKey
Message: The specified key does not exist.
Key: error.html**
`

Can anyone knows.

Which buffer type does out_http use?

Does it use file or memory buffer type? We did a test deployment recently in which the endpoint was not configured to a legitimate URL. After about ~3 days the disk utilization by fluentd had shot up significantly resulting in issues in other docker containers deployed.

My configuration is below:

<source>
  @type tail
  <parse>
    @type json
  </parse>
  path /var/lib/docker/containers/*/*-json.log
  pos_file /var/log/fluentd-docker.pos
  read_from_head true
  tag docker.*
  refresh_interval 5s
  enable_stat_watcher false
</source>

<filter docker.var.lib.docker.containers.**.*>
....
</filter>

<match docker.var.lib.docker.containers.**.*>
  @type rewrite_tag_filter
  <rule>
    ...
  </rule>
</match>

<match sometags>

  @type http
  endpoint DUMMY_URL
  open_timeout 120
  content_type application/json
  http_method post
  headers {"Authorization":"Bearer DUMMY_AUTHORIZATION_BEARER", "structure":"simple"}
  tls_verify_mode none
  <buffer>
    chunk_limit_records 300
    flush_interval 3s
    flush_at_shutdown true
    flush_thread_count 4
    overflow_action drop_oldest_chunk
    retry_max_times 4
  </buffer>

</match>

I have chosen the overflow_action as drop_oldest_chunk. The system storage is 32GB. According to the buffer configuration section, total_limit_size is 512MB for buf_memory and 64GB for buf_file. Which leads me to believe that buffer type for out_http could be buf_file, since if it were memory, and 512MB is filled up, then the oldest chunk would be dropped.

I am not able to find an accurate answer to this. I would appreciate help to confirm this. Thank you!

fix match

<match app.> is depreciated. Should document new format
<label @myapp>
<match app.>

Remove incorrect gem install options

Gem install options --no-ri and --no-rdoc are out of date.
Replace them with --no-document.
Gem documentation: https://gitlab.com/gitlab-org/gitlab-ce/issues/55740
Page that needs updating: https://docs.fluentd.org/installation/install-by-gem

Exponential backoff expression (buffer)

I saw that the buffer page https://github.com/fluent/fluentd-docs-gitbook/blob/1.0/configuration/buffer-section.md said that the following expression is used for exponential backoff:

c + c * b^1 + (...) + c*b^k = c*b^(k+1) - 1

It doesn't seem right to me. For example, if c=2, the number at the left is even and the one at the right is odd.

If you try to simplify b^0 + b^1 + ... + b^k (let's call x), you could do:

x=b^0 + b^1 + ... + b^k

b*x - x = (b^1 + b^2 + ... + b^(k+1)) - (b^0 + b^1 + ... + b^k)

(b - 1) * x = b^(k+1) - b^0

x = (b^(k+1) - 1)/(b-1)

so the correct expression should be c*(b^(k+1) - 1)/(b-1), isn't it?

Considering the following expressions:

[1] b^0 + b^1 + ... + b^k [original]
[2] c*b^(k+1) - 1 [the one in the docs]
[3] c*(b^(k+1) - 1)/(b-1) [the new one]

If you use some random numbers to test some cases for:

c=1
b=2
k=3

[1] 1*2^0 + 1*2^1 + 1*2^2 + 1*2^3 = 1 + 2 + 4 + 8 = 15
[2] 1*2^(3+1) - 1 = 2^4 - 1 = 15
[3] 1*((2^(3+1) - 1)/(2 - 1)) = 2^4 - 1 = 16-1 = 15

in the above case it's the same value, but:

c=2
b=3
k=4

[1] 2*3^0 + 2*3^1 + 2*3^2 + 2*3^3 + 2*3^4 = 2 + 6 + 18 + 54 + 162 = 242
[2] 2*3^(4+1) - 1 = 2*3^5 - 1 = 2*243 - 1 = 485
[3] 2*((3^(4+1) - 1)/(3-1)) = 2*((243 - 1)/2) = 242

in this case the expression in the docs is wrong (unless I made some huge mistake, but I don't think so).

That said, the expression in the docs c*b^(k+1) - 1 increases exponentially as the number of retries increase, so it should be ok to use this expression, but I think that in this case it should be better to remove the expression in the left and let just this expression in the docs (this way there is no need to change the code used in the application, just the docs).

Just my 2 cents :)

Default value for the time_type option

Default value of time_type option may be correct string .

page: https://docs.fluentd.org/configuration/parse-section#time-parameters
Default: float

https://github.com/fluent/fluentd/blob/a0240f6b7d897502fa36f9a720f9fb6b85a23bae/lib/fluent/time.rb#L142
Default: string

thx

docs.flunetd.org has no ip address

CNAME record also empty
nslookup docs.fluentd.org 8.8.8.8 -v
Server: 8.8.8.8
Address: 8.8.8.8#53

** server can't find docs.fluentd.org: NXDOMAIN

Create trouble-shooting category

Currently, trouble-shooting topics are distributed in many article.

Parser plugins

Incomplete documentation for parser plugins.
List of Built-in Parsers missing @type msgpack
List of Core Input Plugins with Parser support missing in_forward

Typo in Year in the regexp parser plugin example in v1.0

Screenshot of the typo:

Link to the doc : https://docs.fluentd.org/parser/regexp

Doc links in search results need redirects

Example: “fluentd output elasticsearch”
Top result is
https://docs.fluentd.org/v1.0/articles/out_elasticsearch

Needs 301 redirect to
https://docs.fluentd.org/output/elasticsearch
Google search console + cdn is how I used to handle these redirects for often changing url promo changes at newegg.com, should be straight forward I think and help users

just using google site:docs.fluentd.org, inurl:articles theres 415 results under /articles indexed
here's first 136 using python I got before my ip was banned(forgot they have a pretty strict rate limit)
results.txt
I see you already do a redirect in your .gitbook.yaml for https://docs.fluentd.org/v1.0/articles/quickstart
so maybe can just be handled there if you don't want to mess with seo way of redirects, eventually google crawlers will learn the structure anyhow.

custom service discovery plugin

can someone share an example and/or update the documentation for creating a custom service plugin? my use case is that i have a set of in_forward receivers that get changed once in a while. I would like to auto-update clients running out_forward as new in_forward receivers are added or removed.

The docs currently reference td-agent for RPM based systems, however td-agent does not have CentOS/RHEL 8 builds (treasure-data/omnibus-td-agent#205), it might be helpful to point RHEL/CentOS 8 users to https://docs.fluentd.org/installation/install-by-gem for now until an RPM is available, since installation via gem works in RHEL 8.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.