Hi users!
We have released v1.12.0. ChangeLog is here.
in_tail
: Support *
in path
with log rotationfluentd v1.12.0 resolves the limitation for *
with log rotation.
follow_inodes true
enables the combination of *
in path with log rotation inside same directory
and read_from_head true
without log duplication problem.
path /path/to/*
read_from_head true
follow_inodes true # without this parameter, log rotation may cause log duplication
in_tail
: Support Linux CapabilityFluentd supports Linux capability via capng_c
gem and
in_tail
now supports CAP_DAC_READ_SEARCH
/CAP_DAC_OVERRIDE
capabilities to read log files.
See official article for more details: Linux Capability
If you want more capability support in official plugins, file it on github.
fluent-ctl
commandfluent-ctl
provides same interface to control fluentd process, shutdown
/restart
/flush
/reload
.
fluent-ctl
uses Signalsfluent-ctl
uses Windows EventCommand example:
# Usage: fluent-ctl action PID
$ fluent-ctl shutdown 11111
retry.step
from being called too many times in a short timeEnjoy logging!
Hi users!
We have released v1.11.5. ChangeLog is here.
newline
parameter to support CRLF
This parameter is for Windows environment.
Users can choose LF
or CRLF
newline for add_newline true
case.
newline lf # or crlf
Add support for sending a client certificate chain for mutual TLS authentication in the HTTP output plugin.
Enjoy logging!
Hey All,
Thank you for being part of the Fluent Slack Community! As part of improving Fluentd and Fluent Bit, we want to know what pains and feedback you are experiencin to better manage our future together.
We have created an anonymous survey that allows you to share this here.
Optionally, if you are interested you can add your email to give us direct feedback. Looking forward to your feedbacks!
Hi users!
We have released v1.11.3. ChangeLog is here.
ignore_same_log_interval
parameterFluentd has ignore_repeated_log_interval
parameter but this is not enough for some frequent log generation case.
For example, if the plugin generates several log messages in one action, logs are not repeated:
# retry generates same error messages with ignore_repeated_log_interval
def write(chunk)
# process 1...
log.error "message1"
# process 2...
log.error "message2"
end
ignore_same_log_interval
resolves these cases. With this option, logger keeps to store all log messages for validation.
<system>
ignore_same_log_interval 60s
</system>
in_exec
doesn't read stderr and this is not good for script debug.
To resolve this problem, add connect_mode
parameter to read stderr logs.
<source>
@type exec
tag somescript
command python /path/to/script.py
connect_mode read_with_stderr
<parse>
@type none
</parse>
</source>
Enjoy logging!
Hi users!
We have released v1.11.2. ChangeLog is here.
Regular expression, /pattern/
, is now allowed in tag matching:
<source>
@type forward
</source>
# For a.xxx tag
<filter a.**>
@type record_transformer
<record>
new_key a-started tag record
</record>
</filter>
# For non a.xxx tag like b.xxx/c.xxx/...
<filter /(?!a\.).*/>
@type record_transformer
<record>
new_key other tag record
</record>
</filter>
<match **>
@type stdout
</match>
If you send following events:
% echo '{"msg":"hi"}' | fluent-cat a.foo
% echo '{"msg":"hi"}' | fluent-cat b.foo
the log shows:
2020-08-06 13:40:03.111196000 +0900 a.foo: {"msg":"hi","new_key":"a-started tag record"}
2020-08-06 13:40:09.492380000 +0900 b.foo: {"msg":"hi","new_key":"other tag record"}
Of course, simple data pipeline is important for robust log collection. If you need this feature, check your configuration/data flow first.
in_dummy
is renamed in_sample
We recommend to use sample
instead of dummy
:
<source>
@type sample
sample {"hello":"world"}
</source>
# If you use fluentd v1.11.1 or earlier, use following configuration
# Fluentd v2 will remove old configuration support
<source>
@type dummy
dummy {"hello":"world"}
</source>
chunk_limit_records
caseEnjoy logging!
Fluentd is an open source data collector to simplify log management.
2021-01-05: Fluentd v1.12.0 has been released
2020-11-06: Fluentd v1.11.5 has been released
2020-10-28: Fluentd Ecosystem Survey 2020
2020-09-30: Fluentd v1.11.3 has been released
2020-08-06: Fluentd v1.11.2 has been released
Want to learn the basics of Fluentd? Check out these pages.
Couldn't find enough information? Let's ask the community!
You need commercial-grade support from Fluentd committers and experts?
©2010-2021 Fluentd Project. ALL Rights Reserved.
Fluentd is a hosted project under the Cloud Native Computing Foundation (CNCF). All components are available under the Apache 2 License.