Fluentd Blog

Fluentd v1.15.3 has been released

Hi users!

We have released v1.15.3 on 2022-11-02. ChangeLog is here.

In this release, we fixed several bugs.

Bug Fixes

out_file: Fix the multi-worker check with <worker N-M> directive

In the v1.15.1, we added a new feature to prevent write conflicts between multiple workers.

• #3808

However, this fix didn't work correctly with <worker N-M> directive.

• <worker N-M> directive

With this setting, the configuration check before starting the supervisor mistakenly determines that the setting of out_file is invalid and causes Fluentd to terminate.

In this release, we fixed this problem.

See #3942 for more information.

Fix log rotation on Windows

We can configure log rotation setting as follows.

• Log Rotation Setting

On Windows, the log files must be separated by each process.

NOTE: When --log-rotate-age is specified on Windows, log files are separated into log-supervisor-0.log, log-0.log, ..., log-N.log where N is generation - 1 due to the system limitation. Windows does not permit delete and rename files simultaneously owned by another process.

However, that log rotation setting in the system-directive didn't satisfy this and Fluentd outputted the logs of the supervisor process into the log file of the worker-0 process.

This could cause errors during log rotation.

In this release, we fixed this problem.

See #3939 for more information.

Support glob for !include directive in YAML config format

In the v1.15.0, we supported YAML config format.

• Config File Syntax (YAML)
• #3712

However, handling glob of !include directive was leaked.

In this release, we supported it.

See #3917 for more information.

Remove meaningless and unsecure oj options

In this release, we removed the following oj options.

• FLUENT_OJ_OPTION_MODE=object
• FLUENT_OJ_OPTION_MAX_NESTING

FLUENT_OJ_OPTION_MODE=object was unsecure, so we removed it.

• GHSA-fppq-mj76-fpj2

This option is not used unless a user explicitly sets the environmental variable, so almost all users do not need to care about this vulnerability.

FLUENT_OJ_OPTION_MAX_NESTING was not supported, so we removed it.

• https://github.com/fluent/fluentd/issues/3311#issuecomment-923741031

See #3929 for more information.

Enjoy logging!

Read More

td-agent v4.4.2 has been released

Hi users!

We have released td-agent v4.4.2. td-agent is a stable distribution package of Fluentd.

Changes from td-agent v4.4.1

• Update fluentd to 1.15.3
  • Fix log initializer to correctly create per-process files on Windows
  • out_file: Fix the multi-worker check with <worker 0-N> directive
  • Remove meaningless oj options
  • Support glob for !include directive in YAML config format
• macOS: Support Apple Silicon
• Update plugins
  • fluent-plugin-elasticsearch 5.2.4
  • fluent-plugin-opensearch 1.0.8
  • fluent-plugin-s3 1.7.2
  • fluent-plugin-windows-eventlog 0.8.2

Download

Please see the download page.

Read More

td-agent v4.4.1 has been released

Hi users!

We have released td-agent v4.4.1. td-agent is a stable distribution package of Fluentd.

Changes from td-agent v4.4.0

• Update fluentd to 1.15.2
  • out_file: Fix append mode with --daemon flag
  • Drop win32-api gem dependency
  • Please see also the release announcement of v1.15.2
• Update fluent-plugin-kafka to 0.18.1
  • Fix outkafka2 doesn't respect `chunklimitrecordsandchunklimit_size`

Download

Please see the download page.

Read More

Fluentd v1.15.2 has been released

Hi users!

We have released v1.15.2. ChangeLog is here.

In this release, we fixed the problem that out_file's append mode with --daemon flag failed to flush the buffer.

Bug Fixes

out_file: Fix append mode with --daemon flag

In the previous version v1.15.1, we added a new feature to prevent write conflicts between multiple workers.

• #3808

However, this fix didn't work correctly with --daemon flag of Fluentd command.

• Command Line Option

With that flag, out_file in the append mode fails to flush the buffer. This is a critical bug for td-agent, because td-agent uses --daemon flag by default.

In this release, we fixed this problem.

See #3864 for more information.

Miscellaneous fixes

• Add a new system configuration enable_jit. #3857
• child_process: Plug file descriptor leak. #3844
• Drop win32-api gem to support Ruby 3.2. #3849, #3866

Enjoy logging!

Read More

td-agent v4.4.0 has been released

Hi users!

We have released td-agent v4.4.0. td-agent is a stable distribution package of Fluentd.

Changes from td-agent v4.3.2

• Update bundled Fluentd from v1.14.6 to v1.15.1. Please see each release announcement of Fluentd for more detail:
  • Fluentd v1.15.0 has been released
  • Fluentd v1.15.1 has been released
• Update OpenSSL to 1.1.1q (for macOS and Windows)
• Remove TD_AGENT_OPTIONS= from td-agent.service. Instead it's loaded from /etc/sysconfig/td-agent (rpm) or /etc/default/td-agent (deb).
• Drop Ubuntu 16.04 "Xenial Xerus" support as we announced before.
• Update plugins and gems

Please see ChangeLog for more detail.

Download

Please see the download page.

Read More