Fluentd Blog

td-agent v4.4.1 has been released

Hi users!

We have released td-agent v4.4.1. td-agent is a stable distribution package of Fluentd.

Changes from td-agent v4.4.0

• Update fluentd to 1.15.2
  • out_file: Fix append mode with --daemon flag
  • Drop win32-api gem dependency
  • Please see also the release announcement of v1.15.2
• Update fluent-plugin-kafka to 0.18.1
  • Fix outkafka2 doesn't respect `chunklimitrecordsandchunklimit_size`

Download

Please see the download page.

Read More

Fluentd v1.15.2 has been released

Hi users!

We have released v1.15.2. ChangeLog is here.

In this release, we fixed the problem that out_file's append mode with --daemon flag failed to flush the buffer.

Bug Fixes

out_file: Fix append mode with --daemon flag

In the previous version v1.15.1, we added a new feature to prevent write conflicts between multiple workers.

• #3808

However, this fix didn't work correctly with --daemon flag of Fluentd command.

• Command Line Option

With that flag, out_file in the append mode fails to flush the buffer. This is a critical bug for td-agent, because td-agent uses --daemon flag by default.

In this release, we fixed this problem.

See #3864 for more information.

Miscellaneous fixes

• Add a new system configuration enable_jit. #3857
• child_process: Plug file descriptor leak. #3844
• Drop win32-api gem to support Ruby 3.2. #3849, #3866

Enjoy logging!

Read More

td-agent v4.4.0 has been released

Hi users!

We have released td-agent v4.4.0. td-agent is a stable distribution package of Fluentd.

Changes from td-agent v4.3.2

• Update bundled Fluentd from v1.14.6 to v1.15.1. Please see each release announcement of Fluentd for more detail:
  • Fluentd v1.15.0 has been released
  • Fluentd v1.15.1 has been released
• Update OpenSSL to 1.1.1q (for macOS and Windows)
• Remove TD_AGENT_OPTIONS= from td-agent.service. Instead it's loaded from /etc/sysconfig/td-agent (rpm) or /etc/default/td-agent (deb).
• Drop Ubuntu 16.04 "Xenial Xerus" support as we announced before.
• Update plugins and gems

Please see ChangeLog for more detail.

Download

Please see the download page.

Read More

Fluentd v1.15.1 has been released

Hi users!

We have released v1.15.1. ChangeLog is here.

This release is a maintenance release of v1.15 series.

Bug Fixes

out_file: Add support for concurrent append

Using "append" option of out_file in multiple workers could cause file corruption due to write conflicts. This could happen when multiple workers append to the same file at the same time, although it was very rare.

In this release, we add a lock-system to Fluentd to prevents write conflicts between multiple workers.

This prevents write conflicts of out_file.

See #3808 for more information.

Miscellaneous bug fixes

• in_tail: Show more information on skipping update_watcher. #3829

Enjoy logging!

Read More

Fluentd v1.15.0 has been released

Hi users!

We have released v1.15.0. ChangeLog is here.

This release is a new release of v1.15 series.

In this release, we added some new functions and fixed some crash bugs, especially about in_tail.

Enhancement

Support YAML configuration format

Fluentd now supports YAML configuration format as follows.

config:
  - source:
      $type: forward
      port: 24224
  - source:
      $type: http
      port: 9880
  - match:
      $tag: myapp.access
      $type: file
      path: /var/log/fluent/access

This is not 1-by-1 correspondence for the traditional Fluentd config file syntax.

Please see the document for detailed usage instructions or see #3712 for more information.

in_tail: Add log throttling in files based on group rules

In this release, we add a new option directive group to in_tail.

From v1.13, We can use read_bytes_limit_per_second to throttle log flow rate, but we can only set it for each source unit.

By using this new option, we can throttle log flow rate for each file unit.

Please see the document for detailed usage instructions or see #3535 for more information.

Add restart_worker_interval to system configuration

In this release, we add a new option restart_worker_interval.

By default, Fluentd immediately restarts stopped workers, but you may want to keep the worker stopped for a while for some reason. In such cases, you can use this option as follows.

<system>
  restart_worker_interval 1m
</system>

By this setting, a stopped worker will restart after 1 minute.

See #3768 for more information.

fluent-ctl: Add a new command dump

In this release, we can use a new command dump in fluent-ctl.

This command is mainly for Windows.

As for non-Windows, you can manually send SIGCONT to each supervisor/worker process to dump their internal status. (Dump fluentd's Internal Information)

By using this new command, we can get the internal status on Windows too.

On Windows, this makes all Fluentd processes (including all worker processes) dump their internal status to the system temp directory (C:\\Windows\\Temp).

$ fluent-ctl dump [PID_OR_SVCNAME]

You can omit [PID_OR_SVCNAME] if you run the fluentd as a Windows service, whose service name is the default value fluentdwinsvc.

Please see the document for detailed usage instructions or see #3680 for more information.

Bug Fixes

• Output plugins: Fix a possible crash of flush thread. #3755
• in_tail: Fix crash bugs on Ruby 3.1 on Windows. #3766
• in_tail: Fix a possible crash on file rotation when follow_inodes true. #3754
• in_tail: Fix a bug that in_tail cannot open non-ascii path on Windows. #3774

Miscellaneous bug fixes

• out_forward: Fix to update timeout of cached sockets. #3711
• Fix a bug that fluentd doesn't release its own log file even after rotated by external tools. #3782

Enjoy logging!

Read More