We are thrilled to announce that Fluentd has become the sixth CNCF Graduated Project! This is a huge recognition to the project and its community. Fluentd wide adoption by the Enterprise and contributions are in a continuous grow: we have more than 900 contributed plugins and more than 100k downloads a day!
Fluentd was created in 2011 by Sadayuki “Sada” Furuhashi, co-founder of Treasure Data, Inc., as an open source data collector for building a Unified Logging Layer, which unifies the data collection and consumption for better use and understanding of data. In November 2016, Fluentd was accepted as CNCF’s sixth hosted project after Kubernetes, Prometheus, and OpenTracing.
As of today, Fluentd is used by major companies to solve log collection and processing at scale: Microsoft, Redhat, and Google are a few names of its known users.
Fluentd's core maintainer, Masahiro Nakagawa (well known as @repeatedly on Twitter), said that he's thrilled to have had the opportunity to collaborate with the CNCF community and to grow its user base, and it's an honor to see Fluentd graduated. Today we celebrate this big accomplishment, and we continue looking forward to improving on upcoming Logging and data processing challenges.
Fluentd at Conferences on 2019
Fluentd team will be attending some conferences this year, save the date!
Fluentd is giving a big step forward in terms of adoption. It was not a surprise that it was early adopted by several companies and from a cloud perspective, it become the default standard to solve Logging in containerized environments. We were able to see how Docker users relies on Fluentd to scale logging while in the orchestration area, users from Kubernetes started their own integrations too, nowadays Kubernetes uses Fluentd to ship logs to Elasticsearch and Google Cloud Platform. Fluentd is having an organic grow.
From a project perspective, adoption is the key to succeed. But to accomplish this adoption a project needs to be a good citizen with other components, a good integration is always desired. Fluentd adoption is merely thanks to the flexibility to adapt and integrate with other platforms, and of course solving a real-worl problem which is logging.
As you might noticed, in the last two years Fluentd team was very active sharing logging knowledge in several conference around the world, I'd say our biggest participation have been in LinuxCon Asia, Europe and NorthAmerica (in all it versions!). This kind of interaction was really positive to understand how the project could evolve even more. At the beginning of 2016, we were thinking about what would be the next natural step for Fluentd and we saw some lights when Linux Foundation announced the new Cloud Native Computing Foundation (aka CNCF).
Since CNCF is a nonprofit organization committed to advancing the development of cloud native technology, it sound a really good fit for Fluentd, at that moment Google already donated Kubernetes to CNCF. One of the biggest benefits of CNCF compared to other foundations are:
Flexibility: development and roadmap continue being handled by the project. CNCF do not want to control that, so we can move forward very quickly.
Ecosystem: formally Fluentd can be part of a cloud native stack. Work together with Kubernetes team (and others) in a better way.
Awareness: Fluentd becomes recognized as the default Logging Cloud Native technology.
After a long process of review and technical discussions, the CNCF Technical Oversight Committee voted for Fluentd ending in positive result, Fluentd joins the CNCF and this was announced in the Opening Keynote session at CloudNativeCon (jump to minute 24:40):
Fluentd at CNCF
Note that Fluentd is a whole ecosystem, if you look around inside our Github Organization, you will see around 35 repositories including Fluentd service, plugins, languages SDKs and complement project such as Fluent Bit. All of them are part of CNCF now!.
In name of Treasure Data, I want thanks to every developer of Fluentd, plugins and SDKs who were very supportive on this transition for the project. Our code and community is part of something bigger now :) .
What's Next ?
Fluentd team continue working hard to make it even better, there is a long roadmap for v0.14 and looking forward for a v1.0 on Q1 of 2017. We want everybody continue be involved on this, this is a really exciting time in the Cloud Native Era and Fluentd Community is having a key role on it.