rabbit-slide-daipom-open-source-summit-japan-2023-fluent-package 1.0.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,874 @@
1
+ # New Chapter of Fluentd
2
+
3
+ subtitle
4
+ : Rebranding and New Release Cycle (LTS)
5
+
6
+ author
7
+ : Daijiro Fukuda, Kentaro Hayashi
8
+
9
+ institution
10
+ : ClearCode Inc.
11
+
12
+ content-source
13
+ : Open Source Summit JAPAN 2023
14
+
15
+ date
16
+ : 2023-12-05
17
+
18
+ allotted-time
19
+ : 35m
20
+
21
+ theme
22
+ : clear-code
23
+
24
+ ## note
25
+
26
+ Hi everyone!
27
+ Thanks for coming to hear our talk.
28
+ We are glad to be here!
29
+ Let's start!
30
+
31
+ We gonna talk about New Chapter of Fluentd,
32
+ Rebranding and New Release Cycle LTS, stands for long term support.
33
+
34
+ # About us
35
+
36
+ * **Maintainers of Fluentd Project**
37
+ * Software Engineers at ClearCode Inc
38
+ * Driving forward Free Software and Make the business
39
+
40
+ ![](images/clearcode.svg){:relative-width="40"}
41
+
42
+ ## note
43
+
44
+ Let me introduce ourselves.
45
+ we are maintainers ...
46
+ I am Daij... He is Ken....
47
+ we are also ...
48
+ clearcode is software development company located in Japan.
49
+ Clearcode drives ..
50
+ I think we are trying something unique.
51
+ Anyway, we are participated in ...
52
+
53
+ # Fluentd and us
54
+
55
+ ![](images/maintainers.png){:relative-height="75"}
56
+
57
+ {:.center}
58
+
59
+ {::note}<https://github.com/fluent/fluentd/graphs/contributors?from=2021-01-01&to=2023-11-30&type=c>{:/note}
60
+
61
+ ## note
62
+
63
+ This graph shows how active ...
64
+ 3 of 4 top contributors are from clearcode.
65
+ We are deeply involved in recent development of fluentd.
66
+ ///
67
+ I am the number 3 daipom, and he is the number 4 kenhys.
68
+ Today, number 1 contributor Ashie is not here.
69
+ Even though, please be happy with us.
70
+
71
+ # Agenda
72
+
73
+ * What is Fluentd
74
+ * History of Fluentd
75
+ * What's new Fluent Package LTS
76
+ * Remarks of updating
77
+ * Major changes
78
+
79
+ ## note
80
+
81
+ Here is the agenda of our talk.
82
+
83
+ First topic is ... Second topic is ... How it is ...
84
+ Third topic is ... We released new package ... We gonna explain it ...
85
+ Fourth topic is ... How users can ..., and why users should.
86
+ Last but not least, we gonna talk about major changes and the future of Fluentd.
87
+
88
+ At end of this talk, we will be happy if everyone here understands about ...
89
+ and feels encouraged ...
90
+ And more people are interested in the Fluentd community.
91
+
92
+ # Agenda
93
+
94
+ * **What is Fluentd**
95
+ * History of Fluentd
96
+ * What's new Fluent Package LTS
97
+ * Remarks of updating
98
+ * Major changes
99
+
100
+ ## note
101
+
102
+ Let's start with what is Fluentd.
103
+
104
+ # What's Fluentd
105
+
106
+ > Fluentd is an open source data collector that unifies data collection and consumption.
107
+
108
+ {::comment}
109
+ See https://raw.githubusercontent.com/fluent/fluentd-docs-gitbook/1.0/images/logo/Fluentd_icon_square.png
110
+ {:/comment}
111
+
112
+ ![](images/Fluentd_icon_square.png){:relative-width="20"}
113
+
114
+ ## note
115
+
116
+ I am sure everyone here heard about Fluentd.
117
+ The need to collect data continues to expand. Fluentd is one of known data collecters.
118
+ 読む。
119
+ said in the official website.
120
+ It is used by so many companies.
121
+ And also forked over 1300 times in GitHub.
122
+ It is very famous product.
123
+
124
+ # Image of data collection without Fluentd
125
+
126
+ {::comment}
127
+ See https://raw.githubusercontent.com/fluent/fluentd-website/master/public/images/fluentd-before.png
128
+ {:/comment}
129
+
130
+ ![](images/fluentd-before.png){:relative-width="55"}
131
+
132
+ ## note
133
+
134
+ Here is an image ...
135
+ In recent use cases, there are many ...
136
+ Data sources are like ...
137
+ Data comes from many kinds of sources, in different format.
138
+ Data outputs are like ...
139
+ It requires to be in specific format.
140
+ Without fluentd, it will be complex like this.
141
+
142
+ ## Slide properties
143
+
144
+ enable-title-on-image
145
+ : false
146
+
147
+ # What Fluentd does
148
+
149
+ {::comment}
150
+ See https://raw.githubusercontent.com/fluent/fluentd-website/master/public/images/fluentd-architecture.png
151
+ {:/comment}
152
+
153
+ ![](images/fluentd-architecture.png){:relative-width="100"}
154
+
155
+ ## note
156
+
157
+ But, Fluentd solves it!
158
+
159
+ Fluentd unifies logging layer and organizes data processing.
160
+ Fluentd can do a whole set of things that are important for data processing.
161
+ collecting ...
162
+ As you can see, data collection becomes very simple with Fluentd.
163
+
164
+ ## Slide properties
165
+
166
+ enable-title-on-image
167
+ : false
168
+
169
+ # Why use Fluentd?
170
+
171
+ * Flexibility
172
+ * Scalability
173
+ * Open source and community
174
+
175
+ ## note
176
+
177
+ There are 3 remarkable points why use Fluentd.
178
+
179
+ First, flexibility.
180
+ Fluentd has plugin system.
181
+ The plugin system unifies many data sources and outputs.
182
+
183
+ Second, scalability.
184
+ It can handle large data collection, and it is well compatible with distributed systems, like cloud native computing.
185
+
186
+ Third, open source and community.
187
+ Anyone can participate in the development of fluentd.
188
+
189
+ # Flexibility
190
+
191
+ * Over 1000 plugins for many data sources and outputs
192
+ * By combining plugins, you can achieve what you want
193
+ {::note}Main functions such as data collection, filtering, formatting, and sending are performed by each plugin{:/note}
194
+ * You can easily make your plugin with Ruby
195
+
196
+ ## note
197
+
198
+ First, flexibility.
199
+ Fluentd has plugin system.
200
+ And there are over 1000 plugins for many ...
201
+ You can choose and combine them, and you can achieve ...
202
+ If you can't find plugin you want, you can easily ...
203
+
204
+ # Scalability
205
+
206
+ ![](images/scaling.png){:relative-width="75"}
207
+
208
+ ## note
209
+
210
+ Scalability.
211
+
212
+ When Fluentd works as forwarder and aggregator in the log collection system.
213
+ You can change the number ... depends on how much data to transfer.
214
+ How to manage it is all up to what you want.
215
+ The number of instances can be dynamically changed,
216
+ so this scalability is very important for Fluentd.
217
+
218
+ ## Slide properties
219
+
220
+ enable-title-on-image
221
+ : false
222
+
223
+ # Open source and community
224
+
225
+ * You can join to development and make what you want
226
+ * Plugins are maintained in the community
227
+ * <https://github.com/fluent-plugins-nursery>
228
+
229
+ ## note
230
+
231
+ Open source and community.
232
+
233
+ Fluentd is open source, the license is Apache License 2.0.
234
+ you can refer to the implementation, and you can make your plugin.
235
+ //// Also, if you find any bugs, you can report it!
236
+ Some bugs are solved with community's help.
237
+ //// You can join the development of Fluentd.
238
+ //// If it necessary, community supports to maintain plugins with nursery project.
239
+ So you can get help to maintain your plugins.
240
+
241
+ # Agenda
242
+
243
+ * What is Fluentd
244
+ * **History of Fluentd**
245
+ * What's new Fluent Package LTS
246
+ * Remarks of updating
247
+ * Major changes
248
+
249
+ ## note
250
+
251
+ Now, you know what is Fluentd and why you use it.
252
+ Next, I gonna tell you the history!
253
+
254
+ # History of Fluentd
255
+
256
+ | 2011 | v0.9 Released by Treasure Data |
257
+ | 2016 | Accepted to CNCF |
258
+ | 2017 | v1.0 Released |
259
+ | 2019 | Graduated CNCF project |
260
+
261
+ ## note
262
+
263
+ Fluentd was born on 2011 at Treasure Data,
264
+ US origin company, providing the marketing data platform.
265
+
266
+ version 1 was released on 2017.
267
+ It was the base of the current product.
268
+
269
+ Fluentd was accepted to Cloud Native Computing Foundation on 2016.
270
+ On 2019, it became the Graduated project maturity level.
271
+
272
+ It was good to have support from CNCF
273
+
274
+ # Needs of distribution package
275
+
276
+ * Fluentd is general purpose
277
+ * Plugins allow specific features
278
+ * Ruby is required to use
279
+
280
+ Users want **convenience**. We need distribution package.
281
+
282
+ ## note
283
+
284
+ Now, I gonna explain the history of the package.
285
+ Dist pkg of Fluentd has also been developed from early days of ...
286
+
287
+ // We need a package to use Fluentd easily.
288
+ Fluentd doesn't work without ...
289
+ Users need to install ...
290
+ Also Fluentd needs Ruby environment.
291
+
292
+ // If there is a package including ..., ... convenient for users.
293
+
294
+ # History of distribution package
295
+
296
+ | Year | Package | Fluentd |
297
+ |------|-------------------|---------|
298
+ | 2011 | td-agent v1 | v0.9 |
299
+ | 2014 | td-agent v2 | v0.10 |
300
+ | 2017 | td-agent v3 | v0.14 |
301
+ | 2020 | td-agent v4 | v1.11 |
302
+ | 2023 | fluent-package v5 | v1.16 |
303
+
304
+ ## note
305
+
306
+ So the package of Fluentd has been developed.
307
+ Here is the history of distribution package.
308
+
309
+ // As a package, td-agent was developed by Treasure Data on 2011.
310
+ Originally, the package was for Treasure Data's own services.
311
+ But it became widely used as a general package of Fluentd.
312
+
313
+ // As you can see, along with the development of ...
314
+ And recently, the development became on the community base.
315
+
316
+ // And this year, we release Fluent Package as the successor of td-agent.
317
+ Why did the name change? and what else has changed?
318
+
319
+ # Reason of rebranding
320
+
321
+ * The name td-agent does not associate with Fluentd
322
+ {::note}The name of distribution package is better to associate or describe the main software{:/note}
323
+ * td-agent is so called all-in-one package, not limited for Treasure Data CDP
324
+
325
+ ## note
326
+
327
+ So why we changed the name?
328
+ Actually, it is the big change we had made.
329
+ The reason of this change is the name of package is better to describe its main software.
330
+ And The name td-agent does not associate with Fluentd. It is difficult to imagine it is actually the package of Fluentd.
331
+ Also, td-agent is so called all-in-one package, not limited for Treasure Data services.
332
+
333
+ # Fluent Package
334
+
335
+ * The new package name reflects community driven development!
336
+
337
+ {::comment}
338
+ See https://raw.githubusercontent.com/fluent/fluentd-docs-gitbook/1.0/images/logo/Fluentd_icon_square.png
339
+ {:/comment}
340
+
341
+ ![](images/Fluentd_icon_square.png){:relative-width="35"}
342
+
343
+ ## note
344
+
345
+ The new package name 'Fluent Package' reflects community driven development!
346
+ It is important to make the name describing it includes Fluentd.
347
+ So we have discussed with community and made the name Fluent Package.
348
+
349
+ It was a big challenge to change the name for developers.
350
+ we have worked through to make sure it does not cause too much trouble for users!
351
+ /// (No one clapping?! patipatipatipati)
352
+ (Thank you, Thank you)
353
+ (You know it is not easy to change the package name! We gonna share details later! But it was hard task!)
354
+ /// Also //// while changing the name, we discussed with community about the release cycle as well.
355
+
356
+ # Agenda
357
+
358
+ * What is Fluentd
359
+ * History of Fluentd
360
+ * **What's new Fluent Package LTS**
361
+ * Remarks of updating
362
+ * Major changes
363
+
364
+ ## note
365
+
366
+ I have introduced what is Fluentd, and history of it.
367
+ Now you realize we have changed the name of the package this year.
368
+ So, what else has changed?
369
+ Not only did we change the name, but also we renewed the release cycle.
370
+ That is the Fluent Package LTS!
371
+ Now let me share what is New Fluent Package LTS.
372
+
373
+ # Fluent Package LTS
374
+
375
+ * v5.0.2 had been released at Nov 2023 🎉
376
+ * Recommended for stable production use
377
+ * **Scheduled** support lifecycle
378
+ * Security fixes, bug fixes for long term
379
+
380
+ ## note
381
+
382
+ LTS means Long Term Support.
383
+ The newest version, 5.0.2 had been released at November.
384
+ It is Recommended for stable production use.
385
+
386
+ // While we involved in the development of Fluentd,
387
+ there were certain number of request to have longer support cycle.
388
+ In the LTS package, we provide scheduled support lifecycle.
389
+ In the lifecycle, we provide only bug fixes and security fixes.
390
+ It makes it easy to update continuously!
391
+
392
+ // We believe that this will meet the needs of users.
393
+ Users who want to use Fluentd stably over the long term.
394
+
395
+ # Standard and LTS
396
+
397
+ | Channel | Support lifecycle |
398
+ |-------------------------|--------------------|
399
+ | Standard version | Every 3 months |
400
+ | LTS (Long term support) | Every 2 year or so |
401
+
402
+ ## note
403
+
404
+ I gonna explain the lifecycles in more detail.
405
+ There are 2 channels with different lifecycles, Standard and LTS.
406
+
407
+ // Standard is the same lifecycle as the td-agent.
408
+ It is very simple.
409
+ About every 3 months, we update the embedded Fluentd to the latest.
410
+ So, you can always use the latest functionalities with Standard channel.
411
+
412
+ //But some users may feel it is difficult to update.
413
+ Because they may worry about encountering new bugs or losing compatibility.
414
+
415
+ // LTS life cycle is for 2 years or so.
416
+ We continue to provide only bug fixes and security fixes.
417
+ It means less possibility of encountering new bugs or losing compatibility.
418
+ So, it is recommended for stable production use.
419
+
420
+ # Planned release cycle
421
+
422
+ {::comment}
423
+ Based on https://raw.githubusercontent.com/fluent/fluentd-website/master/public/images/blog/20230829_fluent-package-scheduled-lifecycle.png
424
+ Execute `rake chart` to generate image.
425
+ {:/comment}
426
+
427
+ ![](images/fluent-package-scheduled-lifecycle.png){:relative-width="100"}
428
+
429
+ {::note}<https://www.fluentd.org/blog/fluent-package-scheduled-lifecycle>{:/note}
430
+
431
+ ## note
432
+
433
+ Here is the chart to describe the schedule image.
434
+ /// First section describes the schedule of td-agent version 4 series.
435
+ It is already announced that td-agent v4 series reaches end-of-life by the end of 2023, this year.
436
+ /// The middle part with a white background is Standard channel.
437
+ And the bottom part with a yellow background is LTS channel.
438
+ /// Currently, both provides same Fluent Package version 5.0.
439
+ But, it will change in the future.
440
+ /// As you see, in Standard channel, we update the minor version.
441
+ We will provide Fluent Package v5.1 in Standard channel, when next minor update of Fluentd 1.17 will be released.
442
+ It will be different from LTS.
443
+ /// In LTS channel, we conitunes to provide version 5.0 series for at least 2 years.
444
+ We update only the patch version, not minor version.
445
+ We announce the update schedule in advance.
446
+ At the moment, the next major version 6.0 is scheduled to be released on 2025.
447
+ And the current version in LTS channel will be supported until then.
448
+
449
+ # Profit for updating to LTS
450
+
451
+ * Secure and stable operation!
452
+ {::note}Long Term Support for updates, ready for stable production use{:/note}
453
+ * Less hustle for major update!
454
+ {::note}Advanced announcement for scheduled major update{:/note}
455
+ {::note}Next major update is scheduled in April, 2025 (T.B.D.){:/note}
456
+
457
+ ## note
458
+
459
+ Let's summarize the points of Fluent Package LTS.
460
+
461
+ First, secure and stable operation!
462
+ You can easily continue updating!
463
+
464
+ Second, less hustle for major update!
465
+ We announce the support lifecycle in advance,
466
+ It makes major updates more user-friendly!
467
+ Users doesn't need to be hustle. We hustle!
468
+
469
+ # Agenda
470
+
471
+ * What is Fluentd
472
+ * History of Fluentd
473
+ * What's new Fluent Package LTS
474
+ * **Remarks of updating**
475
+ * Major changes
476
+
477
+ ## note
478
+
479
+ Then, I'm going to take over the rest of presentation.
480
+ I'm mainly contributed to the development of fluent-package, so fit to explain about it.
481
+
482
+ Hearing what he have told, now I'm sure you are ready to use new Fluent Package.
483
+ Now we gonna share some points that what need to be remarked for update.
484
+ Information would be useful.
485
+
486
+ # How to update from \\n td-agent v4
487
+
488
+ * In most cases, you just install Fluent Package! 🎉
489
+ * **Compatible with td-agent v4!**
490
+ * In some cases, manual migration is necessary
491
+
492
+ ## note
493
+
494
+ Many of you might wonder how difficult to update.
495
+ In most cases, you just install Fluent Package!
496
+ Just install it and it is ready to use it!
497
+ See // you can feel how easy it would be to update!
498
+
499
+ But manual migration is still necessary because td-agent can be customizable path in many ways.
500
+ We can't expect the all of migration path, let you manual migration.
501
+
502
+ # Compatibility
503
+
504
+ You can still use ...
505
+
506
+ * your config files as is
507
+ * {::note}/etc/td-agent/td-agent.conf{:/note}
508
+ * commands with their old names
509
+ * {::note}td-agent, td-agent-gem{:/note}
510
+ * td-agent user and group
511
+
512
+ ## note
513
+
514
+ Basically, we take care of keeping compatibility, so if you upgrade from td-agent version 4,
515
+ you can still use old config files, commands, user name and group.
516
+
517
+ If you had ever experienced package development, you know the difficulty of these transitional package.
518
+ The internal path was totally changed and for providing old command, it need to make symbolic link.
519
+ For moving old log files, it need to implement maintainer hook script.
520
+ Using maintainer hook script must be carefully implemented not to break package at all.
521
+ For usability of old log rotate configuration, need to keep old user name and group.
522
+
523
+ If you install newly fluent-package, these compatibility layer is not provided.
524
+
525
+ # Manual migration cases
526
+
527
+ * General case
528
+ * Specific to Linux
529
+ * Specific to Windows
530
+
531
+ {::note}See <https://www.fluentd.org/blog/upgrade-td-agent-v4-to-v5> for details!{:/note}
532
+
533
+ ## note
534
+
535
+ There are 3 kind of manual migration cases.
536
+ general case, for Linux and for Windows.
537
+
538
+ We already published upgrade guide as fluentd's blog article.
539
+
540
+ # Manual migration: general
541
+
542
+ * Manually installed plugins
543
+ * Reinstall those plugins manually
544
+ * Setting of monitoring Fluentd's log file
545
+ * Update the filepath
546
+ {::note}/var/log/fluent/fluentd.log{:/note}
547
+
548
+ ## note
549
+
550
+ In general, if you installed additional plugins, you need to reinstall plugins for fluent-package.
551
+ This is because the plugin path of td-agent is not recognized by fluent-package.
552
+ Recent version of fluent-diagtool (fluentd diagnostic tool) gem supports to detect only list of
553
+ locally installed gems. so it will help to reinstall gems for fluent-package.
554
+
555
+ And you need to update the filepath settings if you monitor Fluentd's log file.
556
+
557
+ # Manual migration: Linux
558
+
559
+ * Environment file
560
+ * {::note}RHEL: /etc/sysconfig/fluentd{:/note}
561
+ * {::note}Debian: /etc/default/fluentd{:/note}
562
+ * Log rotate configuration
563
+ * {::note}/etc/logrotate.d/fluentd{:/note}
564
+ * Systemd unit file
565
+
566
+ ## note
567
+
568
+ For linux, you need to care new path of fluent-package,
569
+ environment file, log rotate configuration and Systemd unit file.
570
+
571
+ # Systemd unit file
572
+
573
+ Update custom unit files (If you use)
574
+
575
+ {::note}e.g. /etc/systemd/system/td-agent.service{:/note}
576
+
577
+ * Update Fluentd bin path
578
+ * {::note}/opt/td-agent/bin/fluentd -> /opt/fluent/bin/fluentd{:/note}
579
+ * Update environmental variables
580
+ * {::note}LD_PRELOAD: /opt/fluent/lib/libjemalloc.so{:/note}
581
+ * {::note}GEM_HOME, GEM_PATH: /opt/fluentd/lib/ruby/gems/3.2.0/{:/note}
582
+
583
+ ## note
584
+
585
+ As for Systemd unit file, if you customized it,
586
+ need to update fluentd binary path and some environment variables too.
587
+
588
+ # Manual migration: Windows
589
+
590
+ * Command line arguments (If you use)
591
+ * Set them again
592
+ {::note}$ fluentd --reg-winsvc-fluentdopt ...{:/note}
593
+ * Automatic start as Windows Service
594
+ * Enable it manually if you need
595
+ {::note}$ sc config fluentdwinsvc start=delayed-auto{:/note}
596
+
597
+ ## note
598
+
599
+ For Windows, if you customized command line arguments, you need set them again because fluent-package installer reset them.
600
+
601
+ And note that since fluent-package version 5, fluentd service does not start automatically.
602
+ There is no merit to start automatically because you need to shape configuration in advance.
603
+
604
+ # Fluentd's log rotation setting on Windows
605
+
606
+ * No longer need to use command line argument, **`--log-rotate-age`**, **`--log-rotate-size`**
607
+ {::note}Since td-agent v4.4.2, you can use system configuration{:/note}
608
+ * Use [system](https://docs.fluentd.org/deployment/logging#log-rotation-setting) configuration
609
+ {::note}https://docs.fluentd.org/deployment/logging#log-rotation-setting{:/note}
610
+
611
+ ## note
612
+
613
+ On Windows, there is one more thing for you.
614
+ It is not limited to fluent-package change, since td-agent version 4.4.2, system directive was supported.
615
+ So you need not to customize command line arguments for log rotate configuration.
616
+ Just use system directive in fluentd configuration.
617
+
618
+ This should make your system maintenance easier because no need to modify log rotation option via command line.
619
+
620
+ We have explained remarked topics about general and platform specific ones.
621
+
622
+ If you had any problem found updating your system, please let us know!
623
+ Fluentd community can support you!
624
+
625
+ # Agenda
626
+
627
+ * What is Fluentd
628
+ * History of Fluentd
629
+ * What's new Fluent Package LTS
630
+ * Remarks of updating
631
+ * **Major changes**
632
+
633
+ ## note
634
+
635
+ We are going to share technical details of new version.
636
+
637
+ # Changes for Fluent Package
638
+
639
+ * Command name
640
+ {::note}If updated from td-agent, you can still use the old name{:/note}
641
+ * td-agent => fluentd, td-agent-gem => fluent-gem
642
+ * Linux: systemd unit name
643
+ {::note}You can still use the old name{:/note}
644
+ * td-agent => fluentd
645
+ * Windows: no automatic start
646
+
647
+ ## note
648
+
649
+ These points were covered in previous section.
650
+ but let me explain again!
651
+
652
+ If updated from td-agent version 4, command name was changed to fluentd or fluent-gem.
653
+ But you can still use the old command line.
654
+
655
+ And name of systemd unit file was also changed to fluentd. you can still use td-agent as alias.
656
+
657
+ On Windows, fluentd service doesn't start automatically.
658
+
659
+ # Improvements
660
+
661
+ * Fluentd: Fix **in_tail** bug
662
+ * Many other improvements!
663
+ {::note}See <https://github.com/fluent/fluentd/blob/master/CHANGELOG.md>!{:/note}
664
+ * Fluent Package: Update embedded **Ruby** to **3.2**
665
+ {::note}from 2.7{:/note}
666
+ * Many other improvements!
667
+ {::note}See <https://github.com/fluent/fluent-package-builder/blob/master/CHANGELOG.md>!{:/note}
668
+
669
+ ## note
670
+
671
+ There are many improvements for fluent-package.
672
+ Remarkable changes are bug fixes of in_tail in Fluentd and update with bundled Ruby version.
673
+
674
+ # Fix in_tail bug
675
+
676
+ ![](images/blog-in_tail.png){:relative-width="100"}
677
+
678
+ {::note}<https://www.fluentd.org/blog/fluentd-v1.16.2-v1.16.3-have-been-released>{:/note}
679
+
680
+ ## note
681
+ This is a screenshot of fluentd release note
682
+
683
+ There was a long standing bug which wrongly stopping tailing in in_tail.
684
+ in_tail is used to collect the appended content of log files.
685
+ This bug was observed time to time, but hard to fix it.
686
+
687
+ # Fix in_tail bug
688
+
689
+ * Finally, the bug is fixed!
690
+ * With **collaboration of many users**, the cause was found, and it is fixed! 🎉
691
+
692
+ ## note
693
+
694
+ That bug was fixed in recent release of Fluentd.
695
+
696
+ With **collaboration of many users**, the cause was found, and it is fixed!
697
+
698
+ He - fukuda and Ashie - No.1 contributor of Fluentd done it!
699
+
700
+ # Fix in_tail bug
701
+
702
+ ![](images/issue4190.png){:relative-width="70"}
703
+
704
+ ## note
705
+
706
+ This is a screenshot of GitHub issue about this bug.
707
+ Feedback from user are very appreciated.
708
+
709
+ ## Slide properties
710
+
711
+ enable-title-on-image
712
+ : false
713
+
714
+ # Fix in_tail bug
715
+
716
+ ![](images/pr4185.png){:relative-width="70"}
717
+
718
+ ## note
719
+
720
+ This is a screenshot of suggested fix.
721
+
722
+ We could fix it with these kind of feedback.
723
+ Without it, I don't know when we could fix it.
724
+
725
+ ## Slide properties
726
+
727
+ enable-title-on-image
728
+ : false
729
+
730
+ # Update embedded Ruby to 3.2
731
+
732
+ * You can try Ruby's performance improvements **YJIT**!
733
+ {::note}<https://docs.fluentd.org/deployment/system-config#enable_jit-experimental>{:/note}
734
+ * It is still experimental in Fluentd
735
+ {::note}Please try it and give us feedback!{:/note}
736
+
737
+ ## note
738
+
739
+ As you know, Ruby 2.7 was reached EOL, so fluent-package bundles Ruby 3.2.
740
+ ruby 3.2 process faster, performance improvements
741
+ you can take advantage of it!
742
+
743
+ Though it is still experimental in Fluentd, but I'm sure you know, you can try YJIT.
744
+ If fluentd developer could collect enough positive feedback, YJIT will be enabled by default in someday.
745
+
746
+ # Fluent Package and future
747
+
748
+ * What happened?
749
+ * What will happen?
750
+
751
+ ## note
752
+
753
+ We have explained current work.
754
+
755
+ And it is important for the community to think about the future.
756
+ In order to plan future, understanding the current position is necessary.
757
+ So, here are some facts from statistic of Fluentd activities.
758
+
759
+ From these statistics, we may see what happened and what will happen.
760
+
761
+ # The fact from statistics (1)
762
+
763
+ * Recent Top 5 requests:
764
+ * {::wait/}United States (44.74%)
765
+ * {::wait/}Netherlands (9%)
766
+ * {::wait/}**Japan (6.79%)**
767
+ * {::wait/}France (5.96%)
768
+ * {::wait/}Ireland (5.58%)
769
+
770
+ ## note
771
+
772
+ First, I'll introduce recent Top 5 requests against td-agent/fluent-package repository on AWS.
773
+
774
+ Most of request comes from United States.
775
+
776
+ and followed by Netherlands, Japan, France and Ireland.
777
+
778
+ In Japan, td-agent/fluent-package are used more than we expected.
779
+
780
+ # The fact from statistics (2)
781
+
782
+ Recent trends:
783
+
784
+ * Top 5 location Before LTS release
785
+
786
+ * United States,Netherlands,Japan,France,Ireland
787
+
788
+ * Top 5 location After LTS release
789
+
790
+ * United States,Netherlands,Japan,France,**Taiwan**
791
+
792
+ ## note
793
+
794
+ Comparing between Before LTS release and After LTS release,
795
+ the access from Taiwan is gradually increased.
796
+
797
+ It is curious but I don't know the reason why.
798
+ If anyone know the reason, please tell us later.
799
+
800
+ # The fact from statistics (3)
801
+
802
+ * The undesirable facts:
803
+ * The majority of td-agent users: 3.x (unmaintained) or 4.x series.
804
+ * There is still an access for 2.x (unmaintained)
805
+
806
+ ## note
807
+
808
+ We have found the undesirable facts.
809
+
810
+ Most of users still use version 3 or version 4.
811
+ version 3 are old-old version!
812
+
813
+ It's surprised because there is still an access for version 2. It's old-old-old stable.
814
+
815
+ # The fact from statistics (4)
816
+
817
+ * The most widely used package:
818
+ * td-agent 4.x (aarch64) for Amazon Linux 2.
819
+
820
+ ## note
821
+
822
+ We found the popular package is td-agent version 4 for Amazon Linux 2.
823
+
824
+ td-agent package is provided for intel architecture, but maybe with cost merit, arm architecture was selected.
825
+
826
+ # The fact from statistics (5)
827
+
828
+ * GitHub Discussions low activity
829
+
830
+ ![](images/github-discussions.png){:relative-height="100"}
831
+
832
+ ## note
833
+
834
+ Currently, GitHub Discussions has low activity.
835
+ Many questions were post, but there is a few number of supporters.
836
+
837
+ So we want to encourage users to help each other.
838
+
839
+ # The future
840
+
841
+ * No more old package users
842
+ * Renewal about distribution channel (Sponsored by CNCF?)
843
+ * Encourage users to be a fluentd supporter
844
+ {::note}Join GitHub discussions!{:/note}
845
+ * Continuous release
846
+
847
+ ## note
848
+
849
+ How do feel about the fact of statistics?
850
+
851
+ First one: We introduced LTS for enterprise use, so don't keep using old packages.
852
+
853
+ Second one: Currently, it aims to more community based development, repository hosting is heavily rely on Treasure Data.
854
+ It's hard to owe Fluentd Project about massive traffic, so we contact to CNCF for sponsoring.
855
+ CNCF is supportive about it.
856
+
857
+ Third one: There is difficulty to get help in timely manner in GitHub discussions, please more and more people join it.
858
+ When fixing for in_tail bug, many people give us feedback, so it is happy if same thing will happen on GitHub Discussions too.
859
+
860
+ Last but not least: Release channel of LTS had just started, we want to keep continuous release.
861
+
862
+ # Wrap up
863
+
864
+ * Interested in and understand Fluent Package LTS!
865
+ * Encouraged switching to fluent-package LTS further more!
866
+ * Encouraged joining Fluentd community!
867
+
868
+ ## note
869
+
870
+ If you feel excited to know Fluent Package LTS and want to use it or want to join Fluentd community,
871
+ very appreciated.
872
+
873
+ Thank you everyone
874
+ We'd love to talk afterwards if you have some feedback.