fluentd 0.12.40 → 0.14.0

Sign up to get free protection for your applications and to get access to all the features.

Potentially problematic release.


This version of fluentd might be problematic. Click here for more details.

Files changed (252) hide show
  1. checksums.yaml +4 -4
  2. data/.github/ISSUE_TEMPLATE.md +6 -0
  3. data/.gitignore +2 -0
  4. data/.travis.yml +33 -21
  5. data/CONTRIBUTING.md +1 -0
  6. data/ChangeLog +810 -237
  7. data/README.md +0 -25
  8. data/Rakefile +2 -1
  9. data/Vagrantfile +17 -0
  10. data/appveyor.yml +35 -0
  11. data/example/filter_stdout.conf +5 -5
  12. data/example/in_forward.conf +2 -2
  13. data/example/in_http.conf +2 -2
  14. data/example/in_out_forward.conf +17 -0
  15. data/example/in_syslog.conf +2 -2
  16. data/example/in_tail.conf +2 -2
  17. data/example/in_tcp.conf +2 -2
  18. data/example/in_udp.conf +2 -2
  19. data/example/out_copy.conf +4 -4
  20. data/example/out_file.conf +2 -2
  21. data/example/out_forward.conf +2 -2
  22. data/example/out_forward_buf_file.conf +23 -0
  23. data/example/v0_12_filter.conf +8 -8
  24. data/fluent.conf +29 -0
  25. data/fluentd.gemspec +18 -11
  26. data/lib/fluent/agent.rb +60 -58
  27. data/lib/fluent/command/cat.rb +1 -1
  28. data/lib/fluent/command/debug.rb +7 -5
  29. data/lib/fluent/command/fluentd.rb +97 -2
  30. data/lib/fluent/compat/call_super_mixin.rb +67 -0
  31. data/lib/fluent/compat/filter.rb +50 -0
  32. data/lib/fluent/compat/formatter.rb +109 -0
  33. data/lib/fluent/compat/input.rb +50 -0
  34. data/lib/fluent/compat/output.rb +617 -0
  35. data/lib/fluent/compat/output_chain.rb +60 -0
  36. data/lib/fluent/compat/parser.rb +163 -0
  37. data/lib/fluent/compat/propagate_default.rb +62 -0
  38. data/lib/fluent/config.rb +23 -20
  39. data/lib/fluent/config/configure_proxy.rb +119 -70
  40. data/lib/fluent/config/dsl.rb +5 -18
  41. data/lib/fluent/config/element.rb +72 -8
  42. data/lib/fluent/config/error.rb +0 -3
  43. data/lib/fluent/config/literal_parser.rb +0 -2
  44. data/lib/fluent/config/parser.rb +4 -4
  45. data/lib/fluent/config/section.rb +39 -28
  46. data/lib/fluent/config/types.rb +2 -13
  47. data/lib/fluent/config/v1_parser.rb +1 -3
  48. data/lib/fluent/configurable.rb +48 -16
  49. data/lib/fluent/daemon.rb +15 -0
  50. data/lib/fluent/engine.rb +26 -52
  51. data/lib/fluent/env.rb +6 -4
  52. data/lib/fluent/event.rb +58 -11
  53. data/lib/fluent/event_router.rb +5 -5
  54. data/lib/fluent/filter.rb +2 -50
  55. data/lib/fluent/formatter.rb +4 -293
  56. data/lib/fluent/input.rb +2 -32
  57. data/lib/fluent/label.rb +2 -2
  58. data/lib/fluent/load.rb +3 -2
  59. data/lib/fluent/log.rb +107 -38
  60. data/lib/fluent/match.rb +0 -36
  61. data/lib/fluent/mixin.rb +117 -7
  62. data/lib/fluent/msgpack_factory.rb +62 -0
  63. data/lib/fluent/output.rb +7 -612
  64. data/lib/fluent/output_chain.rb +23 -0
  65. data/lib/fluent/parser.rb +4 -800
  66. data/lib/fluent/plugin.rb +100 -121
  67. data/lib/fluent/plugin/bare_output.rb +63 -0
  68. data/lib/fluent/plugin/base.rb +121 -0
  69. data/lib/fluent/plugin/buf_file.rb +101 -182
  70. data/lib/fluent/plugin/buf_memory.rb +9 -92
  71. data/lib/fluent/plugin/buffer.rb +473 -0
  72. data/lib/fluent/plugin/buffer/chunk.rb +135 -0
  73. data/lib/fluent/plugin/buffer/file_chunk.rb +339 -0
  74. data/lib/fluent/plugin/buffer/memory_chunk.rb +100 -0
  75. data/lib/fluent/plugin/exec_util.rb +80 -75
  76. data/lib/fluent/plugin/file_util.rb +33 -28
  77. data/lib/fluent/plugin/file_wrapper.rb +120 -0
  78. data/lib/fluent/plugin/filter.rb +51 -0
  79. data/lib/fluent/plugin/filter_grep.rb +13 -40
  80. data/lib/fluent/plugin/filter_record_transformer.rb +22 -18
  81. data/lib/fluent/plugin/formatter.rb +93 -0
  82. data/lib/fluent/plugin/formatter_csv.rb +48 -0
  83. data/lib/fluent/plugin/formatter_hash.rb +32 -0
  84. data/lib/fluent/plugin/formatter_json.rb +47 -0
  85. data/lib/fluent/plugin/formatter_ltsv.rb +42 -0
  86. data/lib/fluent/plugin/formatter_msgpack.rb +32 -0
  87. data/lib/fluent/plugin/formatter_out_file.rb +45 -0
  88. data/lib/fluent/plugin/formatter_single_value.rb +34 -0
  89. data/lib/fluent/plugin/formatter_stdout.rb +39 -0
  90. data/lib/fluent/plugin/in_debug_agent.rb +4 -0
  91. data/lib/fluent/plugin/in_dummy.rb +22 -18
  92. data/lib/fluent/plugin/in_exec.rb +18 -8
  93. data/lib/fluent/plugin/in_forward.rb +36 -79
  94. data/lib/fluent/plugin/in_gc_stat.rb +4 -0
  95. data/lib/fluent/plugin/in_http.rb +21 -18
  96. data/lib/fluent/plugin/in_monitor_agent.rb +15 -48
  97. data/lib/fluent/plugin/in_object_space.rb +6 -1
  98. data/lib/fluent/plugin/in_stream.rb +7 -3
  99. data/lib/fluent/plugin/in_syslog.rb +46 -95
  100. data/lib/fluent/plugin/in_tail.rb +51 -595
  101. data/lib/fluent/plugin/in_tcp.rb +8 -1
  102. data/lib/fluent/plugin/in_udp.rb +8 -14
  103. data/lib/fluent/plugin/input.rb +33 -0
  104. data/lib/fluent/plugin/multi_output.rb +95 -0
  105. data/lib/fluent/plugin/out_buffered_null.rb +59 -0
  106. data/lib/fluent/plugin/out_copy.rb +11 -7
  107. data/lib/fluent/plugin/out_exec.rb +15 -11
  108. data/lib/fluent/plugin/out_exec_filter.rb +18 -10
  109. data/lib/fluent/plugin/out_file.rb +34 -5
  110. data/lib/fluent/plugin/out_forward.rb +19 -9
  111. data/lib/fluent/plugin/out_null.rb +0 -14
  112. data/lib/fluent/plugin/out_roundrobin.rb +11 -7
  113. data/lib/fluent/plugin/out_stdout.rb +5 -7
  114. data/lib/fluent/plugin/out_stream.rb +3 -1
  115. data/lib/fluent/plugin/output.rb +979 -0
  116. data/lib/fluent/plugin/owned_by_mixin.rb +42 -0
  117. data/lib/fluent/plugin/parser.rb +244 -0
  118. data/lib/fluent/plugin/parser_apache.rb +24 -0
  119. data/lib/fluent/plugin/parser_apache2.rb +84 -0
  120. data/lib/fluent/plugin/parser_apache_error.rb +21 -0
  121. data/lib/fluent/plugin/parser_csv.rb +31 -0
  122. data/lib/fluent/plugin/parser_json.rb +79 -0
  123. data/lib/fluent/plugin/parser_ltsv.rb +50 -0
  124. data/lib/fluent/plugin/parser_multiline.rb +102 -0
  125. data/lib/fluent/plugin/parser_nginx.rb +24 -0
  126. data/lib/fluent/plugin/parser_none.rb +36 -0
  127. data/lib/fluent/plugin/parser_syslog.rb +82 -0
  128. data/lib/fluent/plugin/parser_tsv.rb +37 -0
  129. data/lib/fluent/plugin/socket_util.rb +120 -114
  130. data/lib/fluent/plugin/storage.rb +84 -0
  131. data/lib/fluent/plugin/storage_local.rb +116 -0
  132. data/lib/fluent/plugin/string_util.rb +16 -13
  133. data/lib/fluent/plugin_helper.rb +39 -0
  134. data/lib/fluent/plugin_helper/child_process.rb +298 -0
  135. data/lib/fluent/plugin_helper/compat_parameters.rb +99 -0
  136. data/lib/fluent/plugin_helper/event_emitter.rb +80 -0
  137. data/lib/fluent/plugin_helper/event_loop.rb +118 -0
  138. data/lib/fluent/plugin_helper/retry_state.rb +177 -0
  139. data/lib/fluent/plugin_helper/storage.rb +308 -0
  140. data/lib/fluent/plugin_helper/thread.rb +147 -0
  141. data/lib/fluent/plugin_helper/timer.rb +85 -0
  142. data/lib/fluent/plugin_id.rb +63 -0
  143. data/lib/fluent/process.rb +21 -30
  144. data/lib/fluent/registry.rb +21 -9
  145. data/lib/fluent/root_agent.rb +115 -40
  146. data/lib/fluent/supervisor.rb +330 -320
  147. data/lib/fluent/system_config.rb +42 -18
  148. data/lib/fluent/test.rb +6 -1
  149. data/lib/fluent/test/base.rb +23 -3
  150. data/lib/fluent/test/driver/base.rb +247 -0
  151. data/lib/fluent/test/driver/event_feeder.rb +98 -0
  152. data/lib/fluent/test/driver/filter.rb +35 -0
  153. data/lib/fluent/test/driver/input.rb +31 -0
  154. data/lib/fluent/test/driver/output.rb +78 -0
  155. data/lib/fluent/test/driver/test_event_router.rb +45 -0
  156. data/lib/fluent/test/filter_test.rb +0 -1
  157. data/lib/fluent/test/formatter_test.rb +2 -1
  158. data/lib/fluent/test/input_test.rb +23 -17
  159. data/lib/fluent/test/output_test.rb +28 -39
  160. data/lib/fluent/test/parser_test.rb +1 -1
  161. data/lib/fluent/time.rb +104 -1
  162. data/lib/fluent/{status.rb → unique_id.rb} +15 -24
  163. data/lib/fluent/version.rb +1 -1
  164. data/lib/fluent/winsvc.rb +72 -0
  165. data/test/compat/test_calls_super.rb +164 -0
  166. data/test/config/test_config_parser.rb +83 -0
  167. data/test/config/test_configurable.rb +547 -274
  168. data/test/config/test_configure_proxy.rb +146 -29
  169. data/test/config/test_dsl.rb +3 -181
  170. data/test/config/test_element.rb +274 -0
  171. data/test/config/test_literal_parser.rb +1 -1
  172. data/test/config/test_section.rb +79 -7
  173. data/test/config/test_system_config.rb +21 -0
  174. data/test/config/test_types.rb +3 -26
  175. data/test/helper.rb +78 -8
  176. data/test/plugin/test_bare_output.rb +118 -0
  177. data/test/plugin/test_base.rb +75 -0
  178. data/test/plugin/test_buf_file.rb +420 -521
  179. data/test/plugin/test_buf_memory.rb +32 -194
  180. data/test/plugin/test_buffer.rb +981 -0
  181. data/test/plugin/test_buffer_chunk.rb +110 -0
  182. data/test/plugin/test_buffer_file_chunk.rb +770 -0
  183. data/test/plugin/test_buffer_memory_chunk.rb +265 -0
  184. data/test/plugin/test_filter.rb +255 -0
  185. data/test/plugin/test_filter_grep.rb +2 -73
  186. data/test/plugin/test_filter_record_transformer.rb +24 -68
  187. data/test/plugin/test_filter_stdout.rb +6 -6
  188. data/test/plugin/test_in_debug_agent.rb +2 -0
  189. data/test/plugin/test_in_dummy.rb +11 -17
  190. data/test/plugin/test_in_exec.rb +6 -25
  191. data/test/plugin/test_in_forward.rb +112 -151
  192. data/test/plugin/test_in_gc_stat.rb +2 -0
  193. data/test/plugin/test_in_http.rb +106 -157
  194. data/test/plugin/test_in_object_space.rb +21 -5
  195. data/test/plugin/test_in_stream.rb +14 -13
  196. data/test/plugin/test_in_syslog.rb +30 -275
  197. data/test/plugin/test_in_tail.rb +95 -234
  198. data/test/plugin/test_in_tcp.rb +14 -0
  199. data/test/plugin/test_in_udp.rb +21 -13
  200. data/test/plugin/test_input.rb +122 -0
  201. data/test/plugin/test_multi_output.rb +180 -0
  202. data/test/plugin/test_out_buffered_null.rb +79 -0
  203. data/test/plugin/test_out_copy.rb +15 -2
  204. data/test/plugin/test_out_exec.rb +75 -25
  205. data/test/plugin/test_out_exec_filter.rb +74 -8
  206. data/test/plugin/test_out_file.rb +61 -7
  207. data/test/plugin/test_out_forward.rb +92 -15
  208. data/test/plugin/test_out_roundrobin.rb +1 -0
  209. data/test/plugin/test_out_stdout.rb +22 -13
  210. data/test/plugin/test_out_stream.rb +18 -0
  211. data/test/plugin/test_output.rb +515 -0
  212. data/test/plugin/test_output_as_buffered.rb +1540 -0
  213. data/test/plugin/test_output_as_buffered_overflow.rb +247 -0
  214. data/test/plugin/test_output_as_buffered_retries.rb +808 -0
  215. data/test/plugin/test_output_as_buffered_secondary.rb +776 -0
  216. data/test/plugin/test_output_as_standard.rb +362 -0
  217. data/test/plugin/test_owned_by.rb +35 -0
  218. data/test/plugin/test_storage.rb +167 -0
  219. data/test/plugin/test_storage_local.rb +8 -0
  220. data/test/plugin_helper/test_child_process.rb +599 -0
  221. data/test/plugin_helper/test_compat_parameters.rb +175 -0
  222. data/test/plugin_helper/test_event_emitter.rb +51 -0
  223. data/test/plugin_helper/test_event_loop.rb +52 -0
  224. data/test/plugin_helper/test_retry_state.rb +399 -0
  225. data/test/plugin_helper/test_storage.rb +411 -0
  226. data/test/plugin_helper/test_thread.rb +164 -0
  227. data/test/plugin_helper/test_timer.rb +100 -0
  228. data/test/scripts/exec_script.rb +0 -6
  229. data/test/scripts/fluent/plugin/out_test.rb +3 -0
  230. data/test/test_config.rb +13 -4
  231. data/test/test_event.rb +24 -13
  232. data/test/test_event_router.rb +8 -7
  233. data/test/test_event_time.rb +187 -0
  234. data/test/test_formatter.rb +13 -51
  235. data/test/test_input.rb +1 -1
  236. data/test/test_log.rb +239 -16
  237. data/test/test_mixin.rb +1 -1
  238. data/test/test_output.rb +53 -66
  239. data/test/test_parser.rb +105 -323
  240. data/test/test_plugin_helper.rb +81 -0
  241. data/test/test_root_agent.rb +4 -52
  242. data/test/test_supervisor.rb +272 -0
  243. data/test/test_unique_id.rb +47 -0
  244. metadata +180 -54
  245. data/lib/fluent/buffer.rb +0 -365
  246. data/lib/fluent/plugin/filter_parser.rb +0 -107
  247. data/lib/fluent/plugin/in_status.rb +0 -76
  248. data/lib/fluent/test/helpers.rb +0 -86
  249. data/test/plugin/data/log/foo/bar2 +0 -0
  250. data/test/plugin/test_filter_parser.rb +0 -744
  251. data/test/plugin/test_in_status.rb +0 -38
  252. data/test/test_buffer.rb +0 -624
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA1:
3
- metadata.gz: 524485c147140fc4851fdaeab2ac208ae866363a
4
- data.tar.gz: ba754459fd69e611c6930c0ac6307e47474d2503
3
+ metadata.gz: 65c4b02fdf574383246339cf37f879344d1ab8b3
4
+ data.tar.gz: 55cb7dc5dbbc1743dd24372eb227ff4460d05cd4
5
5
  SHA512:
6
- metadata.gz: 722511c8f2827a6a68d4500ffe49ad761886738caed8a4823737b5d162b4cbefaeed4ecce216b144db07f9392df9b2bf4ef40cb1d24a7e750187a58ca6c57af8
7
- data.tar.gz: 11eb85ece55f56692e2ecaea32eb881b9abf9d34c5b6d76358833eb5936a395e0dd080daaea9fa990c95e1b3f4bdf5bd5fbfd1aebb0ff2aac35a29bcd4f43449
6
+ metadata.gz: 6a7f80a460e9578a196f8a125c459013cfea84a96e29ef1c341aedcbc1b0af2e70aedd0fc58d1335d6f364da7d3aa078e0da33d5539ca8d52070ace779589091
7
+ data.tar.gz: 5fcb5d468553b2ca4a692a1ed0fe2e00fc0bc353c858cc505ee93975c9ce6fc9248cf12160262804bac3fb8a4cced363407567ebd147cb1f83c893097a2c3fcb
@@ -0,0 +1,6 @@
1
+ Check [CONTRIBUTING guideline](https://github.com/fluent/fluentd/blob/master/CONTRIBUTING.md) first and here is the list to help us investigate the problem.
2
+
3
+ - fluentd or td-agent version.
4
+ - Environment information, e.g. OS.
5
+ - Your configuration
6
+ - Your problem explanation. If you have an error logs, write it together.
data/.gitignore CHANGED
@@ -21,4 +21,6 @@ test/config/tmp/*
21
21
  make_dist.sh
22
22
  Gemfile.local
23
23
  .ruby-version
24
+ *.swp
24
25
  coverage/*
26
+ .vagrant/
@@ -1,33 +1,45 @@
1
1
  language: ruby
2
+ cache: bundler
2
3
 
3
- rvm:
4
- - 2.0.0
5
- - 2.1
6
- - 2.2.6
7
- - 2.3.3
8
- - 2.4.0
9
- - ruby-head
4
+ # http://rubies.travis-ci.org/
5
+ # See here for osx_image -> OSX versions: https://docs.travis-ci.com/user/languages/objective-c
6
+ matrix:
7
+ include:
8
+ - rvm: 2.1.10
9
+ os: linux
10
+ - rvm: 2.2.5
11
+ os: linux
12
+ - rvm: 2.3.1
13
+ os: linux
14
+ - rvm: ruby-head
15
+ os: linux
16
+ - rvm: 2.1.10
17
+ os: osx
18
+ osx_image: xcode7.3 # OSX 10.11
19
+ - rvm: 2.2.5
20
+ os: osx
21
+ osx_image: xcode7.3 # OSX 10.11
22
+ - rvm: ruby-head
23
+ os: osx
24
+ osx_image: xcode 7.3 # OSX 10.11
25
+ allow_failures:
26
+ - rvm: ruby-head
10
27
 
11
- os:
12
- - linux
13
- - osx
28
+ # no valid version/env for ruby 2.3 right now
29
+ # - rvm: 2.3.0
30
+ # os: osx
31
+ # osx_image: ....
14
32
 
15
33
  branches:
16
34
  only:
17
35
  - master
36
+ - v0.10
18
37
  - v0.12
19
38
  - v0.14
20
39
 
21
- gemfile:
22
- - Gemfile
23
-
24
- script: bundle exec rake
25
-
26
40
  sudo: false
27
41
 
28
- matrix:
29
- allow_failures:
30
- - rvm: ruby-head
31
- exclude:
32
- - rvm: 2.2.6
33
- os: osx
42
+ addons:
43
+ apt:
44
+ packages:
45
+ - libgmp3-dev
@@ -20,6 +20,7 @@ submitting an issue to Fluentd. Even better you can submit a Pull Request with a
20
20
  * **Documentation**: Use [fluentd-docs](https://github.com/fluent/fluentd-docs) repository.
21
21
 
22
22
  If you find a bug of 3rd party plugins, please submit an issue to each plugin repository.
23
+ And use [omnibus-td-agent](https://github.com/treasure-data/omnibus-td-agent) repository for td-agent releated issues.
23
24
 
24
25
  ## Patch Guidelines
25
26
 
data/ChangeLog CHANGED
@@ -1,247 +1,114 @@
1
- # v0.12
2
-
3
- ## Release 0.12.40 - 2017/08/25
4
-
5
- ### Bug fixes
6
-
7
- * record_transformer: Don't create new keys if the original record doesn't have `keep_keys` keys
8
- https://github.com/fluent/fluentd/pull/1663
9
- * in_tail: Fix the error when 'tag *' is configured.
10
- https://github.com/fluent/fluentd/pull/1664
11
- * plugin: Fix load order to avoid file not found when plugins have own native extension
12
- https://github.com/fluent/fluentd/pull/1670
13
-
14
- ## Release 0.12.39 - 2017/07/14
15
-
16
- ### Bug fixes
17
-
18
- * log: Revert 0.12.38 changes to avoid shutdown stuck
19
- https://github.com/fluent/fluentd/pull/1631
20
- https://github.com/fluent/fluentd/pull/1632
21
-
22
- ## Release 0.12.38 - 2017/07/13
23
-
24
- ### New features / Enhancement
25
-
26
- * in_syslog: Add Add allow_without_priority and default_priority parameters
27
- https://github.com/fluent/fluentd/pull/1608
28
- * in_syslog: More characters are available in tag part of syslog format
29
- https://github.com/fluent/fluentd/pull/1609
30
- * in_syslog: Add resolve_hostname and source_address_key parameters
31
- https://github.com/fluent/fluentd/pull/1615
32
- * filter_grep: Support new configuration format by config_section
33
- https://github.com/fluent/fluentd/pull/1627
34
-
35
- ### Bug fixes
36
-
37
- * log: Capture more fluentd log events during shutdown
38
- https://github.com/fluent/fluentd/pull/1618
39
- https://github.com/fluent/fluentd/pull/1625
40
-
41
- ## Release 0.12.37 - 2017/06/21
42
-
43
- ### New features / Enhancement
44
-
45
- * parser: Add rfc5424 regex without priority
46
- https://github.com/fluent/fluentd/pull/1601
47
-
48
- ### Bug fixes
49
-
50
- * in_tail: fix timing issue that the excluded_path doesn't apply.
51
- https://github.com/fluent/fluentd/pull/1597
52
- * in_tail: Detach watchers before updating watcher to avoid broken pos file
53
- https://github.com/fluent/fluentd/pull/1598
54
-
55
- ## Release 0.12.36 - 2017/05/24
56
-
57
- ### New features / Enhancement
58
-
59
- * config: Allow null byte in double-quoted string
60
- https://github.com/fluent/fluentd/pull/1552
61
- * parser: Support %iso8601 special case for time_format
62
- https://github.com/fluent/fluentd/pull/1562
63
- * in_tail: Add ignore_repeated_permission_error parameter
64
- https://github.com/fluent/fluentd/pull/1574
65
-
66
- ### Bug fixes
67
-
68
- * in_monitor_agent: Enable in_monitor_agent to find plugin type from its class
69
- https://github.com/fluent/fluentd/pull/1564
70
- * Ruby 2.4 warns to forward private methods
71
- https://github.com/fluent/fluentd/pull/1579
72
- * log: Add missing '<<' method to delegators
73
- https://github.com/fluent/fluentd/pull/1558
74
-
75
- ## Release 0.12.35 - 2017/04/19
76
-
77
- ### Bug fixes
78
-
79
- * in_http: Fix X-Forwarded-For header handling. Accpet multiple headers
80
- https://github.com/fluent/fluentd/pull/1535
81
- * in_tail: Do not warn that directories are unreadable
82
- https://github.com/fluent/fluentd/pull/1540
1
+ # v0.14
83
2
 
84
- ## Release 0.12.34 - 2017/03/25
3
+ ## Release 0.14.0 - 2016/05/25
85
4
 
86
5
  ### New features / Enhancement
87
6
 
88
- * in_syslog/in_udp/in_tcp: Fix hostname lookup and unify parameter name to source_hostname_key
89
- https://github.com/fluent/fluentd/pull/1515
90
- * in_http: Support application/msgpack header
91
- https://github.com/fluent/fluentd/pull/1506
92
-
93
- ### Bug fixes
94
-
95
- * engine: Label's plugins should be flushed when receive signal
96
- https://github.com/fluent/fluentd/pull/1508
97
-
98
- ## Release 0.12.33 - 2017/03/09
99
-
100
- ### New features / Enhancement
101
-
102
- * parser_syslog: Backport 'Support rfc5424 syslog format'
103
- https://github.com/fluent/fluentd/pull/1495
104
- * in_forward: Add source_address_key and fix source_hostname_key parameters
105
- https://github.com/fluent/fluentd/pull/1490
106
- * in_tail: Skip directories when use **/* in path
107
- https://github.com/fluent/fluentd/pull/1464
108
- * in_tail: Add limit_recently_modified parameter to limit watching files
109
- https://github.com/fluent/fluentd/pull/1474
110
- * in_tail: Skip the refresh of watching list on startup
111
- https://github.com/fluent/fluentd/pull/1487
112
- * parser: Allow escape sequence in Apache access log
113
- https://github.com/fluent/fluentd/pull/1479
114
- * log: Add Fluent::Log#<< to support some SDKs
115
- https://github.com/fluent/fluentd/pull/1478
116
-
117
- ### Bug fixes
118
-
119
- * config: Set encoding forcefully to avoid UndefinedConversionError
120
- https://github.com/fluent/fluentd/pull/1477
121
-
122
- ## Release 0.12.32 - 2017/02/02
123
-
124
- ### New features / Enhancement
125
-
126
- * formatter: Port add_newline parameter to v012
127
- https://github.com/fluent/fluentd/pull/1447
128
- * record_transformer: remove_keys processing should be last
129
- https://github.com/fluent/fluentd/pull/1433
130
- * in_tail: Capture unmatched lines
131
- https://github.com/fluent/fluentd/pull/1421
132
- * in_monitor_agent: Port #1393 to v0.12 for with_ivars query paretemer
133
- https://github.com/fluent/fluentd/pull/1402
134
- * in_monitor_agent: Port #1387 to v0.12 for retry field
135
- https://github.com/fluent/fluentd/pull/1387
136
- * Allow msgpack-ruby v1
137
-
138
- ### Bug fixes
139
-
140
- * in_exec: Ensure to sleep for prevending fork bomb
141
- https://github.com/fluent/fluentd/pull/1348
142
-
143
- ## Release 0.12.31 - 2016/12/14
144
-
145
- ### New features / Enhancement
146
-
147
- * output: Add slow_flush_log_threshold parameter
148
- https://github.com/fluent/fluentd/pull/1366
149
- * formatter_csv: Change fields parameter to required. Now accepts both a,b and ["a", "b"]
150
- https://github.com/fluent/fluentd/pull/1361
151
- * in_syslog: Add "priority_key" and "facility_key" parameters
152
- https://github.com/fluent/fluentd/pull/1351
153
-
154
- ## Release 0.12.30 - 2016/12/01
155
-
156
- ### New features / Enhancement
157
-
158
- * in_tail: Optimize to split lines
159
- https://github.com/fluent/fluentd/pull/1325
160
- * in_monitor_agent: Port #1317 changes
161
- https://github.com/fluent/fluentd/pull/1317
162
- * filter_parser: Add emit_invalid_record_to_error parameter
163
- https://github.com/fluent/fluentd/pull/1339
164
- * test: Add v0.14 compatible test helpers
165
- https://github.com/fluent/fluentd/pull/1322
166
-
167
- ### Bug fixes
168
-
169
- * Use compat mode instead of stric mode for oj
170
- https://github.com/fluent/fluentd/pull/1304
171
- * Port #1331 changes for oj
172
- https://github.com/fluent/fluentd/pull/1331
173
-
174
- ## Release 0.12.29 - 2016/09/05
175
-
176
- ### New features / Enhancement
177
-
178
- * in_tail: Add from_encoding parameter
179
- https://github.com/fluent/fluentd/pull/1067
180
- * filter: Port parser filter to v0.12
181
- https://github.com/fluent/fluentd/pull/1203
182
- * config: New config_param options to specify deprecated/obsoleted parameters
183
- https://github.com/fluent/fluentd/pull/1186
184
-
185
- ### Bug fixes
186
-
187
- * config: fix to raise ConfigError for type missing, and its tests
188
- https://github.com/fluent/fluentd/pull/1202
189
- * filter_record_transformer: Fix to prevent overwriting reserved placeholder keys such as tag
190
- https://github.com/fluent/fluentd/pull/1176
191
-
192
- ## Release 0.12.28 - 2016/08/14
193
-
194
- ### New features / Enhancement
195
-
196
- * in_forward: Add source_hostname_key parameter
197
- https://github.com/fluent/fluentd/pull/807
198
-
199
- ### Bug fixes
200
-
201
- * parser: Ensure strict mode is used for Oj parser
202
- https://github.com/fluent/fluentd/pull/1147
203
-
204
- ## Release 0.12.27 - 2016/08/03
205
-
206
- ### New features / Enhancement
207
-
208
- * config: Add simplified syntax for hash and array
209
- https://github.com/fluent/fluentd/pull/939
210
- * config: Add include support for Ruby DSL
211
- https://github.com/fluent/fluentd/pull/950
212
- * in_http: Add support of X-Forwarded-For header
213
- https://github.com/fluent/fluentd/pull/1051
214
- * in_syslog: Add message_length_limit option to receive longer udp syslog messages
215
- https://github.com/fluent/fluentd/pull/1128
216
-
217
- ### Bug fixes
218
-
219
- * test: Fix test for TimeSlicedOutput
220
- https://github.com/fluent/fluentd/pull/941
221
- * example: Use `@type` in example confs
222
- https://github.com/fluent/fluentd/pull/1043
223
- * Fix regression of fluent-debug command
224
- https://github.com/fluent/fluentd/pull/1046
225
- * config: Fix wrong message for unsupported parameter
226
- https://github.com/fluent/fluentd/pull/1132
227
-
228
- ## Release 0.12.26 - 2016/05/30
7
+ This list includes changes of 0.14.0.pre.1 and release candidates.
8
+
9
+ * Update supported Ruby version to 2.1 or later
10
+ https://github.com/fluent/fluentd/pull/692
11
+ * Sub-second event time support
12
+ https://github.com/fluent/fluentd/pull/653
13
+ * Windows support and supervisor improvement
14
+ https://github.com/fluent/fluentd/pull/674
15
+ https://github.com/fluent/fluentd/pull/831
16
+ https://github.com/fluent/fluentd/pull/880
17
+ * Add New plugin API
18
+ https://github.com/fluent/fluentd/pull/800
19
+ https://github.com/fluent/fluentd/pull/843
20
+ https://github.com/fluent/fluentd/pull/866
21
+ https://github.com/fluent/fluentd/pull/905
22
+ https://github.com/fluent/fluentd/pull/906
23
+ https://github.com/fluent/fluentd/pull/917
24
+ https://github.com/fluent/fluentd/pull/928
25
+ https://github.com/fluent/fluentd/pull/943
26
+ https://github.com/fluent/fluentd/pull/964
27
+ https://github.com/fluent/fluentd/pull/965
28
+ https://github.com/fluent/fluentd/pull/972
29
+ https://github.com/fluent/fluentd/pull/983
30
+ * Add standard chunking format
31
+ https://github.com/fluent/fluentd/pull/914
32
+ * Add Compatibility layer for v0.12 plugins
33
+ https://github.com/fluent/fluentd/pull/912
34
+ https://github.com/fluent/fluentd/pull/969
35
+ https://github.com/fluent/fluentd/pull/974
36
+ https://github.com/fluent/fluentd/pull/992
37
+ https://github.com/fluent/fluentd/pull/999
38
+ * Add Plugin Storage API
39
+ https://github.com/fluent/fluentd/pull/864
40
+ https://github.com/fluent/fluentd/pull/910
41
+ * Enforce to use router.emit instead of Engine.emit
42
+ https://github.com/fluent/fluentd/pull/883
43
+ * log: Show plugin name and id in logs
44
+ https://github.com/fluent/fluentd/pull/860
45
+ * log: Dump configurations with v1 syntax in logs
46
+ https://github.com/fluent/fluentd/pull/867
47
+ * log: Dump errors with class in logs
48
+ https://github.com/fluent/fluentd/pull/899
49
+ * config: Add simplified syntax for configuration values of hash and array
50
+ https://github.com/fluent/fluentd/pull/875
51
+ * config: Add 'init' option to config_section to initialize section objects
52
+ https://github.com/fluent/fluentd/pull/877
53
+ * config: Support multiline string in quoted strings
54
+ https://github.com/fluent/fluentd/pull/929
55
+ * config: Add optional arguments on Element#elements to select child elements
56
+ https://github.com/fluent/fluentd/pull/948
57
+ * config: Show deprecated warnings for reserved parameters
58
+ https://github.com/fluent/fluentd/pull/971
59
+ * config: Make the detach process forward interval configurable
60
+ https://github.com/fluent/fluentd/pull/982
61
+ * in_tail: Add 'path_key' option to inject tailing path
62
+ https://github.com/fluent/fluentd/pull/951
63
+ * Remove in_status plugin
64
+ https://github.com/fluent/fluentd/pull/690
229
65
 
230
66
  ### Bug fixes
231
67
 
232
- * Fix regression of not require sigdump
68
+ * config: Enum list must be of symbols
69
+ https://github.com/fluent/fluentd/pull/821
70
+ * config: Fix to dup values in default
71
+ https://github.com/fluent/fluentd/pull/827
72
+ * config: Fix problems about overwriting subsections
73
+ https://github.com/fluent/fluentd/pull/844
74
+ https://github.com/fluent/fluentd/pull/981
75
+ * log: Serialize Fluent::EventTime as Integer in JSON
76
+ https://github.com/fluent/fluentd/pull/904
77
+ * out_forward: Add missing error class and tests for it
78
+ https://github.com/fluent/fluentd/pull/922
79
+
80
+ ### Internal fix / Refactoring
81
+
82
+ * Fix dependencies between files
83
+ https://github.com/fluent/fluentd/pull/799
84
+ https://github.com/fluent/fluentd/pull/808
85
+ https://github.com/fluent/fluentd/pull/823
86
+ https://github.com/fluent/fluentd/pull/824
87
+ https://github.com/fluent/fluentd/pull/825
88
+ https://github.com/fluent/fluentd/pull/826
89
+ https://github.com/fluent/fluentd/pull/828
90
+ https://github.com/fluent/fluentd/pull/859
91
+ https://github.com/fluent/fluentd/pull/892
92
+ * Separate PluginId from config
93
+ https://github.com/fluent/fluentd/pull/832
94
+ * Separate MessagePack factory from Engine
95
+ https://github.com/fluent/fluentd/pull/871
96
+ * Register plugins to registry
97
+ https://github.com/fluent/fluentd/pull/838
98
+ * Move TypeConverter mixin to mixin.rb
99
+ https://github.com/fluent/fluentd/pull/842
100
+ * Override default configurations by <system>
101
+ https://github.com/fluent/fluentd/pull/854
102
+ * Suppress Ruby level warnings
103
+ https://github.com/fluent/fluentd/pull/846
104
+ https://github.com/fluent/fluentd/pull/852
105
+ https://github.com/fluent/fluentd/pull/890
106
+ https://github.com/fluent/fluentd/pull/946
107
+ https://github.com/fluent/fluentd/pull/955
108
+ https://github.com/fluent/fluentd/pull/966
233
109
 
234
- ## Release 0.12.25 - 2016/05/25
235
110
 
236
- ### New features / Enhancement
237
-
238
- * process: Add detach_process_forward_interval parameter to control emit interval
239
- https://github.com/fluent/fluentd/pull/982
240
-
241
- ### Bug fixes
242
-
243
- * Fix string-scrub dependency for ruby 2.0 or earlier support
244
- https://github.com/fluent/fluentd/pull/986
111
+ # v0.12
245
112
 
246
113
  ## Release 0.12.24 - 2016/05/20
247
114
 
@@ -390,7 +257,6 @@
390
257
  * filter_record_transformer: Don't use popular name to prevent field overwrite when enable_ruby is true
391
258
  https://github.com/fluent/fluentd/pull/687
392
259
 
393
-
394
260
  ## Release 0.12.16 - 2015/09/30
395
261
 
396
262
  ### New features / Enhancement
@@ -663,4 +529,711 @@ Here is the announcement for above new features: http://www.fluentd.org/blog/flu
663
529
  * out_file: Don't create world writable directory in daemon mode
664
530
  https://github.com/fluent/fluentd/pull/483
665
531
 
666
- See https://github.com/fluent/fluentd/blob/v0.10/ChangeLog for v0.10 changelog
532
+ # v0.10
533
+
534
+ Release 0.10.57 - 2014/11/13
535
+
536
+ * buffer: Make `total_queued_chunk_size` thread-safe to avoid race condition with `in_monitor_agent`
537
+ https://github.com/fluent/fluentd/pull/469
538
+ * Add `--no-supervisor` option to disable the supervisor for supervision tools like runit
539
+ https://github.com/fluent/fluentd/pull/449
540
+
541
+ 0.10.57 was a bug fix release.
542
+
543
+ Release 0.10.56 - 2014/10/31
544
+
545
+ * config: Add Fluent::Config::Section#object_id to avoid NoMethodError by object dump tools
546
+ https://github.com/fluent/fluentd/pull/460
547
+ * mixin: Fix SetTagKeyMixin and SetTimeKeyMixin which ignores config_set_default since 0.10.53
548
+ https://github.com/fluent/fluentd/pull/462
549
+ * input/output: Support 'timezone' configuration parameter (e.g. "+09:00" for JST)
550
+ https://github.com/fluent/fluentd/pull/430
551
+ * log: Use plugin_id instead of object_id in log message for consistency with in_monitor_agent
552
+ https://github.com/fluent/fluentd/pull/459
553
+
554
+ Release 0.10.55 - 2014/10/16
555
+
556
+ * config: Change v1's non-quoted string literal behaviour to v0's behaviour
557
+ https://github.com/fluent/fluentd/pull/436
558
+ * config: Relax '@' handling in the plugin configuration for backward compatibility
559
+ https://github.com/fluent/fluentd/pull/455
560
+ * config: Add --use-v0-config for keeping old configuration
561
+ https://github.com/fluent/fluentd/pull/434
562
+ * config: Add single quoted literal in v1 configuration
563
+ https://github.com/fluent/fluentd/pull/437
564
+ * config: Improve error message of Array / Hash parse error
565
+ https://github.com/fluent/fluentd/pull/457
566
+ * input: Reduce shutdown time in some network related plugins when use Cool.io 1.2
567
+ https://github.com/fluent/fluentd/pull/440
568
+ * parser: Use ParserError instead of general exception classes
569
+ https://github.com/fluent/fluentd/pull/453
570
+ * Remove unused zfile buffer plugin
571
+ https://github.com/fluent/fluentd/pull/445
572
+
573
+ Release 0.10.54 - skipped
574
+
575
+ Release 0.10.53 - 2014/08/21
576
+
577
+ * in_tail: Fix forget to detach Closer timer object
578
+ * in_debug_agent: Fix config_param type of unix_path
579
+ * in_syslog: Add include_source_host and source_host_Key options
580
+ * config: Dump V1 escaped parameter correctly at start phase
581
+ * config: Fix bug for config_param of bool value without defaults
582
+ * config: Add 'alias' option to config_section and config_param
583
+ * buffer: Add 'disable_retry_limit' option
584
+ * engine: Reduce memory usage when retry_limit is large
585
+ * parser: Add apache_error format
586
+ * supervisor: Dump Fluentd version at dry run mode
587
+ * test: InputTestDriver wait 'run' until input plugin emits all test data
588
+
589
+ Release 0.10.52 - 2014/07/15
590
+
591
+ * in_tail: Fix typo of warning argument. lb to line
592
+ * config: Fix 'uninitialized constant Fluent::Config::V1Parser::URI' error
593
+ * config: Reject '@' prefix of parameter name in V1 configuration. @ is reserved prefix.
594
+ * config; Accept '#' comment in array and hash types
595
+ * parser: Add time_format option to SyslogParser
596
+ * parser: SyslogParser now makes ':' optional after pid
597
+ * process: Fix 'mutex can't lock' issue of DetachMultiProcessMixin on Ruby 2.x
598
+ * Add --without-source option to ignore <source> sections
599
+
600
+ Release 0.10.51 - 2014/07/04
601
+
602
+ * in_tail: Fix rotation handling when new file not found
603
+ * in_syslog: Change debug log level to warn at pattern mismatch
604
+ * formatter: Use localtime by default
605
+ * parser: Add SyslogParser
606
+ * parser: Add "estimate_current_event" attribute to TextParsers not to set current time into parse result
607
+ * config: Add <system> section to set core parameters via configuration file
608
+ * test: Support v1 configuration in TestDriver
609
+ * Add udp and tcp input plugins
610
+
611
+ Release 0.10.50 - 2014/06/17
612
+
613
+ * in_tail: Fix race condition at shutdown
614
+ * in_tail: read_from_head now works without pos_file
615
+ * in_tail: Fix multiline format parsing without format_firstline
616
+ * formatter: Add add_newline option to SingleValueFormatter
617
+ * parser: Add block based API to support multi-events parsing
618
+ * config: Fix encoding mismatch when @include used in v1
619
+ * engine: Serialize shutdown order. Now shutdown input plugins first
620
+ * Update rspec to 3.x
621
+
622
+ Release 0.10.49 - 2014/06/05
623
+
624
+ * in_http: Add format option to support various input data format
625
+ * in_http: Accept json / msgpack array in default format
626
+ * in_tail: Print warning message when file not exist with 'read_from_head true'
627
+ * out_file: Add append option to disable path increment
628
+ * out_file: Add format option to support various output data format
629
+ * config: Fix broken 'include' processing in V1 configuration. Now add @include
630
+ * fluentd-debug: Fix undefined method 'usage' error when invalid option passed
631
+ * supervisor: Fix incorrect --group option handling
632
+ * Add TextFormatter module for output plugins
633
+
634
+ Release 0.10.48 - 2014/05/18
635
+
636
+ * config: Add inspect method to Section for dumping the status
637
+ * test: Fix the regression which forget to initialize $log in fluent/test.rb
638
+ * Engine: Remove undocumented legacy plugin load mechanizm
639
+
640
+ Release 0.10.47 - 2014/05/15
641
+
642
+ * in_tail: Fix typo in flush_buffer
643
+ * in_forward: Add chunk_size_warn_limit and chunk_size_limit for large chunks
644
+ * in_monitor_agent: Add /api/config APIs to expose Fluentd configurations
645
+ * supervisor: Add Supervisor.default_options to return default Fluentd options
646
+ * test: Add DummyLogDevise and improve log handling in tests
647
+ * config: Allow empty string value like `tag_mapped` in v1 configuration
648
+
649
+ Release 0.10.46 - 2014/04/21
650
+
651
+ * in_tail: Fix typo in rescue for dumping backtrace
652
+ * in_forward: Add blocking_timeout option to avoid Cool.io loop stuck in shutdown
653
+ * out_forward: Add phi_failure_detector option to disable "The Phi accrual failure detector"
654
+ * buf_memory: Add flush_at_shutdown option to discard buffered event at shutdown
655
+ * parser: Use Engine.now when time_key is missing in ValuesParser
656
+ * parser: TextParser loads fluent/plugin/parser_xxx.rb automatically when 'xxx' format not found
657
+ * Fix match cache expiration
658
+ * Add new v1 configuration format and --use-v1-config option to enable v1 configuration format
659
+ * Add config_section to Configurable to support nested parameters in plugins
660
+ * Relax http_parser.rb gem version to support 0.6 series
661
+
662
+ Release 0.10.45 - 2014/03/28
663
+
664
+ * in_tail: Merge in_tail_ex and in_tail_multiline features
665
+ * in_forward: Add linger_timeout option
666
+ * out_exec: Support json and msgpack format
667
+ * Engine: Fix signal handling when receives SIGTERM before loop starts
668
+ * Use correct out_forward option in fluent.conf with --setup option
669
+ * Ignore sigdump exception on signal unsupported environment
670
+
671
+ Release 0.10.44 - 2014/02/26
672
+
673
+ * in_forward: Print remote address and port in trace log
674
+ * Remove several methods from fluentd-debug to call remote object method directly
675
+ * Add --gemfile option to manage Fluentd and plugins using Gemfile and Bundler
676
+ * Add <include path /> directive to include the configuration file under the elements
677
+ * Add 'ruby' keyword to call Kernel method in configuration DSL
678
+ * Relax Cool.io gem version to allow 1.2.x
679
+
680
+ Release 0.10.43 - 2014/02/03
681
+
682
+ * Input/Output: Add 'log_level' option to plugins
683
+ * parser/in_tail: Fix RegexpParser forget to call configure method
684
+ * parser/in_tail: Improve type conversion performance
685
+ * in_http: Add add_http_headers option to add HTTP headers to record
686
+ * Buffer: Improve submit_buffer throughput using round-robin writer selection
687
+ * add sigdump gem to dump useful information via SIGCONT
688
+
689
+ Release 0.10.42 - 2013/12/25
690
+
691
+ * parser/in_tail: Add 'types' and related parameters to convert record value type
692
+ * in_syslog: Add 'protocol_type' option for TCP support.
693
+ * Buffer: Extract 'storable?' method for hook judge mechanizm by 3rd-party buffer plugins.
694
+ * Output: Add 'try_flush_interval' parameter for high frequency flush.
695
+ It is undocumented because almost users never need this feature.
696
+ * Change configuration unused checking to prevent memory leak when a plugin accesses configuratino keys.
697
+
698
+ Release 0.10.41 - 2013/12/05
699
+
700
+ * BufferedOutput: Add 'max_retry_wait' to limit retry interval
701
+ * in_exec/object_space/syslog: Improve emit error message
702
+ * Log: Add --suppress-repeated-stacktrace option to prevent log size explosion
703
+
704
+ Release 0.10.40 - 2013/11/08
705
+
706
+ * Dump gem version of fluent-plugin-xxx and fluent-mixin-xxx
707
+ * in_http: Doesn't set REMOTE_ADDR when IO#getpeername failed
708
+ * in_tail/parser: Fix RegexpParser which ignores time_format parameter
709
+ * in_exec: Catch error and dumps error message in run_periodic
710
+ * in_forward: Show error class in the error message
711
+ * in_exec/out_exec_filter: Catch more exceptions, not only Errno::ESRCH, at shutdown
712
+ * Log: Catch exception for log event handling at shutdown
713
+
714
+ Release 0.10.39 - 2013/09/18
715
+
716
+ * out_file: Improve symlink handling with buf_file
717
+ * out_copy: Add deep_copy parameter for actual record copy
718
+ * in_tail/parser: Add none format for supporting non-parse tailing like fluent-agent-lite
719
+ * in_tail/parser: Improve performance using parsed time caching
720
+ * Engine: Fix signal related exception in trap context at Ruby 2.0
721
+ * buffer: Fix race condition when remove flushed chunk
722
+ * add --suppress-config-dump option to disable dump configuration at start
723
+
724
+ Release 0.10.38 - 2013/08/29
725
+
726
+ * Fix require related problem in running test
727
+
728
+ Release 0.10.37 - 2013/08/29
729
+
730
+ * in_exec: Add format option to support tsv, json and msgpack. Default is tsv
731
+ * out_stdout: Add output_type to print non-jsonable object
732
+ * Engine: Skip nil record in emit
733
+ * Check buffere_path duplication across buffer configurations.
734
+ * Add experimental DSL to configuration format
735
+
736
+ Release 0.10.36 - 2013/07/31
737
+
738
+ * Log: add class name on each error logs
739
+ * out_foward: change log level of node detachment/recovering/standby-failover from info to warn
740
+ * out_file: add symlink_path parameter to point to latest written file
741
+ * in_forward, in_http, in_unix: add backlog parameter to change resource backlog size
742
+ * add --dry-run option to check fluentd setup without actual run
743
+ * Fluentd now assumes configuration file written in UTF-8
744
+ * update cool.io version to 1.1.1
745
+
746
+ Release 0.10.35 - 2013/06/12
747
+
748
+ * Log: emits fluentd's log via background thread
749
+ * Log: use #inspect for non to_msgpack-able object in log event processing
750
+ * FailureDetector/out_forward: fixed wrong phi calculation
751
+ * in_stream: fixed unix domain connection leak when parsing json or msgpack failed
752
+ * buf_file/out_file: sets 0644 permission to each created file for preventing
753
+ File.umask(0) effect at daemonize mode
754
+
755
+ Release 0.10.34 - 2013/06/03
756
+
757
+ * fluentd: supports --emit-error-log-interval to suppress log messages with the
758
+ same message for a certain seconds
759
+ * BufferedOutput: fixed warning messages so that errors with the same meaning
760
+ use the same message
761
+ * Log: ignores ThreadError which could happen in signal handler
762
+ * Engine: prevents signal handlers from calling stop() method of plugins twice
763
+ * MessagePackEventStream/in_forward: doesn't cache MessagePack::Unpacker (if
764
+ it uses msgpack-0.5.5 which doesn't cause performance impact) to not cause
765
+ problems with out_copy
766
+ * TextParser/in_tail,in_syslog: 'json' format type removes time key from records
767
+ * TextParser/in_tail,in_syslog: raises exception if time_format is set while
768
+ time_key is not set
769
+ * in_tail: fixed minor bugs
770
+
771
+
772
+ Release 0.10.33 - 2013/03/28
773
+
774
+ * added in_monitor_agent
775
+ * switched from jeweler to bundler
776
+ * updated dependency for msgpack from '~> 0.4.4' to '~> 0.4.4 OR ~> 0.5.4'
777
+ * added PluginId module so that in_monitor_agent can search plugins by id
778
+ * BufferedOutput: added queued_chunk_flush_interval option to insert delay
779
+ time before flushing queued chunks
780
+ * BufferedOutput: randomize retry interval to prevent multiple servers from
781
+ bursting network traffic at the same time
782
+ * Configurable: sets @config instance variable
783
+
784
+
785
+ Release 0.10.32 - 2013/03/04
786
+
787
+ * in_tail: fixed the nil error problem which occurs with pos_file option
788
+ * TextParser/in_tail: supports 'ltsv' (Labeled Tab-Separated Values) format: http://ltsv.org
789
+ * #105: TextParser/in_tail: fixed 'nginx' format
790
+ * #102: show log level in log messages
791
+ * Gemfile: uses https source of rubygems instead of http
792
+
793
+
794
+ Release 0.10.31 - 2013/01/31
795
+
796
+ * out_forward: supports TCP heartbeat
797
+ * in_tail reads rotated files from its head rather than its end when pos_file option is set
798
+ * out_/in_ forward set O_NONBLOCK flag to the UDP heartbeat socket
799
+ * Improved match cache expiration algorithm
800
+
801
+
802
+ Release 0.10.30 - 2012/12/06
803
+
804
+ * Shows configuration file at start time
805
+ * Changed ruby version dependency from ~> 1.9.2 to => 1.9.2 so that it works
806
+ with ruby-2.0.
807
+ * TimeSlicedOutput: overwrites default value of buffer_chunk_limit to 256m.
808
+ fluent-plugin-s3 will be affected.
809
+ * TextParser/in_tail: supports 'nginx' preset formats
810
+ * in/out_forward and in_syslog: support IPv6
811
+ * out_forward: fixed a out of bounds bug
812
+
813
+
814
+ Release 0.10.29 - 2012/11/26
815
+
816
+ * buf_file: added flush_at_shutdown option to force flush before shuttingdown
817
+ * TextParser shows message in warn level if text doesn't match the pattern
818
+
819
+
820
+ Release 0.10.28 - 2012/10/30
821
+
822
+ * in_http: on_request method can get headers as HTTP_* key and remote address
823
+ as REMOTE_ADDR key of the params argument
824
+
825
+
826
+ Release 0.10.27 - 2012/10/11
827
+
828
+ * added BufferChunk#unique_id which is an unique identifier of a buffered chunk
829
+ * BufferedOutput: show 'temporarily failed' message
830
+
831
+
832
+ Release 0.10.26 - 2012/09/26
833
+
834
+ * added in_debug_agent plugin and fluent-debug command which enable you to
835
+ gather internal information of running Fluentd process using interactive shell
836
+ * supervisor: --user commandline argument also inherits secondary groups (id -G)
837
+ * out_forward: supports 'expire_dns_cache' option to set DNS expire time or disable
838
+ caching. Default behavior is 'never expire' which is same as former versions
839
+ * out_forward: assumes successful data transfer via TCP as a successful
840
+ heartbeat.
841
+ * out_forward: lazier failure detection: default phi_threshold 8 -> 10
842
+ * in_forward: uses other nodes aggressively if it couldn't send data to the first
843
+ candidate to not stall during the wait time before detecting failure
844
+ * in_forward: fixed shutdown procedure
845
+ * in_tail: seeks to the saved position if detected log rotation actually
846
+ didn't rotate the file (meaning inode doesn't change). this change enables
847
+ cronolog to work with Fluentd.
848
+ * in_tail: fixed a problem that it couldn't recover from uncaught exceptions
849
+ caused by output plugins
850
+ * fluentd command supports '-q' option to decrease log level
851
+
852
+
853
+ Release 0.10.25 - 2012/07/23
854
+
855
+ * shutdown won't block
856
+ * out_exec_filter supports 'child_respawn' option
857
+ * in_tail doesn't remove whitespaces
858
+ * out_roundrobin supports 'weight' option
859
+
860
+
861
+ Release 0.10.24 - 2012/06/28
862
+
863
+ * TextParser/in_tail: supports 'tsv' and 'csv' preset formats
864
+ * supervisor set FD_CLOEXEC to @wait_daemonize_pipe_w in case the child
865
+ process forked during run_configure
866
+
867
+
868
+ Release 0.10.23 - 2012/06/25
869
+
870
+ * out_exec_filter: show more error messages when child process unexpectedly exited
871
+ * in_tail: Added 'apache2' format template which converts fields into integers or nil
872
+ * TextParser creates a parser instance for each output for proper configuration
873
+ * BufferedOutput: reset @flush_now flag
874
+ * changed default buffer limit parameters:
875
+ Fluentd core:
876
+ buffer_chunk_limit 256MB -> 8MB
877
+ buffer_queue_limit 128 -> 256
878
+ buf_memory:
879
+ buffer_chunk_limit 32MB -> 8MB
880
+ buffer_queue_limit 32 -> 64
881
+ out_file:
882
+ buffer_chunk_limit -> 256MB
883
+
884
+
885
+ Release 0.10.22 - 2012/05/02
886
+
887
+ * Fixed in_tail and TextParser not to raise "time_format is required" error
888
+ * out_exec_filter: fixed JSONFormatter to add \n at the end of records
889
+ * out_exec_filter: separated {tag_key,time_key,time_format} parameters to
890
+ {in_,out_}{tag_key,time_key,time_format parameters while keeping
891
+ compatibility
892
+
893
+
894
+ Release 0.10.21 - 2012/05/01
895
+
896
+ * in_tail and TextParser support 'format json'
897
+ * in_tail and TextParser support 'time_key' and 'time_format' parameters for 'format json'
898
+ * in_tail: improved the file reader not to consume too much memory if the file is huge
899
+ * out_stdout: uses logger instead of STDOUT to show records even if Fluentd is daemonized
900
+ * Fixed the type of 'retry_wait' parameter of buffered output plugins from 'float' to 'time'
901
+ * Fixed owner of log files for log rotation to work properly with --user and --group options
902
+
903
+
904
+ Release 0.10.20 - 2012/04/27
905
+
906
+ * Fixed Config#to_s
907
+ * out_exec_filter: supports 'out_format json' option
908
+ * out_exec_filter: supports 'in_format json' option
909
+
910
+
911
+ Release 0.10.19 - 2012/04/17
912
+
913
+ * Fixed in_syslog
914
+ * in_tail: fixed "invalid byte sequence in US-ASCII" error
915
+ * in_unix is not obsoleted
916
+
917
+
918
+ Release 0.10.18 - 2012/04/13
919
+
920
+ * Use Yajl instead of standard json library to avoid encoding problem
921
+ * buf_memory: call force_encoding('ASCII-8BIT') to avoid encoding problem
922
+
923
+
924
+ Release 0.10.17 - 2012/04/02
925
+
926
+ * in_tail: don't ignore last line without LF [#44]
927
+ * Added HandleTagNameMixin
928
+ * Removed automake/conf style build support
929
+ Maintainig automake/conf style files are complex, but no user. We've decided
930
+ not to have those files anymore. Otherwise it's still used at rpm/deb packaging
931
+ scripts.
932
+
933
+
934
+ Release 0.10.16 - 2012/03/26
935
+
936
+ * Added in_gc plugin
937
+ * Added in_object_space plugin
938
+ * Changed dependency yajl-ruby from '~> 1.0.0' to '~> 1.0'
939
+
940
+
941
+ Release 0.10.15 - 2012/03/09
942
+
943
+ * Added experimental in_status plugin
944
+ * out_forward: normalize the phi value of the failure detector into 1sec
945
+ * out_forward: improved memory efficiency
946
+ * out_forward: use weighted moving average for the phi accrual failure detector
947
+
948
+
949
+ Release 0.10.14 - 2012/03/05
950
+
951
+ * Show warnings if in_tcp or out_unix is used
952
+ * BasicBuffer shows warnings when data.bytesize > @buffer_chunk_limit
953
+ * out_forward: randomize roundrobin queue correctly
954
+ * Added development dependencies to the gemspec
955
+
956
+
957
+ Release 0.10.13 - 2012/02/21
958
+
959
+ * Rewrote in_tail
960
+ * Fixed SIGUSR1 handler to force flush logs
961
+
962
+
963
+ Release 0.10.12 - 2012/02/13
964
+
965
+ * Engine shows warnings when emitted record doesn't match any outputs
966
+ * in_tail is rewritten to follow symbolic links correctly
967
+ * out_forward uses independent default value as 'hard_timeout' parameter
968
+
969
+
970
+ Release 0.10.11 - 2012/02/10
971
+
972
+ * out_forward supports 'standby' parameter
973
+ * out_forward handles 'hard_timeout' correctly
974
+
975
+
976
+ Release 0.10.10 - 2012/02/09
977
+
978
+ * in_forward and out_forward don't raise exceptions in callback handlers of
979
+ cool.io not to stop Loop#run
980
+ * TimeSlicedOutput ignores time_slice_wait if flush_interval is specified
981
+ * in_tail follows symbolic links correctly
982
+ * in_http supports "Content-Type: application/json"
983
+ * TestDriver#run sleeps 0.5 seconds for the out_exec_filter plugin
984
+
985
+
986
+ Release 0.10.9 - 2012/01/19
987
+
988
+ * Fixed TimeSlicedOutputTestDriver
989
+ * Updated cool.io 1.0.0 -> 1.1.0
990
+ * TextParser: fixed regexp of syslog parser to work with rsyslog on CentOS
991
+ * out_exec_filter: improve performance by using buffering
992
+ * out_exec_filter: added num_children parameter
993
+ * out_exec_filter: added remove_prefix/add_prefix parameters
994
+ * out_tail: show warning if pos_file parameter is not set
995
+ * out_copy: fixed problems when event stream is not repeatable
996
+
997
+
998
+ Release 0.10.8 - 2011/12/03
999
+
1000
+ * Added Supervisor: restart process on SIGHUP or unexpected end of process
1001
+ * Added -i commandline option which allows inline config
1002
+ * Added TimeSlicedOutputTestDriver
1003
+ * BufferedOutput outputs 'retry succeeded' message
1004
+ * Use Gem::Specification instead of Gem.searcher which is obsoleted
1005
+ * Added BasicBuffer#chunk_limit -> buffer_chunk_limit alias for backward
1006
+ compatibility
1007
+ * buf_file: fixed to work with keys which contains '/'
1008
+
1009
+
1010
+ Release 0.10.7 - 2011/11/16
1011
+
1012
+ * Supports multi-threaded on buffered output plugins ('num_threads')
1013
+ * Supports multi-process on input plugins ('detach_process')
1014
+ * Added ObjectBufferedOutput
1015
+ * Ensure to call 'shutdown' method of started plugins
1016
+ * in_tail supports 'pos_file' option that stores read position to a file
1017
+
1018
+
1019
+ Release 0.10.6 - 2011/11/11
1020
+
1021
+ * Fixed --group NAME cmdline argument
1022
+ * Run configure(conf) after changing user and group
1023
+ * Fixed SIGHUP handling
1024
+ * BasicBuffer plugin uses Configurable module
1025
+ * buf_file uses microseconds + 12 bits random number for unique file name
1026
+
1027
+
1028
+ Release 0.10.5 - 2011/11/08
1029
+
1030
+ * Added out_forward, in_forward
1031
+ * Added out_exec, in_exec
1032
+ * Added out_exec_filter
1033
+
1034
+
1035
+ Release 0.10.4 - 2011/11/07
1036
+
1037
+ * TestDriver uses klass.dup.module_eval instead of inheriting class to
1038
+ override methods
1039
+ * fixed encoding problem of String#[] in FileBufferChunk#<<(data)
1040
+
1041
+
1042
+ Release 0.10.3 - 2011/10/21
1043
+
1044
+ * Supports 'include' in config file
1045
+ * Supports "http://" schema
1046
+ * Supports wildcards
1047
+
1048
+
1049
+ Release 0.10.2 - 2011/10/18
1050
+
1051
+ * Fixed EventStream#to_msgpack_stream (thanks CkReal)
1052
+ * Added gemspec.required_ruby_version = '~> 1.9.2' (thanks sakuro)
1053
+
1054
+
1055
+ Release 0.10.1 - 2011/10/16
1056
+
1057
+ * SetTimeKeyMixin accepts include_time_key parameter
1058
+ * SetTagKeyMixin accepts include_tag_key parameter
1059
+ * Fixed Makefile.am
1060
+ * Fixed MemoryBufferChunk#msgpack_each
1061
+
1062
+
1063
+ Release 0.10.0 - 2011/10/16
1064
+
1065
+ * Removed Event class
1066
+ * def format(tag, event) -> format(time, tag, record)
1067
+ * def emit(tag, event) -> emit(tag, time, record)
1068
+ * Added plugin APIs
1069
+ * Added Configurable
1070
+ * Added TimeFormatter
1071
+ * Added SetTimeKeyMixin
1072
+ * Added SetTagKeyMixin
1073
+ * Added InputTestDriver
1074
+ * Added Gemfile, gemspec and .rvmrc files
1075
+
1076
+
1077
+ Release 0.9.20 - 2011/10/07
1078
+
1079
+ * Config#has_key? sets used flag not to show warning
1080
+ * in_tcp supports JSON
1081
+ * Depends on Yajl
1082
+ * Fixed fluentd -r option
1083
+ * Fixed autogen.sh to create plugins directory
1084
+
1085
+
1086
+ Release 0.9.19 - 2011/10/07
1087
+
1088
+ * Secondary outputs work only when error count exceededs retry_limit
1089
+ * Secondary outputs retry upto secondary_limit
1090
+ * Added Output#secondary_init
1091
+ * Added unit test driver for output plugins
1092
+ * Added Fluent::Test.test? method
1093
+ * Added comparision methods (<=>, ==, eql? and hash) to Event class
1094
+ * Added test cases for out_copy, out_roundrobin and out_file
1095
+
1096
+
1097
+ Release 0.9.18 - 2011/10/04
1098
+
1099
+ * Performance improvements
1100
+ * in_tcp uses lazy deserialization
1101
+ * Engine caches results of Match#match
1102
+ * out_file caches results of strftime
1103
+ * Fixed TextParser.register_template
1104
+
1105
+
1106
+ Release 0.9.17 - 2011/10/03
1107
+
1108
+ * TimeSlicedOutput caches results of strftime() for performance
1109
+ * Fixed TextParser.register_template (thanks eiichiroi)
1110
+ * Fixed fluent-cat --port argument to work
1111
+
1112
+
1113
+ Release 0.9.16 - 2011/10/01
1114
+
1115
+ * Fixed it can't use relative path for --plugin command line argument
1116
+ * Fixed out_copy to work with non-repeatable event streams
1117
+
1118
+
1119
+ Release 0.9.15 - 2011/09/21
1120
+
1121
+ * Set default encoding to ASCII-8BIT
1122
+ * Fixed thread issues in BasicBuffer
1123
+ * Performance improvements
1124
+
1125
+
1126
+ Release 0.9.14 - 2011/09/21
1127
+
1128
+ * Fixed to write unexpected error to log files
1129
+ * Plugin loader uses GemSpec if it is available to load newer plugin
1130
+ * Added Config.bool_value method for plugins
1131
+
1132
+
1133
+ Release 0.9.13 - 2011/09/21
1134
+
1135
+ * Updated out_file plugin
1136
+ * Uses localtime by default
1137
+ * Uses \t to separate time, tag and JSON.
1138
+ * Uses ISO-8601 for the time format
1139
+
1140
+
1141
+ Release 0.9.12 - 2011/09/20
1142
+
1143
+ * Updated out_file plugin
1144
+ * Supports log compression
1145
+ * Slices log files every day by default
1146
+
1147
+
1148
+ Release 0.9.11 - 2011/09/19
1149
+
1150
+ * Added out_null plugin
1151
+ * Added out_roundrobin plugin
1152
+ * in_http supports keep-alive
1153
+ * in_tcp and in_unix detect network failure
1154
+
1155
+
1156
+ Release 0.9.10 - 2011/09/07
1157
+
1158
+ * Periodic timer enqueues buffer chunks only when queue is empty
1159
+
1160
+
1161
+ Release 0.9.9 - 2011/09/06
1162
+
1163
+ * in_tail strips \n at the end of log line
1164
+ * Uses newer one if multiple plugins are found
1165
+
1166
+
1167
+ Release 0.9.8 - 2011/08/16
1168
+
1169
+ * in_http plugin supports 'Expect: 100-continue' header
1170
+ * Added --user and --group command line arguments to change privilege
1171
+ * Changed default retry_limit parameter from 8 to 17
1172
+ * Changed default buffer_chunk_limit parameter from 1m to 16m
1173
+ * Changed default buffer_queue_limit parameter from 100 to 64
1174
+
1175
+
1176
+ Release 0.9.7 - 2011/08/06
1177
+
1178
+ * Load plugins named fluent_plugin.rb installed by RubyGems
1179
+ * Load plugins located on fluent/plugin/{buf,in,out}_{type} installed by RubyGems
1180
+ * Removed out_tdlog plugin to fluent-plugin-td gem
1181
+
1182
+
1183
+ Release 0.9.6 - 2011/08/06
1184
+
1185
+ * Force flush buffered events on SIGUSR1
1186
+ * out_tdlog uses event tag for the database and table name
1187
+ * Fluent can log Fluent logs
1188
+ * Colorize Fluent logs on console
1189
+ * Changed default unix domain socket path to /var/run/fluent/fluent.sock
1190
+ * Makefile.am and configure.in aware fakeroot
1191
+
1192
+
1193
+ Release 0.9.5 - 2011/07/23
1194
+
1195
+ * Added <secondary> tag that fallbacks to secondary output when it can't
1196
+ write to primary output.
1197
+ * <match> pattern supports **; matches any fragments recursively.
1198
+ * <match> pattern supports {x,y,...}; matches any of the inner patterns.
1199
+
1200
+
1201
+ Release 0.9.4 - 2011/07/22
1202
+
1203
+ * Switched EventMachine to Cool.io
1204
+ * in_tail continues to follow file if it is deleted on Linux
1205
+ * Added fluentd --setup option that installs sample configuration file
1206
+ * Added out_tdlog plugin
1207
+
1208
+
1209
+ Release 0.9.3 - 2011/07/05
1210
+
1211
+ * Disable EventMachine.epoll because it doesn't work correctly on
1212
+ Ruby 1.9 with threads
1213
+ * in_tcp and in_unix uses EventMachine instead of threads
1214
+ * Set BasicSocket.do_not_reverse_lookup = true
1215
+
1216
+
1217
+ Release 0.9.2 - 2011/07/03
1218
+
1219
+ * Added TimeSlicedOutput that splits buffer chunk exactly based on the time
1220
+ * Changed structure of buffers from queue to map + queue
1221
+ * Show waring if configuration parameters are not used
1222
+ * Added out_time_file plugin
1223
+
1224
+
1225
+ Release 0.9.1 - 2011/06/26
1226
+
1227
+ * Added in_tail plugin
1228
+ * Added in_syslog plugin
1229
+ * Added out_stdout plugin
1230
+ * Added out_tcp plugin
1231
+ * Added out_unix plugin
1232
+ * Improved performance of in_http plugin by replacing WEBrick + thread
1233
+ with EventMachine
1234
+
1235
+
1236
+ Release 0.9.0 - 2011/06/20
1237
+
1238
+ * First release
1239
+