fluentd 0.12.43 → 0.14.0

Sign up to get free protection for your applications and to get access to all the features.

Potentially problematic release.


This version of fluentd might be problematic. Click here for more details.

Files changed (253) hide show
  1. checksums.yaml +4 -4
  2. data/.github/ISSUE_TEMPLATE.md +6 -0
  3. data/.gitignore +2 -0
  4. data/.travis.yml +33 -21
  5. data/CONTRIBUTING.md +1 -0
  6. data/ChangeLog +1239 -0
  7. data/README.md +0 -25
  8. data/Rakefile +2 -1
  9. data/Vagrantfile +17 -0
  10. data/appveyor.yml +35 -0
  11. data/example/filter_stdout.conf +5 -5
  12. data/example/in_forward.conf +2 -2
  13. data/example/in_http.conf +2 -2
  14. data/example/in_out_forward.conf +17 -0
  15. data/example/in_syslog.conf +2 -2
  16. data/example/in_tail.conf +2 -2
  17. data/example/in_tcp.conf +2 -2
  18. data/example/in_udp.conf +2 -2
  19. data/example/out_copy.conf +4 -4
  20. data/example/out_file.conf +2 -2
  21. data/example/out_forward.conf +2 -2
  22. data/example/out_forward_buf_file.conf +23 -0
  23. data/example/v0_12_filter.conf +8 -8
  24. data/fluent.conf +29 -0
  25. data/fluentd.gemspec +18 -11
  26. data/lib/fluent/agent.rb +60 -58
  27. data/lib/fluent/command/cat.rb +1 -1
  28. data/lib/fluent/command/debug.rb +7 -5
  29. data/lib/fluent/command/fluentd.rb +97 -2
  30. data/lib/fluent/compat/call_super_mixin.rb +67 -0
  31. data/lib/fluent/compat/filter.rb +50 -0
  32. data/lib/fluent/compat/formatter.rb +109 -0
  33. data/lib/fluent/compat/input.rb +50 -0
  34. data/lib/fluent/compat/output.rb +617 -0
  35. data/lib/fluent/compat/output_chain.rb +60 -0
  36. data/lib/fluent/compat/parser.rb +163 -0
  37. data/lib/fluent/compat/propagate_default.rb +62 -0
  38. data/lib/fluent/config.rb +23 -20
  39. data/lib/fluent/config/configure_proxy.rb +119 -70
  40. data/lib/fluent/config/dsl.rb +5 -18
  41. data/lib/fluent/config/element.rb +72 -8
  42. data/lib/fluent/config/error.rb +0 -3
  43. data/lib/fluent/config/literal_parser.rb +0 -2
  44. data/lib/fluent/config/parser.rb +4 -4
  45. data/lib/fluent/config/section.rb +39 -28
  46. data/lib/fluent/config/types.rb +2 -13
  47. data/lib/fluent/config/v1_parser.rb +1 -3
  48. data/lib/fluent/configurable.rb +48 -16
  49. data/lib/fluent/daemon.rb +15 -0
  50. data/lib/fluent/engine.rb +26 -52
  51. data/lib/fluent/env.rb +6 -4
  52. data/lib/fluent/event.rb +58 -11
  53. data/lib/fluent/event_router.rb +5 -5
  54. data/lib/fluent/filter.rb +2 -50
  55. data/lib/fluent/formatter.rb +4 -293
  56. data/lib/fluent/input.rb +2 -32
  57. data/lib/fluent/label.rb +2 -2
  58. data/lib/fluent/load.rb +3 -2
  59. data/lib/fluent/log.rb +107 -38
  60. data/lib/fluent/match.rb +0 -36
  61. data/lib/fluent/mixin.rb +117 -7
  62. data/lib/fluent/msgpack_factory.rb +62 -0
  63. data/lib/fluent/output.rb +7 -612
  64. data/lib/fluent/output_chain.rb +23 -0
  65. data/lib/fluent/parser.rb +4 -800
  66. data/lib/fluent/plugin.rb +100 -121
  67. data/lib/fluent/plugin/bare_output.rb +63 -0
  68. data/lib/fluent/plugin/base.rb +121 -0
  69. data/lib/fluent/plugin/buf_file.rb +101 -182
  70. data/lib/fluent/plugin/buf_memory.rb +9 -92
  71. data/lib/fluent/plugin/buffer.rb +473 -0
  72. data/lib/fluent/plugin/buffer/chunk.rb +135 -0
  73. data/lib/fluent/plugin/buffer/file_chunk.rb +339 -0
  74. data/lib/fluent/plugin/buffer/memory_chunk.rb +100 -0
  75. data/lib/fluent/plugin/exec_util.rb +80 -75
  76. data/lib/fluent/plugin/file_util.rb +33 -28
  77. data/lib/fluent/plugin/file_wrapper.rb +120 -0
  78. data/lib/fluent/plugin/filter.rb +51 -0
  79. data/lib/fluent/plugin/filter_grep.rb +13 -40
  80. data/lib/fluent/plugin/filter_record_transformer.rb +22 -18
  81. data/lib/fluent/plugin/formatter.rb +93 -0
  82. data/lib/fluent/plugin/formatter_csv.rb +48 -0
  83. data/lib/fluent/plugin/formatter_hash.rb +32 -0
  84. data/lib/fluent/plugin/formatter_json.rb +47 -0
  85. data/lib/fluent/plugin/formatter_ltsv.rb +42 -0
  86. data/lib/fluent/plugin/formatter_msgpack.rb +32 -0
  87. data/lib/fluent/plugin/formatter_out_file.rb +45 -0
  88. data/lib/fluent/plugin/formatter_single_value.rb +34 -0
  89. data/lib/fluent/plugin/formatter_stdout.rb +39 -0
  90. data/lib/fluent/plugin/in_debug_agent.rb +4 -0
  91. data/lib/fluent/plugin/in_dummy.rb +22 -18
  92. data/lib/fluent/plugin/in_exec.rb +18 -8
  93. data/lib/fluent/plugin/in_forward.rb +36 -79
  94. data/lib/fluent/plugin/in_gc_stat.rb +4 -0
  95. data/lib/fluent/plugin/in_http.rb +21 -18
  96. data/lib/fluent/plugin/in_monitor_agent.rb +15 -48
  97. data/lib/fluent/plugin/in_object_space.rb +6 -1
  98. data/lib/fluent/plugin/in_stream.rb +7 -3
  99. data/lib/fluent/plugin/in_syslog.rb +46 -95
  100. data/lib/fluent/plugin/in_tail.rb +58 -640
  101. data/lib/fluent/plugin/in_tcp.rb +8 -1
  102. data/lib/fluent/plugin/in_udp.rb +8 -18
  103. data/lib/fluent/plugin/input.rb +33 -0
  104. data/lib/fluent/plugin/multi_output.rb +95 -0
  105. data/lib/fluent/plugin/out_buffered_null.rb +59 -0
  106. data/lib/fluent/plugin/out_copy.rb +11 -7
  107. data/lib/fluent/plugin/out_exec.rb +15 -11
  108. data/lib/fluent/plugin/out_exec_filter.rb +18 -10
  109. data/lib/fluent/plugin/out_file.rb +34 -5
  110. data/lib/fluent/plugin/out_forward.rb +25 -19
  111. data/lib/fluent/plugin/out_null.rb +0 -14
  112. data/lib/fluent/plugin/out_roundrobin.rb +11 -7
  113. data/lib/fluent/plugin/out_stdout.rb +5 -7
  114. data/lib/fluent/plugin/out_stream.rb +3 -1
  115. data/lib/fluent/plugin/output.rb +979 -0
  116. data/lib/fluent/plugin/owned_by_mixin.rb +42 -0
  117. data/lib/fluent/plugin/parser.rb +244 -0
  118. data/lib/fluent/plugin/parser_apache.rb +24 -0
  119. data/lib/fluent/plugin/parser_apache2.rb +84 -0
  120. data/lib/fluent/plugin/parser_apache_error.rb +21 -0
  121. data/lib/fluent/plugin/parser_csv.rb +31 -0
  122. data/lib/fluent/plugin/parser_json.rb +79 -0
  123. data/lib/fluent/plugin/parser_ltsv.rb +50 -0
  124. data/lib/fluent/plugin/parser_multiline.rb +102 -0
  125. data/lib/fluent/plugin/parser_nginx.rb +24 -0
  126. data/lib/fluent/plugin/parser_none.rb +36 -0
  127. data/lib/fluent/plugin/parser_syslog.rb +82 -0
  128. data/lib/fluent/plugin/parser_tsv.rb +37 -0
  129. data/lib/fluent/plugin/socket_util.rb +119 -117
  130. data/lib/fluent/plugin/storage.rb +84 -0
  131. data/lib/fluent/plugin/storage_local.rb +116 -0
  132. data/lib/fluent/plugin/string_util.rb +16 -13
  133. data/lib/fluent/plugin_helper.rb +39 -0
  134. data/lib/fluent/plugin_helper/child_process.rb +298 -0
  135. data/lib/fluent/plugin_helper/compat_parameters.rb +99 -0
  136. data/lib/fluent/plugin_helper/event_emitter.rb +80 -0
  137. data/lib/fluent/plugin_helper/event_loop.rb +118 -0
  138. data/lib/fluent/plugin_helper/retry_state.rb +177 -0
  139. data/lib/fluent/plugin_helper/storage.rb +308 -0
  140. data/lib/fluent/plugin_helper/thread.rb +147 -0
  141. data/lib/fluent/plugin_helper/timer.rb +85 -0
  142. data/lib/fluent/plugin_id.rb +63 -0
  143. data/lib/fluent/process.rb +21 -30
  144. data/lib/fluent/registry.rb +21 -9
  145. data/lib/fluent/root_agent.rb +115 -40
  146. data/lib/fluent/supervisor.rb +330 -320
  147. data/lib/fluent/system_config.rb +42 -18
  148. data/lib/fluent/test.rb +6 -1
  149. data/lib/fluent/test/base.rb +23 -3
  150. data/lib/fluent/test/driver/base.rb +247 -0
  151. data/lib/fluent/test/driver/event_feeder.rb +98 -0
  152. data/lib/fluent/test/driver/filter.rb +35 -0
  153. data/lib/fluent/test/driver/input.rb +31 -0
  154. data/lib/fluent/test/driver/output.rb +78 -0
  155. data/lib/fluent/test/driver/test_event_router.rb +45 -0
  156. data/lib/fluent/test/filter_test.rb +0 -1
  157. data/lib/fluent/test/formatter_test.rb +2 -1
  158. data/lib/fluent/test/input_test.rb +23 -17
  159. data/lib/fluent/test/output_test.rb +28 -39
  160. data/lib/fluent/test/parser_test.rb +1 -1
  161. data/lib/fluent/time.rb +104 -1
  162. data/lib/fluent/{status.rb → unique_id.rb} +15 -24
  163. data/lib/fluent/version.rb +1 -1
  164. data/lib/fluent/winsvc.rb +72 -0
  165. data/test/compat/test_calls_super.rb +164 -0
  166. data/test/config/test_config_parser.rb +83 -0
  167. data/test/config/test_configurable.rb +547 -274
  168. data/test/config/test_configure_proxy.rb +146 -29
  169. data/test/config/test_dsl.rb +3 -181
  170. data/test/config/test_element.rb +274 -0
  171. data/test/config/test_literal_parser.rb +1 -1
  172. data/test/config/test_section.rb +79 -7
  173. data/test/config/test_system_config.rb +21 -0
  174. data/test/config/test_types.rb +3 -26
  175. data/test/helper.rb +78 -8
  176. data/test/plugin/test_bare_output.rb +118 -0
  177. data/test/plugin/test_base.rb +75 -0
  178. data/test/plugin/test_buf_file.rb +420 -521
  179. data/test/plugin/test_buf_memory.rb +32 -194
  180. data/test/plugin/test_buffer.rb +981 -0
  181. data/test/plugin/test_buffer_chunk.rb +110 -0
  182. data/test/plugin/test_buffer_file_chunk.rb +770 -0
  183. data/test/plugin/test_buffer_memory_chunk.rb +265 -0
  184. data/test/plugin/test_filter.rb +255 -0
  185. data/test/plugin/test_filter_grep.rb +2 -73
  186. data/test/plugin/test_filter_record_transformer.rb +24 -68
  187. data/test/plugin/test_filter_stdout.rb +6 -6
  188. data/test/plugin/test_in_debug_agent.rb +2 -0
  189. data/test/plugin/test_in_dummy.rb +11 -17
  190. data/test/plugin/test_in_exec.rb +6 -25
  191. data/test/plugin/test_in_forward.rb +112 -151
  192. data/test/plugin/test_in_gc_stat.rb +2 -0
  193. data/test/plugin/test_in_http.rb +106 -157
  194. data/test/plugin/test_in_object_space.rb +21 -5
  195. data/test/plugin/test_in_stream.rb +14 -13
  196. data/test/plugin/test_in_syslog.rb +30 -275
  197. data/test/plugin/test_in_tail.rb +95 -282
  198. data/test/plugin/test_in_tcp.rb +14 -0
  199. data/test/plugin/test_in_udp.rb +21 -67
  200. data/test/plugin/test_input.rb +122 -0
  201. data/test/plugin/test_multi_output.rb +180 -0
  202. data/test/plugin/test_out_buffered_null.rb +79 -0
  203. data/test/plugin/test_out_copy.rb +15 -2
  204. data/test/plugin/test_out_exec.rb +75 -25
  205. data/test/plugin/test_out_exec_filter.rb +74 -8
  206. data/test/plugin/test_out_file.rb +61 -7
  207. data/test/plugin/test_out_forward.rb +92 -15
  208. data/test/plugin/test_out_roundrobin.rb +1 -0
  209. data/test/plugin/test_out_stdout.rb +22 -13
  210. data/test/plugin/test_out_stream.rb +18 -0
  211. data/test/plugin/test_output.rb +515 -0
  212. data/test/plugin/test_output_as_buffered.rb +1540 -0
  213. data/test/plugin/test_output_as_buffered_overflow.rb +247 -0
  214. data/test/plugin/test_output_as_buffered_retries.rb +808 -0
  215. data/test/plugin/test_output_as_buffered_secondary.rb +776 -0
  216. data/test/plugin/test_output_as_standard.rb +362 -0
  217. data/test/plugin/test_owned_by.rb +35 -0
  218. data/test/plugin/test_storage.rb +167 -0
  219. data/test/plugin/test_storage_local.rb +8 -0
  220. data/test/plugin_helper/test_child_process.rb +599 -0
  221. data/test/plugin_helper/test_compat_parameters.rb +175 -0
  222. data/test/plugin_helper/test_event_emitter.rb +51 -0
  223. data/test/plugin_helper/test_event_loop.rb +52 -0
  224. data/test/plugin_helper/test_retry_state.rb +399 -0
  225. data/test/plugin_helper/test_storage.rb +411 -0
  226. data/test/plugin_helper/test_thread.rb +164 -0
  227. data/test/plugin_helper/test_timer.rb +100 -0
  228. data/test/scripts/exec_script.rb +0 -6
  229. data/test/scripts/fluent/plugin/out_test.rb +3 -0
  230. data/test/test_config.rb +13 -4
  231. data/test/test_event.rb +24 -13
  232. data/test/test_event_router.rb +8 -7
  233. data/test/test_event_time.rb +187 -0
  234. data/test/test_formatter.rb +13 -51
  235. data/test/test_input.rb +1 -1
  236. data/test/test_log.rb +239 -16
  237. data/test/test_mixin.rb +1 -1
  238. data/test/test_output.rb +53 -66
  239. data/test/test_parser.rb +105 -323
  240. data/test/test_plugin_helper.rb +81 -0
  241. data/test/test_root_agent.rb +4 -52
  242. data/test/test_supervisor.rb +272 -0
  243. data/test/test_unique_id.rb +47 -0
  244. metadata +181 -55
  245. data/CHANGELOG.md +0 -710
  246. data/lib/fluent/buffer.rb +0 -365
  247. data/lib/fluent/plugin/filter_parser.rb +0 -107
  248. data/lib/fluent/plugin/in_status.rb +0 -76
  249. data/lib/fluent/test/helpers.rb +0 -86
  250. data/test/plugin/data/log/foo/bar2 +0 -0
  251. data/test/plugin/test_filter_parser.rb +0 -744
  252. data/test/plugin/test_in_status.rb +0 -38
  253. data/test/test_buffer.rb +0 -624
data/CHANGELOG.md DELETED
@@ -1,710 +0,0 @@
1
- # v0.12
2
-
3
- ## Release 0.12.43 - 2018/04/06
4
-
5
- ### Bug fixes
6
-
7
- * out_forward: Remove debug print
8
-
9
- ## Release 0.12.42 - 2017/12/14
10
-
11
- ### New features / Enhancements
12
-
13
- * Disable tracepoint feature to omit unnecessary insts
14
- https://github.com/fluent/fluentd/pull/1764
15
- * in_udp: Add receive_buffer_size parameter
16
- https://github.com/fluent/fluentd/pull/1788
17
-
18
- ### Bug fixes
19
-
20
- * in_tail: Ensure close temporaly opened IO object
21
- https://github.com/fluent/fluentd/pull/1756
22
- * in_tail: Explicitly update position to 0 when the file is truncated
23
- https://github.com/fluent/fluentd/pull/1791
24
- * in_tail: Properly handle moved back and truncated case
25
- https://github.com/fluent/fluentd/pull/1793
26
- * out_forward: Rebuild weight array to apply server setting properly
27
- https://github.com/fluent/fluentd/pull/1784
28
-
29
- ## Release 0.12.41 - 2017/11/15
30
-
31
- ### New features / Enhancements
32
-
33
- * in_udp: Add remove_newline parameter
34
- https://github.com/fluent/fluentd/pull/1748
35
-
36
- ### Bug fixes
37
-
38
- * out_forward: Fix elapsed time miscalculation in tcp heartbeat
39
- https://github.com/fluent/fluentd/pull/1738
40
- * in_tail: Skip setup failed watcher to avoid resource leak and log bloat
41
- https://github.com/fluent/fluentd/pull/1752
42
- * agent: Add error location to emit error logs
43
- https://github.com/fluent/fluentd/pull/1746
44
- * filter_parser: Fix dumpped result for avoiding escape sequence injection
45
- https://github.com/fluent/fluentd/pull/1733
46
-
47
- ## Release 0.12.40 - 2017/08/25
48
-
49
- ### Bug fixes
50
-
51
- * record_transformer: Don't create new keys if the original record doesn't have `keep_keys` keys
52
- https://github.com/fluent/fluentd/pull/1663
53
- * in_tail: Fix the error when 'tag *' is configured.
54
- https://github.com/fluent/fluentd/pull/1664
55
- * plugin: Fix load order to avoid file not found when plugins have own native extension
56
- https://github.com/fluent/fluentd/pull/1670
57
-
58
- ## Release 0.12.39 - 2017/07/14
59
-
60
- ### Bug fixes
61
-
62
- * log: Revert 0.12.38 changes to avoid shutdown stuck
63
- https://github.com/fluent/fluentd/pull/1631
64
- https://github.com/fluent/fluentd/pull/1632
65
-
66
- ## Release 0.12.38 - 2017/07/13
67
-
68
- ### New features / Enhancement
69
-
70
- * in_syslog: Add Add allow_without_priority and default_priority parameters
71
- https://github.com/fluent/fluentd/pull/1608
72
- * in_syslog: More characters are available in tag part of syslog format
73
- https://github.com/fluent/fluentd/pull/1609
74
- * in_syslog: Add resolve_hostname and source_address_key parameters
75
- https://github.com/fluent/fluentd/pull/1615
76
- * filter_grep: Support new configuration format by config_section
77
- https://github.com/fluent/fluentd/pull/1627
78
-
79
- ### Bug fixes
80
-
81
- * log: Capture more fluentd log events during shutdown
82
- https://github.com/fluent/fluentd/pull/1618
83
- https://github.com/fluent/fluentd/pull/1625
84
-
85
- ## Release 0.12.37 - 2017/06/21
86
-
87
- ### New features / Enhancement
88
-
89
- * parser: Add rfc5424 regex without priority
90
- https://github.com/fluent/fluentd/pull/1601
91
-
92
- ### Bug fixes
93
-
94
- * in_tail: fix timing issue that the excluded_path doesn't apply.
95
- https://github.com/fluent/fluentd/pull/1597
96
- * in_tail: Detach watchers before updating watcher to avoid broken pos file
97
- https://github.com/fluent/fluentd/pull/1598
98
-
99
- ## Release 0.12.36 - 2017/05/24
100
-
101
- ### New features / Enhancement
102
-
103
- * config: Allow null byte in double-quoted string
104
- https://github.com/fluent/fluentd/pull/1552
105
- * parser: Support %iso8601 special case for time_format
106
- https://github.com/fluent/fluentd/pull/1562
107
- * in_tail: Add ignore_repeated_permission_error parameter
108
- https://github.com/fluent/fluentd/pull/1574
109
-
110
- ### Bug fixes
111
-
112
- * in_monitor_agent: Enable in_monitor_agent to find plugin type from its class
113
- https://github.com/fluent/fluentd/pull/1564
114
- * Ruby 2.4 warns to forward private methods
115
- https://github.com/fluent/fluentd/pull/1579
116
- * log: Add missing '<<' method to delegators
117
- https://github.com/fluent/fluentd/pull/1558
118
-
119
- ## Release 0.12.35 - 2017/04/19
120
-
121
- ### Bug fixes
122
-
123
- * in_http: Fix X-Forwarded-For header handling. Accpet multiple headers
124
- https://github.com/fluent/fluentd/pull/1535
125
- * in_tail: Do not warn that directories are unreadable
126
- https://github.com/fluent/fluentd/pull/1540
127
-
128
- ## Release 0.12.34 - 2017/03/25
129
-
130
- ### New features / Enhancement
131
-
132
- * in_syslog/in_udp/in_tcp: Fix hostname lookup and unify parameter name to source_hostname_key
133
- https://github.com/fluent/fluentd/pull/1515
134
- * in_http: Support application/msgpack header
135
- https://github.com/fluent/fluentd/pull/1506
136
-
137
- ### Bug fixes
138
-
139
- * engine: Label's plugins should be flushed when receive signal
140
- https://github.com/fluent/fluentd/pull/1508
141
-
142
- ## Release 0.12.33 - 2017/03/09
143
-
144
- ### New features / Enhancement
145
-
146
- * parser_syslog: Backport 'Support rfc5424 syslog format'
147
- https://github.com/fluent/fluentd/pull/1495
148
- * in_forward: Add source_address_key and fix source_hostname_key parameters
149
- https://github.com/fluent/fluentd/pull/1490
150
- * in_tail: Skip directories when use **/* in path
151
- https://github.com/fluent/fluentd/pull/1464
152
- * in_tail: Add limit_recently_modified parameter to limit watching files
153
- https://github.com/fluent/fluentd/pull/1474
154
- * in_tail: Skip the refresh of watching list on startup
155
- https://github.com/fluent/fluentd/pull/1487
156
- * parser: Allow escape sequence in Apache access log
157
- https://github.com/fluent/fluentd/pull/1479
158
- * log: Add Fluent::Log#<< to support some SDKs
159
- https://github.com/fluent/fluentd/pull/1478
160
-
161
- ### Bug fixes
162
-
163
- * config: Set encoding forcefully to avoid UndefinedConversionError
164
- https://github.com/fluent/fluentd/pull/1477
165
-
166
- ## Release 0.12.32 - 2017/02/02
167
-
168
- ### New features / Enhancement
169
-
170
- * formatter: Port add_newline parameter to v012
171
- https://github.com/fluent/fluentd/pull/1447
172
- * record_transformer: remove_keys processing should be last
173
- https://github.com/fluent/fluentd/pull/1433
174
- * in_tail: Capture unmatched lines
175
- https://github.com/fluent/fluentd/pull/1421
176
- * in_monitor_agent: Port #1393 to v0.12 for with_ivars query paretemer
177
- https://github.com/fluent/fluentd/pull/1402
178
- * in_monitor_agent: Port #1387 to v0.12 for retry field
179
- https://github.com/fluent/fluentd/pull/1387
180
- * Allow msgpack-ruby v1
181
-
182
- ### Bug fixes
183
-
184
- * in_exec: Ensure to sleep for prevending fork bomb
185
- https://github.com/fluent/fluentd/pull/1348
186
-
187
- ## Release 0.12.31 - 2016/12/14
188
-
189
- ### New features / Enhancement
190
-
191
- * output: Add slow_flush_log_threshold parameter
192
- https://github.com/fluent/fluentd/pull/1366
193
- * formatter_csv: Change fields parameter to required. Now accepts both a,b and ["a", "b"]
194
- https://github.com/fluent/fluentd/pull/1361
195
- * in_syslog: Add "priority_key" and "facility_key" parameters
196
- https://github.com/fluent/fluentd/pull/1351
197
-
198
- ## Release 0.12.30 - 2016/12/01
199
-
200
- ### New features / Enhancement
201
-
202
- * in_tail: Optimize to split lines
203
- https://github.com/fluent/fluentd/pull/1325
204
- * in_monitor_agent: Port #1317 changes
205
- https://github.com/fluent/fluentd/pull/1317
206
- * filter_parser: Add emit_invalid_record_to_error parameter
207
- https://github.com/fluent/fluentd/pull/1339
208
- * test: Add v0.14 compatible test helpers
209
- https://github.com/fluent/fluentd/pull/1322
210
-
211
- ### Bug fixes
212
-
213
- * Use compat mode instead of stric mode for oj
214
- https://github.com/fluent/fluentd/pull/1304
215
- * Port #1331 changes for oj
216
- https://github.com/fluent/fluentd/pull/1331
217
-
218
- ## Release 0.12.29 - 2016/09/05
219
-
220
- ### New features / Enhancement
221
-
222
- * in_tail: Add from_encoding parameter
223
- https://github.com/fluent/fluentd/pull/1067
224
- * filter: Port parser filter to v0.12
225
- https://github.com/fluent/fluentd/pull/1203
226
- * config: New config_param options to specify deprecated/obsoleted parameters
227
- https://github.com/fluent/fluentd/pull/1186
228
-
229
- ### Bug fixes
230
-
231
- * config: fix to raise ConfigError for type missing, and its tests
232
- https://github.com/fluent/fluentd/pull/1202
233
- * filter_record_transformer: Fix to prevent overwriting reserved placeholder keys such as tag
234
- https://github.com/fluent/fluentd/pull/1176
235
-
236
- ## Release 0.12.28 - 2016/08/14
237
-
238
- ### New features / Enhancement
239
-
240
- * in_forward: Add source_hostname_key parameter
241
- https://github.com/fluent/fluentd/pull/807
242
-
243
- ### Bug fixes
244
-
245
- * parser: Ensure strict mode is used for Oj parser
246
- https://github.com/fluent/fluentd/pull/1147
247
-
248
- ## Release 0.12.27 - 2016/08/03
249
-
250
- ### New features / Enhancement
251
-
252
- * config: Add simplified syntax for hash and array
253
- https://github.com/fluent/fluentd/pull/939
254
- * config: Add include support for Ruby DSL
255
- https://github.com/fluent/fluentd/pull/950
256
- * in_http: Add support of X-Forwarded-For header
257
- https://github.com/fluent/fluentd/pull/1051
258
- * in_syslog: Add message_length_limit option to receive longer udp syslog messages
259
- https://github.com/fluent/fluentd/pull/1128
260
-
261
- ### Bug fixes
262
-
263
- * test: Fix test for TimeSlicedOutput
264
- https://github.com/fluent/fluentd/pull/941
265
- * example: Use `@type` in example confs
266
- https://github.com/fluent/fluentd/pull/1043
267
- * Fix regression of fluent-debug command
268
- https://github.com/fluent/fluentd/pull/1046
269
- * config: Fix wrong message for unsupported parameter
270
- https://github.com/fluent/fluentd/pull/1132
271
-
272
- ## Release 0.12.26 - 2016/05/30
273
-
274
- ### Bug fixes
275
-
276
- * Fix regression of not require sigdump
277
-
278
- ## Release 0.12.25 - 2016/05/25
279
-
280
- ### New features / Enhancement
281
-
282
- * process: Add detach_process_forward_interval parameter to control emit interval
283
- https://github.com/fluent/fluentd/pull/982
284
-
285
- ### Bug fixes
286
-
287
- * Fix string-scrub dependency for ruby 2.0 or earlier support
288
- https://github.com/fluent/fluentd/pull/986
289
-
290
- ## Release 0.12.24 - 2016/05/20
291
-
292
- ### New features / Enhancement
293
-
294
- * buffer: Add drop_oldest_chunk to buffer_queue_full_action parameter
295
- https://github.com/fluent/fluentd/pull/934
296
- * in_tail: Add "encoding" parameter
297
- https://github.com/fluent/fluentd/pull/889
298
- * in_tail: Add "path_key" patameter
299
- https://github.com/fluent/fluentd/pull/951
300
- * in_monitor_agent: Add emit_config parameter to emit plugin configuration together
301
- https://github.com/fluent/fluentd/pull/963
302
- * config: Support multiline string in " quoted string
303
- https://github.com/fluent/fluentd/pull/929
304
-
305
- ### Bug fixes
306
-
307
- * in_http: Add 'Access-Control-Allow-Origin' to response header
308
- https://github.com/fluent/fluentd/pull/882
309
- * parser: Fix logger on Fluent::StringUtil to use $log
310
- https://github.com/fluent/fluentd/pull/926
311
- * out_forward: Add missing error class definition
312
- https://github.com/fluent/fluentd/pull/953
313
-
314
- ## Release 0.12.23 - 2016/05/03
315
-
316
- ### Bug fixes
317
-
318
- * Fix string-scrub dependency on ruby > 2
319
- https://github.com/fluent/fluentd/pull/933
320
- * fluent-debug: Fix regression
321
- https://github.com/fluent/fluentd/pull/894
322
-
323
- ## Release 0.12.22 - 2016/03/10
324
-
325
- ### Bug fixes
326
-
327
- * supervisor: Require fcntl library for daemonize
328
- https://github.com/fluent/fluentd/pull/845
329
-
330
- ## Release 0.12.21 - 2016/03/03
331
-
332
- ### New features / Enhancement
333
-
334
- * output: Use error stream in TimeSlicedOutput#emit
335
- https://github.com/fluent/fluentd/pull/791
336
- * in_tail: Avoid unnecessary open call
337
- https://github.com/fluent/fluentd/pull/788
338
- * in_tail: Add enable_watch_timer option
339
- https://github.com/fluent/fluentd/pull/811
340
- * filter_record_transformer: Relax conditions which auto_typecast is applied when enable_ruby yes
341
- https://github.com/fluent/fluentd/pull/817
342
- * Backport v0.14 refactoring changes
343
-
344
- ### Bug fixes
345
-
346
- * in_tail: Fix input messages loss when receive_lines fail with BufferQueueLimitError
347
- https://github.com/fluent/fluentd/pull/810
348
- * in_monitor_agent: Remove unnecessary fields from API response with debug mode
349
- https://github.com/fluent/fluentd/pull/802
350
- * filter_record_transformer: Fix record_transformer to be thread-safe
351
- https://github.com/fluent/fluentd/pull/816
352
-
353
- ## Release 0.12.20 - 2016/01/26
354
-
355
- ### New features / Enhancement
356
-
357
- * in_forward: Add skip_invalid_event paramter to check and skip invalid event
358
- https://github.com/fluent/fluentd/pull/776
359
- * in_tail: Add multiline_flush_interval parameter for periodic flush with multiline format
360
- https://github.com/fluent/fluentd/pull/775
361
- * filter_record_transformer: Improve ruby placeholder performance and adding 'record["key"]' syntax
362
- https://github.com/fluent/fluentd/pull/766
363
- * Add on_exit_process hook point to DetachProcessMixin
364
- https://github.com/fluent/fluentd/pull/757
365
- * Add descriptions to BufferedOutput and TimeSlicedOutput
366
- https://github.com/fluent/fluentd/pull/759
367
- https://github.com/fluent/fluentd/pull/760
368
-
369
- ### Bug fixes
370
-
371
- * parser: Don't use BigDecimal in JSON parsing result with Oj
372
- https://github.com/fluent/fluentd/pull/778
373
- * config: Fix the regression of unused parameter warning inside sub section
374
- https://github.com/fluent/fluentd/pull/765
375
-
376
- ## Release 0.12.19 - 2015/12/21
377
-
378
- ### New features / Enhancement
379
-
380
- * input: Standardize logging level for source configs
381
- https://github.com/fluent/fluentd/pull/743
382
- * buffer: Add buffer_queue_full_action parameter
383
- https://github.com/fluent/fluentd/pull/745
384
- * parser/formatter: Use 'oj' when oj is installed in json parser/formatter
385
- https://github.com/fluent/fluentd/pull/748
386
-
387
- ### Bug fixes
388
-
389
- * fluent-cat: fix the regression of --msgpack option
390
- https://github.com/fluent/fluentd/pull/747
391
-
392
- ## Release 0.12.18 - 2015/12/09
393
-
394
- ### New features / Enhancement
395
-
396
- * in_exec: Stop in_exec immediately at shutdown
397
- https://github.com/fluent/fluentd/pull/526
398
- * in_exec: Support built-in text parsers
399
- https://github.com/fluent/fluentd/pull/704
400
- * out_forward: raises ZeroDivisionError when no <server> is available
401
- https://github.com/fluent/fluentd/pull/707
402
- * Add process_name parameter in system to change fluentd's process name
403
- https://github.com/fluent/fluentd/pull/708
404
- * test: Add ParserTestDriver
405
- https://github.com/fluent/fluentd/pull/702
406
- * test: Add FormatterTestDriver
407
- https://github.com/fluent/fluentd/pull/712
408
- * Add parameter description to built-in plugins
409
-
410
- ### Bug fixes
411
-
412
- * fix bug not to protect in-memory-buffer for multi thread emitting / run loop
413
- https://github.com/fluent/fluentd/pull/710
414
- * in_tail: expand_paths exclude unreadable files
415
- https://github.com/fluent/fluentd/pull/734
416
-
417
- ## Release 0.12.17 - 2015/11/04
418
-
419
- ### New features / Enhancement
420
-
421
- * Engine: Add Engine#msgpack_factory for v0.14 compatibility
422
- https://github.com/fluent/fluentd/pull/693
423
- * Log shutdown plugin info to check shutdown sequence
424
- https://github.com/fluent/fluentd/pull/689
425
- * in_monitor_agent: Emit plugin info to use existing plugins
426
- https://github.com/fluent/fluentd/pull/670
427
- * config: Improve describing plugin parameters
428
- https://github.com/fluent/fluentd/pull/683
429
-
430
- ### Bug fixes
431
-
432
- * Tempfile should be binary mode
433
- https://github.com/fluent/fluentd/pull/691
434
- * filter_record_transformer: Don't use popular name to prevent field overwrite when enable_ruby is true
435
- https://github.com/fluent/fluentd/pull/687
436
-
437
-
438
- ## Release 0.12.16 - 2015/09/30
439
-
440
- ### New features / Enhancement
441
-
442
- * parser: Add null_value_pattern and null_empty_string option for ltsv, csv and tsv.
443
- https://github.com/fluent/fluentd/pull/657
444
- * RPC: Implement /api/config.dump and /api/config.getDump APIs to dump in memory config
445
- https://github.com/fluent/fluentd/pull/666
446
- * Add --show-plugin-config option
447
- https://github.com/fluent/fluentd/pull/663
448
-
449
- ### Bug fixes
450
-
451
- * in_http: Fix add_remote_addr and add_http_headers options not working on bulk request
452
- https://github.com/fluent/fluentd/pull/673
453
- * parser: RegexpParser#initialize should wrap only Hash configuration
454
- https://github.com/fluent/fluentd/pull/647
455
-
456
- ## Release 0.12.15 - 2015/07/29
457
-
458
- ### New features / Enhancement
459
-
460
- * in_status: Warn deprecation message
461
- https://github.com/fluent/fluentd/pull/635
462
- * output: Modify TimeSlicedOutput#emit mechanizm to fit BufferedOutput#emit way
463
- https://github.com/fluent/fluentd/pull/634
464
-
465
- ## Release 0.12.14 - 2015/07/17
466
-
467
- ### New features / Enhancement
468
-
469
- * config: Log unused section configuration as warn level
470
- https://github.com/fluent/fluentd/pull/629
471
- * config: Add '@' to log_level. Keep log_level for backward compatibility
472
- https://github.com/fluent/fluentd/pull/630
473
- * parser: Add time_key option for RegexpParser
474
- https://github.com/fluent/fluentd/pull/588
475
-
476
- ### Bug fixes
477
-
478
- * out_forward: Add 'dns_round_robin' option
479
- https://github.com/fluent/fluentd/pull/632
480
-
481
- ## Release 0.12.13 - 2015/07/09
482
-
483
- ### New features / Enhancement
484
-
485
- * out_stdout: Support formatter plugins in out_stdout
486
- https://github.com/fluent/fluentd/pull/617
487
- * filter_record_transformer: Add "auto_typecast" parameter
488
- https://github.com/fluent/fluentd/pull/620
489
- * out_forward: Support DNS round robin
490
- https://github.com/fluent/fluentd/pull/625
491
- * out_forward: Support heartbeat_type none to disable heartbeat
492
- https://github.com/fluent/fluentd/pull/626
493
-
494
- ### Bug fixes
495
-
496
- * config: Fix secret option to support config_section
497
- https://github.com/fluent/fluentd/pull/628
498
-
499
- ## Release 0.12.12 - 2015/06/12
500
-
501
- ### New features / Enhancement
502
-
503
- * in_forward: Add chunk format check
504
- https://github.com/fluent/fluentd/pull/611
505
-
506
- ### Bug fixes
507
-
508
- * formatter: Fix SingleValueFormatter to prevent record from modified
509
- https://github.com/fluent/fluentd/pull/615
510
- * config: configure requires Config::Element, not Hash
511
- https://github.com/fluent/fluentd/pull/616
512
-
513
- ## Release 0.12.11 - 2015/06/01
514
-
515
- ### New features / Enhancement
516
-
517
- * fluent-cat: Add none format
518
- https://github.com/fluent/fluentd/pull/606
519
- * config: Add secret option
520
- https://github.com/fluent/fluentd/pull/604
521
-
522
- ## Release 0.12.10 - 2015/05/28
523
-
524
- ### New features / Enhancement
525
-
526
- * filter_record_transformer: add renew_time_key option to replace event time with processed field
527
- https://github.com/fluent/fluentd/pull/602
528
- * config: add config_param `enum` type
529
- https://github.com/fluent/fluentd/pull/600
530
-
531
- ## Release 0.12.9 - 2015/05/19
532
-
533
- ### New features / Enhancement
534
-
535
- * in_tail: Add read_lines_limit parameter to control chunk size
536
- https://github.com/fluent/fluentd/pull/593
537
- * filter: add filter_stdout plugin
538
- https://github.com/fluent/fluentd/pull/586
539
- * parser: add keep_time_key option
540
- https://github.com/fluent/fluentd/pull/587
541
- * parser: keys parameter accepts json array configuration
542
- https://github.com/fluent/fluentd/pull/592
543
- * Implement RPC server for better instance management
544
- https://github.com/fluent/fluentd/pull/585
545
-
546
- ### Bug fixes
547
-
548
- * out_file: Fix out_file can create directory recursively
549
- https://github.com/fluent/fluentd/pull/595
550
-
551
- ## Release 0.12.8 - 2015/04/22
552
-
553
- ### New features / Enhancement
554
-
555
- * output: Support millisecond for try_flush_interval and queued_chunk_flush_interval
556
- https://github.com/fluent/fluentd/pull/568
557
- * filter_record_transformer: Support fields which start with @
558
- https://github.com/fluent/fluentd/pull/574
559
- * config: Add final attribute to prevent config overwritten by subclass
560
- https://github.com/fluent/fluentd/pull/583
561
-
562
- ### Bug fixes
563
-
564
- * config: fix embedded code parsing
565
- https://github.com/fluent/fluentd/pull/564
566
- * out_forward: Resend chunks on dropped connection when wait ACK
567
- https://github.com/fluent/fluentd/pull/580
568
-
569
- ## Release 0.12.7 - 2015/03/22
570
-
571
- ### New features / Enhancement
572
-
573
- * in_tail: Add exclude_path option to support exclusion of files
574
- https://github.com/fluent/fluentd/pull/561
575
- * filter_record_transformer: Support placeholders in record keys
576
- https://github.com/fluent/fluentd/pull/558
577
-
578
-
579
- ## Release 0.12.6 - 2015/03/03
580
-
581
- ### Bug fixes
582
-
583
- * out_forward: Should handle ECONNREFUSED exeception on TCP heartbeat
584
- * test: BufferedOutputTestDriver must use correct buffer chunk type
585
-
586
- ## Release 0.12.5 - 2015/02/09
587
-
588
- ### New features / Enhancement
589
-
590
- * in_tail: Enable multiline mode if format contains 'multiline'
591
- https://github.com/fluent/fluentd/pull/545
592
- * event: Improve EventStream#to_msgpack_stream performance
593
- https://github.com/fluent/fluentd/pull/549
594
- * engine: Add tag information emit log
595
-
596
- ### Bug fixes
597
-
598
- * Update msgpack dependency to avoid incompatible encoding problem
599
- https://github.com/fluent/fluentd/pull/550
600
-
601
- ## Release 0.12.4 - 2015/01/23
602
-
603
- ### New features / Enhancement
604
-
605
- * Support 64bit inode environment in in_tail
606
- https://github.com/fluent/fluentd/pull/542
607
-
608
- ### Bug fixes
609
-
610
- * Fix ThreadError occuring on Signal.trap SIGHUP
611
- https://github.com/fluent/fluentd/pull/541
612
-
613
- ## Release 0.12.3 - 2015/01/16
614
-
615
- ### New features / Enhancement
616
-
617
- * parser: nginx and apache2 format can now parse access log without http-version
618
- https://github.com/fluent/fluentd/pull/535
619
- * filter_record_transformer: Allow non-string values like array / hash
620
- https://github.com/fluent/fluentd/pull/530
621
- * plugin: Add writable check for path related parameter
622
- https://github.com/fluent/fluentd/pull/401
623
- * command: -g and -G now works in embedded Ruby environment like Treasure Agent
624
- https://github.com/fluent/fluentd/pull/423
625
-
626
- ### Bug fixes
627
-
628
- * buffer: Fix to flush a buffer by USR1 signal even on retrying
629
- https://github.com/fluent/fluentd/pull/531
630
- * buffer: Fix TimeSlicedOutput doesn't flush with SIGUSR1
631
- https://github.com/fluent/fluentd/pull/533
632
- * buffer: Fix broken calc_retry_wait if Integer is used for retry_wait parameter
633
- https://github.com/fluent/fluentd/pull/529
634
- * engine: Fix SIGHUP does not reload config
635
- https://github.com/fluent/fluentd/pull/537
636
-
637
- ## Release 0.12.2 - 2014/12/20
638
-
639
- ### New Features / Enhancement
640
-
641
- * filter: Change filter behaviour. If filter method returns nil, its record is removed from stream.
642
- https://github.com/fluent/fluentd/pull/515
643
- * in_monitor_agent: Render filter plugins
644
- https://github.com/fluent/fluentd/pull/514
645
- * test: FilterTestDriver has run, emit and getting result methods
646
- https://github.com/fluent/fluentd/pull/519
647
-
648
- ### Bug fixes
649
-
650
- * test: Support @label by TestDriver
651
- https://github.com/fluent/fluentd/pull/517
652
-
653
- ## Release 0.12.1 - 2014/12/14
654
-
655
- ### Bug fixes
656
-
657
- * plugin: Fix router is nil inside out_copy, out_roundrobin, and BufferedOutput secondary
658
- https://github.com/fluent/fluentd/pull/508
659
-
660
- ## Release 0.12.0 - 2014/12/12
661
-
662
- ### New Features / Enhancement
663
-
664
- * config: Introduce @type and @id parameter for system parameter. type and id are still valid.
665
- * Filter: old tag trick of "using output plugins as filter" is no longer needed
666
- v0.12.0 ships with grep and record_transformer filter plugins
667
- * Label: grouping Filter and Output plugins to reduce the complexity of event routing
668
- @ERROR built-in label is also added to handle errors in emit
669
- Add emit_error_event API to send invalid record to @ERROR
670
- * in_forward/out_forward: Add require_ack_response and ack_response_timeout for At-least-once semantics
671
-
672
- Here is the announcement for above new features: http://www.fluentd.org/blog/fluentd-v0.12-is-released
673
-
674
- * parser/formatter: Add base class and Plugin.new_xxx/Plugin.register_xxx APIs
675
- https://github.com/fluent/fluentd/pull/495
676
- https://github.com/fluent/fluentd/pull/497
677
- * formatter: Add new CSV formatter
678
- https://github.com/fluent/fluentd/pull/489
679
- * formatter: Add msgpack format to built-in Formatter to dump records
680
- https://github.com/fluent/fluentd/pull/479
681
- * input: Add in_dummy plugin
682
- https://github.com/fluent/fluentd/pull/484
683
- * in_http: Add respond_with_empty_img parameter to return empty gif image
684
- https://github.com/fluent/fluentd/pull/480
685
- * in_http: Add cors_allow_origins parameter to support CORS request
686
- https://github.com/fluent/fluentd/pull/473
687
- * output: Add relable output plugin
688
- https://github.com/fluent/fluentd/pull/417
689
- * config: Add self.name to configure_proxy error message
690
- https://github.com/fluent/fluentd/pull/490
691
- * log: --suppress-repeated-stacktrace is true by default
692
- https://github.com/fluent/fluentd/pull/446
693
- * Update msgpack to v0.5 and cool.io to v1.2
694
-
695
- ### Bug fixes
696
-
697
- * config: Fix system config using double memory
698
- https://github.com/fluent/fluentd/pull/496
699
- * config: Fix v1 config to support multiple tag match
700
- https://github.com/fluent/fluentd/pull/478
701
- * config: Fix Config.bool_value regression for nil value
702
- https://github.com/fluent/fluentd/pull/477
703
- * parser: Fix blank column handling of TSVParser
704
- https://github.com/fluent/fluentd/pull/506
705
- * buffer: Prevent an exception with large num_retries
706
- https://github.com/fluent/fluentd/pull/502
707
- * out_file: Don't create world writable directory in daemon mode
708
- https://github.com/fluent/fluentd/pull/483
709
-
710
- See https://github.com/fluent/fluentd/blob/v0.10/ChangeLog for v0.10 changelog