fluentd 0.14.4-x86-mingw32

Sign up to get free protection for your applications and to get access to all the features.

Potentially problematic release.

This version of fluentd might be problematic. Click here for more details.

Files changed (328) hide show
  1. checksums.yaml +7 -0
  2. data/.github/ISSUE_TEMPLATE.md +6 -0
  3. data/.gitignore +26 -0
  4. data/.travis.yml +45 -0
  5. data/AUTHORS +2 -0
  6. data/CONTRIBUTING.md +35 -0
  7. data/COPYING +14 -0
  8. data/ChangeLog +276 -0
  9. data/Gemfile +9 -0
  10. data/README.md +51 -0
  11. data/Rakefile +53 -0
  12. data/Vagrantfile +17 -0
  13. data/appveyor.yml +41 -0
  14. data/bin/fluent-debug +5 -0
  15. data/example/copy_roundrobin.conf +39 -0
  16. data/example/filter_stdout.conf +22 -0
  17. data/example/in_forward.conf +11 -0
  18. data/example/in_http.conf +14 -0
  19. data/example/in_out_forward.conf +17 -0
  20. data/example/in_syslog.conf +15 -0
  21. data/example/in_tail.conf +14 -0
  22. data/example/in_tcp.conf +13 -0
  23. data/example/in_udp.conf +13 -0
  24. data/example/multi_filters.conf +61 -0
  25. data/example/out_buffered_null.conf +32 -0
  26. data/example/out_copy.conf +20 -0
  27. data/example/out_file.conf +13 -0
  28. data/example/out_forward.conf +35 -0
  29. data/example/out_forward_buf_file.conf +23 -0
  30. data/example/v0_12_filter.conf +78 -0
  31. data/example/v1_literal_example.conf +36 -0
  32. data/fluent.conf +139 -0
  33. data/fluentd.gemspec +51 -0
  34. data/lib/fluent/agent.rb +194 -0
  35. data/lib/fluent/command/bundler_injection.rb +45 -0
  36. data/lib/fluent/command/cat.rb +319 -0
  37. data/lib/fluent/command/debug.rb +102 -0
  38. data/lib/fluent/command/fluentd.rb +273 -0
  39. data/lib/fluent/compat/call_super_mixin.rb +67 -0
  40. data/lib/fluent/compat/exec_util.rb +129 -0
  41. data/lib/fluent/compat/file_util.rb +54 -0
  42. data/lib/fluent/compat/filter.rb +68 -0
  43. data/lib/fluent/compat/formatter.rb +111 -0
  44. data/lib/fluent/compat/formatter_utils.rb +85 -0
  45. data/lib/fluent/compat/handle_tag_and_time_mixin.rb +62 -0
  46. data/lib/fluent/compat/handle_tag_name_mixin.rb +53 -0
  47. data/lib/fluent/compat/input.rb +49 -0
  48. data/lib/fluent/compat/output.rb +677 -0
  49. data/lib/fluent/compat/output_chain.rb +60 -0
  50. data/lib/fluent/compat/parser.rb +180 -0
  51. data/lib/fluent/compat/parser_utils.rb +40 -0
  52. data/lib/fluent/compat/propagate_default.rb +62 -0
  53. data/lib/fluent/compat/record_filter_mixin.rb +34 -0
  54. data/lib/fluent/compat/set_tag_key_mixin.rb +50 -0
  55. data/lib/fluent/compat/set_time_key_mixin.rb +69 -0
  56. data/lib/fluent/compat/socket_util.rb +165 -0
  57. data/lib/fluent/compat/string_util.rb +34 -0
  58. data/lib/fluent/compat/structured_format_mixin.rb +26 -0
  59. data/lib/fluent/compat/type_converter.rb +90 -0
  60. data/lib/fluent/config.rb +56 -0
  61. data/lib/fluent/config/basic_parser.rb +123 -0
  62. data/lib/fluent/config/configure_proxy.rb +366 -0
  63. data/lib/fluent/config/dsl.rb +149 -0
  64. data/lib/fluent/config/element.rb +218 -0
  65. data/lib/fluent/config/error.rb +26 -0
  66. data/lib/fluent/config/literal_parser.rb +251 -0
  67. data/lib/fluent/config/parser.rb +107 -0
  68. data/lib/fluent/config/section.rb +212 -0
  69. data/lib/fluent/config/types.rb +136 -0
  70. data/lib/fluent/config/v1_parser.rb +190 -0
  71. data/lib/fluent/configurable.rb +176 -0
  72. data/lib/fluent/daemon.rb +15 -0
  73. data/lib/fluent/engine.rb +220 -0
  74. data/lib/fluent/env.rb +27 -0
  75. data/lib/fluent/event.rb +287 -0
  76. data/lib/fluent/event_router.rb +259 -0
  77. data/lib/fluent/filter.rb +21 -0
  78. data/lib/fluent/formatter.rb +23 -0
  79. data/lib/fluent/input.rb +21 -0
  80. data/lib/fluent/label.rb +38 -0
  81. data/lib/fluent/load.rb +36 -0
  82. data/lib/fluent/log.rb +445 -0
  83. data/lib/fluent/match.rb +141 -0
  84. data/lib/fluent/mixin.rb +31 -0
  85. data/lib/fluent/msgpack_factory.rb +62 -0
  86. data/lib/fluent/output.rb +26 -0
  87. data/lib/fluent/output_chain.rb +23 -0
  88. data/lib/fluent/parser.rb +23 -0
  89. data/lib/fluent/plugin.rb +161 -0
  90. data/lib/fluent/plugin/bare_output.rb +63 -0
  91. data/lib/fluent/plugin/base.rb +130 -0
  92. data/lib/fluent/plugin/buf_file.rb +154 -0
  93. data/lib/fluent/plugin/buf_memory.rb +34 -0
  94. data/lib/fluent/plugin/buffer.rb +603 -0
  95. data/lib/fluent/plugin/buffer/chunk.rb +160 -0
  96. data/lib/fluent/plugin/buffer/file_chunk.rb +323 -0
  97. data/lib/fluent/plugin/buffer/memory_chunk.rb +90 -0
  98. data/lib/fluent/plugin/exec_util.rb +22 -0
  99. data/lib/fluent/plugin/file_util.rb +22 -0
  100. data/lib/fluent/plugin/file_wrapper.rb +120 -0
  101. data/lib/fluent/plugin/filter.rb +93 -0
  102. data/lib/fluent/plugin/filter_grep.rb +75 -0
  103. data/lib/fluent/plugin/filter_record_transformer.rb +342 -0
  104. data/lib/fluent/plugin/filter_stdout.rb +53 -0
  105. data/lib/fluent/plugin/formatter.rb +45 -0
  106. data/lib/fluent/plugin/formatter_csv.rb +47 -0
  107. data/lib/fluent/plugin/formatter_hash.rb +29 -0
  108. data/lib/fluent/plugin/formatter_json.rb +44 -0
  109. data/lib/fluent/plugin/formatter_ltsv.rb +41 -0
  110. data/lib/fluent/plugin/formatter_msgpack.rb +29 -0
  111. data/lib/fluent/plugin/formatter_out_file.rb +78 -0
  112. data/lib/fluent/plugin/formatter_single_value.rb +34 -0
  113. data/lib/fluent/plugin/formatter_stdout.rb +74 -0
  114. data/lib/fluent/plugin/in_debug_agent.rb +64 -0
  115. data/lib/fluent/plugin/in_dummy.rb +135 -0
  116. data/lib/fluent/plugin/in_exec.rb +149 -0
  117. data/lib/fluent/plugin/in_forward.rb +366 -0
  118. data/lib/fluent/plugin/in_gc_stat.rb +52 -0
  119. data/lib/fluent/plugin/in_http.rb +422 -0
  120. data/lib/fluent/plugin/in_monitor_agent.rb +401 -0
  121. data/lib/fluent/plugin/in_object_space.rb +90 -0
  122. data/lib/fluent/plugin/in_syslog.rb +204 -0
  123. data/lib/fluent/plugin/in_tail.rb +838 -0
  124. data/lib/fluent/plugin/in_tcp.rb +41 -0
  125. data/lib/fluent/plugin/in_udp.rb +37 -0
  126. data/lib/fluent/plugin/in_unix.rb +201 -0
  127. data/lib/fluent/plugin/input.rb +33 -0
  128. data/lib/fluent/plugin/multi_output.rb +95 -0
  129. data/lib/fluent/plugin/out_buffered_null.rb +59 -0
  130. data/lib/fluent/plugin/out_buffered_stdout.rb +70 -0
  131. data/lib/fluent/plugin/out_copy.rb +42 -0
  132. data/lib/fluent/plugin/out_exec.rb +114 -0
  133. data/lib/fluent/plugin/out_exec_filter.rb +393 -0
  134. data/lib/fluent/plugin/out_file.rb +167 -0
  135. data/lib/fluent/plugin/out_forward.rb +646 -0
  136. data/lib/fluent/plugin/out_null.rb +27 -0
  137. data/lib/fluent/plugin/out_relabel.rb +28 -0
  138. data/lib/fluent/plugin/out_roundrobin.rb +80 -0
  139. data/lib/fluent/plugin/out_stdout.rb +48 -0
  140. data/lib/fluent/plugin/out_stream.rb +130 -0
  141. data/lib/fluent/plugin/output.rb +1020 -0
  142. data/lib/fluent/plugin/owned_by_mixin.rb +42 -0
  143. data/lib/fluent/plugin/parser.rb +175 -0
  144. data/lib/fluent/plugin/parser_apache.rb +28 -0
  145. data/lib/fluent/plugin/parser_apache2.rb +84 -0
  146. data/lib/fluent/plugin/parser_apache_error.rb +26 -0
  147. data/lib/fluent/plugin/parser_csv.rb +33 -0
  148. data/lib/fluent/plugin/parser_json.rb +79 -0
  149. data/lib/fluent/plugin/parser_ltsv.rb +50 -0
  150. data/lib/fluent/plugin/parser_multiline.rb +104 -0
  151. data/lib/fluent/plugin/parser_nginx.rb +28 -0
  152. data/lib/fluent/plugin/parser_none.rb +36 -0
  153. data/lib/fluent/plugin/parser_regexp.rb +73 -0
  154. data/lib/fluent/plugin/parser_syslog.rb +82 -0
  155. data/lib/fluent/plugin/parser_tsv.rb +37 -0
  156. data/lib/fluent/plugin/socket_util.rb +22 -0
  157. data/lib/fluent/plugin/storage.rb +84 -0
  158. data/lib/fluent/plugin/storage_local.rb +132 -0
  159. data/lib/fluent/plugin/string_util.rb +22 -0
  160. data/lib/fluent/plugin_helper.rb +42 -0
  161. data/lib/fluent/plugin_helper/child_process.rb +298 -0
  162. data/lib/fluent/plugin_helper/compat_parameters.rb +224 -0
  163. data/lib/fluent/plugin_helper/event_emitter.rb +80 -0
  164. data/lib/fluent/plugin_helper/event_loop.rb +118 -0
  165. data/lib/fluent/plugin_helper/formatter.rb +149 -0
  166. data/lib/fluent/plugin_helper/inject.rb +125 -0
  167. data/lib/fluent/plugin_helper/parser.rb +147 -0
  168. data/lib/fluent/plugin_helper/retry_state.rb +177 -0
  169. data/lib/fluent/plugin_helper/storage.rb +331 -0
  170. data/lib/fluent/plugin_helper/thread.rb +147 -0
  171. data/lib/fluent/plugin_helper/timer.rb +90 -0
  172. data/lib/fluent/plugin_id.rb +63 -0
  173. data/lib/fluent/process.rb +504 -0
  174. data/lib/fluent/registry.rb +99 -0
  175. data/lib/fluent/root_agent.rb +314 -0
  176. data/lib/fluent/rpc.rb +94 -0
  177. data/lib/fluent/supervisor.rb +680 -0
  178. data/lib/fluent/system_config.rb +122 -0
  179. data/lib/fluent/test.rb +56 -0
  180. data/lib/fluent/test/base.rb +85 -0
  181. data/lib/fluent/test/driver/base.rb +179 -0
  182. data/lib/fluent/test/driver/base_owned.rb +70 -0
  183. data/lib/fluent/test/driver/base_owner.rb +125 -0
  184. data/lib/fluent/test/driver/event_feeder.rb +98 -0
  185. data/lib/fluent/test/driver/filter.rb +57 -0
  186. data/lib/fluent/test/driver/formatter.rb +30 -0
  187. data/lib/fluent/test/driver/input.rb +31 -0
  188. data/lib/fluent/test/driver/multi_output.rb +52 -0
  189. data/lib/fluent/test/driver/output.rb +76 -0
  190. data/lib/fluent/test/driver/parser.rb +30 -0
  191. data/lib/fluent/test/driver/test_event_router.rb +45 -0
  192. data/lib/fluent/test/filter_test.rb +77 -0
  193. data/lib/fluent/test/formatter_test.rb +65 -0
  194. data/lib/fluent/test/helpers.rb +79 -0
  195. data/lib/fluent/test/input_test.rb +172 -0
  196. data/lib/fluent/test/log.rb +73 -0
  197. data/lib/fluent/test/output_test.rb +156 -0
  198. data/lib/fluent/test/parser_test.rb +70 -0
  199. data/lib/fluent/time.rb +175 -0
  200. data/lib/fluent/timezone.rb +133 -0
  201. data/lib/fluent/unique_id.rb +39 -0
  202. data/lib/fluent/version.rb +21 -0
  203. data/lib/fluent/winsvc.rb +71 -0
  204. data/test/compat/test_calls_super.rb +166 -0
  205. data/test/compat/test_parser.rb +82 -0
  206. data/test/config/assertions.rb +42 -0
  207. data/test/config/test_config_parser.rb +507 -0
  208. data/test/config/test_configurable.rb +1194 -0
  209. data/test/config/test_configure_proxy.rb +386 -0
  210. data/test/config/test_dsl.rb +415 -0
  211. data/test/config/test_element.rb +403 -0
  212. data/test/config/test_literal_parser.rb +297 -0
  213. data/test/config/test_section.rb +184 -0
  214. data/test/config/test_system_config.rb +120 -0
  215. data/test/config/test_types.rb +171 -0
  216. data/test/helper.rb +119 -0
  217. data/test/plugin/data/2010/01/20100102-030405.log +0 -0
  218. data/test/plugin/data/2010/01/20100102-030406.log +0 -0
  219. data/test/plugin/data/2010/01/20100102.log +0 -0
  220. data/test/plugin/data/log/bar +0 -0
  221. data/test/plugin/data/log/foo/bar.log +0 -0
  222. data/test/plugin/data/log/test.log +0 -0
  223. data/test/plugin/test_bare_output.rb +118 -0
  224. data/test/plugin/test_base.rb +75 -0
  225. data/test/plugin/test_buf_file.rb +571 -0
  226. data/test/plugin/test_buf_memory.rb +42 -0
  227. data/test/plugin/test_buffer.rb +1200 -0
  228. data/test/plugin/test_buffer_chunk.rb +168 -0
  229. data/test/plugin/test_buffer_file_chunk.rb +771 -0
  230. data/test/plugin/test_buffer_memory_chunk.rb +265 -0
  231. data/test/plugin/test_file_util.rb +96 -0
  232. data/test/plugin/test_filter.rb +353 -0
  233. data/test/plugin/test_filter_grep.rb +119 -0
  234. data/test/plugin/test_filter_record_transformer.rb +600 -0
  235. data/test/plugin/test_filter_stdout.rb +211 -0
  236. data/test/plugin/test_formatter_csv.rb +94 -0
  237. data/test/plugin/test_formatter_json.rb +30 -0
  238. data/test/plugin/test_formatter_ltsv.rb +52 -0
  239. data/test/plugin/test_formatter_msgpack.rb +28 -0
  240. data/test/plugin/test_formatter_out_file.rb +95 -0
  241. data/test/plugin/test_formatter_single_value.rb +38 -0
  242. data/test/plugin/test_in_debug_agent.rb +28 -0
  243. data/test/plugin/test_in_dummy.rb +188 -0
  244. data/test/plugin/test_in_exec.rb +133 -0
  245. data/test/plugin/test_in_forward.rb +635 -0
  246. data/test/plugin/test_in_gc_stat.rb +39 -0
  247. data/test/plugin/test_in_http.rb +442 -0
  248. data/test/plugin/test_in_monitor_agent.rb +329 -0
  249. data/test/plugin/test_in_object_space.rb +64 -0
  250. data/test/plugin/test_in_syslog.rb +205 -0
  251. data/test/plugin/test_in_tail.rb +1001 -0
  252. data/test/plugin/test_in_tcp.rb +102 -0
  253. data/test/plugin/test_in_udp.rb +121 -0
  254. data/test/plugin/test_in_unix.rb +126 -0
  255. data/test/plugin/test_input.rb +122 -0
  256. data/test/plugin/test_multi_output.rb +180 -0
  257. data/test/plugin/test_out_buffered_null.rb +79 -0
  258. data/test/plugin/test_out_buffered_stdout.rb +122 -0
  259. data/test/plugin/test_out_copy.rb +160 -0
  260. data/test/plugin/test_out_exec.rb +155 -0
  261. data/test/plugin/test_out_exec_filter.rb +262 -0
  262. data/test/plugin/test_out_file.rb +383 -0
  263. data/test/plugin/test_out_forward.rb +590 -0
  264. data/test/plugin/test_out_null.rb +29 -0
  265. data/test/plugin/test_out_relabel.rb +28 -0
  266. data/test/plugin/test_out_roundrobin.rb +146 -0
  267. data/test/plugin/test_out_stdout.rb +92 -0
  268. data/test/plugin/test_out_stream.rb +93 -0
  269. data/test/plugin/test_output.rb +568 -0
  270. data/test/plugin/test_output_as_buffered.rb +1604 -0
  271. data/test/plugin/test_output_as_buffered_overflow.rb +250 -0
  272. data/test/plugin/test_output_as_buffered_retries.rb +839 -0
  273. data/test/plugin/test_output_as_buffered_secondary.rb +817 -0
  274. data/test/plugin/test_output_as_standard.rb +374 -0
  275. data/test/plugin/test_owned_by.rb +35 -0
  276. data/test/plugin/test_parser_apache.rb +42 -0
  277. data/test/plugin/test_parser_apache2.rb +38 -0
  278. data/test/plugin/test_parser_apache_error.rb +45 -0
  279. data/test/plugin/test_parser_base.rb +32 -0
  280. data/test/plugin/test_parser_csv.rb +104 -0
  281. data/test/plugin/test_parser_json.rb +107 -0
  282. data/test/plugin/test_parser_labeled_tsv.rb +129 -0
  283. data/test/plugin/test_parser_multiline.rb +100 -0
  284. data/test/plugin/test_parser_nginx.rb +48 -0
  285. data/test/plugin/test_parser_none.rb +53 -0
  286. data/test/plugin/test_parser_regexp.rb +277 -0
  287. data/test/plugin/test_parser_syslog.rb +66 -0
  288. data/test/plugin/test_parser_time.rb +46 -0
  289. data/test/plugin/test_parser_tsv.rb +121 -0
  290. data/test/plugin/test_storage.rb +167 -0
  291. data/test/plugin/test_storage_local.rb +8 -0
  292. data/test/plugin/test_string_util.rb +26 -0
  293. data/test/plugin_helper/test_child_process.rb +608 -0
  294. data/test/plugin_helper/test_compat_parameters.rb +242 -0
  295. data/test/plugin_helper/test_event_emitter.rb +51 -0
  296. data/test/plugin_helper/test_event_loop.rb +52 -0
  297. data/test/plugin_helper/test_formatter.rb +252 -0
  298. data/test/plugin_helper/test_inject.rb +487 -0
  299. data/test/plugin_helper/test_parser.rb +263 -0
  300. data/test/plugin_helper/test_retry_state.rb +399 -0
  301. data/test/plugin_helper/test_storage.rb +521 -0
  302. data/test/plugin_helper/test_thread.rb +164 -0
  303. data/test/plugin_helper/test_timer.rb +131 -0
  304. data/test/scripts/exec_script.rb +32 -0
  305. data/test/scripts/fluent/plugin/formatter_known.rb +8 -0
  306. data/test/scripts/fluent/plugin/out_test.rb +81 -0
  307. data/test/scripts/fluent/plugin/out_test2.rb +80 -0
  308. data/test/scripts/fluent/plugin/parser_known.rb +4 -0
  309. data/test/test_config.rb +179 -0
  310. data/test/test_configdsl.rb +148 -0
  311. data/test/test_event.rb +329 -0
  312. data/test/test_event_router.rb +331 -0
  313. data/test/test_event_time.rb +184 -0
  314. data/test/test_filter.rb +121 -0
  315. data/test/test_formatter.rb +319 -0
  316. data/test/test_input.rb +31 -0
  317. data/test/test_log.rb +572 -0
  318. data/test/test_match.rb +137 -0
  319. data/test/test_mixin.rb +351 -0
  320. data/test/test_output.rb +214 -0
  321. data/test/test_plugin_classes.rb +136 -0
  322. data/test/test_plugin_helper.rb +81 -0
  323. data/test/test_process.rb +48 -0
  324. data/test/test_root_agent.rb +278 -0
  325. data/test/test_supervisor.rb +339 -0
  326. data/test/test_time_formatter.rb +186 -0
  327. data/test/test_unique_id.rb +47 -0
  328. metadata +823 -0
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA1:
3
+ metadata.gz: 9e4df2d760ce6c015637b7789b6fab8c5e12ee18
4
+ data.tar.gz: 8d4699b9c7651259aa638aa93a6959b0af3f5f37
5
+ SHA512:
6
+ metadata.gz: c0905803f7bfef0f602f05a6ec81064b68a7a6835270e80ec0065495983a01a7b25a7e8a491c26f5766f5761b9e5193741d2c19caccdb18b1f52461e8e20a2b0
7
+ data.tar.gz: c8a637b7d37727551aa04a4b46198745afa8f369a3d679b92f8599d0ab91b48e22b83f9b497901f6eb10b26ba020a7d714acf9902842ee193939eca3c8772fce
data/.github/ISSUE_TEMPLATE.md ADDED
@@ -0,0 +1,6 @@
1
+ Check [CONTRIBUTING guideline](https://github.com/fluent/fluentd/blob/master/CONTRIBUTING.md) first and here is the list to help us investigate the problem.
2
+
3
+ - fluentd or td-agent version.
4
+ - Environment information, e.g. OS.
5
+ - Your configuration
6
+ - Your problem explanation. If you have an error logs, write it together.
data/.gitignore ADDED
@@ -0,0 +1,26 @@
1
+ Gemfile.lock
2
+ INSTALL
3
+ NEWS
4
+ Makefile
5
+ Makefile.in
6
+ README
7
+ ac
8
+ aclocal.m4
9
+ autom4te.cache
10
+ confdefs.h
11
+ config.log
12
+ config.status
13
+ configure
14
+ deps/
15
+ fluent-cat
16
+ fluent-gem
17
+ fluentd
18
+ pkg/*
19
+ test/tmp/*
20
+ test/config/tmp/*
21
+ make_dist.sh
22
+ Gemfile.local
23
+ .ruby-version
24
+ *.swp
25
+ coverage/*
26
+ .vagrant/
data/.travis.yml ADDED
@@ -0,0 +1,45 @@
1
+ language: ruby
2
+ cache: bundler
3
+
4
+ # http://rubies.travis-ci.org/
5
+ # See here for osx_image -> OSX versions: https://docs.travis-ci.com/user/languages/objective-c
6
+ matrix:
7
+ include:
8
+ - rvm: 2.1.10
9
+ os: linux
10
+ - rvm: 2.2.5
11
+ os: linux
12
+ - rvm: 2.3.1
13
+ os: linux
14
+ - rvm: ruby-head
15
+ os: linux
16
+ - rvm: 2.1.10
17
+ os: osx
18
+ osx_image: xcode7.3 # OSX 10.11
19
+ - rvm: 2.2.5
20
+ os: osx
21
+ osx_image: xcode7.3 # OSX 10.11
22
+ - rvm: ruby-head
23
+ os: osx
24
+ osx_image: xcode 7.3 # OSX 10.11
25
+ allow_failures:
26
+ - rvm: ruby-head
27
+
28
+ # no valid version/env for ruby 2.3 right now
29
+ # - rvm: 2.3.0
30
+ # os: osx
31
+ # osx_image: ....
32
+
33
+ branches:
34
+ only:
35
+ - master
36
+ - v0.10
37
+ - v0.12
38
+ - v0.14
39
+
40
+ sudo: false
41
+
42
+ addons:
43
+ apt:
44
+ packages:
45
+ - libgmp3-dev
data/AUTHORS ADDED
@@ -0,0 +1,2 @@
1
+ FURUHASHI Sadayuki <frsyuki _at_ gmail.com>
2
+ NAKAGAWA Masahiro <repeatedly _at_ gmail.com>
data/CONTRIBUTING.md ADDED
@@ -0,0 +1,35 @@
1
+ # Contributing to Fluentd
2
+
3
+ We'd love your contribution. Here are the guidelines!
4
+
5
+ ## Got a question or problem?
6
+
7
+ RESOURCES of [Official site](http://www.fluentd.org/) and [Fluentd documentation](http://docs.fluentd.org/) may help you.
8
+
9
+ If you have further questions about Fluentd and plugins, please direct these to [Mailing List](https://groups.google.com/forum/#!forum/fluentd).
10
+
11
+ Don't use Github issue for asking questions.
12
+ Github issue is mainly for submitting a bug report or feature request. See below.
13
+
14
+ ## Found a bug?
15
+
16
+ If you find a bug of Fluentd or a mistake in the documentation, you can help us by
17
+ submitting an issue to Fluentd. Even better you can submit a Pull Request with a fix.
18
+
19
+ * **Fluentd**: Use [fluentd](https://github.com/fluent/fluentd) repository.
20
+ * **Documentation**: Use [fluentd-docs](https://github.com/fluent/fluentd-docs) repository.
21
+
22
+ If you find a bug of 3rd party plugins, please submit an issue to each plugin repository.
23
+ And use [omnibus-td-agent](https://github.com/treasure-data/omnibus-td-agent) repository for td-agent releated issues.
24
+
25
+ ## Patch Guidelines
26
+
27
+ Here are some things that would increase a chance that your patch is accepted:
28
+
29
+ * Write tests.
30
+ * Run tests before send Pull Request by `bundle exec rake test`
31
+ * Write a [good commit message](http://tbaggery.com/2008/04/19/a-note-about-git-commit-messages.html).
32
+
33
+ There are some patches which are hard to write tests, e.g. process handling, concurrency issue or etc.
34
+ In such case, please don't hesitate to submit a Pull Request.
35
+ We can discuss how to manage a patch on Pull Request :)
data/COPYING ADDED
@@ -0,0 +1,14 @@
1
+ Copyright (C) 2011 FURUHASHI Sadayuki
2
+
3
+ Licensed under the Apache License, Version 2.0 (the "License");
4
+ you may not use this file except in compliance with the License.
5
+ You may obtain a copy of the License at
6
+
7
+ http://www.apache.org/licenses/LICENSE-2.0
8
+
9
+ Unless required by applicable law or agreed to in writing, software
10
+ distributed under the License is distributed on an "AS IS" BASIS,
11
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12
+ See the License for the specific language governing permissions and
13
+ limitations under the License.
14
+
data/ChangeLog ADDED
@@ -0,0 +1,276 @@
1
+ # v0.14
2
+
3
+ ## Release v0.14.4 - 2016/08/31
4
+
5
+ ### New features / Enhancement
6
+
7
+ * Add a method to Filter API to update time of events
8
+ https://github.com/fluent/fluentd/pull/1140
9
+ * Improve performance of filter pipeline
10
+ https://github.com/fluent/fluentd/pull/1145
11
+ * Fix to suppress not to warn about different plugins for primary and secondary without any problems
12
+ https://github.com/fluent/fluentd/pull/1153
13
+ * Add deprecated/obsoleted options to config_param to show removed/warned parameters
14
+ https://github.com/fluent/fluentd/pull/1186
15
+ * in_forward: Add a feature source_hostname_key to inject source hostname into records
16
+ https://github.com/fluent/fluentd/pull/807
17
+ * in_tail: Add a feature from_encoding to specify both encoding from and to
18
+ https://github.com/fluent/fluentd/pull/1067
19
+ * filter_record_transformer: Fix to prevent overwriting reserved placeholder keys
20
+ https://github.com/fluent/fluentd/pull/1176
21
+ * Migrate some build-in plugins into v0.14 API
22
+ https://github.com/fluent/fluentd/pull/1149
23
+ https://github.com/fluent/fluentd/pull/1151
24
+ * Update dependencies
25
+ https://github.com/fluent/fluentd/pull/1193
26
+
27
+ ### Bug fixes
28
+
29
+ * Fix to start/stop/restart Fluentd processes correctly on Windows environment
30
+ https://github.com/fluent/fluentd/pull/1171
31
+ https://github.com/fluent/fluentd/pull/1192
32
+ * Fix to handle Windows events correctly in winsvc.rb
33
+ https://github.com/fluent/fluentd/pull/1155
34
+ https://github.com/fluent/fluentd/pull/1170
35
+ * Fix not to continue to restart workers for configuration errors
36
+ https://github.com/fluent/fluentd/pull/1183
37
+ * Fix output threads to start enqueue/flush buffers until plugins' start method ends
38
+ https://github.com/fluent/fluentd/pull/1190
39
+ * Fix a bug not to set umask 0
40
+ https://github.com/fluent/fluentd/pull/1152
41
+ * Fix resource leak on one-shot timers
42
+ https://github.com/fluent/fluentd/pull/1178
43
+ * Fix to call plugin helper methods in configure
44
+ https://github.com/fluent/fluentd/pull/1184
45
+ * Fix a bug to count event size
46
+ https://github.com/fluent/fluentd/pull/1164/files
47
+ * Fix to require missed compat modules
48
+ https://github.com/fluent/fluentd/pull/1168
49
+ * Fix to start properly for plugins under MultiOutput
50
+ https://github.com/fluent/fluentd/pull/1167
51
+ * Fix test drivers to set class name into plugin instances
52
+ https://github.com/fluent/fluentd/pull/1069
53
+ * Fix tests not to use mocks for Time (improve test stabilization)
54
+ https://github.com/fluent/fluentd/pull/1194
55
+
56
+ ## Release 0.14.3 - 2016/08/30
57
+
58
+ * Fix the dependency for ServerEngine 1.x
59
+
60
+ ## Release 0.14.2 - 2016/08/09
61
+
62
+ ### New features / Enhancement
63
+
64
+ * Fix to split large event stream into some/many chunks in buffers
65
+ https://github.com/fluent/fluentd/pull/1062
66
+ * Add parser and filter support in compat_parameters plugin helper
67
+ https://github.com/fluent/fluentd/pull/1079
68
+ * Add a RPC call to flush buffers and stop workers
69
+ https://github.com/fluent/fluentd/pull/1134
70
+ * Update forward protocol to pass the number of events in a payload
71
+ https://github.com/fluent/fluentd/pull/1137
72
+ * Improve performance of some built-in formatter plugins
73
+ https://github.com/fluent/fluentd/pull/1082
74
+ https://github.com/fluent/fluentd/pull/1086
75
+ * Migrate some built-in plugins and plugin util modules into v0.14 API
76
+ https://github.com/fluent/fluentd/pull/1058
77
+ https://github.com/fluent/fluentd/pull/1061
78
+ https://github.com/fluent/fluentd/pull/1076
79
+ https://github.com/fluent/fluentd/pull/1078
80
+ https://github.com/fluent/fluentd/pull/1081
81
+ https://github.com/fluent/fluentd/pull/1083
82
+ https://github.com/fluent/fluentd/pull/1091
83
+ * Register RegExpParser as a parser plugin explicitly
84
+ https://github.com/fluent/fluentd/pull/1094
85
+ * Add delimiter option to CSV parser
86
+ https://github.com/fluent/fluentd/pull/1108
87
+ * Add an option to receive longer udp syslog messages
88
+ https://github.com/fluent/fluentd/pull/1127
89
+ * Add a option to suspend internal status in dummy plugin
90
+ https://github.com/fluent/fluentd/pull/900
91
+ * Add a feature to capture filtered records in test driver for Filter plugins
92
+ https://github.com/fluent/fluentd/pull/1077
93
+ * Add some utility methods to plugin test drivers
94
+ https://github.com/fluent/fluentd/pull/1114
95
+
96
+ ### Bug fixes
97
+
98
+ * Fix bug to read non buffer-chunk files as buffer chunks when Fluentd resumed
99
+ https://github.com/fluent/fluentd/pull/1124
100
+ * Fix bug not to load Filter plugins which are specified in configurations
101
+ https://github.com/fluent/fluentd/pull/1118
102
+ * Fix bug to ignore `-p` option to specify directories of plugins
103
+ https://github.com/fluent/fluentd/pull/1133
104
+ * Fix bug to overwrite base class configuration section definitions by subclasses
105
+ https://github.com/fluent/fluentd/pull/1119
106
+ * Fix to stop Fluentd worker process by Ctrl-C when --no-supervisor specified
107
+ https://github.com/fluent/fluentd/pull/1089
108
+ * Fix regression about RPC call to reload configuration
109
+ https://github.com/fluent/fluentd/pull/1093
110
+ * Specify to ensure Oj JSON parser to use strict mode
111
+ https://github.com/fluent/fluentd/pull/1147
112
+ * Fix unexisting path handling in Windows environment
113
+ https://github.com/fluent/fluentd/pull/1104
114
+
115
+ ## Release 0.14.1 - 2016/06/30
116
+
117
+ ### New features / Enhancement
118
+
119
+ * Add plugin helpers for parsers and formatters
120
+ https://github.com/fluent/fluentd/pull/1023
121
+ * Extract some mixins into compat modules
122
+ https://github.com/fluent/fluentd/pull/1044
123
+ https://github.com/fluent/fluentd/pull/1052
124
+ * Add utility methods for tests and test drivers
125
+ https://github.com/fluent/fluentd/pull/1047
126
+ * Migrate some built-in plugins to v0.14 APIs
127
+ https://github.com/fluent/fluentd/pull/1049
128
+ https://github.com/fluent/fluentd/pull/1057
129
+ https://github.com/fluent/fluentd/pull/1060
130
+ https://github.com/fluent/fluentd/pull/1064
131
+ * Add support of X-Forwarded-For header in in_http plugin
132
+ https://github.com/fluent/fluentd/pull/1051
133
+ * Warn not to create too many staged chunks at configure
134
+ https://github.com/fluent/fluentd/pull/1054
135
+ * Add a plugin helper to inject tag/time/hostname
136
+ https://github.com/fluent/fluentd/pull/1063
137
+
138
+ ### Bug fixes
139
+
140
+ * Fix in_monitor_agent for v0.14 plugins
141
+ https://github.com/fluent/fluentd/pull/1003
142
+ * Fix to call #format_stream of plugins themselves when RecordFilter mixin included
143
+ https://github.com/fluent/fluentd/pull/1005
144
+ * Fix shutdown sequence to wait force flush
145
+ https://github.com/fluent/fluentd/pull/1009
146
+ * Fix a deadlock bug in shutdown
147
+ https://github.com/fluent/fluentd/pull/1010
148
+ * Fix to require DetachProcessMixin in default for compat plugins
149
+ https://github.com/fluent/fluentd/pull/1014
150
+ * Fix to overwrite configure_proxy name only for root sections for debugging
151
+ https://github.com/fluent/fluentd/pull/1015
152
+ * Rename file for in_unix plugin
153
+ https://github.com/fluent/fluentd/pull/1017
154
+ * Fix a bug not to create pid file when daemonized
155
+ https://github.com/fluent/fluentd/pull/1021
156
+ * Fix wrong DEFAULT_PLUGIN_PATH
157
+ https://github.com/fluent/fluentd/pull/1028
158
+ * Fix a bug not to use primary plugin type for secondary in default
159
+ https://github.com/fluent/fluentd/pull/1032
160
+ * Add --run-worker option to distinguish to run as worker without supervisor
161
+ https://github.com/fluent/fluentd/pull/1033
162
+ * Fix regression of fluent-debug command
163
+ https://github.com/fluent/fluentd/pull/1046
164
+ * Update windows-pr dependency to 1.2.5
165
+ https://github.com/fluent/fluentd/pull/1065
166
+ * Fix supervisor to pass RUBYOPT to worker processes
167
+ https://github.com/fluent/fluentd/pull/1066
168
+
169
+ ## Release 0.14.0 - 2016/05/25
170
+
171
+ ### New features / Enhancement
172
+
173
+ This list includes changes of 0.14.0.pre.1 and release candidates.
174
+
175
+ * Update supported Ruby version to 2.1 or later
176
+ https://github.com/fluent/fluentd/pull/692
177
+ * Sub-second event time support
178
+ https://github.com/fluent/fluentd/pull/653
179
+ * Windows support and supervisor improvement
180
+ https://github.com/fluent/fluentd/pull/674
181
+ https://github.com/fluent/fluentd/pull/831
182
+ https://github.com/fluent/fluentd/pull/880
183
+ * Add New plugin API
184
+ https://github.com/fluent/fluentd/pull/800
185
+ https://github.com/fluent/fluentd/pull/843
186
+ https://github.com/fluent/fluentd/pull/866
187
+ https://github.com/fluent/fluentd/pull/905
188
+ https://github.com/fluent/fluentd/pull/906
189
+ https://github.com/fluent/fluentd/pull/917
190
+ https://github.com/fluent/fluentd/pull/928
191
+ https://github.com/fluent/fluentd/pull/943
192
+ https://github.com/fluent/fluentd/pull/964
193
+ https://github.com/fluent/fluentd/pull/965
194
+ https://github.com/fluent/fluentd/pull/972
195
+ https://github.com/fluent/fluentd/pull/983
196
+ * Add standard chunking format
197
+ https://github.com/fluent/fluentd/pull/914
198
+ * Add Compatibility layer for v0.12 plugins
199
+ https://github.com/fluent/fluentd/pull/912
200
+ https://github.com/fluent/fluentd/pull/969
201
+ https://github.com/fluent/fluentd/pull/974
202
+ https://github.com/fluent/fluentd/pull/992
203
+ https://github.com/fluent/fluentd/pull/999
204
+ * Add Plugin Storage API
205
+ https://github.com/fluent/fluentd/pull/864
206
+ https://github.com/fluent/fluentd/pull/910
207
+ * Enforce to use router.emit instead of Engine.emit
208
+ https://github.com/fluent/fluentd/pull/883
209
+ * log: Show plugin name and id in logs
210
+ https://github.com/fluent/fluentd/pull/860
211
+ * log: Dump configurations with v1 syntax in logs
212
+ https://github.com/fluent/fluentd/pull/867
213
+ * log: Dump errors with class in logs
214
+ https://github.com/fluent/fluentd/pull/899
215
+ * config: Add simplified syntax for configuration values of hash and array
216
+ https://github.com/fluent/fluentd/pull/875
217
+ * config: Add 'init' option to config_section to initialize section objects
218
+ https://github.com/fluent/fluentd/pull/877
219
+ * config: Support multiline string in quoted strings
220
+ https://github.com/fluent/fluentd/pull/929
221
+ * config: Add optional arguments on Element#elements to select child elements
222
+ https://github.com/fluent/fluentd/pull/948
223
+ * config: Show deprecated warnings for reserved parameters
224
+ https://github.com/fluent/fluentd/pull/971
225
+ * config: Make the detach process forward interval configurable
226
+ https://github.com/fluent/fluentd/pull/982
227
+ * in_tail: Add 'path_key' option to inject tailing path
228
+ https://github.com/fluent/fluentd/pull/951
229
+ * Remove in_status plugin
230
+ https://github.com/fluent/fluentd/pull/690
231
+
232
+ ### Bug fixes
233
+
234
+ * config: Enum list must be of symbols
235
+ https://github.com/fluent/fluentd/pull/821
236
+ * config: Fix to dup values in default
237
+ https://github.com/fluent/fluentd/pull/827
238
+ * config: Fix problems about overwriting subsections
239
+ https://github.com/fluent/fluentd/pull/844
240
+ https://github.com/fluent/fluentd/pull/981
241
+ * log: Serialize Fluent::EventTime as Integer in JSON
242
+ https://github.com/fluent/fluentd/pull/904
243
+ * out_forward: Add missing error class and tests for it
244
+ https://github.com/fluent/fluentd/pull/922
245
+
246
+ ### Internal fix / Refactoring
247
+
248
+ * Fix dependencies between files
249
+ https://github.com/fluent/fluentd/pull/799
250
+ https://github.com/fluent/fluentd/pull/808
251
+ https://github.com/fluent/fluentd/pull/823
252
+ https://github.com/fluent/fluentd/pull/824
253
+ https://github.com/fluent/fluentd/pull/825
254
+ https://github.com/fluent/fluentd/pull/826
255
+ https://github.com/fluent/fluentd/pull/828
256
+ https://github.com/fluent/fluentd/pull/859
257
+ https://github.com/fluent/fluentd/pull/892
258
+ * Separate PluginId from config
259
+ https://github.com/fluent/fluentd/pull/832
260
+ * Separate MessagePack factory from Engine
261
+ https://github.com/fluent/fluentd/pull/871
262
+ * Register plugins to registry
263
+ https://github.com/fluent/fluentd/pull/838
264
+ * Move TypeConverter mixin to mixin.rb
265
+ https://github.com/fluent/fluentd/pull/842
266
+ * Override default configurations by <system>
267
+ https://github.com/fluent/fluentd/pull/854
268
+ * Suppress Ruby level warnings
269
+ https://github.com/fluent/fluentd/pull/846
270
+ https://github.com/fluent/fluentd/pull/852
271
+ https://github.com/fluent/fluentd/pull/890
272
+ https://github.com/fluent/fluentd/pull/946
273
+ https://github.com/fluent/fluentd/pull/955
274
+ https://github.com/fluent/fluentd/pull/966
275
+
276
+ See https://github.com/fluent/fluentd/blob/v0.12/ChangeLog for v0.12 changelog
data/Gemfile ADDED
@@ -0,0 +1,9 @@
1
+ source 'https://rubygems.org/'
2
+
3
+ gemspec
4
+
5
+ local_gemfile = File.join(File.dirname(__FILE__), "Gemfile.local")
6
+ if File.exist?(local_gemfile)
7
+ puts "Loading Gemfile.local ..." if $DEBUG # `ruby -d` or `bundle -v`
8
+ instance_eval File.read(local_gemfile)
9
+ end
data/README.md ADDED
@@ -0,0 +1,51 @@
1
+ Fluentd: Open-Source Log Collector
2
+ ===================================
3
+
4
+ [<img src="https://travis-ci.org/fluent/fluentd.svg" />](https://travis-ci.org/fluent/fluentd) [![Code Climate](https://codeclimate.com/github/fluent/fluentd/badges/gpa.svg)](https://codeclimate.com/github/fluent/fluentd)
5
+
6
+ [Fluentd](http://fluentd.org/) collects events from various data sources and writes them to files, RDBMS, NoSQL, IaaS, SaaS, Hadoop and so on. Fluentd helps you unify your logging infrastructure (Learn more about the [Unified Logging Layer](http://www.fluentd.org/blog/unified-logging-layer)).
7
+
8
+ <p align="center">
9
+ <img src="http://docs.fluentd.org/images/fluentd-architecture.png" width="500px"/>
10
+ </p>
11
+
12
+ An event consists of *tag*, *time* and *record*. Tag is a string separated with '.' (e.g. myapp.access). It is used to categorize events. Time is a UNIX time recorded at occurrence of an event. Record is a JSON object.
13
+
14
+ ## Example Use Cases
15
+
16
+ Use Case | Description | Diagram
17
+ -------- | ------------|:---------:
18
+ Centralizing Apache/Nginx Server Logs | Fluentd can be used to tail access/error logs and transport them reliably to remote systems. | <img src="https://www.fluentd.org/assets/img/recipes/elasticsearch-s3-fluentd.png" height="150"/>
19
+ Syslog Alerting | Fluentd can "grep" for events and send out alerts. | <img src="https://www.fluentd.org/images/syslog-fluentd-alert.png" height="100"/>
20
+ Mobile/Web Application Logging | Fluentd can function as middleware to enable asynchronous, scalable logging for user action events. | <img src="https://www.fluentd.org/assets/img/datasources/asynchronous_logging.png" height="150"/>
21
+
22
+ ## Quick Start
23
+
24
+ $ gem install fluentd
25
+ $ fluentd -s conf
26
+ $ fluentd -c conf/fluent.conf &
27
+ $ echo '{"json":"message"}' | fluent-cat debug.test
28
+
29
+ ## Fluentd UI: Admin GUI
30
+
31
+ [Fluentd UI](https://github.com/fluent/fluentd-ui) is a graphical user interface to start/stop/configure Fluentd.
32
+
33
+ <p align="center"><img width="500" src="http://www.fluentd.org/images/blog/fluentd-ui.gif"/></p>
34
+
35
+ ## More Information
36
+
37
+ - Website: http://fluentd.org/
38
+ - Documentation: http://docs.fluentd.org/
39
+ - Source repository: http://github.com/fluent
40
+ - Discussion: http://groups.google.com/group/fluentd
41
+ - Slack / Community: http://slack.fluentd.org
42
+ - Newsletters: http://get.treasuredata.com/Fluentd_education
43
+ - Author: Sadayuki Furuhashi
44
+ - Copyright: (c) 2011 FURUHASHI Sadayuki
45
+ - License: Apache License, Version 2.0
46
+
47
+ ## Contributors:
48
+
49
+ Patches contributed by [great developers](https://github.com/fluent/fluentd/contributors).
50
+
51
+ [<img src="https://ga-beacon.appspot.com/UA-24890265-6/fluent/fluentd" />](https://github.com/fluent/fluentd)