fluent-plugin-sampling-filter 1.0.0 → 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/README.md +43 -6
- data/fluent-plugin-sampling-filter.gemspec +1 -1
- data/lib/fluent/plugin/filter_sampling.rb +1 -0
- metadata +1 -1
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA1:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 649911c9296c2b6a15a2a4a24a9762a577be6c40
|
|
4
|
+
data.tar.gz: 2449647d5f8aedc8516d8dc3777aad753a956262
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 30583bdb0e00e4e99f4eccc342fa52989c652b88e0f9cfc2eab0c214e67620f826fc4e231ca02635b66f36d455854ec647bef7e2ad4e1856a8c81463260947c2
|
|
7
|
+
data.tar.gz: cbcfb440312c6925cc2a7857f0c445265c12c60471fd5f1f99ff4a4828d46f5c60c686f5b17e8f3c35e72b6e9fefaf3f8580969423c01079b4bc47697d0642cf
|
data/README.md
CHANGED
|
@@ -1,18 +1,56 @@
|
|
|
1
1
|
# fluent-plugin-sampling-filter
|
|
2
2
|
|
|
3
|
-
## Component
|
|
4
|
-
|
|
5
|
-
### SamplingFilterOutput
|
|
6
|
-
|
|
7
3
|
This is a [Fluentd](http://fluentd.org) plugin to sample matching messages to analyse and report messages behavior and emit sampled messages with modified tag.
|
|
8
4
|
|
|
9
5
|
* sampling rate per tags, or for all
|
|
10
|
-
* remove_prefix of tags for input messages, and add_prefix of tags for output(sampled) messages
|
|
11
6
|
|
|
12
7
|
## Configuration
|
|
13
8
|
|
|
9
|
+
### SamplingFilter
|
|
10
|
+
|
|
11
|
+
This filter passes a specified part of whole events to following filter/output plugins:
|
|
12
|
+
|
|
13
|
+
<source>
|
|
14
|
+
@type any_great_input
|
|
15
|
+
@label @mydata
|
|
16
|
+
</source>
|
|
17
|
+
|
|
18
|
+
<label @mydata>
|
|
19
|
+
<filter **>
|
|
20
|
+
@type sampling
|
|
21
|
+
interval 10 # pass 1/10 events to following plugins
|
|
22
|
+
</filter>
|
|
23
|
+
|
|
24
|
+
<match **>
|
|
25
|
+
@type ...
|
|
26
|
+
</match>
|
|
27
|
+
</label>
|
|
28
|
+
|
|
29
|
+
Sampling is done for all events, but we can do it per matched tags:
|
|
30
|
+
|
|
31
|
+
<source>
|
|
32
|
+
@type any_great_input
|
|
33
|
+
@label @mydata
|
|
34
|
+
</source>
|
|
35
|
+
|
|
36
|
+
<label @mydata>
|
|
37
|
+
<filter **>
|
|
38
|
+
@type sampling
|
|
39
|
+
interval 10
|
|
40
|
+
sample_unit tag # 1/10 events for each tags
|
|
41
|
+
</filter>
|
|
42
|
+
|
|
43
|
+
<match **>
|
|
44
|
+
@type ...
|
|
45
|
+
</match>
|
|
46
|
+
</label>
|
|
47
|
+
|
|
48
|
+
`minimum_rate_per_min` option(integer) configures this plugin to pass events with the specified rate even how small is the total number of whole events.
|
|
49
|
+
|
|
14
50
|
### SamplingFilterOutput
|
|
15
51
|
|
|
52
|
+
**NOTE: This plugin is deprecated. Use filter plugin instead.**
|
|
53
|
+
|
|
16
54
|
Pickup 1/10 messages about each tags(default: `sample_unit tag`), and add tag prefix `sampled`.
|
|
17
55
|
|
|
18
56
|
<match **>
|
|
@@ -41,7 +79,6 @@ Pickup 1/100 messages of all matched messages, and modify tags from `input.**` t
|
|
|
41
79
|
|
|
42
80
|
## TODO
|
|
43
81
|
|
|
44
|
-
* consider what to do next
|
|
45
82
|
* patches welcome!
|
|
46
83
|
|
|
47
84
|
## Copyright
|
|
@@ -2,7 +2,7 @@
|
|
|
2
2
|
|
|
3
3
|
Gem::Specification.new do |gem|
|
|
4
4
|
gem.name = "fluent-plugin-sampling-filter"
|
|
5
|
-
gem.version = "1.
|
|
5
|
+
gem.version = "1.1.0"
|
|
6
6
|
gem.authors = ["TAGOMORI Satoshi"]
|
|
7
7
|
gem.email = ["tagomoris@gmail.com"]
|
|
8
8
|
gem.description = %q{fluentd plugin to pickup sample data from matched massages}
|