fluent-plugin-kinesis-aggregation 0.2.0 → 0.2.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/.travis.yml +1 -0
- data/CHANGELOG.md +5 -0
- data/README.md +16 -14
- data/fluent-plugin-kinesis-aggregation.gemspec +2 -2
- metadata +4 -4
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA1:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 2ca1b05d0268c5f19045de4e90129f6018cbeca5
|
|
4
|
+
data.tar.gz: 434e9f311ebcb99684d1c11620f6ec0e5dce9a55
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 03035ab01ba22533165a108983b940ba58607b874b9e446ecfd012fe70e6128ab651f371d7d6f0fdd6b60befbe360d727a0c9e121976201bfd5adda619ff5228
|
|
7
|
+
data.tar.gz: 05f031ff1367b86dfce49f178784a02f8f89230a666fc9060752373a0864383dae6ce39db27e0c58e1c47f335890e3c143bde5259e5f0b7d0233c0a9884a3ab6
|
data/.travis.yml
CHANGED
data/CHANGELOG.md
CHANGED
data/README.md
CHANGED
|
@@ -21,6 +21,9 @@ The basic idea is to have one PutRecord === one chunk. This has a number of adva
|
|
|
21
21
|
|
|
22
22
|
However, there are drawbacks:
|
|
23
23
|
|
|
24
|
+
- if you're using this as an aggregator, you will need to tune the
|
|
25
|
+
buffer size on your sources fairly low such that it is less
|
|
26
|
+
that the low buffer_chunk_limit on the aggregator
|
|
24
27
|
- you have to use a KCL library to ingest
|
|
25
28
|
- you can't use a calculated partition key (based on the record);
|
|
26
29
|
essentially, you need to use a random partition key
|
|
@@ -32,8 +35,15 @@ that sends events to [Amazon Kinesis](https://aws.amazon.com/kinesis/).
|
|
|
32
35
|
|
|
33
36
|
## Installation
|
|
34
37
|
|
|
35
|
-
|
|
36
|
-
|
|
38
|
+
This plugin is available as the `fluent-plugin-kinesis-aggregation` gem from RubyGems:
|
|
39
|
+
|
|
40
|
+
gem install fluent-plugin-kinesis-aggregation
|
|
41
|
+
|
|
42
|
+
Or, if using td-agent:
|
|
43
|
+
|
|
44
|
+
fluent-gem install fluent-plugin-kinesis-aggregation
|
|
45
|
+
|
|
46
|
+
To install from the source:
|
|
37
47
|
|
|
38
48
|
git clone https://github.com/atlassian/fluent-plugin-kinesis-aggregation.git
|
|
39
49
|
cd fluent-plugin-kinesis-aggregation
|
|
@@ -41,26 +51,18 @@ Fluentd will be also installed via the process below.
|
|
|
41
51
|
rake build
|
|
42
52
|
rake install
|
|
43
53
|
|
|
44
|
-
|
|
45
|
-
You have to install td-agent before installing this plugin.
|
|
54
|
+
Or, if using td-agent, replace rake install with:
|
|
46
55
|
|
|
47
|
-
git clone https://github.com/atlassian/fluent-plugin-kinesis-aggregation.git
|
|
48
|
-
cd fluent-plugin-kinesis-aggregation
|
|
49
|
-
bundle install
|
|
50
|
-
rake build
|
|
51
56
|
fluent-gem install pkg/fluent-plugin-kinesis-aggregation
|
|
52
57
|
|
|
53
|
-
|
|
54
|
-
|
|
58
|
+
Alternatively, you can replace both the rake steps, and directly
|
|
59
|
+
specify the library path via RUBYLIB:
|
|
55
60
|
|
|
56
|
-
git clone https://github.com/atlassian/fluent-plugin-kinesis-aggregation.git
|
|
57
|
-
cd fluent-plugin-kinesis-aggregation
|
|
58
|
-
bundle install
|
|
59
61
|
export RUBYLIB=$RUBYLIB:/path/to/fluent-plugin-kinesis-aggregation/lib
|
|
60
62
|
|
|
61
63
|
## Dependencies
|
|
62
64
|
|
|
63
|
-
* Ruby 2.
|
|
65
|
+
* Ruby 2.1+
|
|
64
66
|
* Fluentd 0.10.43+
|
|
65
67
|
|
|
66
68
|
## Basic Usage
|
|
@@ -17,8 +17,8 @@ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
|
|
|
17
17
|
|
|
18
18
|
Gem::Specification.new do |spec|
|
|
19
19
|
spec.name = "fluent-plugin-kinesis-aggregation"
|
|
20
|
-
spec.version = '0.2.
|
|
21
|
-
spec.author = '
|
|
20
|
+
spec.version = '0.2.1'
|
|
21
|
+
spec.author = 'Atlassian'
|
|
22
22
|
spec.summary = %q{Fluentd output plugin that sends KPL style aggregated events to Amazon Kinesis.}
|
|
23
23
|
spec.homepage = "https://github.com/atlassian/fluent-plugin-kinesis-aggregation"
|
|
24
24
|
spec.license = "Apache License, Version 2.0"
|
metadata
CHANGED
|
@@ -1,14 +1,14 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: fluent-plugin-kinesis-aggregation
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 0.2.
|
|
4
|
+
version: 0.2.1
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
|
-
-
|
|
7
|
+
- Atlassian
|
|
8
8
|
autorequire:
|
|
9
9
|
bindir: bin
|
|
10
10
|
cert_chain: []
|
|
11
|
-
date:
|
|
11
|
+
date: 2016-02-09 00:00:00.000000000 Z
|
|
12
12
|
dependencies:
|
|
13
13
|
- !ruby/object:Gem::Dependency
|
|
14
14
|
name: bundler
|
|
@@ -160,7 +160,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
|
|
|
160
160
|
version: '0'
|
|
161
161
|
requirements: []
|
|
162
162
|
rubyforge_project:
|
|
163
|
-
rubygems_version: 2.
|
|
163
|
+
rubygems_version: 2.2.2
|
|
164
164
|
signing_key:
|
|
165
165
|
specification_version: 4
|
|
166
166
|
summary: Fluentd output plugin that sends KPL style aggregated events to Amazon Kinesis.
|