fluent-plugin-google-cloud-storage-out 0.1.11 → 0.1.12

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (5) hide show
  1. checksums.yaml +4 -4
  2. data/README.md +46 -18
  3. data/fluent-plugin-google-cloud-storage-out.gemspec +2 -2
  4. data/lib/fluent/plugin/out_google_cloud_storage_out.rb +1 -1
  5. metadata +7 -7
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA1:
3
- metadata.gz: 0ae88e22d3d8cac4aa939ccc35fe2af17ca90fbe
4
- data.tar.gz: 6e94e55d777c8c0bc07819d2119c68402deffd05
3
+ metadata.gz: cca3bf8d8f2334183a8a2c9c822fd4ac1b6da41c
4
+ data.tar.gz: 13670ae18640b2ce42d5e541ac7e150ddaee29cb
5
5
  SHA512:
6
- metadata.gz: 2977e856bd530808ec34d62a30c37fcc85ac3c086c4be95a4a88a470611739fa8e1f937daa3ef584eb903a11a1ffda7d7c74b4cb2a00342454cb73e1304ac229
7
- data.tar.gz: 4326eaad59d06a09c3416fd2e9095804a5d0fea152176517f8a3027383a31eff0515c5276f0282e78b0fd65f02cdf04cbd2c96b4de7b5b650feb2676d5ba1659
6
+ metadata.gz: 6e8b7e4c94c667a44eb0d764d64e0dd71d10feee7e8616defddbd11c324cbf350a5205abef69d237aabd737e72dc26a9bec9c7b44d80d898788745d181c0c8bb
7
+ data.tar.gz: 5f7d259c8fc5e85ce5b18e703d6a1629c2ec770f6028a014a435f029b68dc715983cd685a19eaebdff12dcb5e70bd25ff64baa3a96e54e21aa2bb9ea17ceeb0d
data/README.md CHANGED
@@ -1,36 +1,64 @@
1
- # Fluent::Plugin::Google::Cloud::Storage::Out
2
-
3
- Welcome to your new gem! In this directory, you'll find the files you need to be able to package up your Ruby library into a gem. Put your Ruby code in the file `lib/fluent/plugin/google/cloud/storage/out`. To experiment with that code, run `bin/console` for an interactive prompt.
4
-
5
- TODO: Delete this and the text above, and describe your gem
6
-
1
+ # Fluent::GoogleCloudStorageOut
7
2
  ## Installation
8
3
 
9
4
  Add this line to your application's Gemfile:
10
5
 
11
6
  ```ruby
12
- gem 'fluent-plugin-google-cloud-storage-out'
7
+ $ td-agent-gem install fluent-plugin-google-cloud-storage-out
8
+ ```
9
+
10
+ ## Usage
11
+
12
+ #### Sample Conf
13
+ ```
14
+ <match *.json.log>
15
+ type google_cloud_storage_out
16
+ service_account_json_key_path /etc/td-agent/client_secrets.json
17
+ bucket_id access-log
18
+ path nginx/%Y_%m_%d/${hostname}_%H%M_${unique}
19
+ unique_strategy increment
20
+ format json
21
+ compress gzip
22
+
23
+ buffer_type memory
24
+ buffer_chunk_limit 10m
25
+ </match>
13
26
  ```
14
27
 
15
- And then execute:
28
+ | parameter | description |
29
+ | ---- | ---- |
30
+ | service_account_json_key_path | Absolute Path to json key |
31
+ | bucket_id | GCS Bucket ID to Store |
32
+ | path | Path to save, if you use `/`, that will resolve to directory. And if path is including time format , then rotate by minum unit. Moreover, you can include ${unique}, that is to replace token with unique key|
33
+ | unique_strategy | you can choice chunk_id, timestamp and inctement |
34
+ | unique_format | Now, if you choiced `timestamp` to unique_strategy, then you can ccustom timestampformat. Default format is `%Y%m%d%H%M%S%L` |
35
+ | format | |
36
+ | compress | gzip or nil |
16
37
 
17
- $ bundle
38
+ #### Bucket
18
39
 
19
- Or install it yourself as:
40
+ You shuould beforehand make a Bucket in GCS. This plugin will not support to create a Bucket automatically. Because I assume this plugin was used any servers.
20
41
 
21
- $ gem install fluent-plugin-google-cloud-storage-out
42
+ #### ServiceAccountKey(json)
22
43
 
23
- ## Usage
44
+ TODO
45
+
46
+ #### Conf
47
+
48
+ TODO
49
+
50
+ #### Make Unique Strategy for avoid override object
24
51
 
25
- TODO: Write usage instructions here
52
+ TODO
26
53
 
27
- ## Development
54
+ ###### Use The Chunk ID
28
55
 
29
- After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
56
+ TODO
30
57
 
31
- To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
58
+ ###### Use The Timestamp
32
59
 
33
- ## Contributing
60
+ TODO
34
61
 
35
- Bug reports and pull requests are welcome on GitHub at https://github.com/[USERNAME]/fluent-plugin-google-cloud-storage-out. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](contributor-covenant.org) code of conduct.
62
+ ###### Use The Increment
36
63
 
64
+ TODO
data/fluent-plugin-google-cloud-storage-out.gemspec CHANGED
@@ -4,7 +4,7 @@ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
4
 
5
5
  Gem::Specification.new do |spec|
6
6
  spec.name = "fluent-plugin-google-cloud-storage-out"
7
- spec.version = "0.1.11"
7
+ spec.version = "0.1.12"
8
8
  spec.authors = ["Hideki Matsuoka"]
9
9
  spec.email = ["matsuoka.hide@gmail.com"]
10
10
 
@@ -27,6 +27,6 @@ Gem::Specification.new do |spec|
27
27
  spec.add_runtime_dependency "fluentd", ">= 0.10.60"
28
28
  spec.add_runtime_dependency "fluent-mixin-config-placeholders", ">= 0.3.0"
29
29
  spec.add_runtime_dependency "googleauth", ">= 0.5"
30
- spec.add_runtime_dependency "google-api-client", "0.9.pre5"
30
+ spec.add_runtime_dependency "google-api-client", ">= 0.9.11"
31
31
  spec.add_runtime_dependency "mime-types", ">= 3.0"
32
32
  end
data/lib/fluent/plugin/out_google_cloud_storage_out.rb CHANGED
@@ -191,7 +191,7 @@ module Fluent
191
191
  io = StringIO.new(data)
192
192
  end
193
193
 
194
- @storage.insert_object(@bucket_id, upload_source: io, name: path, content_type:mimetype.content_type)
194
+ @storage.insert_object(@bucket_id, {name: path}, upload_source: io, content_type:mimetype.content_type)
195
195
  end
196
196
 
197
197
  def write(chunk)
metadata CHANGED
@@ -1,14 +1,14 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: fluent-plugin-google-cloud-storage-out
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.1.11
4
+ version: 0.1.12
5
5
  platform: ruby
6
6
  authors:
7
7
  - Hideki Matsuoka
8
8
  autorequire:
9
9
  bindir: exe
10
10
  cert_chain: []
11
- date: 2016-01-13 00:00:00.000000000 Z
11
+ date: 2016-08-01 00:00:00.000000000 Z
12
12
  dependencies:
13
13
  - !ruby/object:Gem::Dependency
14
14
  name: bundler
@@ -98,16 +98,16 @@ dependencies:
98
98
  name: google-api-client
99
99
  requirement: !ruby/object:Gem::Requirement
100
100
  requirements:
101
- - - '='
101
+ - - '>='
102
102
  - !ruby/object:Gem::Version
103
- version: 0.9.pre5
103
+ version: 0.9.11
104
104
  type: :runtime
105
105
  prerelease: false
106
106
  version_requirements: !ruby/object:Gem::Requirement
107
107
  requirements:
108
- - - '='
108
+ - - '>='
109
109
  - !ruby/object:Gem::Version
110
- version: 0.9.pre5
110
+ version: 0.9.11
111
111
  - !ruby/object:Gem::Dependency
112
112
  name: mime-types
113
113
  requirement: !ruby/object:Gem::Requirement
@@ -161,7 +161,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
161
161
  version: '0'
162
162
  requirements: []
163
163
  rubyforge_project:
164
- rubygems_version: 2.0.14
164
+ rubygems_version: 2.0.14.1
165
165
  signing_key:
166
166
  specification_version: 4
167
167
  summary: Fluentd out plugin for store to Google Cloud Storage