fluent-plugin-tcp_output 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA256:
3
+ metadata.gz: 835dbc33077cd045df164616c14f0f67316431e607517b31560f23b31d584497
4
+ data.tar.gz: eb3fc0393f2bf3c1e01b52c07b54d5378b065a3367c1e715e88ae298e3b37432
5
+ SHA512:
6
+ metadata.gz: 1de90bf0fcc88b54a6f1863a72df82c95c42a272f1d74c761aa81533732dfd36313c5778999a749062640149e26b90df73d546fd305364c81b4b72131df309e7
7
+ data.tar.gz: c5d45b9ddbd45eabdd0e3324aaedb0ae16f960b1c60b4a5e4a7af202ff0a06b49988230e7624035d16154cf90bb957122df35d0afa4bb9214efe6e9397eab1f9
@@ -0,0 +1,5 @@
1
+ *.gem
2
+ *.rbc
3
+ Gemfile.lock
4
+ .idea/
5
+ TAGS
@@ -0,0 +1,7 @@
1
+ <?xml version="1.0" encoding="UTF-8"?>
2
+ <Settings><!--This file was automatically generated by Ruby plugin.
3
+ You are allowed to:
4
+ 1. Remove rake task
5
+ 2. Add existing rake tasks
6
+ To add existing rake tasks automatically delete this file and reload the project.
7
+ --><RakeGroup description="" fullCmd="" taksId="rake" /></Settings>
@@ -0,0 +1,5 @@
1
+ # Change Log
2
+
3
+ All notable changes to this project will be documented in this file.
4
+
5
+
data/Gemfile ADDED
@@ -0,0 +1,9 @@
1
+ source 'https://rubygems.org'
2
+
3
+ group :test do
4
+ gem 'codecov'
5
+ gem 'simplecov'
6
+ gem 'webmock'
7
+ end
8
+
9
+ gemspec
data/LICENSE ADDED
@@ -0,0 +1,201 @@
1
+ Apache License
2
+ Version 2.0, January 2004
3
+ http://www.apache.org/licenses/
4
+
5
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6
+
7
+ 1. Definitions.
8
+
9
+ "License" shall mean the terms and conditions for use, reproduction,
10
+ and distribution as defined by Sections 1 through 9 of this document.
11
+
12
+ "Licensor" shall mean the copyright owner or entity authorized by
13
+ the copyright owner that is granting the License.
14
+
15
+ "Legal Entity" shall mean the union of the acting entity and all
16
+ other entities that control, are controlled by, or are under common
17
+ control with that entity. For the purposes of this definition,
18
+ "control" means (i) the power, direct or indirect, to cause the
19
+ direction or management of such entity, whether by contract or
20
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
21
+ outstanding shares, or (iii) beneficial ownership of such entity.
22
+
23
+ "You" (or "Your") shall mean an individual or Legal Entity
24
+ exercising permissions granted by this License.
25
+
26
+ "Source" form shall mean the preferred form for making modifications,
27
+ including but not limited to software source code, documentation
28
+ source, and configuration files.
29
+
30
+ "Object" form shall mean any form resulting from mechanical
31
+ transformation or translation of a Source form, including but
32
+ not limited to compiled object code, generated documentation,
33
+ and conversions to other media types.
34
+
35
+ "Work" shall mean the work of authorship, whether in Source or
36
+ Object form, made available under the License, as indicated by a
37
+ copyright notice that is included in or attached to the work
38
+ (an example is provided in the Appendix below).
39
+
40
+ "Derivative Works" shall mean any work, whether in Source or Object
41
+ form, that is based on (or derived from) the Work and for which the
42
+ editorial revisions, annotations, elaborations, or other modifications
43
+ represent, as a whole, an original work of authorship. For the purposes
44
+ of this License, Derivative Works shall not include works that remain
45
+ separable from, or merely link (or bind by name) to the interfaces of,
46
+ the Work and Derivative Works thereof.
47
+
48
+ "Contribution" shall mean any work of authorship, including
49
+ the original version of the Work and any modifications or additions
50
+ to that Work or Derivative Works thereof, that is intentionally
51
+ submitted to Licensor for inclusion in the Work by the copyright owner
52
+ or by an individual or Legal Entity authorized to submit on behalf of
53
+ the copyright owner. For the purposes of this definition, "submitted"
54
+ means any form of electronic, verbal, or written communication sent
55
+ to the Licensor or its representatives, including but not limited to
56
+ communication on electronic mailing lists, source code control systems,
57
+ and issue tracking systems that are managed by, or on behalf of, the
58
+ Licensor for the purpose of discussing and improving the Work, but
59
+ excluding communication that is conspicuously marked or otherwise
60
+ designated in writing by the copyright owner as "Not a Contribution."
61
+
62
+ "Contributor" shall mean Licensor and any individual or Legal Entity
63
+ on behalf of whom a Contribution has been received by Licensor and
64
+ subsequently incorporated within the Work.
65
+
66
+ 2. Grant of Copyright License. Subject to the terms and conditions of
67
+ this License, each Contributor hereby grants to You a perpetual,
68
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69
+ copyright license to reproduce, prepare Derivative Works of,
70
+ publicly display, publicly perform, sublicense, and distribute the
71
+ Work and such Derivative Works in Source or Object form.
72
+
73
+ 3. Grant of Patent License. Subject to the terms and conditions of
74
+ this License, each Contributor hereby grants to You a perpetual,
75
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76
+ (except as stated in this section) patent license to make, have made,
77
+ use, offer to sell, sell, import, and otherwise transfer the Work,
78
+ where such license applies only to those patent claims licensable
79
+ by such Contributor that are necessarily infringed by their
80
+ Contribution(s) alone or by combination of their Contribution(s)
81
+ with the Work to which such Contribution(s) was submitted. If You
82
+ institute patent litigation against any entity (including a
83
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
84
+ or a Contribution incorporated within the Work constitutes direct
85
+ or contributory patent infringement, then any patent licenses
86
+ granted to You under this License for that Work shall terminate
87
+ as of the date such litigation is filed.
88
+
89
+ 4. Redistribution. You may reproduce and distribute copies of the
90
+ Work or Derivative Works thereof in any medium, with or without
91
+ modifications, and in Source or Object form, provided that You
92
+ meet the following conditions:
93
+
94
+ (a) You must give any other recipients of the Work or
95
+ Derivative Works a copy of this License; and
96
+
97
+ (b) You must cause any modified files to carry prominent notices
98
+ stating that You changed the files; and
99
+
100
+ (c) You must retain, in the Source form of any Derivative Works
101
+ that You distribute, all copyright, patent, trademark, and
102
+ attribution notices from the Source form of the Work,
103
+ excluding those notices that do not pertain to any part of
104
+ the Derivative Works; and
105
+
106
+ (d) If the Work includes a "NOTICE" text file as part of its
107
+ distribution, then any Derivative Works that You distribute must
108
+ include a readable copy of the attribution notices contained
109
+ within such NOTICE file, excluding those notices that do not
110
+ pertain to any part of the Derivative Works, in at least one
111
+ of the following places: within a NOTICE text file distributed
112
+ as part of the Derivative Works; within the Source form or
113
+ documentation, if provided along with the Derivative Works; or,
114
+ within a display generated by the Derivative Works, if and
115
+ wherever such third-party notices normally appear. The contents
116
+ of the NOTICE file are for informational purposes only and
117
+ do not modify the License. You may add Your own attribution
118
+ notices within Derivative Works that You distribute, alongside
119
+ or as an addendum to the NOTICE text from the Work, provided
120
+ that such additional attribution notices cannot be construed
121
+ as modifying the License.
122
+
123
+ You may add Your own copyright statement to Your modifications and
124
+ may provide additional or different license terms and conditions
125
+ for use, reproduction, or distribution of Your modifications, or
126
+ for any such Derivative Works as a whole, provided Your use,
127
+ reproduction, and distribution of the Work otherwise complies with
128
+ the conditions stated in this License.
129
+
130
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
131
+ any Contribution intentionally submitted for inclusion in the Work
132
+ by You to the Licensor shall be under the terms and conditions of
133
+ this License, without any additional terms or conditions.
134
+ Notwithstanding the above, nothing herein shall supersede or modify
135
+ the terms of any separate license agreement you may have executed
136
+ with Licensor regarding such Contributions.
137
+
138
+ 6. Trademarks. This License does not grant permission to use the trade
139
+ names, trademarks, service marks, or product names of the Licensor,
140
+ except as required for reasonable and customary use in describing the
141
+ origin of the Work and reproducing the content of the NOTICE file.
142
+
143
+ 7. Disclaimer of Warranty. Unless required by applicable law or
144
+ agreed to in writing, Licensor provides the Work (and each
145
+ Contributor provides its Contributions) on an "AS IS" BASIS,
146
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147
+ implied, including, without limitation, any warranties or conditions
148
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149
+ PARTICULAR PURPOSE. You are solely responsible for determining the
150
+ appropriateness of using or redistributing the Work and assume any
151
+ risks associated with Your exercise of permissions under this License.
152
+
153
+ 8. Limitation of Liability. In no event and under no legal theory,
154
+ whether in tort (including negligence), contract, or otherwise,
155
+ unless required by applicable law (such as deliberate and grossly
156
+ negligent acts) or agreed to in writing, shall any Contributor be
157
+ liable to You for damages, including any direct, indirect, special,
158
+ incidental, or consequential damages of any character arising as a
159
+ result of this License or out of the use or inability to use the
160
+ Work (including but not limited to damages for loss of goodwill,
161
+ work stoppage, computer failure or malfunction, or any and all
162
+ other commercial damages or losses), even if such Contributor
163
+ has been advised of the possibility of such damages.
164
+
165
+ 9. Accepting Warranty or Additional Liability. While redistributing
166
+ the Work or Derivative Works thereof, You may choose to offer,
167
+ and charge a fee for, acceptance of support, warranty, indemnity,
168
+ or other liability obligations and/or rights consistent with this
169
+ License. However, in accepting such obligations, You may act only
170
+ on Your own behalf and on Your sole responsibility, not on behalf
171
+ of any other Contributor, and only if You agree to indemnify,
172
+ defend, and hold each Contributor harmless for any liability
173
+ incurred by, or claims asserted against, such Contributor by reason
174
+ of your accepting any such warranty or additional liability.
175
+
176
+ END OF TERMS AND CONDITIONS
177
+
178
+ APPENDIX: How to apply the Apache License to your work.
179
+
180
+ To apply the Apache License to your work, attach the following
181
+ boilerplate notice, with the fields enclosed by brackets "{}"
182
+ replaced with your own identifying information. (Don't include
183
+ the brackets!) The text should be enclosed in the appropriate
184
+ comment syntax for the file format. We also recommend that a
185
+ file or class name and description of purpose be included on the
186
+ same "printed page" as the copyright notice for easier
187
+ identification within third-party archives.
188
+
189
+ Copyright {yyyy} {name of copyright owner}
190
+
191
+ Licensed under the Apache License, Version 2.0 (the "License");
192
+ you may not use this file except in compliance with the License.
193
+ You may obtain a copy of the License at
194
+
195
+ http://www.apache.org/licenses/LICENSE-2.0
196
+
197
+ Unless required by applicable law or agreed to in writing, software
198
+ distributed under the License is distributed on an "AS IS" BASIS,
199
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200
+ See the License for the specific language governing permissions and
201
+ limitations under the License.
@@ -0,0 +1,22 @@
1
+
2
+
3
+ # fluent-plugin-tcp-output, a plugin for [Fluentd](http://fluentd.org)
4
+
5
+ This plugin has been designed to output logs over tcp or unix sockets
6
+
7
+ ## Support
8
+ The code in this repository has been developed for internal use, so there is no available support.
9
+
10
+ ## License
11
+ Released under Apache 2.0 License.
12
+
13
+ ## Installation
14
+
15
+ gem install fluent-plugin-tcp
16
+
17
+ ## Configuration
18
+
19
+ Configuration options for fluent.conf are:
20
+
21
+ * `host` - hostname
22
+ * `port` - 4112 default
@@ -0,0 +1,11 @@
1
+ require 'bundler/gem_tasks'
2
+ require 'rake/testtask'
3
+
4
+ Rake::TestTask.new(:test) do |test|
5
+ test.libs << 'test'
6
+ test.pattern = 'test/**/test_*.rb'
7
+ test.verbose = true
8
+ test.warning = false
9
+ end
10
+
11
+ task :default => :test
@@ -0,0 +1,17 @@
1
+ #!/bin/sh
2
+
3
+ echo "Starting build process in: $(pwd)"
4
+ set -e
5
+
6
+ VERSION="${VERSION:=1.0.0}"
7
+ echo "Building for tag $VERSION, modify .gemspec file..."
8
+ sed -i.bak "s/0.0.0/$VERSION/g" ./fluent-plugin-tcp_output.gemspec
9
+ rm -f ./fluent-plugin-tcp.gemspec.bak
10
+
11
+ echo "Install bundler..."
12
+ bundle install
13
+
14
+ echo "Run unit tests..."
15
+ bundle exec rake
16
+
17
+ echo "DONE"
@@ -0,0 +1,27 @@
1
+ # coding: utf-8
2
+ lib = File.expand_path('../lib', __FILE__)
3
+ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
+
5
+ Gem::Specification.new do |gem|
6
+ gem.name = "fluent-plugin-tcp_output"
7
+ gem.version = "1.0.0"
8
+ gem.authors = ["Jonathan Glanz"]
9
+ gem.email = ["jonathan.glanz@gmail.com"]
10
+ gem.description = %q{Output plugin to TCP Socket}
11
+ gem.summary = %q{Output plugin to TCP Socket}
12
+ gem.homepage = "https://github.com/densebrain/fluent-plugin-tcp-output"
13
+ gem.license = "Apache-2.0"
14
+
15
+ gem.files = `git ls-files`.split($/)
16
+ gem.executables = gem.files.grep(%r{^bin/}) { |f| File.basename(f) }
17
+ gem.test_files = gem.files.grep(%r{^(test|spec|features)/})
18
+ gem.require_paths = ["lib"]
19
+
20
+ gem.required_ruby_version = '>= 2.0.0'
21
+
22
+ gem.add_development_dependency "bundler", "~> 2"
23
+ gem.add_development_dependency "rake"
24
+ gem.add_development_dependency 'test-unit', '~> 3.1.0'
25
+ gem.add_development_dependency "codecov", ">= 0.1.10"
26
+ gem.add_runtime_dependency "fluentd", ">= 0.14.12"
27
+ end
@@ -0,0 +1,310 @@
1
+ require 'fluent/plugin/output'
2
+
3
+ class Fluent::Plugin::TcpOutput < Fluent::Plugin::Output
4
+ Fluent::Plugin.register_output('tcp_output', self)
5
+
6
+ # 1. load socket helper
7
+ helpers :socket
8
+
9
+ config_param :host, :string, :default => "localhost"
10
+ config_param :port, :integer, :default => 4112
11
+
12
+ # omit configure, shutdown and other plugin API
13
+
14
+ def try_write(chunk)
15
+ # 2. create socket
16
+ socket = socket_create(:tcp, @host, @port)
17
+ chunk.each do |time, record|
18
+ # 3. write data to socket
19
+ socket.write(record.to_json)
20
+ end
21
+ ensure
22
+ # 4. close socket
23
+ socket.close if socket
24
+ end
25
+ end
26
+
27
+
28
+ # require 'fluent/plugin/output'
29
+ # require 'net/https'
30
+ # require 'yajl'
31
+ # require 'httpclient'
32
+ #
33
+ # class SumologicConnection
34
+ #
35
+ # attr_reader :http
36
+ #
37
+ # def initialize(endpoint, verify_ssl, connect_timeout, proxy_uri, disable_cookies)
38
+ # @endpoint = endpoint
39
+ # create_http_client(verify_ssl, connect_timeout, proxy_uri, disable_cookies)
40
+ # end
41
+ #
42
+ # def publish(raw_data, source_host=nil, source_category=nil, source_name=nil, data_type, metric_data_type, collected_fields)
43
+ # response = http.post(@endpoint, raw_data, request_headers(source_host, source_category, source_name, data_type, metric_data_type, collected_fields))
44
+ # unless response.ok?
45
+ # raise RuntimeError, "Failed to send data to HTTP Source. #{response.code} - #{response.body}"
46
+ # end
47
+ # end
48
+ #
49
+ # def request_headers(source_host, source_category, source_name, data_type, metric_data_format, collected_fields)
50
+ # headers = {
51
+ # 'X-Sumo-Name' => source_name,
52
+ # 'X-Sumo-Category' => source_category,
53
+ # 'X-Sumo-Host' => source_host,
54
+ # 'X-Sumo-Client' => 'fluentd-output'
55
+ # }
56
+ # if data_type == 'metrics'
57
+ # case metric_data_format
58
+ # when 'graphite'
59
+ # headers['Content-Type'] = 'application/vnd.sumologic.graphite'
60
+ # when 'carbon2'
61
+ # headers['Content-Type'] = 'application/vnd.sumologic.carbon2'
62
+ # when 'prometheus'
63
+ # headers['Content-Type'] = 'application/vnd.sumologic.prometheus'
64
+ # else
65
+ # raise RuntimeError, "Invalid #{metric_data_format}, must be graphite or carbon2 or prometheus"
66
+ # end
67
+ # end
68
+ # unless collected_fields.nil?
69
+ # headers['X-Sumo-Fields'] = collected_fields
70
+ # end
71
+ # return headers
72
+ # end
73
+ #
74
+ # def ssl_options(verify_ssl)
75
+ # verify_ssl==true ? OpenSSL::SSL::VERIFY_PEER : OpenSSL::SSL::VERIFY_NONE
76
+ # end
77
+ #
78
+ # def create_http_client(verify_ssl, connect_timeout, proxy_uri, disable_cookies)
79
+ # @http = HTTPClient.new(proxy_uri)
80
+ # @http.ssl_config.verify_mode = ssl_options(verify_ssl)
81
+ # @http.connect_timeout = connect_timeout
82
+ # if disable_cookies
83
+ # @http.cookie_manager = nil
84
+ # end
85
+ # end
86
+ # end
87
+ #
88
+ # class Fluent::Plugin::Sumologic < Fluent::Plugin::Output
89
+ # # First, register the plugin. NAME is the name of this plugin
90
+ # # and identifies the plugin in the configuration file.
91
+ # Fluent::Plugin.register_output('sumologic', self)
92
+ #
93
+ # helpers :compat_parameters
94
+ # DEFAULT_BUFFER_TYPE = "memory"
95
+ # LOGS_DATA_TYPE = "logs"
96
+ # METRICS_DATA_TYPE = "metrics"
97
+ # DEFAULT_DATA_TYPE = LOGS_DATA_TYPE
98
+ # DEFAULT_METRIC_FORMAT_TYPE = 'graphite'
99
+ #
100
+ # config_param :data_type, :string, :default => DEFAULT_DATA_TYPE
101
+ # config_param :metric_data_format, :default => DEFAULT_METRIC_FORMAT_TYPE
102
+ # config_param :endpoint, :string, secret: true
103
+ # config_param :log_format, :string, :default => 'json'
104
+ # config_param :log_key, :string, :default => 'message'
105
+ # config_param :source_category, :string, :default => nil
106
+ # config_param :source_name, :string, :default => nil
107
+ # config_param :source_name_key, :string, :default => 'source_name'
108
+ # config_param :source_host, :string, :default => nil
109
+ # config_param :verify_ssl, :bool, :default => true
110
+ # config_param :delimiter, :string, :default => "."
111
+ # config_param :open_timeout, :integer, :default => 60
112
+ # config_param :add_timestamp, :bool, :default => true
113
+ # config_param :timestamp_key, :string, :default => 'timestamp'
114
+ # config_param :proxy_uri, :string, :default => nil
115
+ # config_param :disable_cookies, :bool, :default => false
116
+ #
117
+ # config_section :buffer do
118
+ # config_set_default :@type, DEFAULT_BUFFER_TYPE
119
+ # config_set_default :chunk_keys, ['tag']
120
+ # end
121
+ #
122
+ # def initialize
123
+ # super
124
+ # end
125
+ #
126
+ # def multi_workers_ready?
127
+ # true
128
+ # end
129
+ #
130
+ # # This method is called before starting.
131
+ # def configure(conf)
132
+ #
133
+ # compat_parameters_convert(conf, :buffer)
134
+ #
135
+ # unless conf['endpoint'] =~ URI::regexp
136
+ # raise Fluent::ConfigError, "Invalid SumoLogic endpoint url: #{conf['endpoint']}"
137
+ # end
138
+ #
139
+ # unless conf['data_type'].nil?
140
+ # unless conf['data_type'] =~ /\A(?:logs|metrics)\z/
141
+ # raise Fluent::ConfigError, "Invalid data_type #{conf['data_type']} must be logs or metrics"
142
+ # end
143
+ # end
144
+ #
145
+ # if conf['data_type'].nil? || conf['data_type'] == LOGS_DATA_TYPE
146
+ # unless conf['log_format'].nil?
147
+ # unless conf['log_format'] =~ /\A(?:json|text|json_merge|fields)\z/
148
+ # raise Fluent::ConfigError, "Invalid log_format #{conf['log_format']} must be text, json, json_merge or fields"
149
+ # end
150
+ # end
151
+ # end
152
+ #
153
+ # if conf['data_type'] == METRICS_DATA_TYPE && ! conf['metrics_data_type'].nil?
154
+ # unless conf['metrics_data_type'] =~ /\A(?:graphite|carbon2|pronetheus)\z/
155
+ # raise Fluent::ConfigError, "Invalid metrics_data_type #{conf['metrics_data_type']} must be graphite or carbon2 or prometheus"
156
+ # end
157
+ # end
158
+ #
159
+ # @sumo_conn = SumologicConnection.new(conf['endpoint'], conf['verify_ssl'], conf['open_timeout'].to_i, conf['proxy_uri'], conf['disable_cookies'])
160
+ # super
161
+ # end
162
+ #
163
+ # # This method is called when starting.
164
+ # def start
165
+ # super
166
+ # end
167
+ #
168
+ # # This method is called when shutting down.
169
+ # def shutdown
170
+ # super
171
+ # end
172
+ #
173
+ # # Used to merge log record into top level json
174
+ # def merge_json(record)
175
+ # if record.has_key?(@log_key)
176
+ # log = record[@log_key].strip
177
+ # if log[0].eql?('{') && log[-1].eql?('}')
178
+ # begin
179
+ # record = record.merge(JSON.parse(log))
180
+ # record.delete(@log_key)
181
+ # rescue JSON::ParserError
182
+ # # do nothing, ignore
183
+ # end
184
+ # end
185
+ # end
186
+ # record
187
+ # end
188
+ #
189
+ # # Strip sumo_metadata and dump to json
190
+ # def dump_log(log)
191
+ # log.delete('_sumo_metadata')
192
+ # begin
193
+ # parser = Yajl::Parser.new
194
+ # hash = parser.parse(log[@log_key])
195
+ # log[@log_key] = hash
196
+ # Yajl.dump(log)
197
+ # rescue
198
+ # Yajl.dump(log)
199
+ # end
200
+ # end
201
+ #
202
+ # def format(tag, time, record)
203
+ # if defined? time.nsec
204
+ # mstime = time * 1000 + (time.nsec / 1000000)
205
+ # [mstime, record].to_msgpack
206
+ # else
207
+ # [time, record].to_msgpack
208
+ # end
209
+ # end
210
+ #
211
+ # def formatted_to_msgpack_binary
212
+ # true
213
+ # end
214
+ #
215
+ # def sumo_key(sumo_metadata, chunk)
216
+ # source_name = sumo_metadata['source'] || @source_name
217
+ # source_name = extract_placeholders(source_name, chunk) unless source_name.nil?
218
+ #
219
+ # source_category = sumo_metadata['category'] || @source_category
220
+ # source_category = extract_placeholders(source_category, chunk) unless source_category.nil?
221
+ #
222
+ # source_host = sumo_metadata['host'] || @source_host
223
+ # source_host = extract_placeholders(source_host, chunk) unless source_host.nil?
224
+ #
225
+ # fields = sumo_metadata['fields'] || ""
226
+ # fields = extract_placeholders(fields, chunk) unless fields.nil?
227
+ #
228
+ # { :source_name => "#{source_name}", :source_category => "#{source_category}",
229
+ # :source_host => "#{source_host}", :fields => "#{fields}" }
230
+ # end
231
+ #
232
+ # # Convert timestamp to 13 digit epoch if necessary
233
+ # def sumo_timestamp(time)
234
+ # time.to_s.length == 13 ? time : time * 1000
235
+ # end
236
+ #
237
+ # # This method is called every flush interval. Write the buffer chunk
238
+ # def write(chunk)
239
+ # messages_list = {}
240
+ #
241
+ # # Sort messages
242
+ # chunk.msgpack_each do |time, record|
243
+ # # plugin dies randomly
244
+ # # https://github.com/uken/fluent-plugin-elasticsearch/commit/8597b5d1faf34dd1f1523bfec45852d380b26601#diff-ae62a005780cc730c558e3e4f47cc544R94
245
+ # next unless record.is_a? Hash
246
+ # sumo_metadata = record.fetch('_sumo_metadata', {:source => record[@source_name_key] })
247
+ # key = sumo_key(sumo_metadata, chunk)
248
+ # log_format = sumo_metadata['log_format'] || @log_format
249
+ #
250
+ # # Strip any unwanted newlines
251
+ # record[@log_key].chomp! if record[@log_key] && record[@log_key].respond_to?(:chomp!)
252
+ #
253
+ # case @data_type
254
+ # when 'logs'
255
+ # case log_format
256
+ # when 'text'
257
+ # log = record[@log_key]
258
+ # unless log.nil?
259
+ # log.strip!
260
+ # end
261
+ # when 'json_merge'
262
+ # if @add_timestamp
263
+ # record = { @timestamp_key => sumo_timestamp(time) }.merge(record)
264
+ # end
265
+ # log = dump_log(merge_json(record))
266
+ # when 'fields'
267
+ # if @add_timestamp
268
+ # record = { @timestamp_key => sumo_timestamp(time) }.merge(record)
269
+ # end
270
+ # log = dump_log(record)
271
+ # else
272
+ # if @add_timestamp
273
+ # record = { @timestamp_key => sumo_timestamp(time) }.merge(record)
274
+ # end
275
+ # log = dump_log(record)
276
+ # end
277
+ # when 'metrics'
278
+ # log = record[@log_key]
279
+ # unless log.nil?
280
+ # log.strip!
281
+ # end
282
+ # end
283
+ #
284
+ # unless log.nil?
285
+ # if messages_list.key?(key)
286
+ # messages_list[key].push(log)
287
+ # else
288
+ # messages_list[key] = [log]
289
+ # end
290
+ # end
291
+ #
292
+ # end
293
+ #
294
+ # # Push logs to sumo
295
+ # messages_list.each do |key, messages|
296
+ # source_name, source_category, source_host, fields = key[:source_name], key[:source_category],
297
+ # key[:source_host], key[:fields]
298
+ # @sumo_conn.publish(
299
+ # messages.join("\n"),
300
+ # source_host =source_host,
301
+ # source_category =source_category,
302
+ # source_name =source_name,
303
+ # data_type =@data_type,
304
+ # metric_data_format =@metric_data_format,
305
+ # collected_fields =fields
306
+ # )
307
+ # end
308
+ #
309
+ # end
310
+ # end
@@ -0,0 +1,16 @@
1
+ require 'simplecov'
2
+ SimpleCov.start
3
+
4
+ if ENV['CI'] == 'true'
5
+ require 'codecov'
6
+ SimpleCov.formatter = SimpleCov::Formatter::Codecov
7
+ end
8
+
9
+ $LOAD_PATH.unshift(File.expand_path("../../", __FILE__))
10
+ require "test-unit"
11
+ require "fluent/test"
12
+ require "fluent/test/driver/output"
13
+ require "fluent/test/helpers"
14
+
15
+ Test::Unit::TestCase.include(Fluent::Test::Helpers)
16
+ Test::Unit::TestCase.extend(Fluent::Test::Helpers)
@@ -0,0 +1,25 @@
1
+ require "test-unit"
2
+ require "fluent/test"
3
+ require "fluent/test/driver/output"
4
+ require "fluent/test/helpers"
5
+ require 'webmock/test_unit'
6
+ require 'fluent/plugin/out_tcp_output'
7
+
8
+ class TestTcpOutput < Test::Unit::TestCase
9
+ include Fluent::Test::Helpers
10
+
11
+ def setup
12
+ Fluent::Test.setup
13
+ end
14
+
15
+ def create_driver(conf = CONFIG)
16
+ Fluent::Test::Driver::Output.new(Fluent::Plugin::TcpOutput).configure(conf)
17
+ end
18
+
19
+ # def test_no_host_configure
20
+ # config = %{}
21
+ # exception = assert_raise(Fluent::ConfigError) {create_driver(config)}
22
+ # assert_equal("Invalid tcp endpoint hostname: ", exception.message)
23
+ # end
24
+
25
+ end
metadata ADDED
@@ -0,0 +1,127 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: fluent-plugin-tcp_output
3
+ version: !ruby/object:Gem::Version
4
+ version: 1.0.0
5
+ platform: ruby
6
+ authors:
7
+ - Jonathan Glanz
8
+ autorequire:
9
+ bindir: bin
10
+ cert_chain: []
11
+ date: 2019-11-07 00:00:00.000000000 Z
12
+ dependencies:
13
+ - !ruby/object:Gem::Dependency
14
+ name: bundler
15
+ requirement: !ruby/object:Gem::Requirement
16
+ requirements:
17
+ - - "~>"
18
+ - !ruby/object:Gem::Version
19
+ version: '2'
20
+ type: :development
21
+ prerelease: false
22
+ version_requirements: !ruby/object:Gem::Requirement
23
+ requirements:
24
+ - - "~>"
25
+ - !ruby/object:Gem::Version
26
+ version: '2'
27
+ - !ruby/object:Gem::Dependency
28
+ name: rake
29
+ requirement: !ruby/object:Gem::Requirement
30
+ requirements:
31
+ - - ">="
32
+ - !ruby/object:Gem::Version
33
+ version: '0'
34
+ type: :development
35
+ prerelease: false
36
+ version_requirements: !ruby/object:Gem::Requirement
37
+ requirements:
38
+ - - ">="
39
+ - !ruby/object:Gem::Version
40
+ version: '0'
41
+ - !ruby/object:Gem::Dependency
42
+ name: test-unit
43
+ requirement: !ruby/object:Gem::Requirement
44
+ requirements:
45
+ - - "~>"
46
+ - !ruby/object:Gem::Version
47
+ version: 3.1.0
48
+ type: :development
49
+ prerelease: false
50
+ version_requirements: !ruby/object:Gem::Requirement
51
+ requirements:
52
+ - - "~>"
53
+ - !ruby/object:Gem::Version
54
+ version: 3.1.0
55
+ - !ruby/object:Gem::Dependency
56
+ name: codecov
57
+ requirement: !ruby/object:Gem::Requirement
58
+ requirements:
59
+ - - ">="
60
+ - !ruby/object:Gem::Version
61
+ version: 0.1.10
62
+ type: :development
63
+ prerelease: false
64
+ version_requirements: !ruby/object:Gem::Requirement
65
+ requirements:
66
+ - - ">="
67
+ - !ruby/object:Gem::Version
68
+ version: 0.1.10
69
+ - !ruby/object:Gem::Dependency
70
+ name: fluentd
71
+ requirement: !ruby/object:Gem::Requirement
72
+ requirements:
73
+ - - ">="
74
+ - !ruby/object:Gem::Version
75
+ version: 0.14.12
76
+ type: :runtime
77
+ prerelease: false
78
+ version_requirements: !ruby/object:Gem::Requirement
79
+ requirements:
80
+ - - ">="
81
+ - !ruby/object:Gem::Version
82
+ version: 0.14.12
83
+ description: Output plugin to TCP Socket
84
+ email:
85
+ - jonathan.glanz@gmail.com
86
+ executables: []
87
+ extensions: []
88
+ extra_rdoc_files: []
89
+ files:
90
+ - ".gitignore"
91
+ - ".rakeTasks"
92
+ - CHANGELOG.md
93
+ - Gemfile
94
+ - LICENSE
95
+ - README.md
96
+ - Rakefile
97
+ - ci/build.sh
98
+ - fluent-plugin-tcp_output.gemspec
99
+ - lib/fluent/plugin/out_tcp_output.rb
100
+ - test/helper.rb
101
+ - test/plugin/test_out_tcp_output.rb
102
+ homepage: https://github.com/densebrain/fluent-plugin-tcp-output
103
+ licenses:
104
+ - Apache-2.0
105
+ metadata: {}
106
+ post_install_message:
107
+ rdoc_options: []
108
+ require_paths:
109
+ - lib
110
+ required_ruby_version: !ruby/object:Gem::Requirement
111
+ requirements:
112
+ - - ">="
113
+ - !ruby/object:Gem::Version
114
+ version: 2.0.0
115
+ required_rubygems_version: !ruby/object:Gem::Requirement
116
+ requirements:
117
+ - - ">="
118
+ - !ruby/object:Gem::Version
119
+ version: '0'
120
+ requirements: []
121
+ rubygems_version: 3.0.6
122
+ signing_key:
123
+ specification_version: 4
124
+ summary: Output plugin to TCP Socket
125
+ test_files:
126
+ - test/helper.rb
127
+ - test/plugin/test_out_tcp_output.rb