logstash-input-azure_blob_storage 0.12.2 → 0.12.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG.md +10 -1
- data/Gemfile +7 -0
- data/README.md +1 -1
- data/lib/logstash/inputs/azure_blob_storage.rb +518 -485
- data/logstash-input-azure_blob_storage.gemspec +22 -20
- data/spec/inputs/azure_blob_storage_spec.rb +10 -10
- metadata +33 -5
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: ec2c4d4ee6fcbbec7e34682089aeaa4c4b212dbb78bc9f6eab63fb4f08bbfd6a
|
|
4
|
+
data.tar.gz: f041887728e35433066791d78a2eae76bf564bcf5e87f4cc199720f1cd1910e4
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 4d745d3fa9ed1c768d2ca8c59b8d9034b4c56294b56e19796c9f622e4fb695c8050ab63c0e961fb1bd66c41b67999a37c42e2f0c49145dc5bf9d6c267a00d334
|
|
7
|
+
data.tar.gz: d7d9a1dbd9f13c44bfeeb600abe82d2e4019e0ca5e5f55974c41777621fc56aedfc2a32d5f272d711e79a711c5e799d84cd5c9056395fee2dccb8b9c0df8bb2a
|
data/CHANGELOG.md
CHANGED
|
@@ -1,4 +1,13 @@
|
|
|
1
|
-
|
|
1
|
+
## 0.12.4
|
|
2
|
+
- Explicit handling of json_lines and respecting line boundaries (thanks nttoshev)
|
|
3
|
+
- Removed reprocessing on any exception
|
|
4
|
+
|
|
5
|
+
## 0.12.3
|
|
6
|
+
- Fixed repetative processing
|
|
7
|
+
- Replaced newreg with registry cleanup, using newreg to replace old registry worked in 0.11, but not in .12
|
|
8
|
+
- Implemented Mutex for the save_registry thread. Also marshal @registry before thread start for better thread safety
|
|
9
|
+
|
|
10
|
+
## 0.12.2
|
|
2
11
|
- Fixed the exception handling, not trying to print how many JSON fields there are while catching the exception
|
|
3
12
|
|
|
4
13
|
## 0.12.1
|
data/Gemfile
CHANGED
|
@@ -1,3 +1,10 @@
|
|
|
1
1
|
source 'https://rubygems.org'
|
|
2
2
|
gemspec
|
|
3
3
|
|
|
4
|
+
logstash_path = ENV['LOGSTASH_PATH'] || '../../logstash'
|
|
5
|
+
use_logstash_source = ENV['LOGSTASH_SOURCE'] && ENV['LOGSTASH_SOURCE'].to_s == '1'
|
|
6
|
+
|
|
7
|
+
if Dir.exist?(logstash_path) && use_logstash_source
|
|
8
|
+
gem 'logstash-core', path: "#{logstash_path}/logstash-core"
|
|
9
|
+
gem 'logstash-core-plugin-api', path: "#{logstash_path}/logstash-core-plugin-api"
|
|
10
|
+
end
|
data/README.md
CHANGED
|
@@ -8,7 +8,7 @@ For problems or feature requests with this specific plugin, raise a github issue
|
|
|
8
8
|
This plugin can read from Azure Storage Blobs, for instance JSON diagnostics logs for NSG flow logs or LINE based accesslogs from App Services.
|
|
9
9
|
[Azure Blob Storage](https://azure.microsoft.com/en-us/services/storage/blobs/)
|
|
10
10
|
|
|
11
|
-
The plugin depends on the [Ruby library azure-storage-
|
|
11
|
+
The plugin depends on the [Ruby library azure-storage-blob](https://rubygems.org/gems/azure-storage-blob/versions/1.1.0) from Microsoft, that depends on Faraday for the HTTPS connection to Azure.
|
|
12
12
|
|
|
13
13
|
The plugin executes the following steps
|
|
14
14
|
1. Lists all the files in the azure storage account. where the path of the files are matching pathprefix
|