logstash-input-rethinkdb 0.2.0 → 0.2.1
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/README.md +4 -9
- data/lib/logstash/inputs/rethinkdb.rb +1 -1
- data/logstash-input-rethinkdb.gemspec +1 -1
- metadata +1 -1
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA1:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 8394f51799b6594ff683d14e9a9606e9e5458431
|
|
4
|
+
data.tar.gz: f17d1db33ce3073dfb9bfcfc0d62d0b2daf4b290
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: c8efd4bdd1a980c63c0eee3348d5716637bec1447b19fc65cdc8ffeb3d78c4b5e5b6d3e9979462620d480489501421e93df49160e81e65d07cc29b1f53782004
|
|
7
|
+
data.tar.gz: 4e0d9cf7e0871d2668a3bd87460fa72f7f448965cce1dfaec4ae7d1837a294d1d6927f7da6496dffd4d880d2ee12ea35da702c4191134f5d58821a46e38bde9f
|
data/README.md
CHANGED
|
@@ -2,14 +2,11 @@
|
|
|
2
2
|
|
|
3
3
|
This is a plugin for [Logstash](https://github.com/elasticsearch/logstash).
|
|
4
4
|
|
|
5
|
-
**Currently this is BETA software. It
|
|
6
|
-
|
|
7
|
-
This plugin will eventually replace the [RethinkDB river](https://github.com/rethinkdb/elasticsearch-river-rethinkdb) as the preferred method of syncing RethinkDB and ElasticSearch. We're hoping to get early feedback on how useful the plugin is, and what can be improved (beyond the known limitations, see below).
|
|
8
|
-
|
|
5
|
+
**Currently this is BETA software. It contains some known limitations (see below)**
|
|
9
6
|
|
|
10
7
|
## Using the plugin
|
|
11
8
|
|
|
12
|
-
You'll need to use this with the Logstash 1.5
|
|
9
|
+
You'll need to use this with the Logstash 1.5 or higher, which you can [download here](https://www.elastic.co/downloads/logstash).
|
|
13
10
|
|
|
14
11
|
- Install the plugin from the Logstash home directory
|
|
15
12
|
```sh
|
|
@@ -33,9 +30,6 @@ output {stdout {codec => json_lines}}'
|
|
|
33
30
|
|
|
34
31
|
This will immediately watch the tables `test.foo` and `db2.baz`, and it will also watch the databases `db1` and `db2` for new or dropped tables and watch or unwatch those tables appropriately. Since `backfill` is `true`, it will automatically send events for the documents that already exist in those tables during initialization.
|
|
35
32
|
|
|
36
|
-
|
|
37
|
-
Since `backfill` is `true`, it will automatically watch any tables it finds in `db1` or `db2`, and will send events over logstash for each document already in those tables.
|
|
38
|
-
|
|
39
33
|
### Format of the events:
|
|
40
34
|
|
|
41
35
|
The events are encoded with the "json_lines" codec, which puts compressed json documents one event per line
|
|
@@ -51,7 +45,8 @@ Fields:
|
|
|
51
45
|
|
|
52
46
|
## Known limitations
|
|
53
47
|
|
|
54
|
-
There are two
|
|
48
|
+
There are two limitations that should be known by anyone using this in production systems:
|
|
49
|
+
|
|
55
50
|
1. Until RethinkDB supports resuming changefeeds, this plugin cannot guarantee that no changes are missed if a connection to the database is dropped. Again, once that functionality is implemented, this plugin will be modified to provide reliable "at least once" semantics for changes (meaning once it reconnects, it can catch back up and send any changes that it missed).
|
|
56
51
|
2. Documents that are deleted in RethinkDB while the LogStash plugin is disconnected will not be synchronized. This is true even if `backfill` is enabled. This limitation is a consequence of LogStash operating on a document-by-document basis.
|
|
57
52
|
|
|
@@ -40,7 +40,7 @@ class LogStash::Inputs::RethinkDB < LogStash::Inputs::Base
|
|
|
40
40
|
@db_feeds = {}
|
|
41
41
|
@queue = nil
|
|
42
42
|
@backfill = @backfill && @backfill != 'false'
|
|
43
|
-
@squash = @squash && @squash != '
|
|
43
|
+
@squash = @squash && @squash != 'false'
|
|
44
44
|
end
|
|
45
45
|
|
|
46
46
|
# # Part of the logstash input interface
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Gem::Specification.new do |s|
|
|
2
2
|
s.name = 'logstash-input-rethinkdb'
|
|
3
|
-
s.version = '0.2.
|
|
3
|
+
s.version = '0.2.1'
|
|
4
4
|
s.licenses = ['Apache License (2.0)']
|
|
5
5
|
s.summary = "Streams changes from RethinkDB tables into LogStash."
|
|
6
6
|
s.description = "This gem is a logstash plugin required to be installed on top of the Logstash core pipeline using $LS_HOME/bin/plugin install gemname. This gem is not a stand-alone program"
|