solr_cursorstream 0.1.1 → 0.2.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG.md +4 -0
- data/README.md +12 -8
- data/lib/solr/cursorstream/version.rb +1 -1
- data/lib/solr/cursorstream.rb +0 -1
- metadata +2 -2
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: '08b5d39809682e6bfae46ebfcfe294db8c6a8b3cc695b7ca63bc6087e2b017b7'
|
4
|
+
data.tar.gz: e378fbe72fb508093a034d23c90993f22ad8a58499e03d4650d3b19a75a3f440
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 262f1eea0c32255672234c9530e2fbf5854e540758a590fd48dbe845e3e43f4410dd2617298a72ce8b9fb2659293d2c82b35907d066d5eb2e325cfaab6ae7c8f
|
7
|
+
data.tar.gz: 7669af73e388a007b1b3356bdb3ec6637872439b76d054be21372c3f3b2aade6ca40b457929e7a8d43f14612682f29571e4eb7c7af7aaa6ce813a4f5e96a7c9d
|
data/CHANGELOG.md
CHANGED
data/README.md
CHANGED
@@ -18,11 +18,13 @@ downloading large sets of data without the "deep paging"
|
|
18
18
|
out-of-memory problems
|
19
19
|
associated with just using the `start` and `rows` parameters.
|
20
20
|
|
21
|
-
The only
|
21
|
+
The only real restriction is that _the sort specification MUST
|
22
22
|
include the`uniqueKey` field_. If you're just downloading a whole dataset and
|
23
23
|
don't care about order, the default query of `*:*` and the default sort of `id asc`
|
24
|
-
will be fine (assuming your uniqueKey is `id`).
|
25
|
-
|
24
|
+
will be fine (assuming your uniqueKey is `id`).
|
25
|
+
|
26
|
+
If you want to sort by
|
27
|
+
another field/value, just include the uniqueKey in a secondary sort (e.g.,
|
26
28
|
`sort: "score desc, id asc"`) to guarantee a stable sort.
|
27
29
|
|
28
30
|
NOTE that if you don't need the `score` (relevancy) field,
|
@@ -81,11 +83,12 @@ end
|
|
81
83
|
|
82
84
|
## TODO
|
83
85
|
|
84
|
-
[ ] Add a
|
85
|
-
[ ]
|
86
|
-
|
87
|
-
[ ] Actual error handling, or at least passing useful
|
88
|
-
|
86
|
+
* [ ] Add a `lucene_escape` utility function
|
87
|
+
* [ ] Change q/fq to take either a string (as current) or a {field => value}
|
88
|
+
hash
|
89
|
+
* [ ] Actual error handling for retries, or at least passing useful
|
90
|
+
information along
|
91
|
+
* [ ] Figure out how to test without a live solr to bounce off of. Maybe use
|
89
92
|
vcr or similar?
|
90
93
|
|
91
94
|
## Installation
|
@@ -94,6 +97,7 @@ Add this line to your application's Gemfile:
|
|
94
97
|
|
95
98
|
```ruby
|
96
99
|
gem 'solr_cursorstream'
|
100
|
+
# require with require "solr/cursorstream"
|
97
101
|
```
|
98
102
|
|
99
103
|
And then execute:
|
data/lib/solr/cursorstream.rb
CHANGED
metadata
CHANGED
@@ -1,14 +1,14 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: solr_cursorstream
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 0.
|
4
|
+
version: 0.2.0
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Bill Dueber
|
8
8
|
autorequire:
|
9
9
|
bindir: exe
|
10
10
|
cert_chain: []
|
11
|
-
date: 2022-
|
11
|
+
date: 2022-08-05 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
name: faraday
|