dmm-crawler 0.4.3 → 0.4.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/CHANGELOG.md +40 -0
- data/README.md +1 -1
- data/lib/dmm-crawler/ranking/dojin_ranking.rb +1 -1
- data/lib/dmm-crawler/version.rb +1 -1
- data/spec/dmm-crawler/ranking/adult_game_ranking_spec.rb +1 -1
- metadata +3 -4
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: ec2e4b341260b38115388c293b57d98ddccf2ea05d5eedeabcbf84b79821a0c0
|
|
4
|
+
data.tar.gz: 6a926c8de5ca4d482812b769a2da0f9dde753b6f02e9819e2061f0fb991916f5
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 05c7d60a958b025c8d3acdc5838b3e9197a341009a9a5624f0dc4260597c193fa2fcd824612c3f5ac9b939b9dd4d5d4e1e6fe9a98c44efe74f537f4ad2aaa6c0
|
|
7
|
+
data.tar.gz: 92d4c449500364fce30d549eeac5d800d1b0e6566ec7ae369325ab73db7c22edaac238495f6f955526b6f264b33d6a739d20513d1d6933965aa17d1d60ba5229
|
data/CHANGELOG.md
CHANGED
|
@@ -1,119 +1,159 @@
|
|
|
1
1
|
# Change logs
|
|
2
2
|
|
|
3
|
+
## 0.4.4
|
|
4
|
+
|
|
5
|
+
- Fix a typo where it inserts submedia into term instance variable.
|
|
6
|
+
|
|
3
7
|
## 0.4.3
|
|
8
|
+
|
|
4
9
|
- Fix a bug where 2019's eroge ranking is not found on FANZA.
|
|
5
10
|
|
|
6
11
|
## 0.4.2
|
|
12
|
+
|
|
7
13
|
- Fix a bug where adult game's tags wrong to be fetched.
|
|
8
14
|
|
|
9
15
|
## 0.4.1
|
|
16
|
+
|
|
10
17
|
- Fix a bug where nil is not accepted in `File.join`.
|
|
11
18
|
|
|
12
19
|
## 0.4.0
|
|
20
|
+
|
|
13
21
|
- Drop support of fetching the art's information.
|
|
14
22
|
- Support adult game's rankings.
|
|
15
23
|
|
|
16
24
|
## 0.3.5
|
|
25
|
+
|
|
17
26
|
- Drop support of fetching art's price.
|
|
18
27
|
|
|
19
28
|
## 0.3.4
|
|
29
|
+
|
|
20
30
|
- Support Ruby `2.5.1`.
|
|
21
31
|
- Implement the function to detect excluded arts for affiliating.
|
|
22
32
|
|
|
23
33
|
## 0.3.3
|
|
34
|
+
|
|
24
35
|
- Fetch first img element from art page.
|
|
25
36
|
|
|
26
37
|
## 0.3.2
|
|
38
|
+
|
|
27
39
|
- Revert "Use HTTPS in all connections".
|
|
28
40
|
|
|
29
41
|
## 0.3.1
|
|
42
|
+
|
|
30
43
|
- Use HTTPS in all connections.
|
|
31
44
|
|
|
32
45
|
## 0.3.0
|
|
46
|
+
|
|
33
47
|
### Critical Bug Fix
|
|
48
|
+
|
|
34
49
|
- Fix a bug where sub price is not found.
|
|
35
50
|
- If sub price is not found, Integer can't parse argument because it's String.
|
|
36
51
|
|
|
37
52
|
## 0.2.7
|
|
53
|
+
|
|
38
54
|
- Make price integer.
|
|
39
55
|
|
|
40
56
|
## 0.2.6
|
|
57
|
+
|
|
41
58
|
- Fetch the price of the art.
|
|
42
59
|
|
|
43
60
|
## 0.2.5
|
|
61
|
+
|
|
44
62
|
- Make agent selectable in Attributes class.
|
|
45
63
|
|
|
46
64
|
## 0.2.4
|
|
65
|
+
|
|
47
66
|
- Do not show rank in art title.
|
|
48
67
|
|
|
49
68
|
## 0.2.3
|
|
69
|
+
|
|
50
70
|
- Do not lock gem versions in 'dmm-crawler.gemspec'.
|
|
51
71
|
- Change the author name element due to it is not found.
|
|
52
72
|
|
|
53
73
|
### Security Changes
|
|
74
|
+
|
|
54
75
|
- Lock the RuboCop version over `0.49.0`.
|
|
55
76
|
|
|
56
77
|
### Breaking Changes
|
|
78
|
+
|
|
57
79
|
- Reduce the ranking size to ten.
|
|
58
80
|
|
|
59
81
|
## 0.2.2
|
|
82
|
+
|
|
60
83
|
- Do not manage 'Gemfile.lock'.
|
|
61
84
|
|
|
62
85
|
## 0.2.1
|
|
86
|
+
|
|
63
87
|
- Add an attribute for author.
|
|
64
88
|
|
|
65
89
|
## 0.2.0
|
|
90
|
+
|
|
66
91
|
- Make optional configuration settable for Mechanize.
|
|
67
92
|
- Fix a bug where data-src is not found
|
|
68
93
|
- Do not fix types of submedia.
|
|
69
94
|
- Update `README.md`.
|
|
70
95
|
|
|
71
96
|
### Breaking Changes
|
|
97
|
+
|
|
72
98
|
- Do not use passed value of submedia type.
|
|
73
99
|
|
|
74
100
|
## 0.1.5
|
|
101
|
+
|
|
75
102
|
- Do not crawl columns related to description.
|
|
76
103
|
|
|
77
104
|
## 0.1.4
|
|
105
|
+
|
|
78
106
|
- Move the series to last.
|
|
79
107
|
|
|
80
108
|
## 0.1.3
|
|
109
|
+
|
|
81
110
|
- Add crawling more information.
|
|
82
111
|
|
|
83
112
|
## 0.1.2
|
|
113
|
+
|
|
84
114
|
- Extract Attributes klass from Ranking klass.
|
|
85
115
|
- Support art page.
|
|
86
116
|
- Add an attribute for submedia.
|
|
87
117
|
|
|
88
118
|
## 0.1.1
|
|
119
|
+
|
|
89
120
|
- Convert double quotes to single qoutes for description_raw.
|
|
90
121
|
|
|
91
122
|
## 0.1.0
|
|
123
|
+
|
|
92
124
|
- Add an attribute raw data of description that include HTML tag.
|
|
93
125
|
|
|
94
126
|
## 0.0.7
|
|
127
|
+
|
|
95
128
|
### Critical bug fix
|
|
129
|
+
|
|
96
130
|
- Replace url with image_url
|
|
97
131
|
- Fix the bug where description is empty.
|
|
98
132
|
|
|
99
133
|
## 0.0.6
|
|
134
|
+
|
|
100
135
|
- Refactor codes related to attributes for the art.
|
|
101
136
|
|
|
102
137
|
## 0.0.5
|
|
138
|
+
|
|
103
139
|
- Add a function to fetch description.
|
|
104
140
|
|
|
105
141
|
## v0.0.4
|
|
142
|
+
|
|
106
143
|
- Fix the code for chech an argument.
|
|
107
144
|
- Rename an attribute from url to title_link.
|
|
108
145
|
- Improve readability of about arguments.
|
|
109
146
|
|
|
110
147
|
## v0.0.3
|
|
148
|
+
|
|
111
149
|
- Rename the method from books to arts.
|
|
112
150
|
- Correct examples for `README.md`.
|
|
113
151
|
|
|
114
152
|
## v0.0.2
|
|
153
|
+
|
|
115
154
|
- Write docs for dmm-crawler.
|
|
116
155
|
- Add a function to fetch tags for the title.
|
|
117
156
|
|
|
118
157
|
## v0.0.1
|
|
158
|
+
|
|
119
159
|
- Implement fetch the ranking for the DMM.R18's rankings.
|
data/README.md
CHANGED
|
@@ -4,7 +4,7 @@
|
|
|
4
4
|
|
|
5
5
|
## :warning: Cation :warning:
|
|
6
6
|
|
|
7
|
-
FANZA does not
|
|
7
|
+
FANZA does not accept crawling pages so I don't recommend to use this gem.
|
|
8
8
|
|
|
9
9
|
I do not take any responsibility or liability for any damage or loss caused by mine gem.
|
|
10
10
|
|
|
@@ -8,7 +8,7 @@ module DMMCrawler
|
|
|
8
8
|
def initialize(agent:, submedia: nil, term: nil)
|
|
9
9
|
@agent = discriminate_agent(agent)
|
|
10
10
|
@submedia = submedia
|
|
11
|
-
@term =
|
|
11
|
+
@term = term
|
|
12
12
|
@url = File.join(BASE_URL, "/dc/doujin/-/ranking-all/=/sort=popular/submedia=#{@submedia}/term=#{@term}")
|
|
13
13
|
end
|
|
14
14
|
|
data/lib/dmm-crawler/version.rb
CHANGED
|
@@ -2,7 +2,7 @@ describe DMMCrawler::Ranking::AdultGameRanking do
|
|
|
2
2
|
let(:agent) { DMMCrawler::Agent.instance.agent }
|
|
3
3
|
let(:arguments) { { agent: agent, term: term } }
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
skip 'The eroge genre does not allow access from except Japan' do
|
|
6
6
|
subject { attachments }
|
|
7
7
|
|
|
8
8
|
after { sleep 2 }
|
metadata
CHANGED
|
@@ -1,14 +1,14 @@
|
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
|
2
2
|
name: dmm-crawler
|
|
3
3
|
version: !ruby/object:Gem::Version
|
|
4
|
-
version: 0.4.
|
|
4
|
+
version: 0.4.4
|
|
5
5
|
platform: ruby
|
|
6
6
|
authors:
|
|
7
7
|
- Satoshi Ohmori
|
|
8
8
|
autorequire:
|
|
9
9
|
bindir: bin
|
|
10
10
|
cert_chain: []
|
|
11
|
-
date: 2019-
|
|
11
|
+
date: 2019-05-02 00:00:00.000000000 Z
|
|
12
12
|
dependencies:
|
|
13
13
|
- !ruby/object:Gem::Dependency
|
|
14
14
|
name: rdmm
|
|
@@ -158,8 +158,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
|
|
|
158
158
|
- !ruby/object:Gem::Version
|
|
159
159
|
version: '0'
|
|
160
160
|
requirements: []
|
|
161
|
-
|
|
162
|
-
rubygems_version: 2.7.6
|
|
161
|
+
rubygems_version: 3.0.3
|
|
163
162
|
signing_key:
|
|
164
163
|
specification_version: 4
|
|
165
164
|
summary: Show DMM and DMM.R18's crawled data
|