mechanize-progressbar 0.1.0

Sign up to get free protection for your applications and to get access to all the features.
@@ -0,0 +1,5 @@
1
+ lib/**/*.rb
2
+ bin/*
3
+ -
4
+ features/**/*.feature
5
+ LICENSE.txt
data/.rspec ADDED
@@ -0,0 +1 @@
1
+ --color
data/Gemfile ADDED
@@ -0,0 +1,18 @@
1
+ source "http://rubygems.org"
2
+ # Add dependencies required to use your gem here.
3
+ # Example:
4
+ # gem "activesupport", ">= 2.3.5"
5
+
6
+ gem 'mechanize', '>= 1.0.0'
7
+ gem 'progressbar', '>= 0.9.0'
8
+
9
+ # Add dependencies to develop your gem here.
10
+ # Include everything needed to run rake, tests, features, etc.
11
+ group :development do
12
+ gem "rspec", "~> 2.3.0"
13
+ gem "bundler", "~> 1.0.0"
14
+ gem "jeweler", "~> 1.5.2"
15
+ gem "rcov", ">= 0"
16
+
17
+ gem 'webmock', '>= 0'
18
+ end
@@ -0,0 +1,340 @@
1
+ GNU GENERAL PUBLIC LICENSE
2
+ Version 2, June 1991
3
+
4
+ Copyright (C) 1989, 1991 Free Software Foundation, Inc.
5
+ 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
6
+ Everyone is permitted to copy and distribute verbatim copies
7
+ of this license document, but changing it is not allowed.
8
+
9
+ Preamble
10
+
11
+ The licenses for most software are designed to take away your
12
+ freedom to share and change it. By contrast, the GNU General Public
13
+ License is intended to guarantee your freedom to share and change free
14
+ software--to make sure the software is free for all its users. This
15
+ General Public License applies to most of the Free Software
16
+ Foundation's software and to any other program whose authors commit to
17
+ using it. (Some other Free Software Foundation software is covered by
18
+ the GNU Library General Public License instead.) You can apply it to
19
+ your programs, too.
20
+
21
+ When we speak of free software, we are referring to freedom, not
22
+ price. Our General Public Licenses are designed to make sure that you
23
+ have the freedom to distribute copies of free software (and charge for
24
+ this service if you wish), that you receive source code or can get it
25
+ if you want it, that you can change the software or use pieces of it
26
+ in new free programs; and that you know you can do these things.
27
+
28
+ To protect your rights, we need to make restrictions that forbid
29
+ anyone to deny you these rights or to ask you to surrender the rights.
30
+ These restrictions translate to certain responsibilities for you if you
31
+ distribute copies of the software, or if you modify it.
32
+
33
+ For example, if you distribute copies of such a program, whether
34
+ gratis or for a fee, you must give the recipients all the rights that
35
+ you have. You must make sure that they, too, receive or can get the
36
+ source code. And you must show them these terms so they know their
37
+ rights.
38
+
39
+ We protect your rights with two steps: (1) copyright the software, and
40
+ (2) offer you this license which gives you legal permission to copy,
41
+ distribute and/or modify the software.
42
+
43
+ Also, for each author's protection and ours, we want to make certain
44
+ that everyone understands that there is no warranty for this free
45
+ software. If the software is modified by someone else and passed on, we
46
+ want its recipients to know that what they have is not the original, so
47
+ that any problems introduced by others will not reflect on the original
48
+ authors' reputations.
49
+
50
+ Finally, any free program is threatened constantly by software
51
+ patents. We wish to avoid the danger that redistributors of a free
52
+ program will individually obtain patent licenses, in effect making the
53
+ program proprietary. To prevent this, we have made it clear that any
54
+ patent must be licensed for everyone's free use or not licensed at all.
55
+
56
+ The precise terms and conditions for copying, distribution and
57
+ modification follow.
58
+
59
+ GNU GENERAL PUBLIC LICENSE
60
+ TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
61
+
62
+ 0. This License applies to any program or other work which contains
63
+ a notice placed by the copyright holder saying it may be distributed
64
+ under the terms of this General Public License. The "Program", below,
65
+ refers to any such program or work, and a "work based on the Program"
66
+ means either the Program or any derivative work under copyright law:
67
+ that is to say, a work containing the Program or a portion of it,
68
+ either verbatim or with modifications and/or translated into another
69
+ language. (Hereinafter, translation is included without limitation in
70
+ the term "modification".) Each licensee is addressed as "you".
71
+
72
+ Activities other than copying, distribution and modification are not
73
+ covered by this License; they are outside its scope. The act of
74
+ running the Program is not restricted, and the output from the Program
75
+ is covered only if its contents constitute a work based on the
76
+ Program (independent of having been made by running the Program).
77
+ Whether that is true depends on what the Program does.
78
+
79
+ 1. You may copy and distribute verbatim copies of the Program's
80
+ source code as you receive it, in any medium, provided that you
81
+ conspicuously and appropriately publish on each copy an appropriate
82
+ copyright notice and disclaimer of warranty; keep intact all the
83
+ notices that refer to this License and to the absence of any warranty;
84
+ and give any other recipients of the Program a copy of this License
85
+ along with the Program.
86
+
87
+ You may charge a fee for the physical act of transferring a copy, and
88
+ you may at your option offer warranty protection in exchange for a fee.
89
+
90
+ 2. You may modify your copy or copies of the Program or any portion
91
+ of it, thus forming a work based on the Program, and copy and
92
+ distribute such modifications or work under the terms of Section 1
93
+ above, provided that you also meet all of these conditions:
94
+
95
+ a) You must cause the modified files to carry prominent notices
96
+ stating that you changed the files and the date of any change.
97
+
98
+ b) You must cause any work that you distribute or publish, that in
99
+ whole or in part contains or is derived from the Program or any
100
+ part thereof, to be licensed as a whole at no charge to all third
101
+ parties under the terms of this License.
102
+
103
+ c) If the modified program normally reads commands interactively
104
+ when run, you must cause it, when started running for such
105
+ interactive use in the most ordinary way, to print or display an
106
+ announcement including an appropriate copyright notice and a
107
+ notice that there is no warranty (or else, saying that you provide
108
+ a warranty) and that users may redistribute the program under
109
+ these conditions, and telling the user how to view a copy of this
110
+ License. (Exception: if the Program itself is interactive but
111
+ does not normally print such an announcement, your work based on
112
+ the Program is not required to print an announcement.)
113
+
114
+ These requirements apply to the modified work as a whole. If
115
+ identifiable sections of that work are not derived from the Program,
116
+ and can be reasonably considered independent and separate works in
117
+ themselves, then this License, and its terms, do not apply to those
118
+ sections when you distribute them as separate works. But when you
119
+ distribute the same sections as part of a whole which is a work based
120
+ on the Program, the distribution of the whole must be on the terms of
121
+ this License, whose permissions for other licensees extend to the
122
+ entire whole, and thus to each and every part regardless of who wrote it.
123
+
124
+ Thus, it is not the intent of this section to claim rights or contest
125
+ your rights to work written entirely by you; rather, the intent is to
126
+ exercise the right to control the distribution of derivative or
127
+ collective works based on the Program.
128
+
129
+ In addition, mere aggregation of another work not based on the Program
130
+ with the Program (or with a work based on the Program) on a volume of
131
+ a storage or distribution medium does not bring the other work under
132
+ the scope of this License.
133
+
134
+ 3. You may copy and distribute the Program (or a work based on it,
135
+ under Section 2) in object code or executable form under the terms of
136
+ Sections 1 and 2 above provided that you also do one of the following:
137
+
138
+ a) Accompany it with the complete corresponding machine-readable
139
+ source code, which must be distributed under the terms of Sections
140
+ 1 and 2 above on a medium customarily used for software interchange; or,
141
+
142
+ b) Accompany it with a written offer, valid for at least three
143
+ years, to give any third party, for a charge no more than your
144
+ cost of physically performing source distribution, a complete
145
+ machine-readable copy of the corresponding source code, to be
146
+ distributed under the terms of Sections 1 and 2 above on a medium
147
+ customarily used for software interchange; or,
148
+
149
+ c) Accompany it with the information you received as to the offer
150
+ to distribute corresponding source code. (This alternative is
151
+ allowed only for noncommercial distribution and only if you
152
+ received the program in object code or executable form with such
153
+ an offer, in accord with Subsection b above.)
154
+
155
+ The source code for a work means the preferred form of the work for
156
+ making modifications to it. For an executable work, complete source
157
+ code means all the source code for all modules it contains, plus any
158
+ associated interface definition files, plus the scripts used to
159
+ control compilation and installation of the executable. However, as a
160
+ special exception, the source code distributed need not include
161
+ anything that is normally distributed (in either source or binary
162
+ form) with the major components (compiler, kernel, and so on) of the
163
+ operating system on which the executable runs, unless that component
164
+ itself accompanies the executable.
165
+
166
+ If distribution of executable or object code is made by offering
167
+ access to copy from a designated place, then offering equivalent
168
+ access to copy the source code from the same place counts as
169
+ distribution of the source code, even though third parties are not
170
+ compelled to copy the source along with the object code.
171
+
172
+ 4. You may not copy, modify, sublicense, or distribute the Program
173
+ except as expressly provided under this License. Any attempt
174
+ otherwise to copy, modify, sublicense or distribute the Program is
175
+ void, and will automatically terminate your rights under this License.
176
+ However, parties who have received copies, or rights, from you under
177
+ this License will not have their licenses terminated so long as such
178
+ parties remain in full compliance.
179
+
180
+ 5. You are not required to accept this License, since you have not
181
+ signed it. However, nothing else grants you permission to modify or
182
+ distribute the Program or its derivative works. These actions are
183
+ prohibited by law if you do not accept this License. Therefore, by
184
+ modifying or distributing the Program (or any work based on the
185
+ Program), you indicate your acceptance of this License to do so, and
186
+ all its terms and conditions for copying, distributing or modifying
187
+ the Program or works based on it.
188
+
189
+ 6. Each time you redistribute the Program (or any work based on the
190
+ Program), the recipient automatically receives a license from the
191
+ original licensor to copy, distribute or modify the Program subject to
192
+ these terms and conditions. You may not impose any further
193
+ restrictions on the recipients' exercise of the rights granted herein.
194
+ You are not responsible for enforcing compliance by third parties to
195
+ this License.
196
+
197
+ 7. If, as a consequence of a court judgment or allegation of patent
198
+ infringement or for any other reason (not limited to patent issues),
199
+ conditions are imposed on you (whether by court order, agreement or
200
+ otherwise) that contradict the conditions of this License, they do not
201
+ excuse you from the conditions of this License. If you cannot
202
+ distribute so as to satisfy simultaneously your obligations under this
203
+ License and any other pertinent obligations, then as a consequence you
204
+ may not distribute the Program at all. For example, if a patent
205
+ license would not permit royalty-free redistribution of the Program by
206
+ all those who receive copies directly or indirectly through you, then
207
+ the only way you could satisfy both it and this License would be to
208
+ refrain entirely from distribution of the Program.
209
+
210
+ If any portion of this section is held invalid or unenforceable under
211
+ any particular circumstance, the balance of the section is intended to
212
+ apply and the section as a whole is intended to apply in other
213
+ circumstances.
214
+
215
+ It is not the purpose of this section to induce you to infringe any
216
+ patents or other property right claims or to contest validity of any
217
+ such claims; this section has the sole purpose of protecting the
218
+ integrity of the free software distribution system, which is
219
+ implemented by public license practices. Many people have made
220
+ generous contributions to the wide range of software distributed
221
+ through that system in reliance on consistent application of that
222
+ system; it is up to the author/donor to decide if he or she is willing
223
+ to distribute software through any other system and a licensee cannot
224
+ impose that choice.
225
+
226
+ This section is intended to make thoroughly clear what is believed to
227
+ be a consequence of the rest of this License.
228
+
229
+ 8. If the distribution and/or use of the Program is restricted in
230
+ certain countries either by patents or by copyrighted interfaces, the
231
+ original copyright holder who places the Program under this License
232
+ may add an explicit geographical distribution limitation excluding
233
+ those countries, so that distribution is permitted only in or among
234
+ countries not thus excluded. In such case, this License incorporates
235
+ the limitation as if written in the body of this License.
236
+
237
+ 9. The Free Software Foundation may publish revised and/or new versions
238
+ of the General Public License from time to time. Such new versions will
239
+ be similar in spirit to the present version, but may differ in detail to
240
+ address new problems or concerns.
241
+
242
+ Each version is given a distinguishing version number. If the Program
243
+ specifies a version number of this License which applies to it and "any
244
+ later version", you have the option of following the terms and conditions
245
+ either of that version or of any later version published by the Free
246
+ Software Foundation. If the Program does not specify a version number of
247
+ this License, you may choose any version ever published by the Free Software
248
+ Foundation.
249
+
250
+ 10. If you wish to incorporate parts of the Program into other free
251
+ programs whose distribution conditions are different, write to the author
252
+ to ask for permission. For software which is copyrighted by the Free
253
+ Software Foundation, write to the Free Software Foundation; we sometimes
254
+ make exceptions for this. Our decision will be guided by the two goals
255
+ of preserving the free status of all derivatives of our free software and
256
+ of promoting the sharing and reuse of software generally.
257
+
258
+ NO WARRANTY
259
+
260
+ 11. BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY
261
+ FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN
262
+ OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES
263
+ PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED
264
+ OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
265
+ MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS
266
+ TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE
267
+ PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING,
268
+ REPAIR OR CORRECTION.
269
+
270
+ 12. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
271
+ WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR
272
+ REDISTRIBUTE THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES,
273
+ INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING
274
+ OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED
275
+ TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY
276
+ YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER
277
+ PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE
278
+ POSSIBILITY OF SUCH DAMAGES.
279
+
280
+ END OF TERMS AND CONDITIONS
281
+
282
+ How to Apply These Terms to Your New Programs
283
+
284
+ If you develop a new program, and you want it to be of the greatest
285
+ possible use to the public, the best way to achieve this is to make it
286
+ free software which everyone can redistribute and change under these terms.
287
+
288
+ To do so, attach the following notices to the program. It is safest
289
+ to attach them to the start of each source file to most effectively
290
+ convey the exclusion of warranty; and each file should have at least
291
+ the "copyright" line and a pointer to where the full notice is found.
292
+
293
+ <one line to give the program's name and a brief idea of what it does.>
294
+ Copyright (C) <year> <name of author>
295
+
296
+ This program is free software; you can redistribute it and/or modify
297
+ it under the terms of the GNU General Public License as published by
298
+ the Free Software Foundation; either version 2 of the License, or
299
+ (at your option) any later version.
300
+
301
+ This program is distributed in the hope that it will be useful,
302
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
303
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
304
+ GNU General Public License for more details.
305
+
306
+ You should have received a copy of the GNU General Public License
307
+ along with this program; if not, write to the Free Software
308
+ Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA
309
+
310
+
311
+ Also add information on how to contact you by electronic and paper mail.
312
+
313
+ If the program is interactive, make it output a short notice like this
314
+ when it starts in an interactive mode:
315
+
316
+ Gnomovision version 69, Copyright (C) year name of author
317
+ Gnomovision comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
318
+ This is free software, and you are welcome to redistribute it
319
+ under certain conditions; type `show c' for details.
320
+
321
+ The hypothetical commands `show w' and `show c' should show the appropriate
322
+ parts of the General Public License. Of course, the commands you use may
323
+ be called something other than `show w' and `show c'; they could even be
324
+ mouse-clicks or menu items--whatever suits your program.
325
+
326
+ You should also get your employer (if you work as a programmer) or your
327
+ school, if any, to sign a "copyright disclaimer" for the program, if
328
+ necessary. Here is a sample; alter the names:
329
+
330
+ Yoyodyne, Inc., hereby disclaims all copyright interest in the program
331
+ `Gnomovision' (which makes passes at compilers) written by James Hacker.
332
+
333
+ <signature of Ty Coon>, 1 April 1989
334
+ Ty Coon, President of Vice
335
+
336
+ This General Public License does not permit incorporating your program into
337
+ proprietary programs. If your program is a subroutine library, you may
338
+ consider it more useful to permit linking proprietary applications with the
339
+ library. If this is what you want to do, use the GNU Library General
340
+ Public License instead of this License.
@@ -0,0 +1,109 @@
1
+ = mechanize-progressbar
2
+
3
+ Mechanize-Progressbar provides ProgressBar when you use Mechanize#get.
4
+ HTTP response only. HTTP requests are not supported.
5
+ Mechanize-Progressbar sets proc object to Mechanize#pre_connect_hooks.
6
+
7
+ == you can do
8
+
9
+ require 'mechanize'
10
+ require 'mechanize/progressbar'
11
+ agent = Mechanize.new
12
+ agent.progressbar{ agent.get(large_file) }
13
+
14
+ http://host/large_file.zip
15
+ 15% |ooooooo | 135.2KB 21.9KB/s ETA: 00:00:10
16
+
17
+ == Requirements
18
+
19
+ - Ruby 1.8.6 or later
20
+ - recent Rubygems
21
+ - Mechanize gem
22
+ - ProgressBar gem
23
+
24
+ == USAGE
25
+
26
+ Get file in Mechanize#progressbar block.
27
+
28
+ require 'mechanize'
29
+ require 'mechanize/progressbar'
30
+ agent = Mechanize.new
31
+ agent.progressbar{ agent.get(large_file) }
32
+
33
+ Link#click also works.
34
+
35
+ agent = Mechanize.new
36
+ agent.get(some_page)
37
+ agent.progressbar do
38
+ agent.page.link_with(:text => 'download here').click
39
+ end
40
+
41
+ If you want to modify ProgressBar object, set options.
42
+
43
+ pbar = ProgressBar.new(title, total, out)
44
+ pbar.format = format
45
+ pbar.format_arguments = format_arguments
46
+
47
+ is
48
+
49
+ agent = Mechanize.new
50
+ agent.progressbar(
51
+ :title => title,
52
+ :total => total,
53
+ :out => out,
54
+ :format => format,
55
+ :format_arguments => format_arguments
56
+ ){ agent.get(large_file) }
57
+
58
+ Mechanize-Progressbar prints the URL to $stderr before progressbar.
59
+
60
+ agent.progressbar{ agent.get(large_file) }
61
+
62
+ http://uri.host/large_file.zip
63
+ 15% |ooooo | 135.2KB 21.9KB/s ETA: 00:00:10
64
+
65
+ If you do not want the "two-line mode", set (:single => true).
66
+
67
+ agent.progressbar(:single => true){ agent.get(large_file) }
68
+
69
+ uri.host: 15% |ooo | 135.2KB 21.9KB/s ETA: 00:00:10
70
+
71
+ When you use Mechanize Logger and same output(i.e, agent.log=Logger.new($stdout)),
72
+ set (:suppress_logger => true).
73
+
74
+ agent.log = Logger.new($stdout)
75
+ agent.progressbar{ agent.get(large_file) }
76
+
77
+ http://uri.host/large_file.zip
78
+ D, [...] DEBUG -- : Read 1000 bytes
79
+ 10% |ooo | 100.2KB 21.9KB/s ETA: 00:00:11
80
+ D, [...] DEBUG -- : Read 2000 bytes
81
+ 15% |ooooo | 200.1KB 21.9KB/s ETA: 00:00:08
82
+ ...
83
+
84
+ agent.log = Logger.new($stdout)
85
+ agent.progressbar(:suppress_logger => true){ agent.get(large_file) }
86
+
87
+ http://uri.host/large_file.zip
88
+ 100% |ooooooooooooooooooooooooooooooo| 1024.0KB 21.9KB/s Time: 00:00:20
89
+ D, [...] DEBUG -- : Read 102400 bytes
90
+
91
+ LARGE FILE DOWNLOAD NOTE:
92
+ Mechanize keeps all the got files as String object.
93
+ When you get the five 100MB files, Mechanize uses at least 500MB memory.
94
+
95
+ If you wish to run Mechanize with minimum memory usage, try
96
+ agent.max_history = 1
97
+
98
+
99
+ == Licence
100
+
101
+ GNU GENERAL PUBLIC LICENSE Version 2
102
+
103
+ alike Mechanize.
104
+
105
+ == Author
106
+
107
+ kitamomonga
108
+ kitamomonga@gmail.com
109
+ http://d.hatena.ne.jp/kitamomonga/ (Japanese)
@@ -0,0 +1,50 @@
1
+ require 'rubygems'
2
+ require 'bundler'
3
+ begin
4
+ Bundler.setup(:default, :development)
5
+ rescue Bundler::BundlerError => e
6
+ $stderr.puts e.message
7
+ $stderr.puts "Run `bundle install` to install missing gems"
8
+ exit e.status_code
9
+ end
10
+ require 'rake'
11
+
12
+ require 'jeweler'
13
+ Jeweler::Tasks.new do |gem|
14
+ gem.name = "mechanize-progressbar"
15
+ gem.homepage = "http://github.com/kitamomonga/mechanize-progressbar"
16
+ gem.license = "GPL-2"
17
+ gem.summary = "Mechanize-Progressbar provides ProgressBar for Mechanize#get and Link#click. requires 'progressbar' gem."
18
+ gem.description = "Mechanize-Progressbar shows ProgressBar when HTTP GET access of Mechanize(Mechanize#get, Page::Link#click, response of Form#submit). It requires 'progressbar' gem. HTTP POST is not supported."
19
+ gem.email = "kitamomonga@gmail.com"
20
+ gem.authors = ["kitamomonga"]
21
+ # See ./Gemfile
22
+ # gem.add_runtime_dependency 'mechanize', '>= 1.0.0'
23
+ # gem.add_runtime_dependency 'progressbar', '>= 0.9.0'
24
+ # gem.add_development_dependency 'rspec', '> 1.2.3'
25
+ # gem.add_development_dependency 'webmock', '> 1.6.1'
26
+ end
27
+ Jeweler::RubygemsDotOrgTasks.new
28
+
29
+ require 'rspec/core'
30
+ require 'rspec/core/rake_task'
31
+ RSpec::Core::RakeTask.new(:spec) do |spec|
32
+ spec.pattern = FileList['spec/**/*_spec.rb']
33
+ end
34
+
35
+ RSpec::Core::RakeTask.new(:rcov) do |spec|
36
+ spec.pattern = 'spec/**/*_spec.rb'
37
+ spec.rcov = true
38
+ end
39
+
40
+ task :default => :spec
41
+
42
+ require 'rake/rdoctask'
43
+ Rake::RDocTask.new do |rdoc|
44
+ version = File.exist?('VERSION') ? File.read('VERSION') : ""
45
+
46
+ rdoc.rdoc_dir = 'rdoc'
47
+ rdoc.title = "mechanize-progressbar #{version}"
48
+ rdoc.rdoc_files.include('README*')
49
+ rdoc.rdoc_files.include('lib/**/*.rb')
50
+ end
data/VERSION ADDED
@@ -0,0 +1 @@
1
+ 0.1.0
@@ -0,0 +1,2 @@
1
+ require 'progressbar'
2
+ require 'mechanize/progressbar/mech_progressbar'
@@ -0,0 +1,149 @@
1
+ module MechanizeProgressBarAPI
2
+ ### Usage:
3
+ ### require 'mechanize'
4
+ ### require 'mechanize/progressbar'
5
+ ### agent = Mechanize.new
6
+ ### agent.progressbar{ agent.get(large_file) }
7
+ ### agent.get(some_page)
8
+ ### agent.progressbar{ agent.page.link_with(:text => 'download here').click }
9
+ ###
10
+ ### If you want to set parameters to ProgressBar object,
11
+ ### agent.progressbar(:title => 'large_file', :format_arguments => @fmt) do
12
+ ### agent.get(large_file)
13
+ ### end
14
+ ### ProgressBar is gem lib. Please install with 'gem install progressbar'.
15
+ ###
16
+ ### options:
17
+ ### [:single] enables single line mode, original ProgressBar gem behavior. default is false
18
+ ### [:title] ProgressBar.new(*title*, total, out), default is empty
19
+ ### [:total] ProgressBar.new(title, *total*, out), default is 'Content-Length' response header
20
+ ### [:out] ProgressBar.new(title, total, *out*), default is $stderr
21
+ ### [:format] ProgressBar.new(*args).format=*format*, default is nil
22
+ ### [:format_arguments] ProgressBar.new(*args).format_arguments=*format_arguments*, default is nil
23
+ ### [:reversed] ReversedProgressBar.new(*args), default is false
24
+ ### [:file_transfer_mode] enables ProgressBar#file_transfer_mode, default is true
25
+ ### [:suppress_logger] makes Logger's output and Progressbar's output independent
26
+ def progressbar(agent_or_pbar_opts = self, pbar_opts = {})
27
+ if agent_or_pbar_opts.kind_of?(Hash) then
28
+ agent, pbar_opts = self, agent_or_pbar_opts
29
+ else
30
+ agent = agent_or_pbar_opts
31
+ end
32
+ MechanizeProgressBar.register(agent, pbar_opts)
33
+ if block_given?
34
+ begin
35
+ yield agent
36
+ rescue Exception, Mechanize::ResponseCodeError
37
+ MechanizeProgressBar.unregister(agent)
38
+ raise
39
+ end
40
+ MechanizeProgressBar.unregister(agent)
41
+ else
42
+ MechanizeProgressBar.reserve_pseudo_unregisteration(agent)
43
+ end
44
+ agent
45
+ end
46
+ end
47
+
48
+ module MechanizeProgressBar
49
+ def self.pbar_hooks ; @pbar_hooks ||= []; end
50
+ def self.default_out ; @default_out ||= $stderr; end
51
+ def self.default_out=(out); @default_out = out; end
52
+
53
+ def self.build(chain_params)
54
+ pbar_opts = chain_params[:progressbar]
55
+
56
+ out = pbar_opts[:out] || pbar_opts[:output] || self.default_out
57
+ if pbar_opts[:single] then
58
+ title = pbar_opts[:title] || chain_params[:uri].host
59
+ format = pbar_opts[:format]
60
+ format_arguments = pbar_opts[:format_arguments]
61
+ else
62
+ title = pbar_opts[:title] || ""
63
+ format = pbar_opts[:format] || "%3d%% %s %s"
64
+ format_arguments = pbar_opts[:format_arguments] || [:percentage, :bar, :stat_for_file_transfer]
65
+ out.print "#{pbar_opts[:title]||chain_params[:uri]}\n"
66
+ end
67
+ total = pbar_opts[:total] || filesize(chain_params)
68
+ pbar_class = pbar_opts[:reversed] ? ReversedProgressBar : ProgressBar
69
+
70
+ progressbar = pbar_class.new(title, total, out)
71
+ progressbar.file_transfer_mode unless pbar_opts[:file_transfer_mode]
72
+ progressbar.format = format if format
73
+ progressbar.format_arguments = format_arguments if format_arguments
74
+ return progressbar
75
+ end
76
+
77
+ def self.filesize(chain_params)
78
+ content_length = chain_params[:response]['content-length']
79
+ content_length ? content_length.to_i : 0
80
+ end
81
+
82
+ def self.register(agent, pbar_opts)
83
+ pre_hook = lambda{|options| options[:progressbar] = pbar_opts}
84
+ self.pbar_hooks << pre_hook
85
+ agent.pre_connect_hooks << pre_hook
86
+ end
87
+
88
+ def self.unregister(agent)
89
+ agent.pre_connect_hooks.each do |pr|
90
+ agent.pre_connect_hooks.delete_if{ self.pbar_hooks.delete(pr)}
91
+ end
92
+ end
93
+
94
+ def self.reserve_pseudo_unregisteration(agent)
95
+ agent.post_connect_hooks << lambda{|options|
96
+ MechanizeProgressBar.unregister(agent) if options[:agent] && options[:progressbar]
97
+ }
98
+ end
99
+
100
+ def self.http_ok?(params)
101
+ params[:progressbar] && params[:response].code == '200'
102
+ end
103
+
104
+ def self.suppress_logger?(params)
105
+ params[:progressbar] && params[:progressbar][:suppress_logger]
106
+ end
107
+ end
108
+
109
+
110
+
111
+ class Mechanize # has 6 added/modified lines
112
+ include MechanizeProgressBarAPI # (1of6)a
113
+ class Chain
114
+ class ResponseReader
115
+ def handle(ctx, params)
116
+ params[:response] = @response
117
+ body = StringIO.new
118
+ total = 0
119
+ pbar = MechanizeProgressBar.build(params) if MechanizeProgressBar.http_ok?(params) # (2of6)a
120
+ @response.read_body { |part|
121
+ total += part.length
122
+ body.write(part)
123
+ # Mechanize.log.debug("Read #{total} bytes") if Mechanize.log
124
+ Mechanize.log.debug("Read #{total} bytes") if Mechanize.log && !MechanizeProgressBar.suppress_logger?(params) # (3of6)m
125
+ pbar.inc(part.length) if MechanizeProgressBar.http_ok?(params) # (4of6)a
126
+ }
127
+ body.rewind
128
+ pbar.finish if MechanizeProgressBar.http_ok?(params) # (5of6)a
129
+ Mechanize.log.debug("Read #{total} bytes") if Mechanize.log && MechanizeProgressBar.suppress_logger?(params) # (6of6)a
130
+
131
+ res_klass = Net::HTTPResponse::CODE_TO_OBJ[@response.code.to_s]
132
+ raise ResponseCodeError.new(@response) unless res_klass
133
+
134
+ # Net::HTTP ignores EOFError if Content-length is given, so we emulate it here.
135
+ unless res_klass <= Net::HTTPRedirection
136
+ raise EOFError if (!params[:request].is_a?(Net::HTTP::Head)) && @response.content_length() && @response.content_length() != total
137
+ end
138
+
139
+ @response.each_header { |k,v|
140
+ Mechanize.log.debug("response-header: #{ k } => #{ v }")
141
+ } if Mechanize.log
142
+
143
+ params[:response_body] = body
144
+ params[:res_klass] = res_klass
145
+ super
146
+ end
147
+ end
148
+ end
149
+ end
@@ -0,0 +1,192 @@
1
+ require File.expand_path(File.dirname(__FILE__) + '../../../spec_helper')
2
+
3
+ ### NOTE: On MechanizeProgressBarAPI - "accepts agent as agent" spec, we swap $stderr.
4
+
5
+ describe MechanizeProgressBarAPI do
6
+
7
+ before :all do
8
+ @url = 'http://uri.host/uri.path'
9
+ @headers_and_body = {
10
+ :headers => {'Content-Length' => 1000},
11
+ :body => 'a'*1000
12
+ }
13
+ end
14
+
15
+ before :each do
16
+ WebMock.stub_request(:get, @url).to_return(@headers_and_body)
17
+ end
18
+
19
+ describe "#progressbar" do
20
+
21
+ def progressbar
22
+ @output.string
23
+ end
24
+
25
+ RSpec::Matchers.define :work_fine do
26
+ match do |actual|
27
+ /oooooooo+/ =~ actual
28
+ end
29
+ end
30
+
31
+ before :each do
32
+ @agent = Mechanize.new
33
+ @output = StringIO.new
34
+ end
35
+ it "accepts Hash as ProgressBar option" do
36
+ @agent.progressbar(:out => @output){@agent.get(@url)}
37
+ progressbar.should work_fine
38
+ end
39
+
40
+ it "accepts agent as agent" do
41
+ o = Object.new
42
+ o.extend(MechanizeProgressBarAPI)
43
+ backup = $stderr
44
+ $stderr = @output
45
+ o.progressbar(@agent){@agent.get(@url)}
46
+ $stderr = backup
47
+ progressbar.should work_fine
48
+ end
49
+
50
+ it "accepts (agent, pbar_opt) arguments" do
51
+ o = Object.new
52
+ o.extend(MechanizeProgressBarAPI)
53
+ o.progressbar(@agent, :out => @output){@agent.get(@url)}
54
+ progressbar.should work_fine
55
+ end
56
+
57
+ it "with block" do
58
+ @agent.progressbar(:out => @output){@agent.get(@url)}
59
+ progressbar.should work_fine
60
+ @agent.pre_connect_hooks.should be_empty
61
+ @agent.post_connect_hooks.should be_empty
62
+ end
63
+
64
+ it "method chain leaves a proc on post_connect_hooks" do
65
+ @agent.progressbar(:out => @output).get(@url)
66
+ progressbar.should work_fine
67
+ @agent.pre_connect_hooks.should be_empty
68
+ @agent.post_connect_hooks.should_not be_empty
69
+ end
70
+
71
+ it "default ProgressBar title is uri.host" do
72
+ @agent.progressbar(:out => @output){@agent.get(@url)}
73
+ progressbar.should work_fine
74
+ progressbar.should match(/uri.host/)
75
+ end
76
+
77
+ it "agent.progressbar(:title => 'new title') changes title" do
78
+ new_title = 'new title'
79
+ @agent.progressbar(:title => new_title, :out => @output){@agent.get(@url)}
80
+ progressbar.should work_fine
81
+ progressbar.should match(/#{new_title}/)
82
+ end
83
+
84
+ it "single mode title is 13 bytes" do
85
+ str15 = '123456789012345'
86
+ @agent.progressbar(:title => str15, :out => @output, :single => true){@agent.get(@url)}
87
+ progressbar.should match(/1234567890123:/)
88
+ end
89
+
90
+ it "default ProgressBar total is response['content-length']" do
91
+ @agent.progressbar(:out => @output){@agent.get(@url)}
92
+ progressbar.should work_fine
93
+ progressbar.should match(/1000B/)
94
+ end
95
+
96
+ it "agent.progressbar(:total => 999) changes total filesize" do
97
+ # TODO:
98
+ @agent.progressbar(:total => 999, :out => @output){
99
+ lambda{@agent.get(@url)}.should_not raise_error
100
+ }
101
+ progressbar.should work_fine
102
+ progressbar.should match(/999B/)
103
+ end
104
+
105
+ it "default ProgressBar out is $stderr" do
106
+ # TODO:
107
+ end
108
+
109
+ it "agent.progressbar(:out => io) changes output to io object" do
110
+ @agent.progressbar(:out => @output){
111
+ lambda{@agent.get(@url)}.should_not raise_error
112
+ }
113
+ progressbar.should work_fine
114
+ end
115
+
116
+ it "agent.progressbar(:format => fmtstr) changes output format" do
117
+ fmt = "%-14s!%3d%% %s %s"
118
+ str15 = '123456789012345'
119
+ @agent.progressbar(:title => str15, :format => fmt, :out => @output, :single => true){@agent.get(@url)}
120
+ progressbar.should match(/1234567890123:!/)
121
+ end
122
+
123
+ it "agent.progressbar(:format_arguments => fmtarg) changes bar view" do
124
+ stat = "uri.host: 100% |oooooooooooooooooooooooooooooooooooooooooo| Time: 00:00:00"
125
+ @agent.progressbar(:out => @output, :single => true){@agent.get(@url)}
126
+ progressbar.should_not be_include(stat)
127
+
128
+ fmtarg = [:title, :percentage, :bar, :stat]
129
+ @agent.progressbar(:format_arguments => fmtarg, :out => @output, :single => true){@agent.get(@url)}
130
+ progressbar.should be_include(stat)
131
+ end
132
+
133
+ it "when HTTP status error occurs in Mechanize, rescue unregister" do
134
+ url_404 = 'http://host/404'
135
+ WebMock.stub_request(:get, url_404).to_return(:status => ['404', 'Not Found'])
136
+ lambda{
137
+ @agent.progressbar(:output => @output) do
138
+ @agent.pre_connect_hooks[0].should be_kind_of(Proc)
139
+ @agent.get(url_404)
140
+ end
141
+ }.should raise_error(Mechanize::ResponseCodeError)
142
+ @agent.pre_connect_hooks.should be_empty
143
+ progressbar.should be_empty
144
+ end
145
+
146
+ it "when Exception occurs in Mechanize, rescue unregister" do
147
+ WebMock.stub_request(:get, @url).to_timeout
148
+ @agent.progressbar(:output => @output) do
149
+ @agent.pre_connect_hooks[0].should be_kind_of(Proc)
150
+ lambda{@agent.get(@url)}.should raise_error(Timeout::Error)
151
+ end
152
+ @agent.pre_connect_hooks.should be_empty
153
+ progressbar.should be_empty
154
+ end
155
+
156
+ it "Mechanize Logger output to $stderr crashes ProgressBar" do
157
+ require 'logger'
158
+ out = StringIO.new
159
+ @agent.log = Logger.new(out)
160
+ @agent.progressbar(:output => out){@agent.get(@url)}
161
+
162
+ # matches:
163
+ ### http://uri.host/uri.path
164
+ ### D, [(date+time)] DEBUG -- : Read 1000 bytes ETA: --:--:--
165
+ ### 100% |ooooooooooooooooooooooooooooooooooooooo| 1000B nnn.nKB/s Time: 00:00:00
166
+ re = /http:\/\/uri\.host\/uri\.path\s+D, \[.+?\] DEBUG -- : Read 1000 bytes\s+100% |o+|\s+1000B/
167
+ out.string.should match(re)
168
+ end
169
+
170
+ it "(:suppress_logger => true) make ProgressBar and Mechanize Logger output independent" do
171
+ require 'logger'
172
+ out = StringIO.new
173
+ @agent.log = Logger.new(out)
174
+ @agent.progressbar(:output => out, :suppress_logger => true){@agent.get(@url)}
175
+
176
+ # matches:
177
+ ### request-header: keep-alive => 300\n
178
+ ### http://uri.host/uri.path
179
+ before_progressbar = /request-header: (.+?) => (.+?)\s+http:\/\/uri\.host\/uri\.path/
180
+ out.string.should match(before_progressbar)
181
+
182
+ # matches:
183
+ ### 100% |ooooooooooooooooooooooooooooooooooooooo| 1000B 151.5KB/s Time: 00:00:00
184
+ ### D, [(date+time)] DEBUG -- : Read 1000 bytes
185
+ after_progressbar = /100%\s*\|o+\|\s+1000B (.+?)B\/s Time: \d\d:\d\d:\d\d\s+D, \[.+?\] DEBUG -- : Read 1000 bytes/
186
+ out.string.should match(after_progressbar)
187
+ end
188
+
189
+ end
190
+ end
191
+
192
+
@@ -0,0 +1,13 @@
1
+ $LOAD_PATH.unshift(File.join(File.dirname(__FILE__), '..', 'lib'))
2
+ $LOAD_PATH.unshift(File.dirname(__FILE__))
3
+ require 'rspec'
4
+
5
+ # Requires supporting files with custom matchers and macros, etc,
6
+ # in ./support/ and its subdirectories.
7
+ Dir["#{File.dirname(__FILE__)}/support/**/*.rb"].each {|f| require f}
8
+
9
+ RSpec.configure do |config|
10
+ require 'mechanize'
11
+ require 'webmock'
12
+ require 'mechanize/progressbar'
13
+ end
metadata ADDED
@@ -0,0 +1,186 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: mechanize-progressbar
3
+ version: !ruby/object:Gem::Version
4
+ hash: 27
5
+ prerelease: false
6
+ segments:
7
+ - 0
8
+ - 1
9
+ - 0
10
+ version: 0.1.0
11
+ platform: ruby
12
+ authors:
13
+ - kitamomonga
14
+ autorequire:
15
+ bindir: bin
16
+ cert_chain: []
17
+
18
+ date: 2011-03-07 00:00:00 +09:00
19
+ default_executable:
20
+ dependencies:
21
+ - !ruby/object:Gem::Dependency
22
+ prerelease: false
23
+ name: mechanize
24
+ version_requirements: &id001 !ruby/object:Gem::Requirement
25
+ none: false
26
+ requirements:
27
+ - - ">="
28
+ - !ruby/object:Gem::Version
29
+ hash: 23
30
+ segments:
31
+ - 1
32
+ - 0
33
+ - 0
34
+ version: 1.0.0
35
+ requirement: *id001
36
+ type: :runtime
37
+ - !ruby/object:Gem::Dependency
38
+ prerelease: false
39
+ name: progressbar
40
+ version_requirements: &id002 !ruby/object:Gem::Requirement
41
+ none: false
42
+ requirements:
43
+ - - ">="
44
+ - !ruby/object:Gem::Version
45
+ hash: 59
46
+ segments:
47
+ - 0
48
+ - 9
49
+ - 0
50
+ version: 0.9.0
51
+ requirement: *id002
52
+ type: :runtime
53
+ - !ruby/object:Gem::Dependency
54
+ prerelease: false
55
+ name: rspec
56
+ version_requirements: &id003 !ruby/object:Gem::Requirement
57
+ none: false
58
+ requirements:
59
+ - - ~>
60
+ - !ruby/object:Gem::Version
61
+ hash: 3
62
+ segments:
63
+ - 2
64
+ - 3
65
+ - 0
66
+ version: 2.3.0
67
+ requirement: *id003
68
+ type: :development
69
+ - !ruby/object:Gem::Dependency
70
+ prerelease: false
71
+ name: bundler
72
+ version_requirements: &id004 !ruby/object:Gem::Requirement
73
+ none: false
74
+ requirements:
75
+ - - ~>
76
+ - !ruby/object:Gem::Version
77
+ hash: 23
78
+ segments:
79
+ - 1
80
+ - 0
81
+ - 0
82
+ version: 1.0.0
83
+ requirement: *id004
84
+ type: :development
85
+ - !ruby/object:Gem::Dependency
86
+ prerelease: false
87
+ name: jeweler
88
+ version_requirements: &id005 !ruby/object:Gem::Requirement
89
+ none: false
90
+ requirements:
91
+ - - ~>
92
+ - !ruby/object:Gem::Version
93
+ hash: 7
94
+ segments:
95
+ - 1
96
+ - 5
97
+ - 2
98
+ version: 1.5.2
99
+ requirement: *id005
100
+ type: :development
101
+ - !ruby/object:Gem::Dependency
102
+ prerelease: false
103
+ name: rcov
104
+ version_requirements: &id006 !ruby/object:Gem::Requirement
105
+ none: false
106
+ requirements:
107
+ - - ">="
108
+ - !ruby/object:Gem::Version
109
+ hash: 3
110
+ segments:
111
+ - 0
112
+ version: "0"
113
+ requirement: *id006
114
+ type: :development
115
+ - !ruby/object:Gem::Dependency
116
+ prerelease: false
117
+ name: webmock
118
+ version_requirements: &id007 !ruby/object:Gem::Requirement
119
+ none: false
120
+ requirements:
121
+ - - ">="
122
+ - !ruby/object:Gem::Version
123
+ hash: 3
124
+ segments:
125
+ - 0
126
+ version: "0"
127
+ requirement: *id007
128
+ type: :development
129
+ description: Mechanize-Progressbar shows ProgressBar when HTTP GET access of Mechanize(Mechanize#get, Page::Link#click, response of Form#submit). It requires 'progressbar' gem. HTTP POST is not supported.
130
+ email: kitamomonga@gmail.com
131
+ executables: []
132
+
133
+ extensions: []
134
+
135
+ extra_rdoc_files:
136
+ - LICENSE.txt
137
+ - README.rdoc
138
+ files:
139
+ - .document
140
+ - .rspec
141
+ - Gemfile
142
+ - LICENSE.txt
143
+ - README.rdoc
144
+ - Rakefile
145
+ - VERSION
146
+ - lib/mechanize/progressbar.rb
147
+ - lib/mechanize/progressbar/mech_progressbar.rb
148
+ - spec/mechanize/progressbar/mech_progressbar_spec.rb
149
+ - spec/spec_helper.rb
150
+ has_rdoc: true
151
+ homepage: http://github.com/kitamomonga/mechanize-progressbar
152
+ licenses:
153
+ - GPL-2
154
+ post_install_message:
155
+ rdoc_options: []
156
+
157
+ require_paths:
158
+ - lib
159
+ required_ruby_version: !ruby/object:Gem::Requirement
160
+ none: false
161
+ requirements:
162
+ - - ">="
163
+ - !ruby/object:Gem::Version
164
+ hash: 3
165
+ segments:
166
+ - 0
167
+ version: "0"
168
+ required_rubygems_version: !ruby/object:Gem::Requirement
169
+ none: false
170
+ requirements:
171
+ - - ">="
172
+ - !ruby/object:Gem::Version
173
+ hash: 3
174
+ segments:
175
+ - 0
176
+ version: "0"
177
+ requirements: []
178
+
179
+ rubyforge_project:
180
+ rubygems_version: 1.3.7
181
+ signing_key:
182
+ specification_version: 3
183
+ summary: Mechanize-Progressbar provides ProgressBar for Mechanize#get and Link#click. requires 'progressbar' gem.
184
+ test_files:
185
+ - spec/mechanize/progressbar/mech_progressbar_spec.rb
186
+ - spec/spec_helper.rb