mogilefs-client 3.6.0 → 3.7.0

data/ChangeLog

@@ -1,5 +1,218 @@
-ChangeLog from http://bogomips.org/mogilefs-client.git (v1.2.1..v3.4.0)
+ChangeLog from http://bogomips.org/mogilefs-client.git (v1.2.1..v3.7.0)
 
+   commit 100f38dadcf472ebf75eb656b53c15071e4f616e
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Jul 18 06:37:51 2013 +0000
+   
+       Ruby mogilefs-client 3.7.0
+       
+       MogileFS::MogileFS#each_key now accepts optional :after and :limit args
+       
+       This allows easy iteration while respecting :after and :limit,
+       giving each_key an interface consistent with each_file_info.
+   
+   commit 118db9865545c6879128e58390d15c6ba80be405
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Tue Jul 9 22:48:43 2013 +0000
+   
+       client: each_key: accept optional :after and :limit args
+       
+       This allows easy iteration while respecting :after and :limit.
+       This gives each_key an interface consistent with each_file_info.
+   
+   commit 9d5770ea12d78c88e5accfbc12b81f8c3af4ed30
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Feb 21 20:07:11 2013 +0000
+   
+       Ruby mogilefs-client 3.6.0
+       
+       We no longer send an empty zone= parameter in create_open
+       calls.  Additionally, if we detect send() failure on a socket,
+       assume a tracker has been restarted and restart the request.
+       There are also some minor code cleanups.
+   
+   commit 70c516713c2dfdfd4168b175db7b7642833ef585
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Feb 21 20:11:54 2013 +0000
+   
+       mysql: remove warning for assigned but unused variable
+       
+       Note: this mysql component is still largely unmaintained.
+   
+   commit e3690296de22902e87901c1dca9b10b4a59b7a44
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Feb 21 20:10:43 2013 +0000
+   
+       backend: fix variable shadow warning
+       
+       This bug was only introduced in
+       commit 3c73f6b434a4c226c09e31c6ba3b034cb314b3fb
+   
+   commit 3c73f6b434a4c226c09e31c6ba3b034cb314b3fb
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Tue Feb 5 21:57:59 2013 +0000
+   
+       backend: retry all trackers on send failure
+       
+       In single tracker configurations, a restarted tracker may cause
+       send()/write() failure on the TCP socket.  Retry immediately in
+       this case, since there's no danger even for non-idempotent
+       tracker requests.
+   
+   commit 3dd52026434fe89a1ef5110fc5fe568cdd4df819
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Jan 17 03:55:23 2013 +0000
+   
+       create_open: do not set empty zone= parameter
+       
+       It's a small waste and adds to visual noise.
+   
+   commit c0b3faa0922d895e6aafa9802df69649b1977eae
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Mon Dec 24 20:20:00 2012 +0000
+   
+       test for size mismatch errors with IO.copy_stream
+       
+       IO.copy_stream does not raise EOFError when specified
+       copy length is less than input size.  Thus we must rely
+       on the MogileFS tracker to validate the input size.
+   
+   commit de18522959de92865bb10582dd02276b3da8ae01
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Tue Dec 4 11:08:03 2012 +0000
+   
+       mogilefs-client 3.5.0
+       
+       client changes:
+       
+       * new_file gains :create_open_args and :create_close_args which
+         allows custom arguments to be passed to plugins.
+         (this matches the Perl client behavior)
+       
+       * new_file also gains :info hash which can be populated with
+         information normally retrieved with file_info
+       
+       * users with net-http-persistent installed will see a small speed
+         boost and reduction of TIME_WAIT sockets when dealing with
+         small data (useful for testing DB-intensive parts of MogileFS).
+       
+       No changes for admin.
+   
+   commit 34ad5c7b88041d904435d86eb5c8335db5409f88
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Thu Nov 8 02:43:38 2012 +0000
+   
+       new_file: don't pass private field to create_open
+       
+       Avoid needless encoding and data transfer to the tracker.
+   
+   commit 462cb6c0fdb2eca95f938a47d33e33691ec65f9a
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 31 19:49:47 2012 +0000
+   
+       mogilefs-client 3.5.0-rc1
+       
+       client changes:
+       
+       * new_file gains :create_open_args and :create_close_args which
+         allows custom arguments to be passed to plugins.
+       
+       * new_file also gains :info hash which can be populated with
+         information normally retrieved with file_info
+       
+       * users with net-http-persistent installed will see a small speed
+         boost and reduction of TIME_WAIT sockets when dealing with
+         small data (useful for testing DB-intensive parts of MogileFS).
+       
+       No changes for admin.
+   
+   commit a8bc9cd0fce3169eccc67b191fdb40abfae59547
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 31 19:38:09 2012 +0000
+   
+       net-http-persistent usage respects timeouts
+       
+       We now have separate Net::HTTP::Persistent instances
+       between clients that may have different timeouts and
+       also between GET and PUT requests.  This hurts our
+       ability to reuse sockets, but correctness is probably
+       more important.
+   
+   commit 3e0b092efc2c5a5383a5d2063b830fe5d5e652f9
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 31 19:20:53 2012 +0000
+   
+       test: fix some warnings found with "ruby -w -c"
+       
+       Less noise should be better.
+   
+   commit 9d4436bd418e6826372c7f2d05d3f41232d268c2
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 31 00:28:39 2012 +0000
+   
+       avoid documenting internal constant (NHP)
+       
+       Implementation details should remain private.
+   
+   commit 9b1339dfe76e04e4a21d39301d2236859dc03bfd
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Tue Oct 30 23:12:10 2012 +0000
+   
+       new_file: support create_open_args and create_close_args
+       
+       This lets us send unsupported/new arguments to plugins
+       and matches the functionality of the Perl client library.
+   
+   commit 42abd93b948881afe5c3e9d04ceb5f40fda4472c
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Tue Oct 30 21:41:01 2012 +0000
+   
+       http_reader: improve robustness of header reading
+       
+       It's possible for networks and servers to break up
+       even small HTTP headers.  We also better enforce the
+       timeout if we too too long to write the request.
+   
+   commit fe0d54c5be260fd1ff5e175869001052a3d379fa
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 24 08:18:21 2012 +0000
+   
+       test: remove assert_nothing_raised checks
+       
+       Tests fail anyways on uncaught exceptions, so
+       assert_nothing_raised only makes it harder to debug the problem
+       by swallowing the backtrace.
+   
+   commit 2ce0b4a31bfae0b632d7ca031a52b24db7cc1b26
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 24 08:13:13 2012 +0000
+   
+       new_file: delay keepalive sockopts until read
+       
+       We don't need to set socket keepalive until we've successfully
+       written the request out and are awaiting a response.
+   
+   commit 2cbeef0f29be4de815b802e705528b6f05d1bb29
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Wed Oct 24 07:27:18 2012 +0000
+   
+       optionally use net-http-persistent for StringIO
+       
+       Given StringIO objects are already in memory, NHP can make
+       small uploads which fit into memory faster.  Large uploads
+       (using big_io or :largefile => :stream still go through
+        IO.copy_stream for now)
+   
+   commit 231d1a91292f39d42df2317a2fe4eaa96fd68f41
+   Author: Eric Wong <normalperson@yhbt.net>
+   Date:   Mon Oct 22 20:18:06 2012 +0000
+   
+       new_file allows optional :info hash to be populated
+       
+       This allows clients to avoid calling #file_info or #get_uris
+       immediate after uploading a file to MogileFS.  This can speed
+       things up for cache-using clients with write-through caching.
+   
    commit c5d000337cdcbb15827258d6fd6b6830e8afcd59
    Author: Eric Wong <normalperson@yhbt.net>
    Date:   Tue Oct 9 02:41:05 2012 +0000

data/GIT-VERSION-GEN

@@ -1,7 +1,7 @@
 #!/usr/bin/env ruby
 CONSTANT = "MogileFS::VERSION"
 RVF = "lib/mogilefs/version.rb"
-DEF_VER = "v3.6.0"
+DEF_VER = "v3.7.0"
 vn = DEF_VER
 
 # First see if there is a version file (included in release tarballs),

data/NEWS

@@ -1,3 +1,50 @@
+=== Ruby mogilefs-client 3.7.0 / 2013-07-18 06:40 UTC
+
+  MogileFS::MogileFS#each_key now accepts optional :after and :limit args
+
+  This allows easy iteration while respecting :after and :limit,
+  giving each_key an interface consistent with each_file_info.
+
+=== Ruby mogilefs-client 3.6.0 / 2013-02-21 20:33 UTC
+
+  We no longer send an empty zone= parameter in create_open
+  calls.  Additionally, if we detect send() failure on a socket,
+  assume a tracker has been restarted and restart the request.
+  There are also some minor code cleanups.
+
+=== mogilefs-client 3.5.0 / 2012-12-04 11:09 UTC
+
+  client changes:
+
+  * new_file gains :create_open_args and :create_close_args which
+    allows custom arguments to be passed to plugins.
+    (this matches the Perl client behavior)
+
+  * new_file also gains :info hash which can be populated with
+    information normally retrieved with file_info
+
+  * users with net-http-persistent installed will see a small speed
+    boost and reduction of TIME_WAIT sockets when dealing with
+    small data (useful for testing DB-intensive parts of MogileFS).
+
+  No changes for admin.
+
+=== mogilefs-client 3.5.0-rc1 / 2012-10-31 19:53 UTC
+
+  client changes:
+
+  * new_file gains :create_open_args and :create_close_args which
+  allows custom arguments to be passed to plugins.
+
+  * new_file also gains :info hash which can be populated with
+  information normally retrieved with file_info
+
+  * users with net-http-persistent installed will see a small speed
+  boost and reduction of TIME_WAIT sockets when dealing with
+  small data (useful for testing DB-intensive parts of MogileFS).
+
+  No changes for admin.
+
 === Ruby mogilefs-client 3.4.0 / 2012-10-09 03:06 UTC
 
   Admin speedups for get_domains, get_hosts, and get_devices.

data/lib/mogilefs/mogilefs.rb

@@ -84,11 +84,19 @@ class MogileFS::MogileFS < MogileFS::Client
   end
 
   # Enumerates keys, limited by optional +prefix+
-  def each_key(prefix = "", &block)
-    after = nil
+  # +args+ may also be specified for an optional +:limit+
+  # and +:after+ (default: nil)
+  def each_key(prefix = "", args = nil, &block)
+    after = limit = nil
+    if args
+      after = args[:after]
+      limit = args[:limit]
+    end
     begin
-      keys, after = list_keys(prefix, after, 1000, &block)
-    end while keys && keys[0]
+      keys, after = list_keys(prefix, after, limit || 1000, &block)
+      return unless keys && keys[0]
+      limit -= keys.size if limit
+    end while limit == nil || limit > 0
     nil
   end
 

data/lib/mogilefs/version.rb

@@ -1 +1 @@
-MogileFS::VERSION = '3.6.0'
+MogileFS::VERSION = '3.7.0'

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: mogilefs-client
 version: !ruby/object:Gem::Version
-  version: 3.6.0
+  version: 3.7.0
   prerelease: 
 platform: ruby
 authors:
@@ -9,7 +9,7 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2013-02-21 00:00:00.000000000 Z
+date: 2013-07-18 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rdoc