RubyGems - fog - Versions diffs - 0.7.2 → 0.8.0 - Mend

fog 0.7.2 → 0.8.0

Files changed (320) hide show

data/README.rdoc CHANGED Viewed

@@ -91,7 +91,7 @@ It will return an {excon}[http://github.com/geemus/excon] response, which has `b
 == Go forth and conquer
-Play around and use the console to explore or check out the {getting started guide}[http://wiki.github.com/geemus/fog/getting-started-with-fog] for more details. Once you are reading to start scripting fog, here is a quick hint on how to make connections without the command line thing to help you.
+Play around and use the console to explore or check out {fog.io}[http://fog.io] for more details and examples. Once you are reading to start scripting fog, here is a quick hint on how to make connections without the command line thing to help you.
   # create a compute connection
   compute = Fog::Compute.new(:provider => 'AWS', :aws_access_key_id => ACCESS_KEY_ID, :aws_secret_access_key => SECRET_ACCESS_KEY)
@@ -119,18 +119,9 @@ Wonder how you can get a lovely fog shirt? Look no further!
 * Grey shirts and a follow from @fog go to people who have made it on to the {contributors list}[https://github.com/geemus/fog/contributors] by submitting code.
 * Black shirts go to people who have made it on to the {collaborators list}[https://github.com/api/v2/json/repos/show/geemus/fog/collaborators] by coercing geemus into adding them (geemus is currently the only member of this list).
-== Resources
+== Additional Resources
-Enjoy, and let me know what I can do to continue improving fog!
-* See a list of supported providers and services on the {providers page}[http://fog.io/providers].
-* Stay up to date by following {@fog}[http://twitter.com/fog] and/or {@geemus}[http://twitter.com/geemus] on Twitter.
-* Get and give help on the {#ruby-fog}[irc://irc.freenode.net/ruby-fog] irc channel on Freenode
-* Follow release notes and discussions on the {mailing list}[http://groups.google.com/group/ruby-fog]
-* Report bugs or find tasks to help with in the {issues}[http://github.com/geemus/fog/issues]
-* Learn about {contributing}[http://github.com/geemus/fog/wiki/contributor-guide]
-* See where fog is used and let the world know how you use it {in the wild}[http://wiki.github.com/geemus/fog/in-the-wild]
-* Check out blog posts and other mentions in the {press}[http://wiki.github.com/geemus/fog/press]
+{fog.io}[http://fog.io]
 == Sponsorship

data/Rakefile CHANGED Viewed

@@ -149,7 +149,8 @@ task :docs do
     if File.extname(file_name) == '.html'
       # rewrite links with version
       body = File.read(file_path)
-      body.gsub!(/href="\//, 'href="/' << version << '/')
+      body.gsub!(/='\//, %{='/} << version << '/')
+      body.gsub!(/="\//, %{="/} << version << '/')
       content_type = 'text/html'
     else
       body = File.open(file_path)
@@ -165,7 +166,7 @@ task :docs do
   # write base index with redirect to new version
   directory.files.create(
-    :body         => '<!doctype html><head><script>window.location = "http://fog.io/' << version << '/index.html"</script></head></html>',
+    :body         => '<!doctype html><head><script>window.location = "http://fog.io/' << version << '"</script></head></html>',
     :content_type => 'text/html',
     :key          => 'index.html',
     :public       => true

data/benchs/parse_vs_push.rb CHANGED Viewed

@@ -16,6 +16,7 @@ class Parser < Nokogiri::XML::SAX::Document
   end
   def characters(string)
+    @value ||= ''
     @value << string.strip
   end
@@ -29,10 +30,14 @@ class Parser < Nokogiri::XML::SAX::Document
       @response[:items] << @item
       @item = {}
     when 'key'
-      @item[:key] = @value
+      @item[:key] = value
     end
   end
+  def value
+    @value.dup
+  end
 end
 data = <<-DATA
@@ -43,18 +48,22 @@ data = <<-DATA
 </items>
 DATA
-COUNT = 100
+COUNT = 10_000
 Benchmark.bmbm(25) do |bench|
   bench.report('parse') do
-    parser = Parser.new
-    Nokogiri::XML::SAX::Parser.new(parser).parse(data)
-    parser.response
+    COUNT.times do
+      parser = Parser.new
+      Nokogiri::XML::SAX::Parser.new(parser).parse(data)
+      parser.response
+    end
   end
   bench.report('push') do
-    parser = Parser.new
-    Nokogiri::XML::SAX::PushParser.new(parser).write(data, true)
-    parser.response
+    COUNT.times do
+      parser = Parser.new
+      Nokogiri::XML::SAX::PushParser.new(parser).write(data, true)
+      parser.response
+    end
   end
 end

data/bin/fog CHANGED Viewed

@@ -4,8 +4,8 @@ require 'irb'
 require 'yaml'
 Fog.credential = ARGV.first ? ARGV.first.to_sym : nil
 Fog.mock! if ENV['FOG_MOCK']
-unless Fog.credentials
-  exit
+if Fog.credentials.empty?
+  Fog::Errors.missing_credentials
 end
 require 'fog/bin'

data/changelog.txt CHANGED Viewed

@@ -1,3 +1,126 @@
+0.8.0 05/12/2011
+================
+MVP! ktheory
+[aws|cloudformation] tests sleep to avoid throttling error :(
+[aws|elb]
+  Add tests for create, describe, and delete. thanks ktheory
+  Fix Policies in describe_load_balancers parser. thanks ktheory
+  Stub out missing requests. thanks ktheory
+  Add configure_health_check request. thanks ktheory
+  Add support for creating and deleting listeners. thanks ktheory
+  Add requests for creating cookie policies. thanks ktheory
+  Add request ELB#delete_load_balancer_policy. thanks ktheory
+  Add request ELB#set_load_balancer_policies_of_listener. thanks ktheory
+  Create a model and collection for load_balancers. thanks ktheory
+  Create Policies collection and model. thanks ktheory
+  Create Listeners collection and model. thanks ktheory
+  Remove redundant NotFound error class. thanks ktheory
+  reorg model files for consistency
+[aws|iam]
+  Added server certificate tests. thanks ktheory
+  Parse server certificate UploadDate. thanks ktheory
+  Add list_server_certificates request. thanks ktheory
+  fix test description for update_login_profile
+[aws|rds]
+  Fix exception for missing DB security groups. thanks ktheory
+  Remove redundant NotFound class. thanks ktheory
+  Improve instance tests. thanks ktheory
+  reorg model files for consistency
+  change status waits for more consistent testing
+[aws|ses]
+  fix format of Destinations in send_raw_email and correct doc. thanks jhawthorne
+  Make specifying Destinations for send_raw_email work and match amazon docs. thanks jhawthorne
+  fix indent in doc. thanks jhawthorne
+[aws|simpledb]
+  correction for item and attribute counters in encode_batch_attributes. thanks joshounapoli
+  Fix a problem with the encoding of the tilde character. AWS needs tilde to be unescaped, or else the signature fails. CGI.escape escapes tilde; don't use it. thanks joshounapoli
+  Correction to the regular expression for unreserved characters. thanks joshounapoli
+  Test encode_batch_attributes with two attributes in one item to demonstrate an error in encode_batch_attributes. An unmocked test run will show a "400 Bad Request" response from SimpleDB. thanks joshounapoli
+[compute]
+  default to Ubuntu 10.04 LTS 64bit for image id
+  [aws]
+    Fix server tests. thanks ktheory
+    Fixes trailing whitespace in attributes. thanks ktheory
+    Fix & improve some tests. thanks ktheory
+    Use default AMI in tests. thanks ktheory
+    Add failing tests for keypair parsing. thanks ktheory
+    Add different availability zones for each region to the mock. thanks smerritt
+    Update docs for Compute::Real#initialize to include ap-* regions. thanks smerritt
+    change default flavor to t1.micro (so it will be 64-bit)
+    use old style, more consistent call to get single instance
+    fix console output format in tests
+  [bluebox]
+    Adding lb_applications, lb_services, lb_backends attributes to the model. thanks cparades
+    Adding in a few more tests for LB's. thanks cparades
+    Rolling back change. thanks cparades
+    Added in some data for testing. thanks cparades
+    Fixed typo in Bluebox test. thanks tokengeek
+    don't use a lb_application I don't own in tests
+  [brightbox]
+    Updated Image identifiers to match latest available Ubuntu Lucid 10.04 LTS 64bit image. thanks tokengeek
+  [ecloud]
+    1.9.2 compat, String#[] doesn't return nil as we expected. thanks dpiddy
+  [stormondemand]
+    Implement Stormondemand API. thanks seeingidog
+    cleanup
+    fixes for tests
+  [voxel]
+    Prevent voxel tests running if missing credentials. thanks tokengeek
+    minor fixes for voxel tests
+[core]
+  Parser does not concatenates all the strings when parsing. thanks geraud
+  Drop default_executable line from gemspec. thanks mattsa
+  Fix small logic error in Model#wait_for. thanks pvande
+  Make Model#reload more resilient against errors. thanks pvande
+  Simplify dup-ing of @attributes for models. thanks smerritt
+  Make Model#dup copy the attributes too. thanks smerritt
+  Fix typo in spec output. thanks smerritt
+  tighten excon dependency. Closes #250
+  cleanup gemspec. closes #251
+  Fixes error messaging when credentials missing
+  update parser to better handle whitespace
+[docs]
+  Add link to multipart upload and threads article. thanks gsandie
+  restructure toward same organization as rest of repo
+  simplify redirector to just point at directory instead of specifically index.html
+  generalize version subbing in href to catch src too
+  style cleanup for cdn/dns/storage
+  storage shouldn't be all caps
+  link to fog.io more prominently
+  fix new links to properly include version
+  replace getting started link
+  add link to learn_fog
+  remove confusion by linking to fog.io instead of wiki
+  reworking getting started guide
+  add requires
+[dns|aws] fix error handling for getting unknown keys
+[storage]
+  auto-paginate for #each     closes #268
+  [aws]
+    Add #each_file method to directory model. thanks smerritt
+    Add documentation for #each_file method. thanks smerritt
+    Emit warning from Files#each. thanks smerritt
+    Make Files#each iterate all files, not just the first page. thanks smerritt
+    Fix docs to say files.each, not each_file. thanks smerritt
+    Issue #283: S3 get_object request doesn't really support the Range header. thanks yalon
+    fix format for multipart upload tests
+  [google]
+    fix format in bucket_tests
+  [rackspace]
+    mark get_object with block test pending when mocked
 0.7.2 04/05/2011
 ================

data/docs/_layouts/default.html CHANGED Viewed

@@ -16,13 +16,13 @@
   <meta name="viewport" content="width=device-width, initial-scale=1.0">
   <!--
-    <link rel="shortcut icon" href="public/favicon.ico">
-    <link rel="apple-touch-icon" href="public/apple-touch-icon.png">
+    <link rel="shortcut icon" href="/public/favicon.ico">
+    <link rel="apple-touch-icon" href="/public/apple-touch-icon.png">
   -->
-  <link rel="stylesheet" href="public/css/style.css?v=2">
-  <link rel="stylesheet" href="public/css/fog.css?v=2">
-  <script src="public/js/libs/modernizr-1.6.min.js"></script>
+  <link rel="stylesheet" href="/public/css/style.css?v=2">
+  <link rel="stylesheet" href="/public/css/fog.css?v=2">
+  <script src="/public/js/libs/modernizr-1.6.min.js"></script>
 </head>
@@ -30,7 +30,7 @@
   <div id="container">
     <header>
-      <a href="/"><img src="public/images/fog.png" title="fog" /></a>
+      <a href="/"><img src="/public/images/fog.png" title="fog" /></a>
       <h1>{{ page.title }}</h1>
       <dl>
         <dt>version</dt><dd>v0.7.2</dd>
@@ -43,13 +43,26 @@
       {{ content }}
-      <h2>See Also:</h2>
+      <h2>Services</h2>
       <ul>
-        <li><a href="/">Home</a></li>
+        <li><a href="/cdn">CDN</a></li>
+        <li><a href="/dns">DNS</a></li>
+        <li><a href="/storage">Storage</a></li>
         {% for post in site.posts %}
         <li><a href="{{ post.url }}">{{ post.title }}</a></li>
         {% endfor %}
       </ul>
+      <h2>About</h2>
+      <ul>
+        <li><a href="/">Home</a></li>
+        <li><a href="/about/contributing.html">Contributing</a></li>
+        <li><a href="/about/getting_started.html">Getting Started</a></li>
+        <li><a href="/about/press.html">Press</a></li>
+        <li><a href="/about/structure.html">Structure</a></li>
+        <li><a href="/about/users.html">Users</a></li>
+      </ul>
     </div>
     <footer>

data/docs/{_posts/2011-01-01-contributing.markdown → about/contributing.markdown} RENAMED Viewed

File without changes

data/docs/about/getting_started.markdown ADDED Viewed

@@ -0,0 +1,83 @@
+---
+layout: default
+title:  Getting Started
+---
+First off, install the gem:
+    $ gem install fog
+## Setting Up Local Storage
+We will be using Local storage in the example.  Local storage provides the same api that cloud storage services in fog do, but without the bother of needing to signup for stuff or pay extra money.
+First, make a local directory to hold your data.
+    $ mkdir ~/fog
+Now we can start writing our script, first off we should require fog.
+    require 'rubygems'
+    require 'fog'
+Now in order to play with our data we need to setup a storage connection.
+    storage = Fog::Storage.new(
+      :local_root => '~/fog',
+      :provider   => 'Local',
+    )
+`storage` will now contain our storage object, configured to use the Local provider from our specified directory.
+## Storing Data
+Now that you have cleared the preliminaries you are ready to start storing data. Storage providers in fog segregate files into `directories` to make it easier to organize things. So lets create a directory so we can see that in action.
+    directory = Fog::Storage.directories.create(
+      :key => 'data'
+    )
+To make sure it was created you can always check in your filesystem, but we can also check from inside fog.
+    storage.directories
+Progress! Now it is time to actually create a file inside our new directory.
+    file = directory.files.create(
+      :body => 'Hello World!',
+      :key  => 'hello_world.txt'
+    )
+We should now have our file, first we can open it up and make sure we are on the right track.
+    $ open ~/fog/hello_world.txt
+It is much more likely that you will want to see what files you have from inside fog though.
+    directory.files
+Now that we have run through all the basics, lets clean up our mess.
+    file.destroy
+    directory.destroy
+After that you should be able to check your directory list in fog or your filesystem and see you are safely back to square one.
+## Next Steps
+Using the same interface you can also practice working against a real provider (such as Amazon S3).  Rather than worrying about signing up for an account right away though, we can use mocks to simulate S3 while we practice.
+This time we will turn on mocking and then, just like before, we will need to make a connection.
+    Fog.mock!
+    storage = Fog::Storage.new(
+      :aws_access_key_id      => 'fake_access_key_id',
+      :aws_secret_access_key  => 'fake_secret_access_key',
+      :provider               => 'AWS'
+    )
+You may notice that we used bogus credentials, this is fine since we are just simulating things.  To use real S3 you can simply omit `Fog.mock!` and swap in your real credentials.
+Once you have your connection you can go through all the steps you did before, only now you will be working against a real cloud service (or at least a simulated one).
+Congratulations and welcome to the cloud!  Continue your journey at [fog.io](http://fog.io)

data/docs/{_posts/2011-01-01-press.markdown → about/press.markdown} RENAMED Viewed

@@ -5,6 +5,11 @@ title:  Press
 Mentions and blog posts from elsewhere in reverse chronological order by day (and alphasorted for same days).
+**April 7th, 2011**
+* [Testing multipart Uploads to S3 with Threads](http://blog.vicecity.co.uk/post/4425574978/multipart-uploads-fog-threads-win)
 **March 9th, 2011**
 * [Offsite Backups with fog](http://www.engineyard.com/blog/2011/offsite-backups-with-fog/)
@@ -29,4 +34,4 @@ Mentions and blog posts from elsewhere in reverse chronological order by day (an
 **September 28, 2010**
-* [The Curious Tale of the Humble Micro](http://www.engineyard.com/blog/2010/the-curious-tale-of-the-humble-micro/)
+* [The Curious Tale of the Humble Micro](http://www.engineyard.com/blog/2010/the-curious-tale-of-the-humble-micro/)

data/docs/{_posts/2011-01-01-structure.markdown → about/structure.markdown} RENAMED Viewed

File without changes

data/docs/{_posts/2011-01-01-users.markdown → about/users.markdown} RENAMED Viewed

File without changes

data/docs/{_posts/2011-01-01-cdn.markdown → cdn/index.markdown} RENAMED Viewed

@@ -1,6 +1,6 @@
 ---
 layout: default
-title:  cdn
+title:  CDN
 ---
 Faster websites are better. <a href="http://www.websiteoptimization.com/speed/tweak/design-factors/">Better experience</a>, <a href="http://exp-platform.com/Documents/IEEEComputer2007OnlineExperiments.pdf">better sales</a>, <a href="http://www.stevesouders.com/blog/2009/07/27/wikia-fast-pages-retain-users/">you name it</a>. Unfortunately, making a website faster can be tough. Thankfully a content distribution network, or CDN, can give you great performance bang for your buck. A CDN helps speed things up by putting copies of your files closer to your users. It's like the difference between pizza delivery from across the street and pizza delivery from the next town over.
@@ -19,9 +19,9 @@ Now you'll need to <a href="https://aws-portal.amazon.com/gp/aws/developer/subsc
     # create a connection to the service
     cdn = Fog::CDN.new({
-      :provider               =&gt; 'AWS',
-      :aws_access_key_id      =&gt; AWS_ACCESS_KEY_ID,
-      :aws_secret_access_key  =&gt; AWS_SECRET_ACCESS_KEY
+      :provider               => 'AWS',
+      :aws_access_key_id      => AWS_ACCESS_KEY_ID,
+      :aws_secret_access_key  => AWS_SECRET_ACCESS_KEY
     }
 ## Setting Up Your CDN
@@ -29,9 +29,9 @@ Now you'll need to <a href="https://aws-portal.amazon.com/gp/aws/developer/subsc
 Now you'll need to create a 'distribution' which represents a mapping from the CDN to your domain. For the examples we'll pretend we are working on 'http://www.example.com', but you can just switch it to your actual domain. Some <a href="http://docs.amazonwebservices.com/AmazonCloudFront/latest/APIReference/CreateDistribution.html">other options</a> are available, but the only other one we need to fill in is OriginProtocolPolicy.  This sets what to do about http vs https. We will use 'match-viewer' which returns the same protocol as the request, but you can also choose 'http-only' which always returns http responses.
     data = cdn.post_distribution({
-      'CustomOrigin' =&gt; {
-        'DNSName'               =&gt; 'www.example.com',
-        'OriginProtocolPolicy'  =&gt; 'match-viewer'
+      'CustomOrigin' => {
+        'DNSName'               => 'www.example.com',
+        'OriginProtocolPolicy'  => 'match-viewer'
       }
     })
@@ -60,12 +60,12 @@ But, just in case you need to update things I'll run through how you can make ch
       distribution_id,
       etag,
       {
-        'CustomOrigin' =&gt; {
-          'DNSName'               =&gt; 'www.example.com',
-          'OriginProtocolPolicy'  =&gt; 'match-viewer'
+        'CustomOrigin'    => {
+          'DNSName'               => 'www.example.com',
+          'OriginProtocolPolicy'  => 'match-viewer'
         },
-        'CallerReference' =&gt; caller_reference,
-        'Enabled' =&gt; 'false'
+        'CallerReference' => caller_reference,
+        'Enabled'         => 'false'
       }
     )