fog-google 0.6.0 → 1.0.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 9f523ba80fe04d0964f24b91dd5972d5a1761171
-  data.tar.gz: 0ec90da4720232b7cecec4262c4f2f93798b0366
+  metadata.gz: 4fa59c3a8e64b4d0f7906e8000166d103f911c40
+  data.tar.gz: 8d36d48ed04b7025fe4c29b620979b61924ec6ed
 SHA512:
-  metadata.gz: 5188db685057edfdd2d96e0a754a66aedb81ef62e416086f9888ca4dc851d1338bac5e46c4ae0d21e83fbbee73518474d9ef96a6868df2510b2dae06ee18abb8
-  data.tar.gz: b6620918dd17cb4e759e1cde19b90e322039b00779f78a0c4ef70539d47b3fd881fafa7df1a9ed3faba162a51c70a10204a4bc3c8a18e350a59e87b4c279f746
+  metadata.gz: 247a59498aef0aff1f7ec983f5662cff88d9916f6d086e47bb8799e5e258888430d040e780a096e2de65d02aed8b3c9c43ab4cab2d7456110b12445401d897e2
+  data.tar.gz: 62c69343e5b0b47162704319c9f3d8005070942f6a68d93514f6c3dec244818c848afb81da45384400dcf783b17ab06f7f6d3857bf1ac9a56dcf73091897b532

data/.rubocop.yml

@@ -6,9 +6,6 @@ Style/ConditionalAssignment:
   SingleLineConditionsOnly: true
   EnforcedStyle: assign_inside_condition
 
-Style/Encoding:
-  EnforcedStyle: when_needed
-
 Style/FormatString:
   Enabled: false
 
@@ -40,7 +37,7 @@ Style/CollectionMethods:
     find: detect
     find_all: select
     reduce: inject
-Style/DotPosition:
+Layout/DotPosition:
   Description: Checks the position of the dot in multi-line method calls.
   StyleGuide: https://github.com/bbatsov/ruby-style-guide#consistent-multi-line-chains
   Enabled: true
@@ -48,7 +45,7 @@ Style/DotPosition:
   SupportedStyles:
   - leading
   - trailing
-Style/FileName:
+Naming/FileName:
   Description: Use snake_case for source file names.
   StyleGuide: https://github.com/bbatsov/ruby-style-guide#snake-case-files
   Enabled: false
@@ -80,7 +77,7 @@ Style/PercentLiteralDelimiters:
     "%w": "()"
     "%W": "()"
     "%x": "()"
-Style/PredicateName:
+Naming/PredicateName:
   Description: Check the names of predicate methods.
   StyleGuide: https://github.com/bbatsov/ruby-style-guide#bool-methods-qmark
   Enabled: true
@@ -186,7 +183,7 @@ Lint/AssignmentInCondition:
 Style/InlineComment:
   Description: Avoid inline comments.
   Enabled: true
-Style/AccessorMethodName:
+Naming/AccessorMethodName:
   Description: Check the naming of accessor methods for get_/set_.
   Enabled: false
 Style/Alias:

data/README.md

@@ -6,7 +6,7 @@ The main maintainers for the Google sections are @icco, @Temikus and @plribeiro3
 
 **As of v0.1.1, Google no longer supports Ruby versions less than 2.0.0.**
 
-**Currently, `fog-google` does not support versions of `google-api-client` >= 0.9 or <= 0.8.5.**
+**As of v1.0.0, fog-google includes google-api-client as a dependency**
 
 
 ## Storage
@@ -20,13 +20,12 @@ There are two ways to access [Google Cloud Storage](https://cloud.google.com/sto
 
 Google Compute Engine is a Virtual Machine hosting service. Currently it is built on version [v1](https://developers.google.com/compute/docs/reference/v1/) of the GCE API.
 
-As of 2015-12-07, we believe Fog for Google Compute engine (`Fog::Compute::Google`) is feature complete.
-
-If you are using Fog to interact with GCE, please keep Fog up to date and [file issues](https://github.com/fog/fog-google/issues) for any anomalies you see or features you would like.
+As of 2017-12-15, we are still working on making Fog for Google Compute engine (`Fog::Compute::Google`) feature complete. If you are using Fog to interact with GCE, please keep Fog up to date and [file issues](https://github.com/fog/fog-google/issues) for any anomalies you see or features you would like.
 
 ## SQL
 
-Fog implements [v1beta3](https://cloud.google.com/sql/docs/admin-api/v1beta3/) of the Google Cloud SQL Admin API. This is a currently deprecated API. Pull Requests for updates would be greatly appreciated.
+Fog implements [v1beta4](https://cloud.google.com/sql/docs/mysql/admin-api/v1beta4/) of the Google Cloud SQL Admin API. As of 2017-11-06, Cloud SQL is mostly feature-complete. Please [file issues](https://github.com/fog/fog-google/issues) for any anomalies you see or features you would like as we finish 
+adding remaining features. 
 
 ## DNS
 
@@ -34,10 +33,7 @@ Fog implements [v1](https://cloud.google.com/dns/api/v1/) of the Google Cloud DN
 
 ## Monitoring
 
-Fog mostly implements [v3](https://cloud.google.com/monitoring/api/ref_v3/rest/) of the Google Cloud Monitoring API. 
-
-As of 2017-09-26, some less common API methods are missing and may be added as requested. Feature requests or pull requests for 
-additions are welcome. 
+Fog implements [v3](https://cloud.google.com/monitoring/api/v3/) of the Google Cloud Monitoring API. As of 2017-10-05, we believe Fog for Google Cloud Monitoring is feature complete for metric-related resources and are working on supporting groups. 
  
 We are always looking for people to improve our code and test coverage, so please [file issues](https://github.com/fog/fog-google/issues) for any anomalies you see or features you would like.
 
@@ -46,7 +42,7 @@ We are always looking for people to improve our code and test coverage, so pleas
 Note: You **must** have a version of google-api-client > 0.8.5 to use the Pub/Sub API; previous versions will not work.
 
 Fog mostly implements [v1](https://cloud.google.com/pubsub/reference/rest/) of the Google Cloud Pub/Sub API; however some less common API methods are missing. Pull requests for additions would be greatly appreciated.
- 
+
 ## Installation
 
 Add the following two lines to your application's `Gemfile`:
@@ -68,16 +64,22 @@ Or install it yourself as:
 $ gem install fog-google
 ```
 
+## Testing
+
+The tests in `tests` are deprecated. We are currently working on a migration of tests to `minitest`.
+
+For your test to be tested with real credentials, a repo maintainer may add the label `integrate` to your PR to run integration tests.
+
 ## Setup
 
 #### Credentials
 
 Follow the [instructions to generate a private key](https://cloud.google.com/storage/docs/authentication#generating-a-private-key). A sample credentials file can be found in `.fog.example` in this directory:
 
-    cat .fog.example >> ~/.fog # appends the sample configuration
-    vim ~/.fog                 # edit file with yout config
-    
-
+```
+cat .fog.example >> ~/.fog # appends the sample configuration
+vim ~/.fog                 # edit file with yout config
+```
 
 #### SSH-ing into instances
 
@@ -99,4 +101,4 @@ $ bundle exec pry
 
 ## Contributing
 
-See `CONTRIBUTING.md` in this repository.
+See `CONTRIBUTING.md` in this repository.

data/ci/.gitignore

@@ -0,0 +1 @@
+credentials.yml

data/ci/README.md

@@ -0,0 +1,70 @@
+# fog-google CI
+
+This pipeline performs two functions.
+
+1. Performing an integration test of the
+upgrade-google-client branch whenever new changes appear there.
+
+1. Running integration tests against every PR with the
+`integrate` label. This allows whitelisted PRs to be tested
+automatically before being merged. Status is updated on the
+PR when the test completes.
+
+## Setup
+
+In order to run the fog-google Concourse Pipeline you must have an existing
+[Concourse](http://concourse.ci) environment.
+See [Deploying Concourse on Google Compute Engine](https://github.com/cloudfoundry-incubator/bosh-google-cpi-release/blob/master/docs/deploy_concourse.md)
+for instructions.
+
+To deploy the pipeline:
+
+* Download the `fly` binary from the Concourse web interface and place it in your `$PATH`.
+
+* Login to your Concourse:
+
+```
+fly -t fog-google login -c <YOUR CONCOURSE URL>
+```
+
+* Update the [credentials.yml](https://github.com/fog/fog-google/blob/master/ci/credentials.yml.tpl)
+file. See [Credentials Requirements](#credentials-requirements) for specific instructions.
+
+* Set the fog-google pipeline:
+
+```
+fly -t fog-google set-pipeline -p fog-google -c pipeline.yml -l credentials.yml
+```
+
+* Unpause the fog-google pipeline:
+
+```
+fly -t fog-google unpause-pipeline -p fog-google
+```
+
+## Credentials Requirements
+
+Several external pieces of authentication are needed for credentials.yml
+
+1. A JSON Service Account File for a service account with at least Editor access to the project.
+    * To get a Service Account File, see [here](https://developers.google.com/identity/protocols/OAuth2ServiceAccount#creatinganaccount) 
+      and create using the Project/Editor role.
+
+1. A [Github Access Token](https://github.com/blog/1509-personal-api-tokens) with at least
+`repo:status` access and a private key with push access to the `fog/fog-google` repositoy.
+
+These items are equivalent to your login credentials for their resources.
+
+## Login Gotchas
+
+* If your Concourse deployment is using a self-signed certificate, use `--insecure` to
+trust the provided certificate.
+
+* If logging into a specific team, ie `fog-google`, use `--team-name fog-google` to specify that.
+
+## Dockerfile
+
+The [docker-image](https://github.com/fog/fog-google/blob/master/ci/docker-image) directory contains
+the Dockerfile necessary for recreating the Docker image used in tasks. This is referenced
+in a per-task basis as `image_resource`, ie in
+image_resource [run-int.yml](https://github.com/fog/fog-google/blob/master/ci/tasks/run-int.yml)

data/ci/credentials.yml.tpl

@@ -0,0 +1,13 @@
+---
+# Google Cloud Platform project to run under
+google_project:
+# Google Compute Engine Service Account email
+google_client_email:
+# Google Compute Engine Service Account JSON
+google_json_key_data: |
+
+# An access token with repo:status access
+github_access_token:
+# A SSH private key associated with the access token's account or
+# a repo push deploy key
+github_private_key: |

data/ci/docker-image/Dockerfile

@@ -0,0 +1,20 @@
+FROM ubuntu:16.04
+
+# Packages
+RUN DEBIAN_FRONTEND=noninteractive apt-get -y -qq update && apt-get -y -qq install \
+  build-essential \
+  curl \
+  git \
+  zlib1g-dev \
+  libssl-dev \
+  libreadline-dev \
+  libyaml-dev \
+  libxml2-dev \
+  libxslt-dev
+
+# Ubuntu 16.04 will fetch us 2.3.x without any issues.
+RUN DEBIAN_FRONTEND=noninteractive apt-get -y -qq install ruby ruby-dev
+
+RUN apt-get clean
+
+RUN gem install bundler

data/ci/pipeline.yml

@@ -0,0 +1,63 @@
+jobs:
+  - name: base-int
+    plan:
+      - aggregate:
+        - {
+            get: fog-google-src, resource: fog-google-src-in, trigger: true
+          }
+
+      - task: full-integration-tests
+        file: fog-google-src/ci/tasks/run-int.yml
+        params:
+          google_project: {{google_project}}
+          google_json_key_data: {{google_json_key_data}}
+          google_client_email: {{google_client_email}}
+
+  - name: pr-int
+    plan:
+      - get: fog-google-src
+        resource: pull-request
+        version: every
+        trigger: true
+      - put: pull-request
+        params: {path: fog-google-src, status: pending}
+
+      - task: full-integration-tests
+        file: fog-google-src/ci/tasks/run-int.yml
+        params:
+          google_project: {{google_project}}
+          google_json_key_data: {{google_json_key_data}}
+          google_client_email: {{google_client_email}}
+        on_success:
+          put: pull-request
+          params:
+            path: fog-google-src
+            status: success
+        on_failure:
+          put: pull-request
+          params:
+            path: fog-google-src
+            status: failure
+
+resources:
+  - name: fog-google-src-in
+    type: git
+    source:
+      uri: https://github.com/fog/fog-google.git
+      branch: upgrade-google-client
+  - name: pull-request
+    type: pull-request
+    source:
+      access_token: {{github_access_token}}
+      private_key: {{github_private_key}}
+      label: integrate
+      repo: fog/fog-google
+
+resource_types:
+  # This is a third party resource.
+  # The referenced docker-image is maintained externally
+  # https://github.com/jtarchie/pullrequest-resource
+  - name: pull-request
+    type: docker-image
+    source:
+      repository: jtarchie/pr

data/ci/tasks/run-int.sh

@@ -0,0 +1,34 @@
+#!/usr/bin/env bash
+
+set -e
+
+my_dir="$( cd $(dirname $0) && pwd )"
+release_dir="$( cd ${my_dir} && cd ../.. && pwd )"
+workspace_dir="$( cd ${release_dir} && cd ../../../.. && pwd )"
+
+pushd ${release_dir} > /dev/null
+
+source ci/tasks/utils.sh
+
+popd > /dev/null
+
+check_param google_project
+check_param google_client_email
+check_param google_json_key_data
+
+echo $google_json_key_data > `pwd`/service_account_key.json
+
+cat >~/.fog <<EOL
+test:
+  google_project: ${google_project}
+  google_client_email: ${google_client_email}
+  google_json_key_location: `pwd`/service_account_key.json
+EOL
+
+pushd ${release_dir} > /dev/null
+
+bundle install
+
+FOG_MOCK=false rake test
+
+popd > /dev/null

data/ci/tasks/run-int.yml

@@ -0,0 +1,15 @@
+---
+platform: linux
+image_resource:
+  type: docker-image
+  source: {repository: everlag/fog-google}
+inputs:
+- name: fog-google-src
+  path: src/fog-google
+run:
+  path: src/fog-google/ci/tasks/run-int.sh
+params:
+  google_project: replace-me
+  google_client_email: replace-me
+  google_json_key_data: |
+    replace-me

data/ci/tasks/utils.sh

@@ -0,0 +1,10 @@
+#!/usr/bin/env bash
+
+check_param() {
+  local name=$1
+  local value=$(eval echo '$'$name)
+  if [ "$value" == 'replace-me' ]; then
+    echo "environment variable $name must be set"
+    exit 1
+  fi
+}

data/examples/l7_load_balance.rb

@@ -16,31 +16,37 @@ def test
     :name => "fog-l7-resource-view-1",
     :numMembers => 1,
     :members => [instance1.self_link],
-    :zone => "us-central1-a")
+    :zone => "us-central1-a"
+  )
   resource_view1.add_resources(instance1.self_link)
   resource_view2 = connection.resource_views.create(
     :name => "fog-l7-resource-view-2",
     :numMembers => 1,
     :members => [instance2.self_link],
-    :zone => "us-central1-a")
+    :zone => "us-central1-a"
+  )
   resource_view2.add_resources(instance2.self_link)
   resource_view3 = connection.resource_views.create(
     :name => "fog-l7-resource-view-3",
     :members => [instance3.self_link],
-    :zone => "us-central1-b")
+    :zone => "us-central1-b"
+  )
   resource_view3.add_resources(instance3.self_link)
   backend_service1 = connection.backend_services.create(
     :name => "fog-l7-backend-service-1",
     :health_checks => [health.self_link],
-    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view1.self_link }])
+    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view1.self_link }]
+  )
   backend_service2 = connection.backend_services.create(
     :name => "fog-l7-backend-service-2",
     :health_checks => [health.self_link],
-    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view2.self_link }])
+    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view2.self_link }]
+  )
   backend_service3 = connection.backend_services.create(
     :name => "fog-l7-backend-service-3",
     :health_checks => [health.self_link],
-    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view3.self_link }])
+    :backends => [{ "balancingMode" => "RATE", "maxRate" => 100, "group" => resource_view3.self_link }]
+  )
   url_map = connection.url_maps.create(
     :name => "fog-l7-url-map",
     :pathMatchers => [{
@@ -62,10 +68,12 @@ def test
       ]
     }],
     :hostRules => [{ "hosts" => ["*"], "pathMatcher" => "pathmatcher" }],
-    :default_service => backend_service1.self_link)
+    :default_service => backend_service1.self_link
+  )
   proxy = connection.target_http_proxies.create(
     :name => "fog-l7-proxy",
-    :url_map => url_map.self_link)
+    :url_map => url_map.self_link
+  )
 
   connection.global_forwarding_rules.create(:name => "fog-l7-fwd-rule", :target => proxy.self_link)
 end

data/examples/metadata.rb

@@ -26,7 +26,8 @@ def test
     :machine_type => "n1-standard-1",
     :zone_name => "us-central1-f",
     :private_key_path => File.expand_path("~/.ssh/id_rsa"),
-    :public_key_path => File.expand_path("~/.ssh/id_rsa.pub"))
+    :public_key_path => File.expand_path("~/.ssh/id_rsa.pub")
+  )
 
   server.wait_for { ready? }
 

data/examples/monitoring/timeseries_collection.rb

@@ -9,8 +9,8 @@ Bundler.require(:default, :development)
 def test
   connection = Fog::Google::Monitoring.new
   interval = {
-    :start_time => (DateTime.now - 1).rfc3339,
-    :end_time => DateTime.now.rfc3339
+    :start_time => (Time.now - 1).rfc3339,
+    :end_time => Time.now.to_datetime.rfc3339
   }
   puts "Listing Timeseries from the last hour for metric compute.googleapis.com/instance/uptime..."
   puts "-------------------------------------------------------------------------------"