gitlab-fog-azure-rm 0.6.0

data/CONTRIBUTING.md

@@ -0,0 +1,40 @@
+## Getting Involved
+
+New contributors are always welcome, when it doubt please ask questions. We strive to be an open and welcoming community. Please be nice to one another.
+
+For structure information of fog click [here](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/structure.md)
+
+### Coding
+
+* Pick a task:
+  * Offer feedback on open [pull requests](https://github.com/fog/fog-azure-rm/pulls).
+  * Review open [issues](https://github.com/fog/fog-azure-rm/issues) for things to help on.
+  * [Create an issue](https://github.com/fog/fog-azure-rm/issues/new) to start a discussion on additions or features.
+* Fork the project, add your changes and tests to cover them in a topic branch.
+  * [Fork](https://github.com/fog/fog-azure-rm/fork)
+  * Create your feature branch (`git checkout -b my-new-feature`)
+  * Commit your changes (`git commit -am 'Add some feature'`)
+  * Push to the branch (`git push origin my-new-feature`)
+  * Create a new pull request
+* Commit your changes and rebase against `fog/fog-azure-rm` to ensure everything is up to date.
+* [Submit a pull request](https://github.com/fog/fog-azure-rm/compare/).
+
+### Non-Coding
+
+* Offer feedback on open [issues](https://github.com/fog/fog-azure-rm/issues).
+* Organize or volunteer at events.
+* Write and help edit [documentation](https://github.com/fog/fog-azure-rm/tree/master/lib/fog/azurerm/docs).
+
+## Testing 
+You can run `Minitest` tests by running this command in the root directory.
+
+```shell
+$ rake test
+```
+
+## Code Coverage
+We are using Simplecov Gem for code coverage. You can see the report of  Code Coverage by running this command in the root directory.
+
+```shell
+$ rake coverage
+```

data/CONTRIBUTORS.md

@@ -0,0 +1,12 @@
+
+* Adnan Khalil <adnan.khalil@confiz.com>
+* Samawia Moin <samawia.moin@confiz.com>
+* Shaffan Chaudhry <shaffan.chaudhry@confiz.com>
+* Zeeshan Arshad <zeeshan.arshad@confiz.com>
+* Haider Ali <haider.ali@confiz.com>
+* Waqar Haider <waqar.haider@confiz.com>
+* Bilal Naeem <bilal.naeem@confiz.com>
+* Azeem Sajid <azeem.sajid@confiz.com>
+* Maham Nazir <maham.nazir@confiz.com>
+* Muhammad Asad <muhammad.asad@confiz.com>
+* Muhammad Abbas Sheikh <abbas.sheikh@confiz.com>

data/Gemfile

@@ -0,0 +1,3 @@
+source 'https://rubygems.org'
+# Specify your gem's dependencies in fog-azure-rm.gemspec
+gemspec

data/LICENSE.md

@@ -0,0 +1,20 @@
+The MIT License (MIT)
+
+Copyright (c) 2014-2015 [CONTRIBUTORS.md](https://github.com/fog/fog-azure-rm/blob/master/CONTRIBUTORS.md)
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of
+this software and associated documentation files (the "Software"), to deal in
+the Software without restriction, including without limitation the rights to
+use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of
+the Software, and to permit persons to whom the Software is furnished to do so,
+subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS
+FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
+COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER
+IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN
+CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,100 @@
+[![Gem Version](https://badge.fury.io/rb/fog-azure-rm.svg)](https://badge.fury.io/rb/fog-azure-rm)
+[![Build Status](https://travis-ci.org/fog/fog-azure-rm.svg?branch=master)](https://travis-ci.org/fog/fog-azure-rm)
+[![security](https://hakiri.io/github/fog/fog-azure-rm/master.svg)](https://hakiri.io/github/fog/fog-azure-rm/master)
+[![Test Coverage](https://codeclimate.com/github/fog/fog-azure-rm/badges/coverage.svg)](https://codeclimate.com/github/fog/fog-azure-rm/coverage)
+[![Code Climate](https://codeclimate.com/github/fog/fog-azure-rm/badges/gpa.svg)](https://codeclimate.com/github/fog/fog-azure-rm)
+
+# Fog Azure Resource Manager
+
+NOTE: This is a fork of https://github.com/fog/fog-azure-rm. This fork
+is used to support blob transfers with CarrierWave and Fog v2.
+
+This document describes how to get started with Fog using Microsoft Azure as a cloud resource management services provider.
+
+## Pre-requisites
+
+* Fog-azure-rm supports Ruby version 2.0.0 or later
+
+## Installation
+
+Add this line to your application's Gemfile:
+
+```ruby
+gem 'fog-azure-rm'
+```
+
+And then execute:
+
+    $ bundle
+
+Or install it yourself as:
+
+    $ gem install fog-azure-rm
+    
+    
+## Usage
+
+You can use this gem against the Microsoft Azure Resource Manager Services in the cloud. Of course, to use the Microsoft Azure Resource Manager Services in the cloud, you need to first [create a Microsoft Azure account](http://www.azure.com/en-us/pricing/free-trial/).
+* Set 'LOCATION' constant based on the Azure cloud you are using in [config.rb] (https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/config.rb) file. By default it will be 'eastus'.
+
+### Authentication
+
+The next step to use this gem, is authentication and permissioning. It is important to get familiar with this concept. For a reference on setting up a service principal from the command line see
+[Authenticating a service principal with Azure Resource Manager](http://aka.ms/cli-service-principal) or
+[Unattended Authentication](http://aka.ms/auth-unattended). For a more robust explanation of authentication in Azure,
+see [Developer’s guide to auth with Azure Resource Manager API](http://aka.ms/arm-auth-dev-guide).
+
+After creating the service principal, you should have three pieces of information, a client id (GUID), client secret
+(string) and tenant id (GUID).
+
+### Compute
+
+  Fog-AzureRM for compute includes implementation of Virtual Machines and Availability Sets. Readme for the usage of [Compute](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/compute.md) module.
+
+### Resources
+
+  Fog-AzureRM for resources includes implementation of Resource Groups. Readme for the usage of [Resources](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/resources.md) module.
+
+### DNS
+
+  Fog-AzureRM for dns includes implementation of Record sets and Zones. Readme for the usage of [DNS](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/dns.md) module.
+
+### Network
+
+  Fog-AzureRM for network includes implementation of Network Interfaces, Public IPs, Subnets and Virtual Networks. Readme for the usage of [Network](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/network.md) module.
+
+### Storage
+
+  Fog-AzureRM for storage includes implementation of Storage Accounts. Readme for the usage of [Storage](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/storage.md) module.
+  
+### Traffic Manager
+  
+  Fog-AzureRM for Traffic Manager includes implementation of Traffic Manager Profile and Traffic Manager End-points. Readme for the usage of [Traffic Manager](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/traffic_manager.md) module.
+
+### SQL 
+  
+  Fog-AzureRM for SQL includes implementation of SQL Server, SQL Databases and Data Warehouse. Readme for the usage of [Azure SQL](https://github.com/fog/fog-azure-rm/blob/master/lib/fog/azurerm/docs/sql.md) module.
+
+## Supported Services
+
+Use following command for the complete list of services, Fog provides for Azure Resource Manager.
+
+```ruby
+Fog::AzureRM.services
+```
+# Documentation 
+
+https://www.rubydoc.info/github/fog/fog-azure-rm/master
+  
+## Contributing
+
+See [CONTRIBUTING.md](https://github.com/fog/fog-azure-rm/blob/master/CONTRIBUTING.md) in this repository.
+
+## License
+
+The gem is available as open source under the terms of the [MIT License](http://opensource.org/licenses/MIT).
+
+
+
+
+

data/gitlab-fog-azure-rm.gemspec

@@ -0,0 +1,31 @@
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'fog/azurerm/version'
+
+Gem::Specification.new do |spec|
+  spec.name          = 'gitlab-fog-azure-rm'
+  spec.version       = Fog::AzureRM::VERSION
+  spec.authors       = ['Shaffan Chaudhry', 'Samawia Moin', 'Adnan Khalil', 'Zeeshan Arshad', 'Haider Ali', 'Waqar Haider', 'Bilal Naeem', 'Muhammad Asad', 'Azeem Sajid', 'Maham Nazir', 'Abbas Sheikh']
+  spec.summary       = "Module for the 'fog' gem to support Azure Blob Storage with CarrierWave and Fog."
+  spec.description   = "This is a stripped-down fork of fog-azure-rm that enables Azure Blob Storage to be used with CarrierWave and Fog."
+  spec.files = `git ls-files`.split("\n")
+  spec.test_files = `git ls-files -- {spec,tests}/*`.split("\n")
+  spec.require_paths = %w[lib]
+  spec.license  = 'MIT'
+  spec.homepage = 'https://gitlab.com/gitlab-org/gitlab-fog-azure-rm'
+  spec.rdoc_options = %w[--charset=UTF-8]
+  spec.extra_rdoc_files = %w[README.md]
+  spec.required_ruby_version = '>= 2.0.0'
+  spec.post_install_message = 'Thanks for installing!'
+  spec.add_development_dependency 'codeclimate-test-reporter' , '~> 1.0.0'
+  spec.add_development_dependency 'minitest', '~> 5.8.4'
+  spec.add_development_dependency 'rake', '~> 10.0'
+  spec.add_development_dependency 'rubocop', '~> 0.89'
+  spec.add_development_dependency 'simplecov'
+  spec.add_dependency 'azure_mgmt_storage', '~> 0.21'
+  spec.add_dependency 'azure-storage', '~> 0.15.0.preview'
+  spec.add_dependency 'fog-core', '= 2.1.0'
+  spec.add_dependency 'fog-json', '~> 1.2.0'
+  spec.add_dependency 'mime-types', '~> 3.2.2'
+  spec.add_dependency 'vhd', '0.0.4'
+end

data/lib/fog/azurerm.rb

@@ -0,0 +1,30 @@
+require 'ms_rest_azure'
+require 'azure/core/http/http_error'
+require 'erb'
+require 'fog/azurerm/config'
+require 'fog/azurerm/constants'
+require 'fog/azurerm/utilities/general'
+require 'fog/azurerm/version'
+require 'fog/core'
+require 'fog/json'
+require 'fog/azurerm/models/storage/sku_name'
+require 'fog/azurerm/models/storage/sku_tier'
+require 'fog/azurerm/models/storage/kind'
+
+module Fog
+  # Autoload Module for Credentials
+  module Credentials
+    autoload :AzureRM, File.expand_path('azurerm/credentials', __dir__)
+  end
+
+  # Autoload Module for Storage
+  module Storage
+    autoload :AzureRM, File.expand_path('azurerm/storage', __dir__)
+  end
+
+  # Main AzureRM fog Provider Module
+  module AzureRM
+    extend Fog::Provider
+    service(:storage, 'Storage')
+  end
+end

data/lib/fog/azurerm/async_response.rb

@@ -0,0 +1,44 @@
+module Fog
+  module AzureRM
+    # class for Async Response
+    class AsyncResponse
+      def initialize(model, promise, delete_extra_resource = false, post_method_execute = nil)
+        @fog_model = model
+        @promise = promise
+        @delete_extra_resource = delete_extra_resource
+        @post_method_execute = post_method_execute
+      end
+
+      def value
+        response = @promise.value.body
+        @fog_model.merge_attributes(@fog_model.class.parse(response))
+        @fog_model.delete_extra_resources if @delete_extra_resource
+        # This code block will execute the method mentioned in post_method_execute after getting the response
+        unless @post_method_execute.nil?
+          @fog_model.public_send(@post_method_execute) if @fog_model.respond_to? @post_method_execute
+        end
+        @fog_model
+      end
+
+      def state
+        @promise.state
+      end
+
+      def reason
+        @promise.reason
+      end
+
+      def pending?
+        @promise.pending?
+      end
+
+      def fulfilled?
+        @promise.fulfilled?
+      end
+
+      def rejected?
+        @promise.rejected?
+      end
+    end
+  end
+end

data/lib/fog/azurerm/config.rb

@@ -0,0 +1 @@
+LOCATION = 'eastus'.freeze

data/lib/fog/azurerm/constants.rb

@@ -0,0 +1,72 @@
+AZURE_RESOURCE = 'https://management.azure.com'.freeze
+DEFAULT_ADDRESS_PREFIXES = ['10.2.0.0/16'].freeze
+SUBNET = 'Subnet'.freeze
+PUBLIC_IP = 'Public-IP-Address'.freeze
+NETWORK_SECURITY_GROUP = 'Network-Security-Group'.freeze
+STANDARD_STORAGE = 'Standard'.freeze
+PREMIUM_STORAGE = 'Premium'.freeze
+ALLOWED_STANDARD_REPLICATION = %w[LRS ZRS GRS RAGRS].freeze
+API_VERSION = '2016-06-01'.freeze
+FAULT_DOMAIN_COUNT = 2
+UPDATE_DOMAIN_COUNT = 5
+WINDOWS = 'windows'.freeze
+VPN = 'Vpn'.freeze
+MICROSOFT_PEERING = 'MicrosoftPeering'.freeze
+RESOURCE_GROUP_NAME = 4
+RESOURCE_PROVIDER_NAMESPACE = 6
+RESOURCE_TYPE = 7
+RESOURCE_NAME = 8
+ENDPOINT_PREFIX = 'Microsoft.Network/trafficManagerProfiles'.freeze
+DISK_PREFIX = 'Microsoft.Compute/disks'.freeze
+SNAPSHOT_PREFIX = 'Microsoft.Compute/snapshots'.freeze
+AZURE_ENDPOINTS = 'azureEndpoints'.freeze
+EXTERNAL_ENDPOINTS = 'externalEndpoints'.freeze
+NESTED_ENDPOINTS = 'nestedEndpoints'.freeze
+GLOBAL = 'global'.freeze
+UPLOAD_BLOB_WORKER_THREAD_COUNT = 8
+VM_NAME_POSITION = 8
+PRIMARY_NIC_INDEX = 0
+
+ENVIRONMENT_AZURE_CLOUD = 'AzureCloud'.freeze
+ENVIRONMENT_AZURE_CHINA_CLOUD = 'AzureChinaCloud'.freeze
+ENVIRONMENT_AZURE_US_GOVERNMENT = 'AzureUSGovernment'.freeze
+ENVIRONMENT_AZURE_GERMAN_CLOUD = 'AzureGermanCloud'.freeze
+
+# MsRestAzure::AzureOperationError class Error Codes
+ERROR_CODE_RESOURCE_NOT_FOUND = 'ResourceNotFound'.freeze
+ERROR_CODE_NOT_FOUND = 'NotFound'.freeze
+ERROR_CODE_RESOURCE_GROUP_NOT_FOUND = 'ResourceGroupNotFound'.freeze
+ERROR_CODE_PARENT_RESOURCE_NOT_FOUND = 'ParentResourceNotFound'.freeze
+
+PLATFORM_LINUX = 'linux'.freeze
+
+# State of the copy operation
+COPY_STATUS =
+  {
+    # The copy completed successfully.
+    SUCCESS: 'success',
+    # The copy is in progress
+    PENDING: 'pending'
+  }.freeze
+
+# https://msdn.microsoft.com/en-us/library/azure/dd179451.aspx
+# The maximum size for a block blob created via Put Blob is 64 MB. But for better performance, this size should be 32 MB.
+# If your blob is larger than 32 MB, you must upload it as a set of blocks.
+SINGLE_BLOB_PUT_THRESHOLD = 32 * 1024 * 1024
+
+# Block blob: https://msdn.microsoft.com/en-us/library/azure/dd135726.aspx
+# Page blob: https://msdn.microsoft.com/en-us/library/azure/ee691975.aspx
+# Each block/page can be a different size, up to a maximum of 4 MB
+MAXIMUM_CHUNK_SIZE = 4 * 1024 * 1024
+
+# The hash value of 4MB empty content
+HASH_OF_4MB_EMPTY_CONTENT = 'b5cfa9d6c8febd618f91ac2843d50a1c'.freeze
+REST_CLIENT_API_VERSION = %w[2014-04-01-preview 2016-05-01].freeze
+AS_SKU_CLASSIC = 'Classic'.freeze
+AS_SKU_ALIGNED = 'Aligned'.freeze
+
+# The tag key and tag value for creating a temporary storage account for generalized image
+TEMPORARY_STORAGE_ACCOUNT_TAG_KEY = 'generalized_image'.freeze
+TEMPORARY_STORAGE_ACCOUNT_TAG_VALUE = 'delete'.freeze
+
+HTTP_NOT_FOUND = 404

data/lib/fog/azurerm/credentials.rb

@@ -0,0 +1,40 @@
+module Fog
+  module Credentials
+    # This class is managing credentials token
+    class AzureRM
+      def self.get_credentials(tenant_id, client_id, client_secret, environment = ENVIRONMENT_AZURE_CLOUD)
+        if @credentials.nil? || new_management_credential?(tenant_id, client_id, client_secret, environment)
+          get_new_credentials(tenant_id, client_id, client_secret, environment)
+        else
+          @credentials
+        end
+      end
+
+      def self.get_token(tenant_id, client_id, client_secret, environment = ENVIRONMENT_AZURE_CLOUD)
+        get_credentials(tenant_id, client_id, client_secret, environment) if @credentials.nil?
+        @token_provider.get_authentication_header
+      end
+
+      def self.get_new_credentials(tenant_id, client_id, client_secret, environment)
+        @tenant_id = tenant_id
+        @client_id = client_id
+        @client_secret = client_secret
+        @environment = environment
+        return if @tenant_id.nil? || @client_id.nil? || @client_secret.nil?
+        @token_provider = MsRestAzure::ApplicationTokenProvider.new(@tenant_id, @client_id, @client_secret, active_directory_service_settings(environment))
+        @credentials = MsRest::TokenCredentials.new(@token_provider)
+        @credentials
+      end
+
+      def self.new_management_credential?(tenant_id, client_id, client_secret, environment)
+        @tenant_id != tenant_id ||
+          @client_id != client_id ||
+          @client_secret != client_secret ||
+          @environment != environment
+      end
+
+      private_class_method :get_new_credentials
+      private_class_method :new_management_credential?
+    end
+  end
+end

data/lib/fog/azurerm/custom_fog_errors.rb

@@ -0,0 +1,52 @@
+# This file contains any or all custom Fog errors that we create
+module Fog
+  module AzureRM
+    # This is a custom Fog exception inherited from MsRestAzure::AzureOperationError
+    class CustomAzureOperationError < MsRestAzure::AzureOperationError
+      def initialize(message, azure_exception)
+        super(azure_exception.request, azure_exception.response, azure_exception.body, "Exception in #{message}")
+      end
+
+      def print_subscription_limits_information
+        request_method = @request.method
+        subscription_id = @request.path_params['subscriptionId']
+
+        limit_value = remaining_subscription_request_limits(@response)
+
+        puts "Subscription: '#{subscription_id}'. Request Method: '#{request_method}'. \nLimit Value: #{limit_value['header']}: #{limit_value['value']}\n" unless limit_value.empty?
+      end
+
+      def remaining_subscription_request_limits(response)
+        limit = {}
+        # handles both read and write limits
+        if response.headers.key? 'x-ms-ratelimit-remaining-subscription-resource-requests'
+          limit['header'] = 'x-ms-ratelimit-remaining-subscription-resource-requests'
+          limit['value'] = response.headers['x-ms-ratelimit-remaining-subscription-resource-requests']
+
+        # limit for collection API calls
+        elsif response.headers.key? 'x-ms-ratelimit-remaining-subscription-resource-entities-read'
+          limit['header'] = 'x-ms-ratelimit-remaining-subscription-resource-entities-read'
+          limit['value'] = response.headers['x-ms-ratelimit-remaining-subscription-resource-entities-read']
+
+        # read requests limit
+        elsif response.headers.key? 'x-ms-ratelimit-remaining-subscription-reads'
+          limit['header'] = 'x-ms-ratelimit-remaining-subscription-reads'
+          limit['value'] = response.headers['x-ms-ratelimit-remaining-subscription-reads']
+
+        # write requests limit
+        elsif response.headers.key? 'x-ms-ratelimit-remaining-subscription-writes'
+          limit['header'] = 'x-ms-ratelimit-remaining-subscription-writes'
+          limit['value'] = response.headers['x-ms-ratelimit-remaining-subscription-writes']
+        end
+        limit
+      end
+    end
+
+    # This is a custom Fog exception inherited from Azure::Core::Http::HTTPError
+    class CustomAzureCoreHttpError < Azure::Core::Http::HTTPError
+      def initialize(azure_exception)
+        super(azure_exception.http_response)
+      end
+    end
+  end
+end