propono 2.0.0.rc3 → 3.0.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
-SHA1:
-  metadata.gz: 97673d01a5c39db6689660e59a8667a342c759ab
-  data.tar.gz: 3e221dff98ec598ee9bd3144bca3dbae9a286de2
+SHA256:
+  metadata.gz: a7790d050fa3ee543affb106f6ef8478f7576c07270a7c285ffb3dc60dc65635
+  data.tar.gz: 9fab2edbfda2def0ce81b27ff12a9da4d57ecc3b4e45fded5d1513b2a02b855e
 SHA512:
-  metadata.gz: 94bbdc2ef73278a7258ef1d404c225e26e40db5f62cd5f5f3d1b7a35380b6867e256fc39dbda5755291bca3c5333444190a516a86ffcacaac98a21559cc0371c
-  data.tar.gz: cac7956743dbf2c7eab5237966471ccdc86cc460756d9f0d113284637d360746af27abbb1dc4eea65a962cca18a0a6696a4a74d279e819ad7a152ec8af215af8
+  metadata.gz: beb2e62ada80b404c4b590b88e2166034217f812483c097e1d1b86585076c261e7bc6b947a1a6e6cfdf3af362c63cdeeb9760d85c3c4dcfed5016b18b14bdd5b
+  data.tar.gz: 694302c72bd5aaada4f5472707f52c491d13d2707c7cc3d69575c9330961cd8049e5dcb4baf1c08f24ed5b9d8ae07173849995c922eae559a6746ee806460efb

data/.github/workflows/tests.yml

@@ -0,0 +1,30 @@
+name: Tests
+
+on:
+  push:
+    branches: [main]
+  pull_request:
+    branches: [main]
+
+jobs:
+  test:
+    name: Ruby ${{ matrix.ruby-version }} - ${{ matrix.os }} - ${{ github.event_name }}
+    runs-on: ${{ matrix.os }}
+    strategy:
+      fail-fast: false
+      matrix:
+        os:
+          - ubuntu-latest
+        ruby-version: [2.6, 2.7]
+
+    steps:
+      - uses: actions/checkout@v2
+
+      - name: Set up Ruby
+        uses: ruby/setup-ruby@a699edbce608a2c128dedad88e3b6a0e28687b3c
+        with:
+          ruby-version: ${{ matrix.ruby-version }}
+          bundler-cache: true
+
+      - name: Test
+        run: bundle exec rake test:local

data/.ruby-version

@@ -0,0 +1 @@
+2.6.6

data/CHANGELOG.md

@@ -1,3 +1,12 @@
+# 3.0.0 / 2021-01-10
+* [FEATURE] Improve AWS configuration.
+
+# 2.2.0 / 2019-09-21
+* [FEATURE] Add setting to disable slow queue
+
+# 2.1.0 / 2017-03-14
+* [FEATURE] Added visibility_timeout to listen
+
 # 2.0.0 / 2017-03-14
 * [FEATURE] Remove UDP and TCP support
 * [FEATURE] Change default publish behaviour from async to sync

data/README.md

@@ -21,13 +21,9 @@ Propono::Client.new.publish('some-topic', "The Best Message Ever")
 # - "I just received The Best Message Ever"
 ```
 
-## Changes from v1 to v2
+## Upgrading
 
-Version 2 of Propono changed a few things: 
-- We moved from a global interface to a client interface. Rather than calling `publish` and equivalent on `Propono`, you should now initialize a `Propono::Client` and then call everything on that client. This fixes issues with thread safety and global config.
-- We have also removed the dependancy on Fog and instead switch to the `sns` and `sqs` mini-gems of `aws-sdk`.
-- UDP and TCP support have been removed, and `subscribe_by_post` has been removed.
-- We are now using long-polling. This makes Propono **significantly** faster (10-100x).
+Upgrades from v1 to v2, and v2 to v3 are covered in the [upgrade documentation](docs/upgrading.md).
 
 ## Installation
 
@@ -41,18 +37,12 @@ And then execute:
 
 ## Usage
 
-The first thing to do is setup some configuration keys for Propono. It's best to do this in an initializer, or at the start of your application.
+The first thing to do is setup some configuration for Propono.
+It's best to do this in an initializer, or at the start of your application.
+If you need to setup AWS authentication, see the [AWS Configuration](#aws-configuration) section.
 
 ```ruby
 client = Propono::Client.new
-client.config.access_key       = "access-key"       # From AWS
-client.config.secret_key       = "secret-key"       # From AWS
-client.config.queue_region     = "queue-region"     # From AWS
-
-# Or use the IAM profile of the machine
-client.config.use_iam_profile  = true
-client.config.queue_region     = "queue-region"     # From AWS
-
 ```
 
 You can then start publishing messages easily from anywhere in your codebase.
@@ -81,28 +71,64 @@ This is because a queue is established for each application_name/topic combinati
 * subscribers that share the same `application_name` will act as multiple workers on the same queue. Only one will get to process each message.
 * subscribers that have a different `application_name` will each get a copy of a message to process independently i.e. acts as a one-to-many broadcast.
 
-### Configuration
+### AWS Configuration
+
+By default, Propono will create SQS and SNS clients with no options.
+In the absence of options, these clients will make use of the credentials on the current host.
+See the [AWS SDK For Ruby Configuration documentation](https://docs.aws.amazon.com/sdk-for-ruby/v3/developer-guide/setup-config.html) for more details.
+
+To manually configure options for use with AWS, use `aws_options`, which sets options to be passed to both clients. For example:
+
+    client = Propono::Client.new do |config|
+      config.aws_options = {
+        region:            'aws_region',
+        access_key_id:     'your_access_key_id',
+        secret_access_key: 'your_secret_access_key'        
+      }
+    end
 
-The following configuration settings are available:
+In addition to this, there are also `sqs_options` and `sns_options`, used to configure each client independently.
+See the [SQS Client](https://docs.aws.amazon.com/sdk-for-ruby/v3/api/Aws/SQS/Client.html#initialize-instance_method) and [SNS Client](https://docs.aws.amazon.com/sdk-for-ruby/v3/api/Aws/SNS/Client.html#initialize-instance_method) documentation for available options.
+These individual options are merged with `aws_options` with the per-client options taking precendence.
+
+### General Configuration
 
 ```
 Propono::Client.new do |config|
-  # Use AWS access and secret keys
-  config.access_key = "An AWS access key"
-  config.secret_key = "A AWS secret key"
-  # Or use AWS IAM profile of the machine
-  config.use_iam_profile = true
+  # AWS Configuration, see above.
+  config.aws_options = {...}
+  config.sqs_options = {...}
+  config.sns_options = {...}
 
-  config.queue_region = "An AWS queue region"
   config.application_name = "A name unique in your network"
   config.logger = "A logger such as Log4r or Rails.logger"
 
   config.max_retries = "The number of retries if a message raises an exception before being placed on the failed queue"
   config.num_messages_per_poll = "The number of messages retrieved per poll to SQS"
+
+  config.slow_queue_enabled = true
+end
+```
+
+### Options
+
+#### Async
+
+By default messages are posted inline, blocking the main thread. The `async: true` option can be sent when posting a message, which will spawn a new thread for the message networking calls, and unblocking the main thread.
+
+#### Visiblity Timeout
+
+For certain tasks (e.g. video processing), being able to hold messages for longer is important. To achieve this, the [visibility timeout of a message](http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/sqs-visibility-timeout.html) can be changed on the call to listen. e.g.
+
+```
+client.listen('long-running-tasks', visiblity_timeout: 3600) do |message|
+  puts "I just received: #{message}"
 end
 ```
 
-These can all also be set using the `client.config.access_key = "..."` syntax.
+### Slow Queue
+
+The slow queue can be disabled by setting `slow_queue_enabled` to `false`. This will yield performance improvements if you do not make use of the "slow queue" functionality.
 
 ### Is it any good?
 

data/docs/upgrading.md

@@ -0,0 +1,48 @@
+# Upgrading
+
+## Changes from v2 to v3
+
+Version 3 changed the way configuration options for the two AWS services are
+passed to the client gems. Instead of Propono attempting to guess which
+configuration options you might want, it now accepts hashes for AWS
+configuration which are passed directly to the appropriate clients.
+
+If you are upgrading from v2 to v3, and using the configuration as previously
+given in the README, you need to change from:
+
+```ruby
+client = Propono::Client.new
+client.config.queue_region = 'aws_region'
+client.config.access_key   = 'your_access_key_id'
+client.config.secret_key   = 'your_secret_access_key'
+```
+
+To:
+
+```ruby
+client = Propono::Client.new do |config|
+  config.aws_options = {
+    region:            'aws_region',
+    access_key_id:     'your_access_key_id',
+    secret_access_key: 'your_secret_access_key'
+  }
+end
+```
+
+For a full rundown, see the [AWS Configuration
+section](../README.md#aws-configuration) of the README.
+
+
+## Changes from v1 to v2
+
+Version 2 of Propono changed a few things:
+- We moved from a global interface to a client interface. Rather than calling
+  `publish` and equivalent on `Propono`, you should now initialize a
+  `Propono::Client` and then call everything on that client. This fixes issues
+  with thread safety and global config.
+- We have also removed the dependancy on Fog and instead switch to the `sns`
+  and `sqs` mini-gems of `aws-sdk`.
+- UDP and TCP support have been removed, and `subscribe_by_post` has been
+  removed.
+- We are now using long-polling. This makes Propono **significantly** faster
+  (10-100x).

data/lib/propono/components/aws_client.rb

@@ -43,16 +43,18 @@ module Propono
     def set_sqs_policy(queue, policy)
       sqs_client.set_queue_attributes(
         queue_url: queue.url,
-        attributes: { "Policy": policy }
+        attributes: { Policy: policy }
       )
     end
 
-    def read_from_sqs(queue, num_messages, long_poll: true)
+    def read_from_sqs(queue, num_messages, long_poll: true, visibility_timeout: nil)
       wait_time_seconds = long_poll ? 20 : 0
+      visibility_timeout ||= 30
       sqs_client.receive_message(
         queue_url: queue.url,
         wait_time_seconds: wait_time_seconds,
-        max_number_of_messages: num_messages
+        max_number_of_messages: num_messages,
+        visibility_timeout: visibility_timeout
       ).messages
     end
 
@@ -66,11 +68,11 @@ module Propono
     private
 
     def sns_client
-      @sns_client ||= Aws::SNS::Client.new(aws_config.aws_options)
+      @sns_client ||= Aws::SNS::Client.new(aws_config.sns_options)
     end
 
     def sqs_client
-      @sqs_client ||= Aws::SQS::Client.new(aws_config.aws_options)
+      @sqs_client ||= Aws::SQS::Client.new(aws_config.sqs_options)
     end
   end
 end

data/lib/propono/components/aws_config.rb

@@ -5,19 +5,13 @@ module Propono
       @config = config
     end
 
-    def aws_options
-      if @config.use_iam_profile
-        {
-          :use_iam_profile => true,
-          :region => @config.queue_region
-        }
-      else
-        {
-          :access_key_id => @config.access_key,
-          :secret_access_key => @config.secret_key,
-          :region => @config.queue_region
-        }
-      end
+    def sqs_options
+      @config.aws_options.merge(@config.sqs_options)
     end
+
+    def sns_options
+      @config.aws_options.merge(@config.sns_options)
+    end
+
   end
 end

data/lib/propono/components/client.rb

@@ -1,23 +1,28 @@
 module Propono
   class Client
 
-    # Propono configuration settings.
+    # Propono configuration.
     #
     # Settings should be set in an initializer or using some
-    # other method that insures they are set before any
-    # Propono code is used. They can be set as followed:
+    # other method that ensures they are set before any
+    # Propono code is used.
     #
-    #   Propono.config.access_key = "my-access-key"
+    # They can be set in one of the following ways:
     #
-    # The following settings are allowed:
+    # 1. As options passed to <tt>new</tt> as a hash.
     #
-    # * <tt>:access_key</tt> - The AWS access key
-    # * <tt>:secret_key</tt> - The AWS secret key
-    # * <tt>:queue_region</tt> - The AWS region
-    # * <tt>:application_name</tt> - The name of the application Propono
-    #   is included in.
-    # * <tt>:queue_suffix</tt> - Optional string to append to topic and queue names.
-    # * <tt>:logger</tt> - A logger object that responds to puts.
+    #   Propono::Client.new(application_name: 'my-application')
+    #
+    # 2. As options passed to <tt>new</tt> using a block.
+    #
+    #   Propono::Client.new do |config"
+    #     config.application_name: 'my-application'
+    #   end
+    #   
+    # 3. By calling the <tt>Propono::Client#configure</tt>.
+    #   client.configure do |config|
+    #     config.access_key = "my-access-key"
+    #   end
 
     attr_reader :config, :aws_client
     def initialize(settings = {}, &block)
@@ -33,7 +38,7 @@ module Propono
       @aws_client = AwsClient.new(AwsConfig.new(config))
     end
 
-    def configure(&block)
+    def configure
       yield config
     end
 
@@ -69,8 +74,8 @@ module Propono
     #
     # @param [String] topic The topic to subscribe to.
     # @param &message_processor The block to yield for each message.
-    def listen(topic_name, &message_processor)
-      QueueListener.listen(aws_client, config, topic_name, &message_processor)
+    def listen(topic_name, options = {}, &message_processor)
+      QueueListener.listen(aws_client, config, topic_name, options, &message_processor)
     end
 
     # Listens on a queue and yields for each message

data/lib/propono/components/queue_subscription.rb

@@ -15,7 +15,7 @@ module Propono
       @topic_name = topic_name
       @suffixed_topic_name = "#{topic_name}#{propono_config.queue_suffix}"
       @suffixed_slow_topic_name = "#{topic_name}#{propono_config.queue_suffix}-slow"
-      @queue_name = "#{propono_config.application_name.gsub(" ", "_")}-#{@suffixed_topic_name}"
+      @queue_name = "#{propono_config.application_name.tr(" ", "_")}-#{@suffixed_topic_name}"
     end
 
     def create

data/lib/propono/configuration.rb

@@ -15,24 +15,26 @@ module Propono
       end
     end
 
-    add_setting :access_key
-    add_setting :secret_key
-    add_setting :queue_region
+    add_setting :aws_options
+    add_setting :sqs_options
+    add_setting :sns_options
     add_setting :application_name
     add_setting :logger
     add_setting :max_retries
     add_setting :num_messages_per_poll
-
-    add_setting :use_iam_profile, required: false
-    add_setting :queue_suffix,    required: false
+    add_setting :slow_queue_enabled, required: false
+    add_setting :queue_suffix, required: false
 
     def initialize
       @settings = {
+        aws_options:           {},
+        sqs_options:           {},
+        sns_options:           {},
         logger:                Propono::Logger.new,
         queue_suffix:          "",
-        use_iam_profile:       false,
         max_retries:           0,
-        num_messages_per_poll: 10
+        num_messages_per_poll: 1,
+        slow_queue_enabled:    true
       }
     end
 

data/lib/propono/services/queue_listener.rb

@@ -9,12 +9,13 @@ module Propono
       new(*args, &message_processor).drain
     end
 
-    attr_reader :aws_client, :propono_config, :topic_name, :message_processor
-    def initialize(aws_client, propono_config, topic_name, &message_processor)
+    attr_reader :aws_client, :propono_config, :topic_name, :visibility_timeout, :message_processor
+    def initialize(aws_client, propono_config, topic_name, options = {}, &message_processor)
       @aws_client = aws_client
       @propono_config = propono_config
       @topic_name = topic_name
       @message_processor = message_processor
+      @visibility_timeout = options[:visibility_timeout] || nil
     end
 
     def listen
@@ -27,18 +28,18 @@ module Propono
     def drain
       raise ProponoError.new("topic_name is nil") unless topic_name
       true while read_messages_from_queue(main_queue, 10, long_poll: false)
-      true while read_messages_from_queue(slow_queue, 10, long_poll: false)
+      true while read_messages_from_queue(slow_queue, 10, long_poll: false) if propono_config.slow_queue_enabled
     end
 
     private
 
     def read_messages
       read_messages_from_queue(main_queue, propono_config.num_messages_per_poll) ||
-      read_messages_from_queue(slow_queue, 1)
+        (propono_config.slow_queue_enabled ?  read_messages_from_queue(slow_queue, 1) : nil)
     end
 
     def read_messages_from_queue(queue, num_messages, long_poll: true)
-      messages = aws_client.read_from_sqs(queue, num_messages, long_poll: long_poll)
+      messages = aws_client.read_from_sqs(queue, num_messages, long_poll: long_poll, visibility_timeout: visibility_timeout)
       if messages.empty?
         false
       else

data/lib/propono/version.rb

@@ -1,3 +1,3 @@
 module Propono
-  VERSION = "2.0.0.rc3"
+  VERSION = "3.0.0"
 end

data/propono.gemspec

@@ -6,11 +6,11 @@ require 'propono/version'
 Gem::Specification.new do |spec|
   spec.name          = "propono"
   spec.version       = Propono::VERSION
-  spec.authors       = ["MalcyL", "iHiD"]
-  spec.email         = ["jez.walker@gmail.com", "c.p.care@gmail.com", "malcolm@landonsonline.me.uk"]
+  spec.authors       = ["iHiD", "dougal", "ccare", "MalcyL"]
+  spec.email         = ["jez.walker@gmail.com"]
   spec.description   = %q{Pub / Sub Library using Amazon Web Services}
   spec.summary       = %q{General purpose pub/sub library built on top of AWS SNS and SQS}
-  spec.homepage      = ""
+  spec.homepage      = "https://github.com/iHiD/propono/"
   spec.license       = "MIT"
 
   spec.files         = `git ls-files`.split($/)
@@ -21,7 +21,7 @@ Gem::Specification.new do |spec|
   spec.add_dependency "aws-sdk-sns"
   spec.add_dependency "aws-sdk-sqs"
 
-  spec.add_development_dependency "bundler", "~> 1.3"
+  spec.add_development_dependency "bundler", "~> 2.1"
   spec.add_development_dependency "rake"
   spec.add_development_dependency "mocha"
   spec.add_development_dependency "yard"

data/test/components/aws_config_test.rb

@@ -7,47 +7,27 @@ module Propono
       super
       @config = Propono::Configuration.new
 
-      @config.access_key = "test-access-key"
-      @config.secret_key = "test-secret-key"
-      @config.queue_region = "test-queue-region"
+      @config.aws_options = { a: 'any', b: 'aws-specific' }
+      @config.sqs_options = { a: 'sqs', c: 'sqs-specific' }
+      @config.sns_options = { a: 'sns', c: 'sns-specific' }
 
       @aws_config = Propono::AwsConfig.new(@config)
     end
 
-    def test_access_key
-      assert_equal "test-access-key", @aws_config.aws_options[:access_key_id]
+    def test_overwritten_keys_take_precendence
+      assert_equal 'sqs', @aws_config.sqs_options[:a]
+      assert_equal 'sns', @aws_config.sns_options[:a]
     end
 
-    def test_secret_key
-      assert_equal "test-secret-key", @aws_config.aws_options[:secret_access_key]
+    def test_common_keys_remain
+      assert_equal 'aws-specific', @aws_config.sqs_options[:b]
+      assert_equal 'aws-specific', @aws_config.sns_options[:b]
     end
 
-    def test_region
-      assert_equal "test-queue-region", @aws_config.aws_options[:region]
+    def test_specific_keys_remain
+      assert_equal 'sqs-specific', @aws_config.sqs_options[:c]
+      assert_equal 'sns-specific', @aws_config.sns_options[:c]
     end
 
-    def test_no_iam_profile_selected
-      assert ! @aws_config.aws_options.has_key?(:use_iam_profile)
-    end
-
-    def test_use_iam_profile
-      @config.use_iam_profile = true
-      assert @aws_config.aws_options[:use_iam_profile]
-    end
-
-    def test_selecting_use_iam_profile_results_in_no_access_key
-      @config.use_iam_profile = true
-      assert ! @aws_config.aws_options.has_key?(:access_key_id)
-    end
-
-    def test_selecting_use_iam_profile_results_in_no_secret_key
-      @config.use_iam_profile = true
-      assert ! @aws_config.aws_options.has_key?(:secret_access_key)
-    end
-
-    def test_region_when_using_iam_profile
-      @config.use_iam_profile = true
-      assert_equal "test-queue-region", @aws_config.aws_options[:region]
-    end
   end
 end

data/test/components/client_test.rb

@@ -40,11 +40,28 @@ module Propono
       QueueListener.expects(:listen).with(
         client.aws_client,
         client.config,
-        topic
+        topic,
+        {}
       )
       client.listen(topic)
     end
 
+    def test_listen_calls_queue_listener_with_options
+      topic = 'foobar'
+      options = {foo: 'bar'}
+
+      client = Propono::Client.new
+      QueueListener.expects(:listen).with(
+        client.aws_client,
+        client.config,
+        topic,
+        options
+      )
+      client.listen(topic, options)
+    end
+
+
+
     def test_drain_queue_calls_queue_listener
       topic = 'foobar'
 
@@ -58,11 +75,11 @@ module Propono
     end
 
     def test_block_configuration_syntax
-      test_key = "foobar-123-access"
+      test_application_name = "my-application"
       client = Propono::Client.new do |config|
-        config.access_key = test_key
+        config.application_name = test_application_name
       end
-      assert_equal test_key, client.config.access_key
+      assert_equal test_application_name, client.config.application_name
     end
   end
 end

data/test/config.yml.example

@@ -1,4 +1,23 @@
-access_key: test-aws-access-key
-secret_key: test-aws-secret-key
-queue_region: test-aws-region
 application_name: tests-yourinitials
+
+# Whatever keys are in aws_options are passed directly to the AWS clients.
+
+# Option 1 - Do nothing.
+# AWS clients will either use the default profile in ~/.aws/credentials, or use an IAM Role if on EC2.
+
+# Option 2 - Use environment variables
+# You can set a non-default local profile with the AWS_PROFILE environment variable.
+# You can also set keys directly: https://docs.aws.amazon.com/sdk-for-ruby/v3/developer-guide/setup-config.html#aws-ruby-sdk-credentials-environment
+
+# Option 3 - Set values directly.
+aws_options: 
+  # Required
+  region: 'test-aws-region'
+
+  # Set keys:
+  # access_key_id: test-aws-access-key
+  # secret_access_key: test-aws-secret-key
+
+  # Or set a profile:
+  # profile: profile-name
+

data/test/configuration_test.rb

@@ -12,37 +12,40 @@ module Propono
       refute propono_config.nil?
     end
 
-    def test_use_iam_profile_defaults_false
-      assert ! propono_config.use_iam_profile
+    def test_application_name
+      application_name = "test-application-name"
+      propono_config.application_name = application_name
+      assert_equal application_name, propono_config.application_name
     end
 
-    def test_use_iam_profile
-      propono_config.use_iam_profile = true
-      assert propono_config.use_iam_profile
+    def test_default_aws_options
+      assert_equal({}, propono_config.aws_options)
     end
 
-    def test_access_key
-      access_key = "test-access-key"
-      propono_config.access_key = access_key
-      assert_equal access_key, propono_config.access_key
+    def test_aws_options
+      opts = { foo: 'bar' }
+      propono_config.aws_options = opts
+      assert_equal opts, propono_config.aws_options
     end
 
-    def test_secret_key
-      secret_key = "test-secret-key"
-      propono_config.secret_key = secret_key
-      assert_equal secret_key, propono_config.secret_key
+    def test_default_sqs_options
+      assert_equal({}, propono_config.sqs_options)
     end
 
-    def test_queue_region
-      queue_region = "test-queue-region"
-      propono_config.queue_region = queue_region
-      assert_equal queue_region, propono_config.queue_region
+    def test_sqs_options
+      opts = { foo: 'bar' }
+      propono_config.sqs_options = opts
+      assert_equal opts, propono_config.sqs_options
     end
 
-    def test_application_name
-      application_name = "test-application-name"
-      propono_config.application_name = application_name
-      assert_equal application_name, propono_config.application_name
+    def test_default_sns_options
+      assert_equal({}, propono_config.sns_options)
+    end
+
+    def test_sns_options
+      opts = { foo: 'bar' }
+      propono_config.sns_options = opts
+      assert_equal opts, propono_config.sns_options
     end
 
     def test_default_logger
@@ -65,7 +68,7 @@ module Propono
     end
 
     def test_default_num_messages_per_poll
-      assert_equal 10, propono_config.num_messages_per_poll
+      assert_equal 1, propono_config.num_messages_per_poll
     end
 
     def test_num_messages_per_poll
@@ -74,24 +77,6 @@ module Propono
       assert_equal val, propono_config.num_messages_per_poll
     end
 
-    def test_missing_access_key_throws_exception
-      assert_raises(ProponoConfigurationError) do
-        propono_config.access_key
-      end
-    end
-
-    def test_missing_secret_key_throws_exception
-      assert_raises(ProponoConfigurationError) do
-        propono_config.secret_key
-      end
-    end
-
-    def test_missing_queue_region_throws_exception
-      assert_raises(ProponoConfigurationError) do
-        propono_config.queue_region
-      end
-    end
-
     def test_missing_application_name_throws_exception
       assert_raises(ProponoConfigurationError) do
         propono_config.application_name

data/test/integration/integration_test.rb

@@ -6,9 +6,7 @@ module Propono
     def propono_client
       config_file = YAML.load_file( File.expand_path('../../config.yml', __FILE__))
       @propono_client ||= Propono::Client.new do |config|
-        config.access_key = config_file['access_key']
-        config.secret_key = config_file['secret_key']
-        config.queue_region = config_file['queue_region']
+        config.aws_options      = config_file['aws_options']
         config.application_name = config_file['application_name']
       end
     end

data/test/services/queue_listener_test.rb

@@ -58,6 +58,7 @@ module Propono
       end
     end
 
+    # Keep this test in sync with the one below, just with the config enabled
     def test_drain_should_continue_if_queue_empty
       @listener.expects(:read_messages_from_queue).with(@slow_queue, 10, long_poll: false).returns(false)
       @listener.expects(:read_messages_from_queue).with(@queue, 10, long_poll: false).returns(false)
@@ -65,6 +66,16 @@ module Propono
       assert true
     end
 
+    # Keep this test in sync with the one above, just with the config disabled
+    def test_drain_ignores_slow_queue_if_disabled
+      propono_config.slow_queue_enabled = false
+
+      @listener.expects(:read_messages_from_queue).with(@slow_queue, 10, long_poll: false).never
+      @listener.expects(:read_messages_from_queue).with(@queue, 10, long_poll: false).returns(false)
+      @listener.drain
+      assert true
+    end
+
     def test_drain_raises_with_nil_topic
       listener = QueueListener.new(aws_client, propono_config, nil) {}
       assert_raises ProponoError do
@@ -81,7 +92,7 @@ module Propono
 
     def test_read_message_from_sqs
       max_number_of_messages = 5
-      aws_client.expects(:read_from_sqs).with(@queue, max_number_of_messages, long_poll: true)
+      aws_client.expects(:read_from_sqs).with(@queue, max_number_of_messages, long_poll: true, visibility_timeout: nil)
       @listener.send(:read_messages_from_queue, @queue, max_number_of_messages)
     end
 
@@ -217,6 +228,7 @@ module Propono
       @listener.send(:move_to_corrupt_queue, @sqs_message1)
     end
 
+    # Keep this test in sync with the one below, just with the config enabled
     def test_if_no_messages_read_from_normal_queue_read_from_slow_queue
       main_queue = mock
       @listener.stubs(main_queue: main_queue)
@@ -228,6 +240,20 @@ module Propono
       @listener.send(:read_messages)
     end
 
+    # Keep this test in sync with the one above, just with the config disabled
+    def ignore_slow_queue_if_disabled
+      propono_config.slow_queue_enabled = false
+
+      main_queue = mock
+      @listener.stubs(main_queue: main_queue)
+      slow_queue = mock
+      @listener.stubs(slow_queue: slow_queue)
+
+      @listener.expects(:read_messages_from_queue).with(main_queue, propono_config.num_messages_per_poll).returns(false)
+      @listener.expects(:read_messages_from_queue).with(slow_queue, 1).never
+      @listener.send(:read_messages)
+    end
+
     def test_if_read_messages_from_normal_do_not_read_from_slow_queue
       main_queue = mock
       @listener.stubs(main_queue: main_queue)

data/test/test_helper.rb

@@ -15,9 +15,6 @@ class Minitest::Test
 
   def propono_config
     @propono_config ||= Propono::Configuration.new.tap do |c|
-      c.access_key = "test-access-key"
-      c.secret_key = "test-secret-key"
-      c.queue_region = "us-east-1"
       c.application_name = "MyApp"
       c.queue_suffix = ""
 

metadata

@@ -1,15 +1,17 @@
 --- !ruby/object:Gem::Specification
 name: propono
 version: !ruby/object:Gem::Version
-  version: 2.0.0.rc3
+  version: 3.0.0
 platform: ruby
 authors:
-- MalcyL
 - iHiD
-autorequire: 
+- dougal
+- ccare
+- MalcyL
+autorequire:
 bindir: bin
 cert_chain: []
-date: 2017-10-11 00:00:00.000000000 Z
+date: 2021-02-10 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: aws-sdk-sns
@@ -45,14 +47,14 @@ dependencies:
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '1.3'
+        version: '2.1'
   type: :development
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - "~>"
       - !ruby/object:Gem::Version
-        version: '1.3'
+        version: '2.1'
 - !ruby/object:Gem::Dependency
   name: rake
   requirement: !ruby/object:Gem::Requirement
@@ -112,20 +114,20 @@ dependencies:
 description: Pub / Sub Library using Amazon Web Services
 email:
 - jez.walker@gmail.com
-- c.p.care@gmail.com
-- malcolm@landonsonline.me.uk
 executables: []
 extensions: []
 extra_rdoc_files: []
 files:
+- ".github/workflows/tests.yml"
 - ".gitignore"
-- ".travis.yml"
+- ".ruby-version"
 - CHANGELOG.md
 - CONTRIBUTING.md
 - Gemfile
 - LICENCE.md
 - README.md
 - Rakefile
+- docs/upgrading.md
 - lib/propono.rb
 - lib/propono/components/aws_client.rb
 - lib/propono/components/aws_config.rb
@@ -158,11 +160,11 @@ files:
 - test/services/queue_listener_test.rb
 - test/test_helper.rb
 - test/utils/hash_test.rb
-homepage: ''
+homepage: https://github.com/iHiD/propono/
 licenses:
 - MIT
 metadata: {}
-post_install_message: 
+post_install_message:
 rdoc_options: []
 require_paths:
 - lib
@@ -173,13 +175,12 @@ required_ruby_version: !ruby/object:Gem::Requirement
       version: '0'
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
-  - - ">"
+  - - ">="
     - !ruby/object:Gem::Version
-      version: 1.3.1
+      version: '0'
 requirements: []
-rubyforge_project: 
-rubygems_version: 2.6.13
-signing_key: 
+rubygems_version: 3.0.3
+signing_key:
 specification_version: 4
 summary: General purpose pub/sub library built on top of AWS SNS and SQS
 test_files:
@@ -199,4 +200,3 @@ test_files:
 - test/services/queue_listener_test.rb
 - test/test_helper.rb
 - test/utils/hash_test.rb
-has_rdoc: 

data/.travis.yml

@@ -1,7 +0,0 @@
-language: ruby
-cache: bundler
-rvm:
-  - 2.2.8
-  - 2.4.2
-script:
-  - bundle exec rake test:local