bugsnag 6.7.3 → 6.8.0

data/features/plain_features/api_key.feature

@@ -0,0 +1,26 @@
+Feature: API Key configuration options
+
+Background:
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: The API key configuration option can be set
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I set environment variable "MAZE_API_KEY" to "b35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby configuration/api_key.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "b35a2a72bd230ac0aa0f52715bbdc6aa"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/app_type.feature

@@ -0,0 +1,29 @@
+Feature: App type configuration option
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: The App type configuration option can be set
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I set environment variable "MAZE_APP_TYPE" to "test_app"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby configuration/send_handled.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "app.type" is "test_app"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/app_version.feature

@@ -0,0 +1,29 @@
+Feature: App version configuration option
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: The App version configuration option can be set
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I set environment variable "MAZE_APP_VERSION" to "9.9.8"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby configuration/send_handled.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "app.version" is "9.9.8"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/auto_notify.feature

@@ -0,0 +1,25 @@
+Feature: Auto notify configuration option
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: When Auto-notify is false notifications are not sent
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I set environment variable "MAZE_AUTO_NOTIFY" to "false"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby configuration/send_unhandled.rb"
+  And I wait for 1 second
+  Then I should receive 0 requests
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/delivery.feature

@@ -0,0 +1,70 @@
+Feature: delivery_method configuration option
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: When the delivery_method is set to :synchronous
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby delivery/synchronous.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "RuntimeError"
+  And the event "metaData.config" matches the JSON fixture in "features/fixtures/plain/json/delivery_synchronous.json"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |
+
+Scenario Outline: When the delivery_method is set to :thread_queue
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby delivery/threadpool.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "RuntimeError"
+  And the event "metaData.config" matches the JSON fixture in "features/fixtures/plain/json/delivery_threadpool.json"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |
+
+Scenario Outline: When the delivery_method is set to :thread_queue in a fork
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby delivery/fork_threadpool.rb"
+  And I wait for 1 second
+  Then I should receive 2 requests
+  And the request used the Ruby notifier
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "RuntimeError"
+  And the event "metaData.config" matches the JSON fixture in "features/fixtures/plain/json/delivery_fork.json"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/exception_data.feature

@@ -0,0 +1,122 @@
+Feature: Plain exception data
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  Given I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: An error has built in meta-data
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby exception_data/<state>_meta_data.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "CustomError"
+  And the event "metaData.exception.exception_type" equals "FATAL"
+  And the event "metaData.exception.exception_base" equals "RuntimeError"
+
+  Examples:
+  | ruby version | state     |
+  | 1.9.3        | unhandled |
+  | 1.9.3        | handled   |
+  | 2.0          | unhandled |
+  | 2.0          | handled   |
+  | 2.1          | unhandled |
+  | 2.1          | handled   |
+  | 2.2          | unhandled |
+  | 2.2          | handled   |
+  | 2.3          | unhandled |
+  | 2.3          | handled   |
+  | 2.4          | unhandled |
+  | 2.4          | handled   |
+  | 2.5          | unhandled |
+  | 2.5          | handled   |
+
+Scenario Outline: An error has built in context
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby exception_data/<state>_context.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "CustomError"
+  And the event "context" equals "IntegrationTests"
+
+  Examples:
+  | ruby version | state     |
+  | 1.9.3        | unhandled |
+  | 1.9.3        | handled   |
+  | 2.0          | unhandled |
+  | 2.0          | handled   |
+  | 2.1          | unhandled |
+  | 2.1          | handled   |
+  | 2.2          | unhandled |
+  | 2.2          | handled   |
+  | 2.3          | unhandled |
+  | 2.3          | handled   |
+  | 2.4          | unhandled |
+  | 2.4          | handled   |
+  | 2.5          | unhandled |
+  | 2.5          | handled   |
+
+Scenario Outline: An error has built in grouping hash
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby exception_data/<state>_hash.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "CustomError"
+  And the event "groupingHash" equals "ABCDE12345"
+
+  Examples:
+  | ruby version | state     |
+  | 1.9.3        | unhandled |
+  | 1.9.3        | handled   |
+  | 2.0          | unhandled |
+  | 2.0          | handled   |
+  | 2.1          | unhandled |
+  | 2.1          | handled   |
+  | 2.2          | unhandled |
+  | 2.2          | handled   |
+  | 2.3          | unhandled |
+  | 2.3          | handled   |
+  | 2.4          | unhandled |
+  | 2.4          | handled   |
+  | 2.5          | unhandled |
+  | 2.5          | handled   |
+
+Scenario Outline: An error has built in user id
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby exception_data/<state>_user_id.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the exception "errorClass" equals "CustomError"
+  And the event "user.id" equals "000001"
+
+  Examples:
+  | ruby version | state     |
+  | 1.9.3        | unhandled |
+  | 1.9.3        | handled   |
+  | 2.0          | unhandled |
+  | 2.0          | handled   |
+  | 2.1          | unhandled |
+  | 2.1          | handled   |
+  | 2.2          | unhandled |
+  | 2.2          | handled   |
+  | 2.3          | unhandled |
+  | 2.3          | handled   |
+  | 2.4          | unhandled |
+  | 2.4          | handled   |
+  | 2.5          | unhandled |
+  | 2.5          | handled   |

data/features/plain_features/filters.feature

@@ -0,0 +1,50 @@
+Feature: Plain filtering of metadata
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  Given I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: Metadata is filtered through the default filters
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby filters/default_filters.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "metaData.filter" matches the JSON fixture in "features/fixtures/plain/json/filters_default_metadata_filters.json"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |
+
+Scenario Outline: Additional filters can be added to the filter list
+  Given I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I set environment variable "MAZE_META_DATA_FILTERS" to "filter_me"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby filters/additional_filters.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "metaData.filter.filter_me" is "[FILTERED]"
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/handled_errors.feature

@@ -0,0 +1,86 @@
+Feature: Plain handled errors
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: A handled error sends a report
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby handled/<file>.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "unhandled" is false
+  And the event "severity" is "warning"
+  And the event "severityReason.type" is "handledException"
+  And the exception "errorClass" equals "RuntimeError"
+  And the "file" of stack frame 0 equals "/usr/src/handled/<file>.rb"
+  And the "lineNumber" of stack frame 0 equals <lineNumber>
+
+  Examples:
+  | ruby version | file                | lineNumber |
+  | 1.9.3        | notify_exception    | 6          |
+  | 1.9.3        | notify_string       | 8          |
+  | 2.0          | notify_exception    | 6          |
+  | 2.0          | notify_string       | 8          |
+  | 2.1          | notify_exception    | 6          |
+  | 2.1          | notify_string       | 8          |
+  | 2.2          | notify_exception    | 6          |
+  | 2.2          | notify_string       | 8          |
+  | 2.3          | notify_exception    | 6          |
+  | 2.3          | notify_string       | 8          |
+  | 2.4          | notify_exception    | 6          |
+  | 2.4          | notify_string       | 8          |
+  | 2.5          | notify_exception    | 6          |
+  | 2.5          | notify_string       | 8          |
+
+Scenario Outline: A handled error doesn't send a report when the :skip_bugsnag flag is set
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby handled/ignore_exception.rb"
+  And I wait for 1 second
+  Then I should receive 0 requests
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |
+
+Scenario Outline: A handled error can attach metadata in a block
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby handled/block_metadata.rb"
+  And I wait for 1 second
+  Then I should receive a request
+  And the request used the Ruby notifier
+  And the request used payload v4 headers
+  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And the event "unhandled" is false
+  And the event "severity" is "warning"
+  And the event "severityReason.type" is "handledException"
+  And the exception "errorClass" equals "RuntimeError"
+  And the "file" of stack frame 0 equals "/usr/src/handled/block_metadata.rb"
+  And the "lineNumber" of stack frame 0 equals 6
+  And the event "metaData.account.id" is "1234abcd"
+  And the event "metaData.account.name" is "Acme Co"
+  And the event "metaData.account.support" is true
+
+  Examples:
+  | ruby version |
+  | 1.9.3        |
+  | 2.0          |
+  | 2.1          |
+  | 2.2          |
+  | 2.3          |
+  | 2.4          |
+  | 2.5          |

data/features/plain_features/ignore_classes.feature

@@ -0,0 +1,31 @@
+Feature: Plain ignore classes
+
+Background:
+  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  Given I set environment variable "MAZE_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
+  And I set environment variable "APP_PATH" to "/usr/src"
+  And I configure the bugsnag endpoint
+
+Scenario Outline: An errors class is in the ignore_classes array
+  And I set environment variable "RUBY_VERSION" to "<ruby version>"
+  And I have built the service "plain-ruby"
+  And I run the service "plain-ruby" with the command "bundle exec ruby ignore_classes/<state>.rb"
+  And I wait for 1 second
+  Then I should receive 0 requests
+
+  Examples:
+  | ruby version | state     |
+  | 1.9.3        | unhandled |
+  | 1.9.3        | handled   |
+  | 2.0          | unhandled |
+  | 2.0          | handled   |
+  | 2.1          | unhandled |
+  | 2.1          | handled   |
+  | 2.2          | unhandled |
+  | 2.2          | handled   |
+  | 2.3          | unhandled |
+  | 2.3          | handled   |
+  | 2.4          | unhandled |
+  | 2.4          | handled   |
+  | 2.5          | unhandled |
+  | 2.5          | handled   |