bugsnag 6.12.2 → 6.13.0

data/features/rails_features/meta_data_filters.feature

@@ -1,42 +1,14 @@
 Feature: Metadata filters
 
-Background:
-  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And I set environment variable "APP_PATH" to "/usr/src"
-  And I configure the bugsnag endpoint
-
-Scenario Outline: Meta_data_filters should include Rails.configuration.filter_parameters
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/metadata_filters/filter" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Meta_data_filters should include Rails.configuration.filter_parameters
+  Given I start the rails service
+  When I navigate to the route "/metadata_filters/filter" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "unhandled" is false
   And the exception "errorClass" equals "RuntimeError"
   And the exception "message" starts with "handled string"
   And the event "app.type" equals "rails"
   And the event "metaData.request.url" ends with "/metadata_filters/filter"
   And the event "metaData.my_specific_filter" equals "[FILTERED]"
-
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |

data/features/rails_features/mongo_breadcrumbs.feature

@@ -1,109 +1,26 @@
 Feature: Mongo automatic breadcrumbs
 
-Background:
-  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And I set environment variable "APP_PATH" to "/usr/src"
-  And I configure the bugsnag endpoint
+@rails4 @rails5 @rails6
+Scenario: Successful breadcrumbs
+  Given I start the rails service
+  When I navigate to the route "/mongo/success_crash" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
+  And the event contains a breadcrumb matching the JSON fixture in "features/fixtures/expected_breadcrumbs/mongo_success.json"
 
-Scenario Outline: Successful breadcrumbs
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/mongo/success_crash" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the event has a "process" breadcrumb named "Mongo query succeeded"
-  And the event "breadcrumbs.1.timestamp" is a timestamp
-  And the event "breadcrumbs.1.metaData.event_name" equals "mongo.succeeded"
-  And the event "breadcrumbs.1.metaData.command_name" equals "insert"
-  And the event "breadcrumbs.1.metaData.database_name" equals "rails<rails_version>_development"
-  And the event "breadcrumbs.1.metaData.operation_id" is not null
-  And the event "breadcrumbs.1.metaData.request_id" is not null
-  And the event "breadcrumbs.1.metaData.duration" is not null
-  And the event "breadcrumbs.1.metaData.collection" equals "mongo_models"
+@rails4 @rails5 @rails6
+Scenario: Breadcrumb with filter parameters
+  Given I start the rails service
+  When I navigate to the route "/mongo/get_crash" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
+  And the event contains a breadcrumb matching the JSON fixture in "features/fixtures/expected_breadcrumbs/mongo_filtered_request.json"
+  And the event contains a breadcrumb matching the JSON fixture in "features/fixtures/expected_breadcrumbs/mongo_filtered_result.json"
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 5             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Breadcrumb with filter parameters
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/mongo/get_crash" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the event has a "process" breadcrumb named "Mongo query succeeded"
-  And the event "breadcrumbs.1.timestamp" is a timestamp
-  And the event "breadcrumbs.1.metaData.event_name" equals "mongo.succeeded"
-  And the event "breadcrumbs.1.metaData.command_name" equals "find"
-  And the event "breadcrumbs.1.metaData.database_name" equals "rails<rails_version>_development"
-  And the event "breadcrumbs.1.metaData.operation_id" is not null
-  And the event "breadcrumbs.1.metaData.request_id" is not null
-  And the event "breadcrumbs.1.metaData.duration" is not null
-  And the event "breadcrumbs.1.metaData.collection" equals "mongo_models"
-  And the event "breadcrumbs.1.metaData.filter" equals "{"string_field":"?"}"
-  And the event "breadcrumbs.2.timestamp" is a timestamp
-  And the event "breadcrumbs.2.metaData.event_name" equals "mongo.succeeded"
-  And the event "breadcrumbs.2.metaData.command_name" equals "find"
-  And the event "breadcrumbs.2.metaData.database_name" equals "rails<rails_version>_development"
-  And the event "breadcrumbs.2.metaData.operation_id" is not null
-  And the event "breadcrumbs.2.metaData.request_id" is not null
-  And the event "breadcrumbs.2.metaData.duration" is not null
-  And the event "breadcrumbs.2.metaData.collection" equals "mongo_models"
-  And the event "breadcrumbs.2.metaData.filter" equals "{"$or":[{"string_field":"?"},{"numeric_field":"?"}]}"
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 5             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Failure breadcrumbs
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/mongo/failure_crash" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the event has a "process" breadcrumb named "Mongo query failed"
-  And the event "breadcrumbs.1.timestamp" is a timestamp
-  And the event "breadcrumbs.1.metaData.event_name" equals "mongo.failed"
-  And the event "breadcrumbs.1.metaData.command_name" equals "bogus"
-  And the event "breadcrumbs.1.metaData.database_name" equals "rails<rails_version>_development"
-  And the event "breadcrumbs.1.metaData.operation_id" is not null
-  And the event "breadcrumbs.1.metaData.request_id" is not null
-  And the event "breadcrumbs.1.metaData.duration" is not null
-  And the event "breadcrumbs.1.metaData.collection" equals 1
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 5             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
+@rails4 @rails5 @rails6
+Scenario: Failure breadcrumbs
+  Given I start the rails service
+  When I navigate to the route "/mongo/failure_crash" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
+  And the event contains a breadcrumb matching the JSON fixture in "features/fixtures/expected_breadcrumbs/mongo_failed.json"

data/features/rails_features/project_root.feature

@@ -1,106 +1,35 @@
 Feature: Project root configuration
 
-Background:
-  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And I set environment variable "APP_PATH" to "/usr/src"
-  And I configure the bugsnag endpoint
-
-Scenario Outline: Project_root should default to Rails.root
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/project_root/default" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Project_root should default to Rails.root
+  Given I start the rails service
+  When I navigate to the route "/project_root/default" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the exception "errorClass" equals "RuntimeError"
   And the exception "message" starts with "handled string"
   And the event "metaData.request.url" ends with "/project_root/default"
   And the "file" of the top non-bugsnag stackframe equals "app/controllers/project_root_controller.rb"
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Project_root can be set in an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I set environment variable "BUGSNAG_PROJECT_ROOT" to "/foo/bar"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/project_root/initializer" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Project_root can be set in an initializer
+  Given I set environment variable "BUGSNAG_PROJECT_ROOT" to "/foo/bar"
+  And I start the rails service
+  When I navigate to the route "/project_root/initializer" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the exception "errorClass" equals "RuntimeError"
   And the exception "message" starts with "handled string"
   And the event "metaData.request.url" ends with "/project_root/initializer"
   And the "file" of the top non-bugsnag stackframe equals "/usr/src/app/controllers/project_root_controller.rb"
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Project_root can be set after an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/project_root/after" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request used the "Ruby Bugsnag Notifier" notifier
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Project_root can be set after an initializer
+  Given I start the rails service
+  When I navigate to the route "/project_root/after" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the exception "errorClass" equals "RuntimeError"
   And the exception "message" starts with "handled string"
   And the event "metaData.request.url" ends with "/project_root/after"
   And the "file" of the top non-bugsnag stackframe equals "/usr/src/app/controllers/project_root_controller.rb"
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |

data/features/rails_features/release_stage.feature

@@ -1,95 +1,27 @@
 Feature: Release stage
 
-Background:
-  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And I set environment variable "APP_PATH" to "/usr/src"
-  And I configure the bugsnag endpoint
-
-Scenario Outline: Release_stage should default to RAILS_ENV
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I set environment variable "RAILS_ENV" to "rails_env"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/release_stage/default" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Release_stage should default to RAILS_ENV
+  Given I set environment variable "RAILS_ENV" to "rails_env"
+  And I start the rails service
+  When I navigate to the route "/release_stage/default" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "app.releaseStage" equals "rails_env"
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Release_stage can be set in an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I set environment variable "BUGSNAG_RELEASE_STAGE" to "maze_release_stage_env"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/release_stage/default" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Release_stage can be set in an initializer
+  Given I set environment variable "BUGSNAG_RELEASE_STAGE" to "maze_release_stage_env"
+  And I start the rails service
+  When I navigate to the route "/release_stage/default" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "app.releaseStage" equals "maze_release_stage_env"
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Release_stage can be set after an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/release_stage/after?stage=set_after_env" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Release_stage can be set after an initializer
+  Given I start the rails service
+  When I navigate to the route "/release_stage/after?stage=set_after_env" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "app.releaseStage" equals "set_after_env"
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |

data/features/rails_features/send_code.feature

@@ -1,64 +1,18 @@
 Feature: Send code
 
-Background:
-  Given I set environment variable "BUGSNAG_API_KEY" to "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And I set environment variable "APP_PATH" to "/usr/src"
-  And I configure the bugsnag endpoint
-
-Scenario Outline: Send_code can be updated in an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I set environment variable "BUGSNAG_SEND_CODE" to "false"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/send_code/initializer" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Send_code can be updated in an initializer
+  Given I set environment variable "BUGSNAG_SEND_CODE" to "false"
+  And I start the rails service
+  When I navigate to the route "/send_code/initializer" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "exceptions.0.stacktrace.0.code" is null
 
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |
-
-Scenario Outline: Send_code can be updated after an initializer
-  Given I set environment variable "RUBY_VERSION" to "<ruby_version>"
-  And I start the service "rails<rails_version>"
-  And I wait for the app to respond on port "6128<rails_version>"
-  When I navigate to the route "/send_code/after" on port "6128<rails_version>"
-  Then I should receive a request
-  And the request is a valid for the error reporting API
-  And the request contained the api key "a35a2a72bd230ac0aa0f52715bbdc6aa"
-  And the payload field "events" is an array with 1 element
+@rails3 @rails4 @rails5 @rails6
+Scenario: Send_code can be updated after an initializer
+  Given I start the rails service
+  When I navigate to the route "/send_code/after" on the rails app
+  And I wait to receive a request
+  Then the request is valid for the error reporting API version "4.0" for the "Ruby Bugsnag Notifier"
   And the event "exceptions.0.stacktrace.0.code" is null
-
-  Examples:
-    | ruby_version | rails_version |
-    | 2.0          | 3             |
-    | 2.1          | 3             |
-    | 2.2          | 3             |
-    | 2.2          | 4             |
-    | 2.2          | 5             |
-    | 2.3          | 3             |
-    | 2.3          | 4             |
-    | 2.3          | 5             |
-    | 2.4          | 3             |
-    | 2.4          | 5             |
-    | 2.5          | 3             |
-    | 2.5          | 5             |
-    | 2.5          | 6             |
-    | 2.6          | 5             |
-    | 2.6          | 6             |