cuke_linter 0.9.0 → 0.10.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 064456ffb63c27969a361497f8c1d6c9f9b96f5a59f488506db5611faa695f0f
-  data.tar.gz: b31161d84e3bda65527caa854bdcfcb2e1bdaca8a0f94b4dc540d00274d54bdf
+  metadata.gz: 5bc16cc61de218e7a1790a86b16d614e9b831e24fb31b46dafa7fe60fbc6768a
+  data.tar.gz: d4bc88c2c166feef1057e89d2430889cb3baa4522a7bf03e2cc2a05586069707
 SHA512:
-  metadata.gz: b83fad28c5cd56da418697695f4333659f8cd16f750e4be51cd796e62a979c125413aa7b9d443ef56a832e1585b7247e9eb07512acb62e9071a074ed3593e079
-  data.tar.gz: 414f730e30415505687acc8abc8a197ba7d49e1bdb6ff9337d079d4450e928cb88d3582f85124b047bd554d13a0f2cf6fbb13f6c43e6a58db26b8ffb41e36d8a
+  metadata.gz: 2504c5d82a51883f883976bc427b9894a8af138a92bd4d714d8cac8c0dbfca9bff9467811002cfd748ad9f9f8d47ce3584d30443927cbce029ceb2549d8c12bb
+  data.tar.gz: 557843507486823449ff2cfed0e8e69f1b5500f3996a42df170e83286ef61d247bc586f3cf04b2393ad5b4b619080a9a95264620631dd82b8f0490cb411241dc

data/CHANGELOG.md

@@ -8,6 +8,21 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 Nothing yet...
 
+
+## [0.10.0] - 2019-10-04
+
+### Added
+ - New linters
+   - FeatureWithTooManyDifferentTagsLinter
+   - TestShouldUseBackgroundLinter
+   - TestWithActionStepAsFinalStepLinter
+   - TestWithSetupStepAfterActionStepLinter
+   - TestWithSetupStepAfterVerificationStepLinter
+   - TestWithSetupStepAsFinalStepLinter
+
+### Changed
+ - Improved some of the documentation and linting messages so that it is more clear what the problem is.
+
 ## [0.9.0] - 2019-09-11
 
 ### Added
@@ -90,7 +105,8 @@ Nothing yet...
 - Custom linters, formatters, and command line usability
 
 
-[Unreleased]: https://github.com/enkessler/cuke_linter/compare/v0.9.0...HEAD
+[Unreleased]: https://github.com/enkessler/cuke_linter/compare/v0.10.0...HEAD
+[0.10.0]: https://github.com/enkessler/cuke_linter/compare/v0.9.0...v0.10.0
 [0.9.0]: https://github.com/enkessler/cuke_linter/compare/v0.8.0...v0.9.0
 [0.8.0]: https://github.com/enkessler/cuke_linter/compare/v0.7.0...v0.8.0
 [0.7.0]: https://github.com/enkessler/cuke_linter/compare/v0.6.0...v0.7.0

data/CONTRIBUTING.md

@@ -0,0 +1,26 @@
+# Development
+
+After checking out the repo, run `bin/setup` to install dependencies. Then, run `bundle exec rake cuke_linter:test_everything` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
+
+
+## Contributing
+
+Bug reports and pull requests are welcome on GitHub at https://github.com/enkessler/cuke_linter.
+
+1. Fork it
+2. Create your feature branch **(off of the development branch)**
+   `git checkout -b my-new-feature dev`
+3. Commit your changes
+   `git commit -am 'Add some feature'`
+4. Push to the branch
+   `git push origin my-new-feature`
+5. Create new Pull Request
+
+
+### Adding a new linter
+
+Some guidelines when adding a new linter
+  * Inherit from the base linter class. It will handle almost all of the functional requirements of a linter.
+  * Existing linters should provide decent examples of how to create new linters and how to test them. A copy/paste/tweak approach is perfectly valid.
+  * Keep linters simple. Rather than have one linter that has different behaviors depending on context, create a different linter class for each context.
+  * Keep things alphabetical. There are going to be lots of linters and things will be easier to find if lists of them in the code base (e.g. `require` statments, documentation, etc.) are in an intuitive order.

data/README.md

@@ -147,23 +147,10 @@ Rather than using the default linters or providing a custom set of of modified l
 
 For more detailed examples of usage, see the documentation [here](https://app.cucumber.pro/projects/cuke_linter).
 
+## Development and Contributing
 
-## Development
+See [CONTRIBUTING.md](https://github.com/enkessler/cuke_linter/blob/master/CONTRIBUTING.md)
 
-After checking out the repo, run `bin/setup` to install dependencies. Then, run `bundle exec rake cuke_linter:test_everything` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
-
-## Contributing
-
-Bug reports and pull requests are welcome on GitHub at https://github.com/enkessler/cuke_linter.
-
-1. Fork it
-2. Create your feature branch **(off of the development branch)**
-   `git checkout -b my-new-feature`
-3. Commit your changes
-   `git commit -am 'Add some feature'`
-4. Push to the branch
-   `git push origin my-new-feature`
-5. Create new Pull Request
 
 ## License
 

data/lib/cuke_linter.rb

@@ -7,6 +7,7 @@ require 'cuke_linter/linters/linter'
 require 'cuke_linter/linters/background_does_more_than_setup_linter'
 require 'cuke_linter/linters/element_with_too_many_tags_linter'
 require 'cuke_linter/linters/example_without_name_linter'
+require 'cuke_linter/linters/feature_with_too_many_different_tags_linter'
 require 'cuke_linter/linters/feature_without_name_linter'
 require 'cuke_linter/linters/feature_without_description_linter'
 require 'cuke_linter/linters/feature_without_scenarios_linter'
@@ -14,9 +15,14 @@ require 'cuke_linter/linters/outline_with_single_example_row_linter'
 require 'cuke_linter/linters/single_test_background_linter'
 require 'cuke_linter/linters/step_with_end_period_linter'
 require 'cuke_linter/linters/step_with_too_many_characters_linter'
+require 'cuke_linter/linters/test_should_use_background_linter'
+require 'cuke_linter/linters/test_with_action_step_as_final_step_linter'
 require 'cuke_linter/linters/test_with_no_action_step_linter'
 require 'cuke_linter/linters/test_with_no_name_linter'
 require 'cuke_linter/linters/test_with_no_verification_step_linter'
+require 'cuke_linter/linters/test_with_setup_step_after_action_step_linter'
+require 'cuke_linter/linters/test_with_setup_step_after_verification_step_linter'
+require 'cuke_linter/linters/test_with_setup_step_as_final_step_linter'
 require 'cuke_linter/linters/test_with_too_many_steps_linter'
 
 
@@ -24,20 +30,26 @@ require 'cuke_linter/linters/test_with_too_many_steps_linter'
 
 module CukeLinter
 
-  @original_linters = { 'BackgroundDoesMoreThanSetupLinter' => BackgroundDoesMoreThanSetupLinter.new,
-                        'ElementWithTooManyTagsLinter'      => ElementWithTooManyTagsLinter.new,
-                        'ExampleWithoutNameLinter'          => ExampleWithoutNameLinter.new,
-                        'FeatureWithoutDescriptionLinter'   => FeatureWithoutDescriptionLinter.new,
-                        'FeatureWithoutNameLinter'          => FeatureWithoutNameLinter.new,
-                        'FeatureWithoutScenariosLinter'     => FeatureWithoutScenariosLinter.new,
-                        'OutlineWithSingleExampleRowLinter' => OutlineWithSingleExampleRowLinter.new,
-                        'SingleTestBackgroundLinter'        => SingleTestBackgroundLinter.new,
-                        'StepWithEndPeriodLinter'           => StepWithEndPeriodLinter.new,
-                        'TestWithNoActionStepLinter'        => TestWithNoActionStepLinter.new,
-                        'TestWithNoNameLinter'              => TestWithNoNameLinter.new,
-                        'TestWithNoVerificationStepLinter'  => TestWithNoVerificationStepLinter.new,
-                        'StepWithTooManyCharactersLinter'   => StepWithTooManyCharactersLinter.new,
-                        'TestWithTooManyStepsLinter'        => TestWithTooManyStepsLinter.new }
+  @original_linters = { 'BackgroundDoesMoreThanSetupLinter'            => BackgroundDoesMoreThanSetupLinter.new,
+                        'ElementWithTooManyTagsLinter'                 => ElementWithTooManyTagsLinter.new,
+                        'ExampleWithoutNameLinter'                     => ExampleWithoutNameLinter.new,
+                        'FeatureWithTooManyDifferentTagsLinter'        => FeatureWithTooManyDifferentTagsLinter.new,
+                        'FeatureWithoutDescriptionLinter'              => FeatureWithoutDescriptionLinter.new,
+                        'FeatureWithoutNameLinter'                     => FeatureWithoutNameLinter.new,
+                        'FeatureWithoutScenariosLinter'                => FeatureWithoutScenariosLinter.new,
+                        'OutlineWithSingleExampleRowLinter'            => OutlineWithSingleExampleRowLinter.new,
+                        'SingleTestBackgroundLinter'                   => SingleTestBackgroundLinter.new,
+                        'StepWithEndPeriodLinter'                      => StepWithEndPeriodLinter.new,
+                        'StepWithTooManyCharactersLinter'              => StepWithTooManyCharactersLinter.new,
+                        'TestShouldUseBackgroundLinter'                => TestShouldUseBackgroundLinter.new,
+                        'TestWithActionStepAsFinalStepLinter'          => TestWithActionStepAsFinalStepLinter.new,
+                        'TestWithNoActionStepLinter'                   => TestWithNoActionStepLinter.new,
+                        'TestWithNoNameLinter'                         => TestWithNoNameLinter.new,
+                        'TestWithNoVerificationStepLinter'             => TestWithNoVerificationStepLinter.new,
+                        'TestWithSetupStepAfterActionStepLinter'       => TestWithSetupStepAfterActionStepLinter.new,
+                        'TestWithSetupStepAfterVerificationStepLinter' => TestWithSetupStepAfterVerificationStepLinter.new,
+                        'TestWithSetupStepAsFinalStepLinter'           => TestWithSetupStepAsFinalStepLinter.new,
+                        'TestWithTooManyStepsLinter'                   => TestWithTooManyStepsLinter.new }
 
 
   # Configures linters based on the given options
@@ -97,8 +109,15 @@ module CukeLinter
   # Lints the given model trees and file paths using the given linting objects and formatting the results with the given formatters and their respective output locations
   def self.lint(file_paths: [], model_trees: [], linters: self.registered_linters.values, formatters: [[CukeLinter::PrettyFormatter.new]])
 
-    model_trees      = [CukeModeler::Directory.new(Dir.pwd)] if model_trees.empty? && file_paths.empty?
-    file_path_models = file_paths.collect do |file_path|
+    # TODO: Test this?
+    # Because directive memoization is based on a model's `#object_id` and Ruby reuses object IDs over the life
+    # life of a program as objects are garbage collected, it is not safe to remember the IDs forever. However,
+    # models shouldn't get GC'd in the middle of the linting process and so the start of the linting process is
+    # a good time to reset things
+    @directives_for_feature_file = {}
+
+    model_trees                  = [CukeModeler::Directory.new(Dir.pwd)] if model_trees.empty? && file_paths.empty?
+    file_path_models             = file_paths.collect do |file_path|
       # TODO: raise exception unless path exists
       case
         when File.directory?(file_path)
@@ -178,8 +197,7 @@ module CukeLinter
 
 
   def self.linter_directives_for_feature_file(feature_file_model)
-    # IMPORTANT ASSUMPTION: Models never change during the life of the program, so data only has to be gathered once
-    @directives_for_feature_file ||= {}
+    # IMPORTANT ASSUMPTION: Models never change during the life of a linting, so data only has to be gathered once
     return @directives_for_feature_file[feature_file_model.object_id] if @directives_for_feature_file[feature_file_model.object_id]
 
 

data/lib/cuke_linter/linters/example_without_name_linter.rb

@@ -13,7 +13,7 @@ module CukeLinter
 
     # The message used to describe the problem that has been found
     def message
-      'Example has no name'
+      'Example grouping has no name'
     end
 
   end

data/lib/cuke_linter/linters/feature_with_too_many_different_tags_linter.rb

@@ -0,0 +1,38 @@
+module CukeLinter
+
+  # A linter that detects features that contain too many different tags
+
+  class FeatureWithTooManyDifferentTagsLinter < Linter
+
+    # Changes the linting settings on the linter using the provided configuration
+    def configure(options)
+      @tag_threshold = options['TagCountThreshold']
+    end
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Feature)
+
+      tags = model.tags
+
+      model.each_descendant do |descendant_model|
+        if descendant_model.respond_to?(:tags)
+          tags.concat(descendant_model.tags)
+        end
+      end
+
+      tags = tags.collect(&:name).uniq
+
+      @linted_tag_threshold = @tag_threshold || 10
+      @linted_tag_count     = tags.count
+
+      @linted_tag_count > @linted_tag_threshold
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      "Feature contains too many different tags. #{@linted_tag_count} tags found (max #{@linted_tag_threshold})."
+    end
+
+  end
+end

data/lib/cuke_linter/linters/test_should_use_background_linter.rb

@@ -0,0 +1,28 @@
+module CukeLinter
+
+  # A linter that detects scenarios and outlines within a feature that all share common beginning steps
+
+  class TestShouldUseBackgroundLinter < Linter
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Scenario) || model.is_a?(CukeModeler::Outline)
+
+      model_steps          = model.steps || []
+      parent_feature_model = model.get_ancestor(:feature)
+
+      return false unless parent_feature_model.tests.count > 1
+
+      parent_feature_model.tests.all? do |test|
+        test_steps = test.steps || []
+        test_steps.first == model_steps.first
+      end
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      'Test shares steps with all other tests in feature. Use a background.'
+    end
+
+  end
+end

data/lib/cuke_linter/linters/test_with_action_step_as_final_step_linter.rb

@@ -0,0 +1,23 @@
+module CukeLinter
+
+  # A linter that detects scenarios and outlines that have an action step as their final step
+
+  class TestWithActionStepAsFinalStepLinter < Linter
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Scenario) || model.is_a?(CukeModeler::Outline)
+
+      model_steps = model.steps || []
+      return false unless model_steps.last
+
+      model_steps.last.keyword == 'When'
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      "Test has 'When' as the final step."
+    end
+
+  end
+end

data/lib/cuke_linter/linters/test_with_setup_step_after_action_step_linter.rb

@@ -0,0 +1,31 @@
+module CukeLinter
+
+  # A linter that detects scenarios and outlines that have a setup step that comes after an action step
+
+  class TestWithSetupStepAfterActionStepLinter < Linter
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Scenario) || model.is_a?(CukeModeler::Outline)
+
+      model_steps       = model.steps || []
+      action_step_found = false
+
+      model_steps.each do |step|
+        if action_step_found
+          return true if step.keyword == 'Given'
+        else
+          action_step_found = step.keyword == 'When'
+        end
+      end
+
+      false
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      "Test has 'Given' step after 'When' step."
+    end
+
+  end
+end

data/lib/cuke_linter/linters/test_with_setup_step_after_verification_step_linter.rb

@@ -0,0 +1,31 @@
+module CukeLinter
+
+  # A linter that detects scenarios and outlines that have a setup step that comes after a verification step
+
+  class TestWithSetupStepAfterVerificationStepLinter < Linter
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Scenario) || model.is_a?(CukeModeler::Outline)
+
+      model_steps             = model.steps || []
+      verification_step_found = false
+
+      model_steps.each do |step|
+        if verification_step_found
+          return true if step.keyword == 'Given'
+        else
+          verification_step_found = step.keyword == 'Then'
+        end
+      end
+
+      false
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      "Test has 'Given' step after 'Then' step."
+    end
+
+  end
+end

data/lib/cuke_linter/linters/test_with_setup_step_as_final_step_linter.rb

@@ -0,0 +1,23 @@
+module CukeLinter
+
+  # A linter that detects scenarios and outlines that have a setup step as their final step
+
+  class TestWithSetupStepAsFinalStepLinter < Linter
+
+    # The rule used to determine if a model has a problem
+    def rule(model)
+      return false unless model.is_a?(CukeModeler::Scenario) || model.is_a?(CukeModeler::Outline)
+
+      model_steps = model.steps || []
+      return false unless model_steps.last
+
+      model_steps.last.keyword == 'Given'
+    end
+
+    # The message used to describe the problem that has been found
+    def message
+      "Test has 'Given' as the final step."
+    end
+
+  end
+end

data/lib/cuke_linter/version.rb

@@ -1,4 +1,4 @@
 module CukeLinter
   # The release version of this gem
-  VERSION = "0.9.0"
+  VERSION = '0.10.0'
 end

data/testing/cucumber/features/default_linters.feature

@@ -8,20 +8,26 @@ Feature: Default Linters
   Scenario: Using the default linters
     Given no other linters have been registered or unregistered
     Then the following linters are registered by default
-      | BackgroundDoesMoreThanSetupLinter |
-      | ElementWithTooManyTagsLinter      |
-      | ExampleWithoutNameLinter          |
-      | FeatureWithoutDescriptionLinter   |
-      | FeatureWithoutNameLinter          |
-      | FeatureWithoutScenariosLinter     |
-      | OutlineWithSingleExampleRowLinter |
-      | SingleTestBackgroundLinter        |
-      | StepWithEndPeriodLinter           |
-      | StepWithTooManyCharactersLinter   |
-      | TestWithNoActionStepLinter        |
-      | TestWithNoNameLinter              |
-      | TestWithNoVerificationStepLinter  |
-      | TestWithTooManyStepsLinter        |
+      | BackgroundDoesMoreThanSetupLinter            |
+      | ElementWithTooManyTagsLinter                 |
+      | ExampleWithoutNameLinter                     |
+      | FeatureWithTooManyDifferentTagsLinter        |
+      | FeatureWithoutDescriptionLinter              |
+      | FeatureWithoutNameLinter                     |
+      | FeatureWithoutScenariosLinter                |
+      | OutlineWithSingleExampleRowLinter            |
+      | SingleTestBackgroundLinter                   |
+      | StepWithEndPeriodLinter                      |
+      | StepWithTooManyCharactersLinter              |
+      | TestShouldUseBackgroundLinter                |
+      | TestWithActionStepAsFinalStepLinter          |
+      | TestWithNoActionStepLinter                   |
+      | TestWithNoNameLinter                         |
+      | TestWithNoVerificationStepLinter             |
+      | TestWithSetupStepAfterActionStepLinter       |
+      | TestWithSetupStepAfterVerificationStepLinter |
+      | TestWithSetupStepAsFinalStepLinter           |
+      | TestWithTooManyStepsLinter                   |
 
 
   Scenario: Registering new linters

data/testing/cucumber/features/linters/example_without_name.feature

@@ -1,8 +1,8 @@
 Feature: Example without name linter
 
   As a reader of documentation
-  I want every example to have a name
-  So that I can understand the significance of the example grouping
+  I want every example grouping to have a name
+  So that I can understand the significance of the example data
 
 
   Scenario: Linting
@@ -13,18 +13,20 @@ Feature: Example without name linter
 
         Scenario Outline:
           * a step
-        Examples:
+
+        Examples: Happy paths!
           | param |
           | value |
+
+        # Unknown paths :(
         Examples:
           | param |
           | value |
       """
     When it is linted
     Then an error is reported:
-      | linter                   | problem             | location         |
-      | ExampleWithoutNameLinter | Example has no name | <path_to_file>:5 |
-      | ExampleWithoutNameLinter | Example has no name | <path_to_file>:8 |
+      | linter                   | problem                      | location          |
+      | ExampleWithoutNameLinter | Example grouping has no name | <path_to_file>:11 |
 
   @wip
   Scenario: Configuration