engineyard-cucumber 0.3.101

data/features/background.feature

@@ -0,0 +1,311 @@
+Feature: backgrounds
+  In order to provide a context to my scenarios within a feature
+  As a feature editor
+  I want to write a background section in my features.
+
+  Scenario: run a specific scenario with a background
+    When I run cucumber -q features/background/passing_background.feature:9 --require features
+    Then it should pass with
+    """
+    Feature: Passing background sample
+    
+      Background: 
+        Given '10' cukes
+
+      Scenario: another passing background
+        Then I should have '10' cukes
+
+    1 scenario (1 passed)
+    2 steps (2 passed)
+    
+    """
+  
+  Scenario: run a feature with a background that passes
+    When I run cucumber -q features/background/passing_background.feature --require features
+    Then it should pass with
+    """
+    Feature: Passing background sample
+
+      Background: 
+        Given '10' cukes
+
+      Scenario: passing background
+        Then I should have '10' cukes
+
+      Scenario: another passing background
+        Then I should have '10' cukes
+
+    2 scenarios (2 passed)
+    4 steps (4 passed)
+    
+    """
+
+  Scenario: run a feature with scenario outlines that has a background that passes
+    When I run cucumber -q features/background/scenario_outline_passing_background.feature --require features
+    Then it should pass with
+    """
+    Feature: Passing background with scenario outlines sample
+
+      Background: 
+        Given '10' cukes
+
+      Scenario Outline: passing background
+        Then I should have '<count>' cukes
+
+        Examples: 
+          | count |
+          | 10    |
+
+      Scenario Outline: another passing background
+        Then I should have '<count>' cukes
+
+        Examples: 
+          | count |
+          | 10    |
+
+    2 scenarios (2 passed)
+    4 steps (4 passed)
+
+    """
+
+  Scenario: run a feature with scenario outlines that has a background that passes
+    When I run cucumber -q features/background/background_tagged_before_on_outline.feature --require features
+    Then it should pass with
+    """
+    @background_tagged_before_on_outline
+    Feature: Background tagged Before on Outline
+
+      Background: 
+        Given passing without a table
+
+      Scenario Outline: passing background
+        Then I should have '<count>' cukes
+
+        Examples: 
+          | count |
+          | 888   |
+
+    1 scenario (1 passed)
+    2 steps (2 passed)
+
+    """
+
+  @mri186
+  Scenario: run a feature with a background that fails
+    When I run cucumber -q features/background/failing_background.feature --require features
+    Then it should fail with
+    """
+    @after_file
+    Feature: Failing background sample
+
+      Background: 
+        Given failing without a table
+          FAIL (RuntimeError)
+          ./features/step_definitions/sample_steps.rb:2:in `flunker'
+          ./features/step_definitions/sample_steps.rb:16:in `/^failing without a table$/'
+          features/background/failing_background.feature:5:in `Given failing without a table'
+        And '10' cukes
+
+      Scenario: failing background
+        Then I should have '10' cukes
+
+      Scenario: another failing background
+        Then I should have '10' cukes
+
+    Failing Scenarios:
+    cucumber features/background/failing_background.feature:8 # Scenario: failing background
+    
+    2 scenarios (1 failed, 1 skipped)
+    6 steps (1 failed, 5 skipped)
+
+    """
+    And "examples/self_test/tmp/after.txt" should exist
+
+  @mri186
+  Scenario: run a feature with scenario outlines that has a background that fails
+    When I run cucumber -q features/background/scenario_outline_failing_background.feature --require features
+    Then it should fail with
+    """
+    Feature: Failing background with scenario outlines sample
+
+      Background: 
+        Given failing without a table
+          FAIL (RuntimeError)
+          ./features/step_definitions/sample_steps.rb:2:in `flunker'
+          ./features/step_definitions/sample_steps.rb:16:in `/^failing without a table$/'
+          features/background/scenario_outline_failing_background.feature:4:in `Given failing without a table'
+
+      Scenario Outline: failing background
+        Then I should have '<count>' cukes
+
+        Examples: 
+          | count |
+          | 10    |
+
+      Scenario Outline: another failing background
+        Then I should have '<count>' cukes
+
+        Examples: 
+          | count |
+          | 10    |
+
+    2 scenarios (1 failed, 1 skipped)
+    4 steps (1 failed, 3 skipped)
+
+    """
+
+  Scenario: run a feature with a background that is pending
+    When I run cucumber -q features/background/pending_background.feature --require features
+    Then it should pass with
+    """
+    Feature: Pending background sample
+
+      Background: 
+        Given pending
+
+      Scenario: pending background
+        Then I should have '10' cukes
+
+      Scenario: another pending background
+        Then I should have '10' cukes
+
+    2 scenarios (2 undefined)
+    4 steps (2 skipped, 2 undefined)
+
+    """
+
+  @mri186
+  Scenario: background passes with first scenario but fails with second
+    When I run cucumber -q features/background/failing_background_after_success.feature --require features
+    Then it should fail with
+    """
+    Feature: Failing background after previously successful background sample
+
+      Background: 
+        Given passing without a table
+        And '10' global cukes
+
+      Scenario: passing background
+        Then I should have '10' global cukes
+
+      Scenario: failing background
+        And '10' global cukes
+          FAIL (RuntimeError)
+          ./features/step_definitions/sample_steps.rb:2:in `flunker'
+          ./features/step_definitions/sample_steps.rb:37:in `/^'(.+)' global cukes$/'
+          features/background/failing_background_after_success.feature:5:in `And '10' global cukes'
+        Then I should have '10' global cukes
+
+    Failing Scenarios:
+    cucumber features/background/failing_background_after_success.feature:10 # Scenario: failing background
+
+    2 scenarios (1 failed, 1 passed)
+    6 steps (1 failed, 1 skipped, 4 passed)
+
+    """
+
+  Scenario: background with multline args
+  When I run cucumber -q features/background/multiline_args_background.feature --require features
+  Then it should pass with
+    """
+    Feature: Passing background with multiline args
+
+      Background: 
+        Given table
+          | a | b |
+          | c | d |
+        And multiline string
+          \"\"\"
+            I'm a cucumber and I'm okay. 
+            I sleep all night and I test all day
+          \"\"\"
+
+      Scenario: passing background
+        Then the table should be
+          | a | b |
+          | c | d |
+        Then the multiline string should be
+          \"\"\"
+            I'm a cucumber and I'm okay. 
+            I sleep all night and I test all day
+          \"\"\"
+
+      Scenario: another passing background
+        Then the table should be
+          | a | b |
+          | c | d |
+        Then the multiline string should be
+          \"\"\"
+            I'm a cucumber and I'm okay. 
+            I sleep all night and I test all day
+          \"\"\"
+
+    2 scenarios (2 passed)
+    8 steps (8 passed)
+    
+    """
+
+  Scenario: background with name
+    When I run cucumber -q features/background/background_with_name.feature --require features
+    Then it should pass with
+    """
+    Feature: background with name
+
+      Background: I'm a background and I'm ok
+        Given '10' cukes
+
+      Scenario: example
+        Then I should have '10' cukes
+
+    1 scenario (1 passed)
+    2 steps (2 passed)
+    
+    """
+
+  Scenario: https://rspec.lighthouseapp.com/projects/16211/tickets/329
+    Given a standard Cucumber project directory structure
+    And a file named "features/only_background_and_hooks.feature" with:
+      """
+      Feature: woo yeah
+
+        Background:
+          Given whatever
+
+      """
+    And a file named "features/only_background_and_hooks_steps.rb" with:
+      """
+      require 'spec/expectations'
+
+      Before do
+        $before = true
+      end
+
+      After do
+        $after = true
+      end
+
+      Given /^whatever$/ do
+        $before.should == true
+        $step = true
+      end
+
+      at_exit do
+        $before.should == true
+        $step.should == true
+        $after.should == true
+      end
+      """
+    When I run cucumber features/only_background_and_hooks.feature 
+    Then it should pass
+    And the output should be
+      """
+      Feature: woo yeah
+
+        Background:      # features/only_background_and_hooks.feature:3
+          Given whatever # features/only_background_and_hooks_steps.rb:11
+
+      0 scenarios
+      1 step (1 passed)
+      
+      """
+    And STDERR should be empty

data/features/bug_371.feature

@@ -0,0 +1,32 @@
+Feature: https://rspec.lighthouseapp.com/projects/16211/tickets/371
+  Scenario: Before runs once
+    Given a standard Cucumber project directory structure
+    And a file named "features/f.feature" with:
+      """
+      Feature: F
+        Scenario: S
+          Given G
+      """
+    And a file named "features/step_definitions/steps.rb" with:
+      """
+      Before do
+        puts "B"
+      end
+      Given /G/ do
+        puts "G"
+      end
+      """
+    When I run cucumber -q --format pretty --format progress --out progress.txt features/f.feature
+    Then it should pass with
+      """
+      Feature: F
+
+        Scenario: S
+      B
+      G
+          Given G
+
+      1 scenario (1 passed)
+      1 step (1 passed)
+
+      """

data/features/cucumber_cli.feature

@@ -0,0 +1,667 @@
+Feature: Cucumber command line
+  In order to write better software
+  Developers should be able to execute requirements as tests
+
+  Scenario: Run single scenario with missing step definition
+    When I run cucumber -q features/sample.feature:5
+    Then it should pass with      
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+      1 scenario (1 undefined)
+      1 step (1 undefined)
+
+      """
+
+  Scenario: Fail with --strict
+    When I run cucumber -q features/sample.feature:5 --strict
+    Then it should fail with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+            Undefined step: "missing" (Cucumber::Undefined)
+            features/sample.feature:7:in `Given missing'
+
+      1 scenario (1 undefined)
+      1 step (1 undefined)
+
+      """
+
+  Scenario: Succeed with --strict
+    When I run cucumber -q features/sample.feature:10 --strict
+    Then it should pass with
+    """
+    # Feature comment
+    @one
+    Feature: Sample
+
+      # Scenario comment
+      @three
+      Scenario: Passing
+        Given passing
+          | a | b |
+          | c | d |
+
+    1 scenario (1 passed)
+    1 step (1 passed)
+
+    """
+
+  @mri186
+  Scenario: Specify 2 line numbers where one is a tag
+    When I run cucumber -q features/sample.feature:5:16
+    Then it should fail with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        @four
+        Scenario: Failing
+          Given failing
+            \"\"\"
+            hello
+            \"\"\"
+            FAIL (RuntimeError)
+            ./features/step_definitions/sample_steps.rb:2:in `flunker'
+            ./features/step_definitions/sample_steps.rb:9:in `/^failing$/'
+            features/sample.feature:18:in `Given failing'
+      
+      Failing Scenarios:
+      cucumber features/sample.feature:17 # Scenario: Failing
+      
+      2 scenarios (1 failed, 1 undefined)
+      2 steps (1 failed, 1 undefined)
+
+      """
+
+  Scenario: Require missing step definition from elsewhere
+    When I run cucumber -q -r ../../features/step_definitions/extra_steps.rb features/sample.feature:5
+    Then it should pass with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+      1 scenario (1 passed)
+      1 step (1 passed)
+
+      """
+
+  Scenario: Specify the line number of a row
+    When I run cucumber -q features/sample.feature:12
+    Then it should pass with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+      1 scenario (1 passed)
+      1 step (1 passed)
+
+      """
+
+  Scenario: Use @-notation to specify a file containing feature file list
+    When I run cucumber -q @list-of-features.txt
+    Then it should pass with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+      1 scenario (1 passed)
+      1 step (1 passed)
+
+      """
+
+  @mri186
+  Scenario: Run all with progress formatter
+    When I run cucumber -q --format progress features/sample.feature
+    Then it should fail with
+      """
+      U.F
+
+      (::) failed steps (::)
+
+      FAIL (RuntimeError)
+      ./features/step_definitions/sample_steps.rb:2:in `flunker'
+      ./features/step_definitions/sample_steps.rb:9:in `/^failing$/'
+      features/sample.feature:18:in `Given failing'
+
+      Failing Scenarios:
+      cucumber features/sample.feature:17 # Scenario: Failing
+
+      3 scenarios (1 failed, 1 undefined, 1 passed)
+      3 steps (1 failed, 1 undefined, 1 passed)
+
+      """
+
+  Scenario: Run Norwegian
+    Given I am in i18n/no
+    When I run cucumber -q --language no features
+    Then STDERR should be empty
+    Then it should pass with
+      """
+      # language: no
+      Egenskap: Summering
+        For å slippe å gjøre dumme feil
+        Som en regnskapsfører
+        Vil jeg kunne legge sammen
+
+        Scenario: to tall
+          Gitt at jeg har tastet inn 5
+          Og at jeg har tastet inn 7
+          Når jeg summerer
+          Så skal resultatet være 12
+
+        @iterasjon3
+        Scenario: tre tall
+          Gitt at jeg har tastet inn 5
+          Og at jeg har tastet inn 7
+          Og at jeg har tastet inn 1
+          Når jeg summerer
+          Så skal resultatet være 13
+
+      2 scenarios (2 passed)
+      9 steps (9 passed)
+
+      """
+
+  Scenario: --dry-run
+    When I run cucumber --dry-run --no-snippets features/*.feature --tags ~@lots
+    Then it should pass with
+      """
+      Feature: Calling undefined step
+
+        Scenario: Call directly
+          Given a step definition that calls an undefined step
+
+        Scenario: Call via another
+          Given call step "a step definition that calls an undefined step"
+
+      Feature: Failing expectation
+
+        Scenario: Failing expectation
+          Given failing expectation
+
+      Feature: Lots of undefined
+
+        Scenario: Implement me
+          Given it snows in Sahara
+          Given it's 40 degrees in Norway
+          And it's 40 degrees in Norway
+          When I stop procrastinating
+          And there is world peace
+
+      Feature: multiline
+
+        Background: I'm a multiline name
+          which goes on and on and on for three lines
+          yawn
+          Given passing without a table
+
+        Scenario: I'm a multiline name
+          which goes on and on and on for three lines
+          yawn
+          Given passing without a table
+
+        Scenario Outline: I'm a multiline name
+          which goes on and on and on for three lines
+          yawn
+          Given <state> without a table
+
+          Examples: 
+            | state   |
+            | passing |
+    
+        Scenario Outline: name
+          Given <state> without a table
+
+          Examples: I'm a multiline name
+            which goes on and on and on for three lines
+            yawn
+            | state   |
+            | passing |
+
+      Feature: Outline Sample
+
+        Scenario: I have no steps
+
+        Scenario Outline: Test state
+          Given <state> without a table
+          Given <other_state> without a table
+
+          Examples: Rainbow colours
+            | state   | other_state |
+            | missing | passing     |
+            | passing | passing     |
+            | failing | passing     |
+
+          Examples: Only passing
+            | state   | other_state |
+            | passing | passing     |
+
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+        @four
+        Scenario: Failing
+          Given failing
+            \"\"\"
+            hello
+            \"\"\"
+
+      Feature: search examples
+
+        Background: Hantu Pisang background match
+          Given passing without a table
+
+        Scenario: should match Hantu Pisang
+          Given passing without a table
+
+        Scenario: Ignore me
+          Given failing without a table
+
+        Scenario Outline: Ignore me
+          Given <state> without a table
+
+          Examples: 
+            | state   |
+            | failing |
+
+        Scenario Outline: Hantu Pisang match
+          Given <state> without a table
+
+          Examples: 
+            | state   |
+            | passing |
+
+        Scenario Outline: no match in name but in examples
+          Given <state> without a table
+
+          Examples: Hantu Pisang
+            | state   |
+            | passing |
+
+          Examples: Ignore me
+            | state   |
+            | failing |
+
+      @sample_one
+      Feature: Tag samples
+
+        @sample_two @sample_four
+        Scenario: Passing
+          Given missing
+
+        @sample_three
+        Scenario Outline: 
+          Given <state>
+
+          Examples: 
+            | state   |
+            | missing |
+
+        @sample_three @sample_four
+        Scenario: Skipped
+          Given missing
+
+      Feature: Step argument transformations
+      
+        Scenario: transform with matches
+          Then I should transform '10' to an Integer
+      
+        Scenario: transform with matches that capture
+          Then I should transform 'abc' to a Symbol
+
+        Scenario: transform without matches
+          Then I should not transform '10' to an Integer
+
+      Feature: undefined multiline args
+      
+        Scenario: pystring
+          Given a pystring
+            \"\"\"
+              example
+            \"\"\"
+      
+        Scenario: table
+          Given a table
+            | table   |
+            | example |
+
+      29 scenarios (20 skipped, 8 undefined, 1 passed)
+      45 steps (33 skipped, 12 undefined)
+
+      """
+
+  Scenario: Multiple formatters and outputs
+    When I run cucumber --format progress --out tmp/progress.txt --format pretty --out tmp/pretty.txt  --dry-run features/lots_of_undefined.feature
+    And "examples/self_test/tmp/progress.txt" should contain
+      """
+      UUUUU
+
+      1 scenario (1 undefined)
+      5 steps (5 undefined)
+
+      """
+    And "examples/self_test/tmp/pretty.txt" should contain
+      """
+      Feature: Lots of undefined
+
+        Scenario: Implement me
+          Given it snows in Sahara
+          Given it's 40 degrees in Norway
+          And it's 40 degrees in Norway
+          When I stop procrastinating
+          And there is world peace
+      
+      1 scenario (1 undefined)
+      5 steps (5 undefined)
+
+      """
+
+  Scenario: Run feature elements which matches a name using --name
+    When I run cucumber --name Pisang -q features/
+    Then it should pass with
+      """
+      Feature: search examples
+
+        Background: Hantu Pisang background match
+          Given passing without a table
+
+        Scenario: should match Hantu Pisang
+          Given passing without a table
+
+        Scenario Outline: Hantu Pisang match
+          Given <state> without a table
+
+          Examples: 
+            | state   |
+            | passing |
+
+        Scenario Outline: no match in name but in examples
+          Given <state> without a table
+
+          Examples: Hantu Pisang
+            | state   |
+            | passing |
+
+      3 scenarios (3 passed)
+      6 steps (6 passed)
+
+      """
+
+  Scenario: Run a single background which matches a name using --name (Useful if there is an error in it)
+    When I run cucumber --name 'Hantu Pisang background' -q features/
+    Then it should pass with
+      """
+      Feature: search examples
+
+        Background: Hantu Pisang background match
+          Given passing without a table
+
+      0 scenarios
+      1 step (1 passed)
+
+      """
+
+
+  Scenario: Run with a tag that exists on 2 scenarios
+    When I run cucumber -q features --tags three
+    Then it should pass with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+      2 scenarios (1 undefined, 1 passed)
+      2 steps (1 undefined, 1 passed)
+
+      """
+
+  @mri186
+  Scenario: Run with a tag that exists on 1 feature
+    When I run cucumber -q features --tags one
+    Then it should fail with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+        @four
+        Scenario: Failing
+          Given failing
+            \"\"\"
+            hello
+            \"\"\"
+            FAIL (RuntimeError)
+            ./features/step_definitions/sample_steps.rb:2:in `flunker'
+            ./features/step_definitions/sample_steps.rb:9:in `/^failing$/'
+            features/sample.feature:18:in `Given failing'
+
+      Failing Scenarios:
+      cucumber features/sample.feature:17 # Scenario: Failing
+
+      3 scenarios (1 failed, 1 undefined, 1 passed)
+      3 steps (1 failed, 1 undefined, 1 passed)
+
+      """
+
+  Scenario: Run with a negative tag
+    When I run cucumber -q features/sample.feature --dry-run -t ~four
+    Then it should pass with
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+      2 scenarios (1 skipped, 1 undefined)
+      2 steps (1 skipped, 1 undefined)
+
+      """
+
+  Scenario: Run with limited tag number
+     When I run cucumber -q features/tags_sample.feature --dry-run -t sample_three:1
+     Then it should fail with      
+     """
+     @sample_one
+     Feature: Tag samples
+
+       @sample_three
+       Scenario Outline: 
+         Given <state>
+
+         Examples: 
+           | state   |
+           | missing |
+
+       @sample_three @sample_four
+       Scenario: Skipped
+         Given missing
+
+     2 scenarios (2 undefined)
+     2 steps (2 undefined)
+
+     Failed due to exceeding the tag limit
+     @sample_three occurred:2 limit:1
+       features/tags_sample.feature:9
+       features/tags_sample.feature:16
+
+     """
+
+   Scenario: Run with a feature tag which has a limit
+     When I run cucumber -q features/tags_sample.feature --dry-run -t sample_one:1
+     Then it should fail with
+     """
+     @sample_one
+     Feature: Tag samples
+
+       @sample_two @sample_four
+       Scenario: Passing
+         Given missing
+
+       @sample_three
+       Scenario Outline: 
+         Given <state>
+
+         Examples: 
+           | state   |
+           | missing |
+
+       @sample_three @sample_four
+       Scenario: Skipped
+         Given missing
+
+     3 scenarios (3 undefined)
+     3 steps (3 undefined)
+
+     Failed due to exceeding the tag limit
+     @sample_one occurred:3 limit:1
+       features/tags_sample.feature:5
+       features/tags_sample.feature:9
+       features/tags_sample.feature:16
+
+     """
+
+  Scenario: Reformat files with --autoformat
+    When I run cucumber --autoformat tmp/formatted features
+    Then "examples/self_test/tmp/formatted/features/sample.feature" should contain
+      """
+      # Feature comment
+      @one
+      Feature: Sample
+
+        @two @three
+        Scenario: Missing
+          Given missing
+
+        # Scenario comment
+        @three
+        Scenario: Passing
+          Given passing
+            | a | b |
+            | c | d |
+
+        @four
+        Scenario: Failing
+          Given failing
+            \"\"\"
+            hello
+            \"\"\"
+
+
+      """
+
+  Scenario: Generate PDF with pdf formatter
+		When I run cucumber --format pdf --out tmp/sample.pdf --dry-run features/sample.feature
+		Then "examples/self_test/tmp/sample.pdf" should match "Pages 2"
+
+  Scenario: Run feature elements which match a name using -n
+    When I run cucumber -n Pisang -q features/
+    Then it should pass with
+      """
+      Feature: search examples
+
+        Background: Hantu Pisang background match
+          Given passing without a table
+
+        Scenario: should match Hantu Pisang
+          Given passing without a table
+
+        Scenario Outline: Hantu Pisang match
+          Given <state> without a table
+
+          Examples: 
+            | state   |
+            | passing |
+
+        Scenario Outline: no match in name but in examples
+          Given <state> without a table
+
+          Examples: Hantu Pisang
+            | state   |
+            | passing |
+
+      3 scenarios (3 passed)
+      6 steps (6 passed)
+
+      """