mkbison 0.0.4 → 0.0.5

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 95b6da8ba8118a59aede83a038e4f944bc775af0
-  data.tar.gz: 324be9460b8a0a91c9ca3e5762169bb590dbe66c
+  metadata.gz: 4953dfa30988cbe416adf37cf53b7cc7cb6650e5
+  data.tar.gz: 4d2ca4c185047779a8f1aa998ee27b512ae161f7
 SHA512:
-  metadata.gz: cafb5be27276443cdcda7a92314391c8a4c44e57327c5fe9169ec1985724743ac473eac8deb610fe1570a4977289da8df6047ac6fdc5db4b7d805332eb03f7cd
-  data.tar.gz: 65ecb89dde9730af99122599bc73aef47198274e823ba1708259c01fa0ea26e1b7ed73fc872823b3f581a4cb787afaf3b041e863a5b1398ce3e0c65452a880ba
+  metadata.gz: 3b34b3be1c7e9212793c7b7a4d3efb4bed4ac290e575a54b95f8d0c3c258ed4b67d6e1c7422f7ebd86026ebeaec2c4a634a1813a29805c33e6d9dc6861cd96b6
+  data.tar.gz: 634ec92aa22ec51f382d316f32ea70c152f9a835ba40ccc802a2bb7166eef13b9a0cb3dc0d64fd5e031cd92c5b0031d58d893890a04d21252271a50be0e50e0d

data/.gitignore

@@ -20,3 +20,6 @@ tmp
 *.o
 *.a
 mkmf.log
+
+examples/*/ext
+examples/*/lib

data/README.md

@@ -1,43 +1,31 @@
 # mkbison
 
-TODO: Write a gem description
+`mkbison` is a tool to create native ruby extensions containing [GNU Bison](https://www.gnu.org/software/bison/) generated LALR(1) grammar parsers.
 
 ## Installation
 
-Add this line to your application's Gemfile:
+Add these lines to your application's Gemfile:
 
     gem 'mkbison'
+    gem 'rake-compiler'
 
-And then execute:
-
-    $ bundle
-
-Or install it yourself as:
-
-    $ gem install mkbison
-
-You'll need to install [GNU Bison](https://www.gnu.org/software/bison/) as well, e.g.:
+You'll need to install a GNU Bison version >= 3.0.0 as well, with e.g.:
 
     $ sudo apt-get install bison
 
 ## Usage and Example
 
-The gem installs a command `mkbison` which translates `.rby` files into `.y` Bison grammar files, and generates a native ruby extension to expose the resulting parser.
-
-`.rby` files contain a grammar definition and ruby code. Their syntax mostly mirrors that of Bison grammar files, with the following differences:
+`mkbison` operates on grammar files with a syntax which mostly mirrors the Bison grammar. For example, here is a file which describes basic arithmetic:
 
-   * Actions are written in ruby, rather than C (as is the lex section).
-   * Positional references to semantic values are not allowed.
-   * [Named references](http://www.gnu.org/software/bison/manual/html_node/Named-References.html) should not use a dollar sign `$`.
+**[arithmetic.rby](https://github.com/wioux/mkbison/blob/master/examples/arithmetic/arithmetic.rby)**
+```yacc
 
-For example, here is a mkbison grammar for parsing very simple arithmetic expressions:
-
-**arithmetic.rby**
-```
 %token NUMBER
+%token LPAREN
+%token RPAREN
 
-%left OP_PLUS
-%left OP_MINUS
+%left OP_PLUS  OP_MINUS
+%left OP_TIMES OP_OVER
 
 %%
 
@@ -48,8 +36,14 @@ arithmetic:
 
 expression :
   NUMBER
+| OP_MINUS expression[x]
+  { -x }
+| LPAREN expression[x] RPAREN
+  { x }
 | addition
 | subtraction
+| multiplication
+| division
 ;
 
 addition :
@@ -62,30 +56,24 @@ subtraction :
   { left - right }
 ;
 
+multiplication:
+  expression[left] OP_TIMES expression[right]
+  { left * right }
+;
+
+division:
+  expression[left] OP_OVER expression[right]
+  { left / right }
+;
+
 %%
 
 class Arithmetic
   def lex
-    # skip space
-    while true
-      while (c = self.read) && c =~ /\s/
-      end
-
-      if c == '#'
-        while (char = self.read) && char != "\n"
-        end
-      else
-        break
-      end
-    end
-
+    c = read_over_whitespace
     case c
     when '0'..'9'
-      number = c
-      while (c = self.peak) && ('0'..'9').include?(c)
-        number << self.read
-      end
-
+      number = read_integer(c)
       self.lex_value = number.to_i
       return Tokens::NUMBER
 
@@ -94,30 +82,65 @@ class Arithmetic
 
     when '-'
       return Tokens::OP_MINUS
-    end
 
-    nil
+    when '*'
+      return Tokens::OP_TIMES
+
+    when '/'
+      return Tokens::OP_OVER
+
+    when '('
+      return Tokens::LPAREN
+
+    when ')'
+      return Tokens::RPAREN
+
+    else
+      return nil
+    end
   end
 end
 ```
 
-To translate it into a Bison grammar file, run
+The structure here should be recognizable to those familiar with GNU Bison. If you aren't, you might want to [read up on its usage](https://www.gnu.org/software/bison/manual/html_node/index.html) before using `mkbison`.
 
-    $ bundle exec mkbison -n Arithmetic -o . arithmetic.rby
-    $ rake compile
+There are three sections:
+
+   1) Token and precedence definitions
+   2) The description of the grammar
+   3) The lexing implementation
+
+To compile this into a ruby extension which we can use to calculate basic arithmetic expressions, first run `mkbison`:
+
+    $ bundle exec mkbison -n Arithmetic arithmetic.rby
+
+This creates the ruby extension in the current directory (under `lib/` and `ext/` directories). The Bison translation of the grammar can be found at `ext/arithmetic/arithmetic.y`. Once compiled, we'll be able to require it as `'arithmetic'` and use it with `Arithmetic.new(expression).parse`.
+
+Next we'll need to create a `rake` task as follows:
+
+**[Rakefile](https://github.com/wioux/mkbison/blob/master/examples/arithmetic/Rakefile)**
+```ruby
+require "rake/extensiontask"
+
+Rake::ExtensionTask.new "arithmetic" do |ext|
+  ext.lib_dir = "lib/arithmetic"
+end
+```
 
-This will generate and build a native extension named `arithmetic` in the current directory. A class named `Arithmetic` exposes the grammar parser. We can perform calculations now with `Arithmetic.new(expression).parse` which will return the result (or raise an exception if a syntax error is encountered).
+Once we have that, we can compile our extension simply by running
+
+    $ rake compile
 
 ## TODO
+  * Add tests
+  * Support string/character literals in grammar rules
   * Automatically create Rakefile task
-  * Change the parsers initialize() behavior (don't assume argument is file path)
-
-  * Seems like you can hit EOF in the middle of action block and get wrong error msg
-  * Benchmark -- what takes so long on the koa grammar?
   * Write to temp files, then move them into place
   * Move base module into the c extension and document the lexing helpers
+  * Seems like you can hit EOF in the middle of action block and get wrong error msg
+  * Benchmark -- what takes so long on the koa grammar?
 
-Not all Bison features are supported yet.
+Not all Bison features are supported yet...
 
 ## Contributing
 

data/bin/mkbison

@@ -17,6 +17,7 @@ def underscore(name)
 end
 
 options = OpenStruct.new
+options.output = '.'
 
 opts = OptionParser.new do |opts|
   opts.banner += ' grammar_file'
@@ -39,7 +40,7 @@ options.name or abort(opts.help)
 options.output or abort(opts.help)
 
 begin
-  bison = BisonParser.new(grammar_file).parse
+  bison = BisonParser.new(File.open(grammar_file, 'r')).parse
 rescue BisonParser::Error => e
   abort(e.message)
 end
@@ -72,6 +73,7 @@ Tempfile.new('bison-output.c').tap do |output|
   bison = Cocaine::CommandLine.new(ENV['BISON_PATH'] || 'bison', '-o :out :in')
   begin
     bison.run(in: bison_file.path, out: output.path)
+    warn bison.command_error_output
   rescue Cocaine::CommandNotFoundError => e
     warn("The bison command was not found on this system. " +
          "Make sure to install it before attempting rake compile.")

data/bison_parser.rby

@@ -68,8 +68,7 @@ grammar_rule:
 ;
 
 components:
-  { [] }
-| sequence[sequence]
+  sequence[sequence]
   { [sequence] }
 |
   components[sequences] PIPE sequence[sequence]
@@ -104,19 +103,7 @@ class BisonParser
       return Tokens::ACTIONS
     end
 
-    # skip space
-    while true
-      while (c = self.read) && c =~ /\s/
-      end
-
-      if c == '#'
-        while (char = self.read) && char != "\n"
-        end
-      else
-        break
-      end
-    end
-    
+    c = read_over_whitespace(line_comment_prefix: '#')
     return nil unless c
 
     case c

data/examples/arithmetic/Gemfile

@@ -0,0 +1,4 @@
+source "https://rubygems.org"
+
+gem 'mkbison', path: '../..'
+gem 'rake-compiler'

data/examples/arithmetic/Rakefile

@@ -0,0 +1,5 @@
+require "rake/extensiontask"
+
+Rake::ExtensionTask.new "arithmetic" do |ext|
+  ext.lib_dir = "lib/arithmetic"
+end

data/examples/arithmetic/arithmetic.rby

@@ -0,0 +1,80 @@
+%token NUMBER
+%token LPAREN
+%token RPAREN
+
+%left OP_PLUS  OP_MINUS
+%left OP_TIMES OP_OVER
+
+%%
+
+arithmetic:
+  expression[x]
+  { self.result = x }
+;
+
+expression :
+  NUMBER
+| OP_MINUS expression[x]
+  { -x }
+| LPAREN expression[x] RPAREN
+  { x }
+| addition
+| subtraction
+| multiplication
+| division
+;
+
+addition :
+  expression[left] OP_PLUS expression[right]
+  { left + right }
+;
+
+subtraction :
+  expression[left] OP_MINUS expression[right]
+  { left - right }
+;
+
+multiplication:
+  expression[left] OP_TIMES expression[right]
+  { left * right }
+;
+
+division:
+  expression[left] OP_OVER expression[right]
+  { left / right }
+;
+
+%%
+
+class Arithmetic
+  def lex
+    c = read_over_whitespace
+    case c
+    when '0'..'9'
+      number = read_integer(c)
+      self.lex_value = number.to_i
+      return Tokens::NUMBER
+
+    when '+'
+      return Tokens::OP_PLUS
+
+    when '-'
+      return Tokens::OP_MINUS
+
+    when '*'
+      return Tokens::OP_TIMES
+
+    when '/'
+      return Tokens::OP_OVER
+
+    when '('
+      return Tokens::LPAREN
+
+    when ')'
+      return Tokens::RPAREN
+
+    else
+      return nil
+    end
+  end
+end

data/ext/bison_parser/bison_parser.c

@@ -403,7 +403,7 @@ union yyalloc
 /* YYNNTS -- Number of nonterminals.  */
 #define YYNNTS  10
 /* YYNRULES -- Number of rules.  */
-#define YYNRULES  22
+#define YYNRULES  21
 /* YYNSTATES -- Number of states.  */
 #define YYNSTATES  33
 
@@ -454,8 +454,8 @@ static const yytype_uint8 yytranslate[] =
 static const yytype_uint8 yyrline[] =
 {
        0,    37,    37,    50,    56,    67,    73,    84,    92,    96,
-     107,   115,   123,   135,   141,   152,   164,   170,   178,   190,
-     196,   205,   214
+     107,   115,   123,   135,   141,   152,   163,   171,   183,   189,
+     198,   207
 };
 #endif
 
@@ -482,12 +482,12 @@ static const yytype_uint16 yytoknum[] =
 };
 # endif
 
-#define YYPACT_NINF -8
+#define YYPACT_NINF -9
 
 #define yypact_value_is_default(Yystate) \
-  (!!((Yystate) == (-8)))
+  (!!((Yystate) == (-9)))
 
-#define YYTABLE_NINF -20
+#define YYTABLE_NINF -1
 
 #define yytable_value_is_error(Yytable_value) \
   0
@@ -496,10 +496,10 @@ static const yytype_uint16 yytoknum[] =
      STATE-NUM.  */
 static const yytype_int8 yypact[] =
 {
-      -8,    10,    -7,    -8,    -6,    -8,     8,    12,    13,    14,
-      15,    -1,    -8,    -8,    -8,    -8,    -8,    16,     3,    -8,
-      -8,    -3,    -8,    -4,    -2,    -8,    -8,    17,    -8,    -2,
-      18,    11,    -8
+      -9,     9,    -8,    -9,    -7,    -9,     7,    11,    12,    13,
+      14,    -2,    -9,    -9,    -9,    -9,    -9,     6,     2,    -9,
+      -9,    -9,    -9,    -5,    -3,    -9,    -9,    15,    -9,    -3,
+      16,    17,    -9
 };
 
   /* YYDEFACT[STATE-NUM] -- Default reduction number in state STATE-NUM.
@@ -509,14 +509,14 @@ static const yytype_uint8 yydefact[] =
 {
        5,     0,     0,     1,     0,    13,     6,     8,     0,     0,
        0,     3,     9,    12,     7,    10,    11,     0,     0,     2,
-      14,    16,     4,     0,    17,    15,    19,    21,    20,    18,
-       0,     0,    22
+      14,    18,     4,     0,    16,    15,    18,    20,    19,    17,
+       0,     0,    21
 };
 
   /* YYPGOTO[NTERM-NUM].  */
 static const yytype_int8 yypgoto[] =
 {
-      -8,    -8,    -8,    -8,    -8,    -8,    -8,    -8,    -8,     0
+      -9,    -9,    -9,    -9,    -9,    -9,    -9,    -9,    -9,    -6
 };
 
   /* YYDEFGOTO[NTERM-NUM].  */
@@ -528,18 +528,18 @@ static const yytype_int8 yydefgoto[] =
   /* YYTABLE[YYPACT[STATE-NUM]] -- What to do in state STATE-NUM.  If
      positive, shift that token.  If negative, reduce the rule whose
      number is the opposite.  If YYTABLE_NINF, syntax error.  */
-static const yytype_int8 yytable[] =
+static const yytype_uint8 yytable[] =
 {
-     -19,    27,    17,    25,     4,     5,    26,     8,     9,    10,
-       3,    18,    12,   -19,    28,    13,    14,    15,    16,    22,
-      32,    31,    21,     0,     0,    30,    29
+      27,    17,    25,     4,     5,    26,     8,     9,    10,     3,
+      18,    12,    21,    28,    13,    14,    15,    16,    22,    31,
+      29,     0,     0,    30,     0,     0,    32
 };
 
 static const yytype_int8 yycheck[] =
 {
-       3,     3,     3,     7,    11,    12,    10,    13,    14,    15,
-       0,    12,     4,    16,    16,     3,     3,     3,     3,    16,
-       9,     3,     6,    -1,    -1,     8,    26
+       3,     3,     7,    11,    12,    10,    13,    14,    15,     0,
+      12,     4,     6,    16,     3,     3,     3,     3,    16,     3,
+      26,    -1,    -1,     8,    -1,    -1,     9
 };
 
   /* YYSTOS[STATE-NUM] -- The (internal number of the) accessing
@@ -556,16 +556,16 @@ static const yytype_uint8 yystos[] =
 static const yytype_uint8 yyr1[] =
 {
        0,    17,    18,    19,    19,    20,    20,    21,    21,    21,
-      22,    22,    22,    23,    23,    24,    25,    25,    25,    26,
-      26,    26,    26
+      22,    22,    22,    23,    23,    24,    25,    25,    26,    26,
+      26,    26
 };
 
   /* YYR2[YYN] -- Number of symbols on the right hand side of rule YYN.  */
 static const yytype_uint8 yyr2[] =
 {
        0,     2,     4,     0,     2,     0,     2,     3,     1,     2,
-       3,     3,     2,     0,     2,     4,     0,     1,     3,     0,
-       2,     2,     5
+       3,     3,     2,     0,     2,     4,     1,     3,     0,     2,
+       2,     5
 };
 
 
@@ -1486,65 +1486,56 @@ yyreduce:
 #line 164 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
-    (yyval) = rb_funcall(__actions, rb_intern("_0_components_99914b932bd37a50b983c5e7c90ae93b"), 0);
+    rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[0]).first_line), INT2FIX((yylsp[0]).first_column)));
+    (yyval) = rb_funcall(__actions, rb_intern("_0_components_2403a823f1a9854a29da7cf64f191fbe"), 1, (yyvsp[0]));
   }
-#line 1492 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1493 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
   case 17:
-#line 171 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
+#line 172 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
+    rb_ivar_set(__actions, rb_intern("@sequences"), rb_ary_new3(2, INT2FIX((yylsp[-2]).first_line), INT2FIX((yylsp[-2]).first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[0]).first_line), INT2FIX((yylsp[0]).first_column)));
-    (yyval) = rb_funcall(__actions, rb_intern("_1_components_2403a823f1a9854a29da7cf64f191fbe"), 1, (yyvsp[0]));
+    (yyval) = rb_funcall(__actions, rb_intern("_1_components_62da044340939f02b6c0b52917617e17"), 2, (yyvsp[-2]), (yyvsp[0]));
   }
-#line 1502 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1504 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
   case 18:
-#line 179 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
+#line 183 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
-    rb_ivar_set(__actions, rb_intern("@sequences"), rb_ary_new3(2, INT2FIX((yylsp[-2]).first_line), INT2FIX((yylsp[-2]).first_column)));
-    rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[0]).first_line), INT2FIX((yylsp[0]).first_column)));
-    (yyval) = rb_funcall(__actions, rb_intern("_2_components_62da044340939f02b6c0b52917617e17"), 2, (yyvsp[-2]), (yyvsp[0]));
+    (yyval) = rb_funcall(__actions, rb_intern("_0_sequence_99914b932bd37a50b983c5e7c90ae93b"), 0);
   }
 #line 1513 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
   case 19:
 #line 190 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
-    {
-    rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
-    (yyval) = rb_funcall(__actions, rb_intern("_0_sequence_99914b932bd37a50b983c5e7c90ae93b"), 0);
-  }
-#line 1522 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
-    break;
-
-  case 20:
-#line 197 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[-1]).first_line), INT2FIX((yylsp[-1]).first_column)));
     rb_ivar_set(__actions, rb_intern("@code"), rb_ary_new3(2, INT2FIX((yylsp[0]).first_line), INT2FIX((yylsp[0]).first_column)));
     (yyval) = rb_funcall(__actions, rb_intern("_1_sequence_512ceffccf6bb7565046f90d6d7762ad"), 2, (yyvsp[-1]), (yyvsp[0]));
   }
-#line 1533 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1524 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
-  case 21:
-#line 206 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
+  case 20:
+#line 199 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[-1]).first_line), INT2FIX((yylsp[-1]).first_column)));
     rb_ivar_set(__actions, rb_intern("@follower"), rb_ary_new3(2, INT2FIX((yylsp[0]).first_line), INT2FIX((yylsp[0]).first_column)));
     (yyval) = rb_funcall(__actions, rb_intern("_2_sequence_4b2903c3aeb37d22d413a53653d0df28"), 2, (yyvsp[-1]), (yyvsp[0]));
   }
-#line 1544 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1535 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
-  case 22:
-#line 215 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
+  case 21:
+#line 208 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1661  */
     {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX((yyloc).first_line), INT2FIX((yyloc).first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX((yylsp[-4]).first_line), INT2FIX((yylsp[-4]).first_column)));
@@ -1552,11 +1543,11 @@ yyreduce:
     rb_ivar_set(__actions, rb_intern("@tag"), rb_ary_new3(2, INT2FIX((yylsp[-1]).first_line), INT2FIX((yylsp[-1]).first_column)));
     (yyval) = rb_funcall(__actions, rb_intern("_3_sequence_68f2380aa0f3a7de0fb9b3482705a54c"), 3, (yyvsp[-4]), (yyvsp[-3]), (yyvsp[-1]));
   }
-#line 1556 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1547 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
     break;
 
 
-#line 1560 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
+#line 1551 "../../../../ext/bison_parser/bison_parser.c" /* yacc.c:1661  */
       default: break;
     }
   /* User semantic actions sometimes alter yychar, and that requires
@@ -1791,7 +1782,7 @@ yyreturn:
 #endif
   return yyresult;
 }
-#line 226 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1906  */
+#line 219 "../../../../ext/bison_parser/bison_parser.y" /* yacc.c:1906  */
 
 
 static VALUE cBisonParser;

data/ext/bison_parser/bison_parser.y

@@ -160,18 +160,11 @@ grammar_rule:
 ;
 
 components:
-  
-  {
-    rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX(@$.first_line), INT2FIX(@$.first_column)));
-    $$ = rb_funcall(__actions, rb_intern("_0_components_99914b932bd37a50b983c5e7c90ae93b"), 0);
-  }
-
-|
   sequence 
   {
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX(@$.first_line), INT2FIX(@$.first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX(@1.first_line), INT2FIX(@1.first_column)));
-    $$ = rb_funcall(__actions, rb_intern("_1_components_2403a823f1a9854a29da7cf64f191fbe"), 1, $1);
+    $$ = rb_funcall(__actions, rb_intern("_0_components_2403a823f1a9854a29da7cf64f191fbe"), 1, $1);
   }
 
 |
@@ -180,7 +173,7 @@ components:
     rb_ivar_set(__actions, rb_intern("@_"), rb_ary_new3(2, INT2FIX(@$.first_line), INT2FIX(@$.first_column)));
     rb_ivar_set(__actions, rb_intern("@sequences"), rb_ary_new3(2, INT2FIX(@1.first_line), INT2FIX(@1.first_column)));
     rb_ivar_set(__actions, rb_intern("@sequence"), rb_ary_new3(2, INT2FIX(@3.first_line), INT2FIX(@3.first_column)));
-    $$ = rb_funcall(__actions, rb_intern("_2_components_62da044340939f02b6c0b52917617e17"), 2, $1, $3);
+    $$ = rb_funcall(__actions, rb_intern("_1_components_62da044340939f02b6c0b52917617e17"), 2, $1, $3);
   }
 
 ;

data/ext/bison_parser/extconf.rb

@@ -1,9 +1,14 @@
 require 'mkmf'
+require 'shellwords'
 
 output = "#{File.dirname(__FILE__)}/bison_parser.c"
 bison_file = "#{File.dirname(__FILE__)}/bison_parser.y"
 
 bison = find_executable(ENV['BISON_PATH'] || 'bison')
+bison_version = `#{Shellwords.shellescape(bison)} --version`.lines[0]
+if bison_version =~ / [012]\.\d+(\.\d+)?\b/
+  abort("bison version must be >= 3.0.0")
+end
 system(bison, '-o', output, bison_file) or abort("bison command failed")
 
 create_makefile 'bison_parser/bison_parser'

data/lib/bison/version.rb

@@ -1,3 +1,3 @@
 module Bison
-  VERSION = "0.0.4"
+  VERSION = "0.0.5"
 end

data/lib/bison_parser.rb

@@ -12,19 +12,7 @@ class BisonParser
       return Tokens::ACTIONS
     end
 
-    # skip space
-    while true
-      while (c = self.read) && c =~ /\s/
-      end
-
-      if c == '#'
-        while (char = self.read) && char != "\n"
-        end
-      else
-        break
-      end
-    end
-    
+    c = read_over_whitespace(line_comment_prefix: '#')
     return nil unless c
 
     case c

data/lib/bison_parser/actions.rb

@@ -54,15 +54,11 @@ class BisonParser
       Bison::Rule.new(name, components).tap{ |r| r.location = @name }
     end
 
-    def _0_components_99914b932bd37a50b983c5e7c90ae93b()
-      []
-    end
-
-    def _1_components_2403a823f1a9854a29da7cf64f191fbe(sequence)
+    def _0_components_2403a823f1a9854a29da7cf64f191fbe(sequence)
       [sequence]
     end
 
-    def _2_components_62da044340939f02b6c0b52917617e17(sequences, sequence)
+    def _1_components_62da044340939f02b6c0b52917617e17(sequences, sequence)
       sequences << sequence
     end
 

data/lib/bison_parser/base.rb

@@ -1,3 +1,5 @@
+require 'stringio'
+
 class BisonParser
   attr_reader :io
   attr_accessor :lex_value, :token_row, :token_col, :row, :col
@@ -6,12 +8,34 @@ class BisonParser
   module Base
     def initialize(io)
       if String === io
-        io = ::File.open(io, 'r')
+        io = StringIO.new(io)
       end
       @source = io.respond_to?(:path) ? io.path : nil
       @io, @row, @col = io, 1, 0
     end
 
+    def read_over_whitespace(line_comment_prefix: nil)
+      while true
+        while (c = self.read) && c =~ /\s/
+        end
+
+        if line_comment_prefix && c == line_comment_prefix
+          while (char = self.read) && char != "\n"
+          end
+        else
+          break
+        end
+      end
+      c
+    end
+
+    def read_integer(number='')
+      while (c = self.peak) && ('0'..'9').include?(c)
+        number << self.read
+      end
+      number
+    end
+
     def read
       io.read(1).tap do |c|
         if c == "\n"

data/templates/base.rb.erb

@@ -1,3 +1,5 @@
+require 'stringio'
+
 class <%= name %>
   attr_reader :io
   attr_accessor :lex_value, :token_row, :token_col, :row, :col
@@ -6,12 +8,34 @@ class <%= name %>
   module Base
     def initialize(io)
       if String === io
-        io = ::File.open(io, 'r')
+        io = StringIO.new(io)
       end
       @source = io.respond_to?(:path) ? io.path : nil
       @io, @row, @col = io, 1, 0
     end
 
+    def read_over_whitespace(line_comment_prefix: nil)
+      while true
+        while (c = self.read) && c =~ /\s/
+        end
+
+        if line_comment_prefix && c == line_comment_prefix
+          while (char = self.read) && char != "\n"
+          end
+        else
+          break
+        end
+      end
+      c
+    end
+
+    def read_integer(number='')
+      while (c = self.peak) && ('0'..'9').include?(c)
+        number << self.read
+      end
+      number
+    end
+
     def read
       io.read(1).tap do |c|
         if c == "\n"

data/templates/extconf.rb.erb

@@ -1,9 +1,14 @@
 require 'mkmf'
+require 'shellwords'
 
 output = "#{File.dirname(__FILE__)}/<%= uname %>.c"
 bison_file = "#{File.dirname(__FILE__)}/<%= uname %>.y"
 
 bison = find_executable(ENV['BISON_PATH'] || 'bison')
+bison_version = `#{Shellwords.shellescape(bison)} --version`.lines[0]
+if bison_version =~ / [012]\.\d+(\.\d+)?\b/
+  abort("bison version must be >= 3.0.0")
+end
 system(bison, '-o', output, bison_file) or abort("bison command failed")
 
 create_makefile '<%= uname %>/<%= uname %>'

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: mkbison
 version: !ruby/object:Gem::Version
-  version: 0.0.4
+  version: 0.0.5
 platform: ruby
 authors:
 - Peter Woo
@@ -82,6 +82,9 @@ files:
 - Rakefile
 - bin/mkbison
 - bison_parser.rby
+- examples/arithmetic/Gemfile
+- examples/arithmetic/Rakefile
+- examples/arithmetic/arithmetic.rby
 - ext/bison_parser/bison_parser.c
 - ext/bison_parser/bison_parser.y
 - ext/bison_parser/extconf.rb