alf 0.15.0 → 0.16.0

data/CHANGELOG.md

@@ -1,482 +1,19 @@
-# 0.13.0 / FIX ME
-
-* Ruby 1.8.x is no longer supported. Please upgrade.
-
-## Enhancements of the shell interface
-
-* When used in shell, the default database is set to the current folder instead of the embedded suppliers and parts example database. This saves you from having to use 'alf --db=.' everytime you want to use .csv or .rash files as base relations. An --examples option allows easily setting the embedded database as default one.
-
-* When used in shell, the default rendering format is set to --text if the standard output is detected to be a tty. This saves you from having to use 'alf ... | alf show' too many times. The behavior of alf in shell, 'alf show' in particular, might be broken for you (see below). Thanks go to @eregontp for this suggestion!
-
-* Added --json output format.
-
-## Enhancements of the ruby interface
-
-* Added Alf.connect for connecting to databases in the easiest possible way:
-
-      Alf.connect("somewhere/to/a/folder") do |conn| ... end
-      Alf.connect("database.sqlite3") do |conn| ... end
-      Alf.connect("postgres://user:password@host/database") ...
-      Alf.connect(adapter: "sqlite", database: "test.sqlite3") ...
-
-* Evaluation of queries are now sent to a connection specifically:
-
-      Alf.connect(...) do |conn|
-        conn.query{ (restrict :suppliers, ->{ status > 10 } )}
-      end
-
-* Alf::Relation now respond to aggregation functions with an object-oriented syntax:
-
-      Relation(...).sum{ qty }
-
-* Alf::Relation(...) (aliased as Alf.relation) now recognize IO objects and Path.like instances and load them with available readers in the easiest possible way:
-
-      Alf::Relation("path/to/a/suppliers.csv")
-      # => Alf::Relation[...]
-
-* Alf::Relation(...) ensures that attribute names are Symbols and symbolize them if needed.
-
-* Added Relation#tuple_extract, aliased as Relation#tuple! that returns the only tuple of the relation, or raises a NoSuchTupleError if no tuple or more than one.
-
-* Added Alf::Tuple(...) that behaves similarly to Alf::Relation(...) but for tuples.
-
-* Added Alf.reader as a convenient shortcut for Alf::Reader.reader.
-
-      Alf.reader("path/to/a/suppliers.csv")
-      # => #<Alf::CSV::Reader:0x007fd554058440 ...>
-
-* Added Alf::Reader#path that always returns a Path instance, unless the reader operates on an IO/StringIO. Use Alf::Reader#input to get the source passed at construction.
-
-* All queries as well as tuple expressions (in restrictions, extensions, summarizations, etc.) are now evaluated in a cleaner and extended scope through a BasicObject extended with all database helpers. This has multiple advantages and one drawback:
-  * It allows you to have all database helpers available in those expressions.
-  * You no longer have to worry about name clashes with Kernel's methods.
-  * Kernel's functions are no longer accessible whithout prefixing with ::Kernel.
-
-* In sync with the previous point, Relation (the class), DUM and DEE are now defined globally (unless you define `ALF_NO_CORE_EXTENSIONS` before loading Alf). Those constants can thus be safely used in query expressions without experiencing a NameError.
-
-* Added a JSON renderer.
-
-## Bug fixes
-
-* The Aggregator class, Summarization type and Summarize operator have been made thread-safe through #happens that now takes a TupleScope instead of a tuple.
-
-* Sequel::Connection#relvar correctly raises a NoSuchRelvarError if no table can be found.
-
-## Broken stuff
-
-* The `heading` operator has been renamed `infer-heading` (Heading -> InferHeading accordingly).
-
-* `Alf.lispy` has been removed from the public API. Please use `connect` instead:
-
-      Alf.lipsy(db_params).query{ ... }
-
-   becomes:
-
-      Alf.connect(db_params) do |conn|
-        conn.query{ ... }
-      end
-
-* The Environment concept as been removed and replaced by Connection. That also means that `environment` readers and writers here have been replaced according to cases. Also, the --env option has been renamed to --db in the shell command. This is a major incompatible change of Alf internals that might break existing code that extends Alf::Environment, Alf::Reader or any subclass.
-
-* Connection#dataset has been replaced to Connection#relvar and now serves relation variables instead of pure iterators.
-
-* You now have to explicitely use 'alf show --text > ...' or 'alf --text ... > ' if you don't want ruby hashes to be outputted to output files. This is a consequence of tty detection that ensures a better shell experience.
-
-* Kernel's functions are no longer accessible in tuple expressions that are executed within a BasicObject's scope.
-
-* The syntax (Relation :relvar_name) is no longer supported as it does not denote a relation literal at all.
-
-* `Iterator#to_rel` has been removed. Use `Iterator#to_relation` instead.
-
-* Renderers are no longer able to coerce their input from a Symbol.
-
-* Renderer.renderers and Renderer.each_renderer have been removed. Use Renderer.all and Renderer.each instead, respectively.
-
-* Reader.readers has been removed. Use Reader.all or Reader.each instead.
-
-* Aggregator.aggregators has been removed. Use Aggregator.all or Aggregator.each instead.
-
-* TupleExpression#call and TupleExpression#[] have been removed.
-
-* TuplePredicate has been replaced by Predicate. The latter is no longer a subclass of TupleExpression.
-
-## Bug fixes
-
-* The backports gem is no longer required on ruby =1.9
-
-# 0.12.2 / 2012-06-12
-
-* Bumped and weakened backports dependency to '~> 2.6'
-
-# 0.12.1 / 2012-03-13
-
-## Enhancements
-
-* Add `Alf::Relation()`, with the same semantics as the main `Relation()` function
-  added in 0.12.0.
-
-## Bugfixes
-
-* Ensure that `Relation()` reads a reader/operator only once.
-* The Sequel environment now correctly uses the jdbc driver when attempting to connect
-  to a sqlite database/file.
-
-# 0.12.0 / 2012-02-09
-
-* Add a Relation() toplevel method that mimics Array(), Integer(), and so on.
-  That method uses Tools::ToRelation which is a set of Myrrha coercion rules.
-  The Relation() method helps building relation "literals" (say) for common
-  cases, such as the following:
-
-      Relation(:name => "Alf")
-      # => (Relation (Tuple :name => "Alf"))
-
-      Relation([{:name => "Alf"}, {:name => "Myrrha"}])
-      # => (Relation (Tuple :name => "Alf"), (Tuple :name => "Myrrha"))
-
-      Relation(:name => ["Alf", "Myrrha"])
-      # => (Relation (Tuple :name => "Alf"), (Tuple :name => "Myrrha"))
-
-# 0.11.1 / 2012-01-25
-
-## Bugfixes
-
-* Fix Aggregator.stddev and Lispy.stddev that were missing
-
-# 0.11.0 / 2012-01-25
-
-## Broken APIs (private sections only)
-
-* All pipe() methods have been removed and replaced by arguments taken at
-  construction time. This affects the implementation of operators and may
-  require changes to contributed readers and renderers.
-* Alf::Operator::Base    -> Alf::Operator::InstanceMethods
-* Alf::Reader::Base      -> Alf::Reader::InstanceMethods
-* Alf::Rendered::Base    -> Alf::Rendered::InstanceMethods
-* Alf::Environment::Base -> Alf::Environment::InstanceMethods
-* Alf::Aggregator::Base  -> Alf::Aggregator::InstanceMethods
-* Alf::Buffer has been removed as well as the Sorted specialization.
-* Alf::Environment::Explicit has been removed as well as associated tools.
-* Ordering#order_of has been removed
-* Ordering#order_by has been removed
-* Alf::Tools.coerce now raise a Alf::CoercionError instead of a Myrrha::Error
-  in case of coercion failure
-
-## On the development side
-
-* Bumped ruby.noe to 1.7.0
-* Bumped rspec to 2.8.0
-* Bumped sequel to 3.30.0
-
-# 0.10.1 / 2011-08-31
-
-## Miscellaneous enhancements
-
-* Added Variance and Stddev aggregation operators; they are available under
-  Aggregator.variance{} and Aggregator.stddev{}, respectively
-* Added a --pretty option to 'alf', whose semantics is delegated to the output
-  renderer. Same option is available on 'alf show'.
-* 'alf show' now accepts an optional ordering argument. This avoids explicitely
-  including non-relational sort invocations in your pipe (sorting should be
-  seen as a displaying issue)
-* Added an options hash to text renderer, :float_format among others
-* Added a --ff option to 'alf show', for float format in text rendering
-
-## Bugfixes
-
-* Alf::Environment::(Folder/Explicit)#dataset now correctly raises a
-  NoSuchDatasetError when the dataset cannot be found, as required by the
-  specification.
-* Alf::Reader.reader now correctly returns a Rash reader when invoked on a
-  StringIO
-
-# 0.10.0 / 2011-08-15
-
-## New recognized data sources
-
-* Alf now provides an Environment implementation on top of a SQL database.
-  This means that SQL tables can now be used as data-sources. This feature
-  relies on the sequel gem ('gem install sequel' is required), that drives
-  recognized SQL servers. Then (don't forget that ALF_OPTS also exists):
-
-      % alf --env=postgres://user:password@host/database show table
-
-* Alf now recognizes and allows manipulating .csv files as first-class data
-  sources. CSV output is also supported of course. Under ruby <= 1.9, the
-  fastercsv gem is required ('gem install fastercsv' is required). Then:
-
-      % alf restrict suppliers.csv -- "city == 'Paris'"    (input)
-      % alf show suppliers --csv                           (output)
-
-* Alf now recognizes and allows manipulating .log files as first-class data
-  sources. This feature relies on request-log-analyzer gem that provides the
-  parsers that Alf uses, and the log formats it recognizes
-  ('gem install request-log-analyzer' is required). See examples/logs.
-
-## New operators and enhancements
-
-* A GENERATOR operator is introduced. It allows generating a relation with one
-  auto-number attribute, up to a given size.
-
-* A COERCE operator is introduced. It provides a quick way to obtain type-safe
-  relations from type-unsafe sources like .csv files. For example:
-
-      % alf coerce mydirtyfile.csv -- name String  price Float  at Time
-
-  The coerce operator is of course available in Ruby as well:
-
-      (coerce "mydirtyfile.csv", :name => String, :price => Float, :at => Time)
-
-* The DEFAULTS (non-relational) operator now accepts default values as tuple
-  expressions. When used in shell, provided default values are now evaluated
-  that way. This allows specifying default values as being computed on the
-  current tuple.
-
-* Aggregations in the Lispy DSL must not be prefixed by Agg:: anymore.
-
-## Miscellaneous enhancements
-
-* Added 'alf --input-reader' to specify $stdin format (csv, rash, etc.)
-* Added 'alf -Ipath' that mimics ruby's -I (add path to $LOAD_PATH before run)
-* Lispy#run supports command arguments to be passed as a string
-* Lispy#run supports piped commands, with '|' as in shell
-
-## Hurting changes to Lispy DSL (and therefore to Relation)
-
-* The attribute-name syntax of aggregation operators has been removed. The Agg::
-  prefix must not be specified anymore.
-
-      Agg::sum(:qty)    # !! error !!
-      Agg::sum{ qty }   # !! error !!
-      sum{ qty }        # simply, and only!
-
-* The group aggregation operator has been removed. It will probably be replaced
-  in a future version. In the meantime, the GROUP relational operator allows
-  obtaining similar results.
-
-* Lispy syntax of CLIP has changed (when used with --allbut option)
-
-      (clip :suppliers, [:name, :city], true)                           (before)
-      (clip :suppliers, [:name, :city], :allbut => true)                (after)
-
-* Lispy syntax of DEFAULTS has changed (when used with --strict option)
-
-      (defaults :suppliers, {:country => 'Belgium'}, true)              (before)
-      (defaults :suppliers, {:country => 'Belgium'}, :strict => true)   (after)
-
-* Lispy syntax of GROUP has changed (when used with --allbut option)
-
-      (group :supplies, [:sid], :supplying, true)                       (before)
-      (group :supplies, [:sid], :supplying, :allbut => true)            (after)
-
-* Lispy syntax of PROJECT has changed (when used with --allbut option)
-
-      (project :suppliers, [:name, :city], true)                        (before)
-      (project :suppliers, [:name, :city], :allbut => true)             (after)
-
-* Lispy syntax of SUMMARIZE has changed (when used with --allbut option)
-
-      (summarize :supplies, [:qty, :pid], {...}, true)                  (before)
-      (summarize :supplies, [:qty, :pid], {...}, :allbut => true)       (after)
-
-## Hurting changes in shell
-
-* The attribute-name syntax of aggregation operators has been removed
-
-      sum(:qty)   # !! error !!
-      sum{ qty }  # works
-
-* Shell syntax of GROUP has changed (option separator before introduced name)
-
-      % alf --text group supplies  -- pid qty supplying                 (before)
-      % alf --text group supplies  -- pid qty -- supplying              (after)
-
-* Shell syntax of WRAP has changed (option separator before introduced name)
-
-      % alf --text wrap suppliers -- city status loc_and_status         (before)
-      % alf --text wrap suppliers -- city status -- loc_and_status      (after)
-
-* Shell syntax of QUOTA has changed (--by and --order become pure arguments)
-
-      % alf quota supplies --by=sid --order=qty -- position count sum_qty "sum{ qty }" (before)
-      % alf quota supplies -- sid -- qty -- position count sum_qty "sum{ qty }"        (after)
-
-* Shell syntax of RANK has changed (--order becomes a pure argument)
-
-      % alf rank parts --order=weight,desc,pid,asc -- position          (before)
-      % alf rank parts -- weight desc pid asc -- position               (after)
-
-* Shell syntax of SUMMARIZE has changed (--by becomes a pure argument)
-
-      % alf summarize supplies --by=sid -- total_qty "sum{ qty }"        (before)
-      % alf summarize supplies -- sid -- total_qty "sum{ qty }"          (after)
-
-## Bug fixes
-
-* [In shell] Options are now correctly parsed in presence of option separators.
-  That is, every argument after a '--' separator is considered a non-option
-  argument.
-
-# 0.9.3 / 2011-07-23
-
-## New operators (available both in shell and in Lispy DSL)
-
-* Added MATCHING and NOT MATCHING operators. These operators are useful
-  shortcuts for the following expressions.
-
-      (matching     l, r) := (project (join l, r), [l's attributes])
-      (not_matching l, r) := (minus l, (matching l, r))
-
-  For example:
-
-      # Give suppliers who supply at least one part
-      (matching suppliers, supplies)
-
-      # Give suppliers who don't supply any part
-      (not_matching suppliers, supplies)
-
-* Added RANK operator, which is useful for for computing quota queries as
-  illustrated below. See 'alf help rank' for details.
-
-      # Give the three heaviest parts
-      (restrict (rank :parts, [[:weight, :desc]], :pos), lambda{ pos < 3 })
-
-## Enhancements when using Alf in shell
-
-* added 'alf -r', that mimics 'ruby -r' (require library before run)
-
-* When alf is invoked in shell (and only in this case), ALF_OPTS is used as
-  global options to apply as if they were specified inline:
-
-      % export ALF_OPTS="--env=. --yaml"
-      % alf show suppliers
-
-  is the same as
-
-      % alf --env=. --yaml show suppliers
-
-* 'alf --help' now distinguishes experimental operators (quota in particular)
-  from those coming from the (much more stable) **Tutorial D** specification. The
-  former should be used with care as their specification may change at any
-  time.
-
-## Enhancements when using Alf in Ruby
-
-* Alf.lispy now accepts any argument recognized by Environment.autodetect; it
-  obtains its working Environment that way. Among others:
-
-      Alf.lispy(Alf::Environment.folder("path/to/an/existing/folder"))
-
-  is the same as:
-
-      Alf.lispy("path/to/an/existing/folder")
-
-* Added Relation::DUM and Relation::DEE constants (relations of empty heading
-  with no and one tuple, respectively). They are also available as DUM and DEE
-  in Lispy functional expressions.
-
-* Added a Heading abstraction, as a set of attribute (name, type) pairs.
-
-## Internal enhancements (extension points)
-
-* The Reader and Renderer classes accept a Hash of options as third
-  constructor argument. These options can be used by extension points.
-
-* The Environment class now provides a class-based registering mechanism 'ala'
-  Reader and Renderer. This allows auto-detecting the target environment when
-  --env=... is used in shell. See Environment.autodetect and
-  Environment#recognizes? for contributing to this extension point.
-
-* Internals now rely on Myrrha for code generation. This means that all
-  datatypes can now be safely used in relations and dumped to .rash files in
-  particular.
-
-## Bug fixes
-
-* Added Relation#allbut, forgotten in two previous releases
-* Fixed (join xxx, DEE) and (join xxx, DUM)
-* Fixed scoping bug when using attributes named :path, :expr or :block in
-  Lispy compiled expressions (coming from .alf files)
-* Fixed 'alf --yaml show suppliers' that renderer a --text table instead of
-  a yaml output
-* Fixed bugs when using Date and Time attributes with .rash files
-* Fixed bugs when using Date and Time attributes in restrict expressions
-  compiled from the commandline
-* Fixed a few bugs when using attribute names that are ruby keywords
-  (restrict & extend)
-
-# 0.9.2 / 2011.07.13
-
-# Bug fixes
-
-* Fixed the "alf show" command (undefined method `chain')
-
-# 0.9.1 / 2011.07.13
-
-## Enhancements (public APIs)
-
-* Added the in-memory Alf::Relation data structure and associated tooling.
-  This allows using Alf in a object-oriented usual way, in addition to the
-  functional DSL:
-
-      Alf.lispy.evaluate {
-        (join (restrict :suppliers, lambda{ status > 10 }), :cities)
-      }
-
-  is equivalent to
-
-      suppliers, cities = [...], [...]
-      suppliers.restrict(lambda{ status > 10 }).join(cities)
-
-  see README about how to obtain suppliers and cities relations in the first
-  place.
-
-* Summarize now accepts a --allbut option, to specify 'by' attributes from an
-  exclusion perspective
-
-* .alf files are now evaluated in such a way that backtraces are "traceability
-  friendly"
-
-## Non backward-compatible changes to public APIs
-
-* Lispy#with has been removed because not being stable enough. The clean way
-  of reusing sub-queries is as follows (non purely functional, so far)
-
-      kept_suppliers = (restrict :suppliers, lambda{ status > 10 })
-      with_countries = (join kept_suppliers, :cities)
-      supplying      = (join with_countries, :supplies)
-      (summarize supplying,
-                 [:country],
-                 :which => Agg::group(:pid),
-                 :total => Agg::sum{ qty })
-
-* As a consequence, named data sources (Symbols, like :suppliers above) are
-  now resolved at compile time, which is less powerful, yet much simpler and
-  sound.
-
-* Nest and Unnest have been renamed to Wrap and Unwrap respectively. This is
-  to better conform to **Tutorial D**'s terminology.
-
-* Lispy#chain was kept public in 0.9.0 by error and has been entirely removed
-  from the DSL.
-
-## Enhancements (internals)
-
-* Reader.reader delegates to Reader.coerce when its first argument is not
-  a String. This allows calling Reader.reader(args.first || $stdin) in quickl
-  commands for example.
-
-* Operator, Operator::Relational and Operator::NonRelational have a .each
-  class method that yields operator classes
-
-## Bug fixes
-
-* Fixed a bug that led to an Nil error when using unary operators on $stdin
-* Fixed a bug when summarizing or sorting on Symbol attributes with ruby 1.8
-* Fixed numerous crashes under rubinius
-
-# 0.9.0 / 2011.06.19
-
-## Enhancements
-
-* Birthday!
+# 0.16.0 - 2014-02-18
+
+* Fixed SQL compilation when projecting over set operators (minus, union,
+  intersection)
+* Fixed SQL compilation of join with DEE/DUM.
+* Removed `is_table_dee` attribute when projecting all attributes away from
+  a SQL data source.
+* Fixed compilation of shortcut operators involving complex expressions.
+* Fixed Tuple() that now accepts no arg and returns an empty tuple.
+* Fixed "comparison failure" errors in the presence of `nil`. You should NOT
+  use `nil`, but robustness is probably necessary anyway.
+* Added the ability to load a .rash file through Path#load. Result is an array
+  of hashes.
+* Fixed default signature of Hierarchize.
+* Added a basic `image` operator as a shortcut expression.
+
+# 0.15.0 - 2013-11-01
+
+New birthday.

data/Gemfile

@@ -7,6 +7,7 @@ group :runtime do
   gem "alf-shell",  path: "./alf-shell"
   gem "alf-sequel", path: "./alf-sequel"
   gem "alf-rack",   path: "./alf-rack"
+  gem "alf-repl",   path: "./alf-repl"
 end
 
 group :test do
@@ -15,9 +16,18 @@ group :test do
   gem "sqlite3", "~> 1.3",      :platforms => ['mri', 'rbx']
   gem "jdbc-sqlite3", "~> 3.7", :platforms => ['jruby']
   gem "pg", "~> 0.14",          :platforms => ['mri', 'rbx']
+  gem "highline", "~> 1.6"
 end
 
 group :release do
   gem "rake", "~> 10.1"
   gem "rspec", "~> 2.14"
 end
+
+group :devel do
+  gem "rack", "~> 1.5"
+  gem "rack-robustness", "~> 1.1"
+  gem "sinatra", "~> 1.4"
+  gem "wlang", "~> 2.2"
+  gem "sprockets", "~> 2.10"
+end

data/Gemfile.lock

@@ -1,17 +1,18 @@
 PATH
   remote: .
   specs:
-    alf (0.15.0)
-      alf-core (~> 0.15.0)
-      alf-rack (~> 0.15.0)
-      alf-sequel (~> 0.15.0)
-      alf-shell (~> 0.15.0)
-      alf-sql (~> 0.15.0)
+    alf (0.16.0)
+      alf-core (~> 0.16.0)
+      alf-rack (~> 0.16.0)
+      alf-repl (~> 0.16.0)
+      alf-sequel (~> 0.16.0)
+      alf-shell (~> 0.16.0)
+      alf-sql (~> 0.16.0)
 
 PATH
   remote: ./alf-core
   specs:
-    alf-core (0.15.0)
+    alf-core (0.16.0)
       domain (~> 1.0)
       myrrha (~> 3.0)
       path (~> 1.3)
@@ -20,39 +21,57 @@ PATH
 PATH
   remote: ./alf-rack
   specs:
-    alf-rack (0.15.0)
-      alf-core (~> 0.15.0)
+    alf-rack (0.16.0)
+      alf-core (= 0.16.0)
       rack (~> 1.5)
       rack-accept (~> 0.4.5)
       ruby_cop (~> 1.0)
 
+PATH
+  remote: ./alf-repl
+  specs:
+    alf-repl (0.16.0)
+      alf-core (= 0.16.0)
+      alf-rack (= 0.16.0)
+      rack (~> 1.5)
+      rack-robustness (~> 1.1)
+      sinatra (~> 1.4)
+      sprockets (~> 2.10)
+      wlang (~> 2.2)
+
 PATH
   remote: ./alf-sequel
   specs:
-    alf-sequel (0.15.0)
-      alf-core (~> 0.15.0)
-      alf-sql (~> 0.15.0)
+    alf-sequel (0.16.0)
+      alf-core (= 0.16.0)
+      alf-sql (= 0.16.0)
       sequel (~> 4.2)
 
 PATH
   remote: ./alf-shell
   specs:
-    alf-shell (0.15.0)
-      alf-core (~> 0.15.0)
+    alf-shell (0.16.0)
+      alf-core (= 0.16.0)
+      highline (~> 1.6)
       quickl (~> 0.4.3)
 
 PATH
   remote: ./alf-sql
   specs:
-    alf-sql (0.15.0)
-      alf-core (~> 0.15.0)
+    alf-sql (0.16.0)
+      alf-core (= 0.16.0)
       sexpr (~> 0.6.0)
 
 GEM
   remote: http://rubygems.org/
   specs:
+    backports (2.8.2)
+    citrus (2.4.1)
     diff-lcs (1.2.4)
     domain (1.0.0)
+    highline (1.6.20)
+    hike (1.2.3)
+    multi_json (1.8.2)
     myrrha (3.0.0)
       domain (~> 1.0)
     path (1.3.3)
@@ -61,6 +80,9 @@ GEM
     rack (1.5.2)
     rack-accept (0.4.5)
       rack (>= 0.4)
+    rack-protection (1.5.1)
+      rack
+    rack-robustness (1.1.0)
     rake (10.1.0)
     rspec (2.14.1)
       rspec-core (~> 2.14.0)
@@ -71,9 +93,26 @@ GEM
       diff-lcs (>= 1.1.3, < 2.0)
     rspec-mocks (2.14.4)
     ruby_cop (1.0.5)
-    sequel (4.3.0)
+    sequel (4.4.0)
     sexpr (0.6.0)
+    sinatra (1.4.4)
+      rack (~> 1.4)
+      rack-protection (~> 1.4)
+      tilt (~> 1.3, >= 1.3.4)
+    sprockets (2.10.0)
+      hike (~> 1.2)
+      multi_json (~> 1.0)
+      rack (~> 1.0)
+      tilt (~> 1.1, != 1.3.0)
     sqlite3 (1.3.8)
+    temple (0.6.7)
+    tilt (1.4.1)
+    wlang (2.2.3)
+      backports (~> 2.6)
+      citrus (~> 2.4.1)
+      path (~> 1.3)
+      quickl (~> 0.4.3)
+      temple (~> 0.6)
 
 PLATFORMS
   ruby
@@ -82,11 +121,18 @@ DEPENDENCIES
   alf!
   alf-core!
   alf-rack!
+  alf-repl!
   alf-sequel!
   alf-shell!
   alf-sql!
+  highline (~> 1.6)
   jdbc-sqlite3 (~> 3.7)
   pg (~> 0.14)
+  rack (~> 1.5)
+  rack-robustness (~> 1.1)
   rake (~> 10.1)
   rspec (~> 2.14)
+  sinatra (~> 1.4)
+  sprockets (~> 2.10)
   sqlite3 (~> 1.3)
+  wlang (~> 2.2)

data/Rakefile

@@ -7,6 +7,7 @@ SUB_MODULES = %w[
   sequel
   shell
   rack
+  repl
   doc
   rest
 ]

data/alf.gemspec

@@ -125,11 +125,12 @@ Gem::Specification.new do |s|
   #
   s.add_development_dependency("rake", "~> 10.1")
   s.add_development_dependency("rspec", "~> 2.14")
-  s.add_dependency("alf-core", "~> 0.15.0")
-  s.add_dependency("alf-sql", "~> 0.15.0")
-  s.add_dependency("alf-sequel", "~> 0.15.0")
-  s.add_dependency("alf-shell", "~> 0.15.0")
-  s.add_dependency("alf-rack", "~> 0.15.0")
+  s.add_dependency("alf-core", "~> 0.16.0")
+  s.add_dependency("alf-sql", "~> 0.16.0")
+  s.add_dependency("alf-sequel", "~> 0.16.0")
+  s.add_dependency("alf-shell", "~> 0.16.0")
+  s.add_dependency("alf-rack", "~> 0.16.0")
+  s.add_dependency("alf-repl", "~> 0.16.0")
 
   # The version of ruby required by this gem
   #

data/alf.noespec

@@ -4,19 +4,23 @@ template-info:
   manifest:
     Gemfile:
       safe-override: false
+    Gemfile.ci:
+      safe-override: false
     tasks/spec_test.rake:
       ignore: true
     spec/spec_helper.rb:
       ignore: true
     spec/test___lower__.rb:
       ignore: true
+    Rakefile:
+      safe-override: false
 variables:
   lower:
     alf
   upper:
     Alf
   version:
-    0.15.0
+    0.16.0
   summary: |-
     Relational Algebra at your fingertips
   description: |-
@@ -29,10 +33,11 @@ variables:
     - http://rubygems.org/gems/alf
     - http://rubydoc.info/gems/alf
   dependencies:
-    - {name: alf-core,   version: "~> 0.15.0", groups: [runtime]}
-    - {name: alf-sql,    version: "~> 0.15.0", groups: [runtime]}
-    - {name: alf-sequel, version: "~> 0.15.0", groups: [runtime]}
-    - {name: alf-shell,  version: "~> 0.15.0", groups: [runtime]}
-    - {name: alf-rack,   version: "~> 0.15.0", groups: [runtime]}
+    - {name: alf-core,   version: "~> 0.16.0", groups: [runtime]}
+    - {name: alf-sql,    version: "~> 0.16.0", groups: [runtime]}
+    - {name: alf-sequel, version: "~> 0.16.0", groups: [runtime]}
+    - {name: alf-shell,  version: "~> 0.16.0", groups: [runtime]}
+    - {name: alf-rack,   version: "~> 0.16.0", groups: [runtime]}
+    - {name: alf-repl,   version: "~> 0.16.0", groups: [runtime]}
     - {name: rake,       version: "~> 10.1",   groups: [test, release]}
     - {name: rspec,      version: "~> 2.14",   groups: [test, release]}

data/lib/alf/loader.rb

@@ -2,3 +2,5 @@ require "alf-core"
 require "alf-sql"
 require "alf-sequel"
 require "alf-shell"
+require "alf-rack"
+require "alf-repl"

data/lib/alf/version.rb

@@ -2,7 +2,7 @@ module Alf
   module Version
 
     MAJOR = 0
-    MINOR = 15
+    MINOR = 16
     TINY  = 0
 
     def self.to_s

data/spec/dd-operators/test_shortcut_operator.rb

@@ -0,0 +1,19 @@
+require 'test_helpers'
+describe Alf, "the ability to define shortcut operators" do
+
+  class MyShortcutOperator
+    include Alf::Algebra::Shortcut
+    include Alf::Algebra::Unary
+
+    def expand
+      allbut(rename(operand, foo: :bar), [:bar])
+    end
+  end
+
+  it 'works as expected' do
+    input = Relation(foo: 12, baz: 13)
+    expected = Relation(baz: 13)
+    input.my_shortcut_operator.should eq(expected)
+  end
+
+end

data/spec/facade/test_query.rb

@@ -9,4 +9,13 @@ describe Alf, "query" do
     subject.heading.should eq(Heading(sid: String, name: String, status: Integer, city: String))
   end
 
+  it 'should have all tuples of exact same class' do
+    clazz = nil
+    subject.each do |tuple|
+      clazz ||= tuple.class
+      tuple.class.object_id.should eq(clazz.object_id)
+    end
+    clazz.should_not be_nil
+  end
+
 end

data/spec/facade/test_tuple.rb

@@ -0,0 +1,10 @@
+require 'test_helpers'
+describe Alf, "Tuple" do
+
+  it 'supports no attribute at all' do
+    lambda{
+      Tuple()
+    }.should_not raise_error
+  end
+
+end

data/spec/io/suppliers.rash

@@ -0,0 +1 @@
+{sid: "S1", name: "Smith"}

data/spec/io/test_rash_loader.rb

@@ -0,0 +1,12 @@
+require 'test_helpers'
+describe Path, "the .rash registered loader" do
+
+  let(:expected){
+    [{sid: "S1", name: "Smith"}]
+  }
+
+  subject{ (Path.dir/"suppliers.rash").load }
+
+  it{ should eq(expected) }
+
+end

data/spec/operators/test_image.rb

@@ -0,0 +1,33 @@
+require 'test_helpers'
+module Alf
+  module Algebra
+    describe Image do
+
+      context 'on sap' do
+
+        subject{
+          db.connect do |c|
+            c.query{ image(suppliers, supplies, :supplying) }
+          end
+        }
+
+        it{ should be_a(Relation) }
+
+        it 'should have all suppliers' do
+          subject.size.should eq(5)
+        end
+
+        it 'should have the supplying attr' do
+          subject.each do |tuple|
+            tuple.supplying.should be_a(Relation)
+            if tuple.sid == 'S5'
+              tuple.supplying.should be_empty
+            end
+          end
+        end
+
+      end
+
+    end
+  end
+end

data/spec/optimizer/project/minus.yml

@@ -7,3 +7,10 @@
     in Paris and in London, the minus simply returns the left operand. In
     contrast, if we project first then the city information is lost and we
     could restrict the left operand through common names, which is wrong.
+- alf: |-
+    project(minus(suppliers, suppliers_in_paris), [])
+  optimized: |-
+    project(minus(suppliers, suppliers_in_paris), [])
+  comment: |-
+    This is NOT minus(project, project), cfr. counterexample provided by Kim
+    Mens project/master thesis at UCL.

data/spec/regression/test_0001.rb

@@ -0,0 +1,12 @@
+require 'test_helpers'
+describe Alf do
+
+  it 'should allow joining with an empty projection' do
+    db.connect do |conn|
+      rel = conn.query{ join(suppliers, project(suppliers, [])) }
+      exp = conn.query{ suppliers }
+      rel.should eq(exp)
+    end
+  end
+
+end

data/spec/regression/test_0002.rb

@@ -0,0 +1,12 @@
+require 'test_helpers'
+describe Alf do
+
+  it 'should support projecting over no attribute' do
+    db.connect do |conn|
+      rel = conn.query{ project(suppliers, []) }
+      exp = Relation::DEE
+      rel.should eq(exp)
+    end
+  end
+
+end

data/spec/sql/queries/06-join.yml

@@ -205,3 +205,22 @@
 # joining from Relation::DEE
 - alf: |-
     join(Relation::DEE, suppliers)
+# joining with Relation::DEE
+- alf: |-
+    join(suppliers, Relation::DEE)
+# joining with Relation::DEE-like
+- alf: |-
+    join(suppliers, project(suppliers, []))
+  sql: |-
+    SELECT t1.sid, t1.name, t1.status, t1.city
+    FROM suppliers AS t1 WHERE EXISTS(
+      SELECT * FROM suppliers AS t2
+    )
+# joining from Relation::DEE-like
+- alf: |-
+    join(project(suppliers, []), suppliers)
+  sql: |-
+    SELECT t2.sid, t2.name, t2.status, t2.city
+    FROM suppliers AS t2 WHERE EXISTS(
+      SELECT * FROM suppliers AS t1
+    )

data/spec/sql/queries/11-project.yml

@@ -46,3 +46,21 @@
     WHERE EXISTS(
       SELECT TRUE AS is_table_dee
         WHERE EXISTS(SELECT * FROM suppliers AS t1))
+# projection of minus
+- alf: |-
+    project(minus(suppliers, suppliers_in_london), [:sid])
+  sql: |-
+    WITH t3 AS (
+      (SELECT t1.sid, t1.name, t1.status, t1.city FROM suppliers AS t1)
+      EXCEPT
+      (SELECT t2.sid, t2.name, t2.status, t2.city FROM suppliers AS t2 WHERE t2.city = 'London')
+    ) SELECT t3.sid FROM t3 AS t3
+# empty projection of of minus
+- alf: |-
+    project(minus(suppliers, suppliers_in_london), [])
+  sql: |-
+    WITH t3 AS (
+      (SELECT t1.sid, t1.name, t1.status, t1.city FROM suppliers AS t1)
+      EXCEPT
+      (SELECT t2.sid, t2.name, t2.status, t2.city FROM suppliers AS t2 WHERE t2.city = 'London')
+    ) SELECT TRUE AS is_table_dee WHERE EXISTS(SELECT * FROM t3 AS t3)

data/spec/typing/test_typing_on_coerce.rb

@@ -0,0 +1,14 @@
+require 'test_helpers'
+describe Alf, "resulting type on coerce" do
+
+  it 'should use the coerced info' do
+    db.connect do |conn|
+      rel = conn.query{
+        project(coerce(suppliers, status: Integer), [:status])
+      }
+      exp = Relation[status: Integer]
+      rel.class.should eq(exp)
+    end
+  end
+
+end

data/tasks/mod.rake

@@ -47,4 +47,25 @@ namespace :mod do
     end
   end
 
+  desc "Display 'git status' on each sub-module"
+  task :status do
+    in_each_sub_module("git status") do |sub|
+      system "git status"
+    end
+  end
+
+  desc "Run 'git reset --hard' on each sub-module"
+  task :'reset-hard' do
+    in_each_sub_module("git reset --hard") do |sub|
+      system "git reset --hard"
+    end
+  end
+
+  desc "Display 'git diff' on each sub-module"
+  task :diff do
+    in_each_sub_module("git diff") do |sub|
+      system "git diff"
+    end
+  end
+
 end

data/tasks/release.rake

@@ -1,7 +1,51 @@
 namespace :release do
 
+  desc "Bump the version number"
+  task :bump, :to do |t, args|
+    require 'path'
+    raise "Missing version number" unless to = args[:to]
+    in_each_sub_module("bump to #{to}") do |sub|
+      noespec = Path("alf-#{sub}.noespec")
+      content = noespec.read.gsub(/^  version:\n    (.*?)\n/){|x|
+        "  version:\n    #{to}\n"
+      }
+      noespec.write(content)
+      system("noe go -s")
+      system("git commit -a -m 'Bump version to #{to}'")
+    end
+  end
+
+  desc "Set the CHANGELOG 'FIX ME' to the current date"
+  task :stamp do
+    require 'time'
+    require 'path'
+    require 'alf/version'
+    date = Time.now.strftime("%Y-%m-%d")
+    version = Alf::VERSION
+    cmd = "git commit -a -m 'Releasing #{version}'"
+    doit = ->{
+      clog = Path('CHANGELOG.md')
+      clog.write clog.read.gsub(/FIX ME/, date)
+      system(cmd)
+    }
+    in_each_sub_module("stamping CHANGELOG in") do |sub|
+      doit()
+    end
+    doit()
+  end
+
+  desc "Tag the version and push everything"
+  task :tag => :stamp do
+    require 'alf/version'
+    version = Alf::VERSION
+    cmd = "git tag v#{version} && git push origin master --tags"
+    in_each_sub_module("'git tag and push' in") do |sub|
+      system(cmd)
+    end
+  end
+
   desc "Create all gems, including in sub-modules"
-  task :gem do
+  task :gem => :doc do
     cmd = "rm -rf pkg && rake gem"
     in_each_sub_module("'rake gem' in") do |sub|
       system(cmd)
@@ -22,7 +66,7 @@ namespace :release do
   task :go => :gem do
     require 'alf/version'
     version = Alf::VERSION
-    cmd = "gem push pkg/*.gem && git tag v#{version} && git push origin --tags"
+    cmd = "gem push pkg/*.gem"
     in_each_sub_module("'gem push & git tag' in") do |sub|
       system(cmd)
     end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: alf
 version: !ruby/object:Gem::Version
-  version: 0.15.0
+  version: 0.16.0
   prerelease: 
 platform: ruby
 authors:
@@ -9,7 +9,7 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2013-10-31 00:00:00.000000000 Z
+date: 2014-02-18 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rake
@@ -50,7 +50,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
@@ -58,7 +58,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
 - !ruby/object:Gem::Dependency
   name: alf-sql
   requirement: !ruby/object:Gem::Requirement
@@ -66,7 +66,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
@@ -74,7 +74,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
 - !ruby/object:Gem::Dependency
   name: alf-sequel
   requirement: !ruby/object:Gem::Requirement
@@ -82,7 +82,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
@@ -90,7 +90,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
 - !ruby/object:Gem::Dependency
   name: alf-shell
   requirement: !ruby/object:Gem::Requirement
@@ -98,7 +98,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
@@ -106,7 +106,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
 - !ruby/object:Gem::Dependency
   name: alf-rack
   requirement: !ruby/object:Gem::Requirement
@@ -114,7 +114,7 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
@@ -122,7 +122,23 @@ dependencies:
     requirements:
     - - ~>
       - !ruby/object:Gem::Version
-        version: 0.15.0
+        version: 0.16.0
+- !ruby/object:Gem::Dependency
+  name: alf-repl
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.16.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.16.0
 description: Alf brings a beautiful yet powerful relational algebra to the Shell and
   to Ruby.
 email:
@@ -146,11 +162,16 @@ files:
 - Manifest.txt
 - Rakefile
 - README.md
+- spec/dd-operators/test_shortcut_operator.rb
 - spec/facade/test_query.rb
+- spec/facade/test_tuple.rb
+- spec/io/suppliers.rash
+- spec/io/test_rash_loader.rb
 - spec/key-inference/queries.yml
 - spec/key-inference/test_all.rb
 - spec/migrations/test_folder_migration.rb
 - spec/migrations/test_sequel_migration.rb
+- spec/operators/test_image.rb
 - spec/operators/ungroup/grouped.json
 - spec/operators/ungroup/test_on_json_content.rb
 - spec/operators/unwrap/test_on_json_content.rb
@@ -176,6 +197,8 @@ files:
 - spec/optimizer/restrict/sort.yml
 - spec/optimizer/restrict/union.yml
 - spec/optimizer/test_all.rb
+- spec/regression/test_0001.rb
+- spec/regression/test_0002.rb
 - spec/sql/helpers.rb
 - spec/sql/queries/01-leaf-operand.yml
 - spec/sql/queries/02-clip.yml
@@ -197,6 +220,7 @@ files:
 - spec/sql/test_sql_compiler.rb
 - spec/test_alf.rb
 - spec/test_helpers.rb
+- spec/typing/test_typing_on_coerce.rb
 - tasks/doc.rake
 - tasks/fixtures.rake
 - tasks/gem.rake
@@ -217,7 +241,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 825147625363283130
+      hash: -1931769678054539313
 required_rubygems_version: !ruby/object:Gem::Requirement
   none: false
   requirements:
@@ -226,7 +250,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 825147625363283130
+      hash: -1931769678054539313
 requirements: []
 rubyforge_project: 
 rubygems_version: 1.8.25
@@ -234,11 +258,16 @@ signing_key:
 specification_version: 3
 summary: Relational Algebra at your fingertips
 test_files:
+- spec/dd-operators/test_shortcut_operator.rb
 - spec/facade/test_query.rb
+- spec/facade/test_tuple.rb
+- spec/io/suppliers.rash
+- spec/io/test_rash_loader.rb
 - spec/key-inference/queries.yml
 - spec/key-inference/test_all.rb
 - spec/migrations/test_folder_migration.rb
 - spec/migrations/test_sequel_migration.rb
+- spec/operators/test_image.rb
 - spec/operators/ungroup/grouped.json
 - spec/operators/ungroup/test_on_json_content.rb
 - spec/operators/unwrap/test_on_json_content.rb
@@ -264,6 +293,8 @@ test_files:
 - spec/optimizer/restrict/sort.yml
 - spec/optimizer/restrict/union.yml
 - spec/optimizer/test_all.rb
+- spec/regression/test_0001.rb
+- spec/regression/test_0002.rb
 - spec/sql/helpers.rb
 - spec/sql/queries/01-leaf-operand.yml
 - spec/sql/queries/02-clip.yml
@@ -285,3 +316,4 @@ test_files:
 - spec/sql/test_sql_compiler.rb
 - spec/test_alf.rb
 - spec/test_helpers.rb
+- spec/typing/test_typing_on_coerce.rb