jk-ferret 0.11.8.2

data/CHANGELOG

@@ -0,0 +1,24 @@
+Fri Oct 20 22:25:37 JST 2006
+  * Added Filter#bits method to built-in Filters.
+  * Added MappingFilter < TokenFilter that can be used to map strings to other
+    strings during analysis. A possible use of this is it to Filter utf-8
+    characters to ascii characters.
+
+Fri Oct 13 09:18:31 JST 2006
+  * Changed documentation to state truthfully that FULL_ENGLISH_STOP_WORDS is
+    being used by default in StandardAnalyzer and StopwordFilter.
+  * Removed 'will', 's' and 't' from ENGLISH_STOP_WORDS so that all words in
+    ENGLISH_STOP_WORDS can be found in FULL_ENGLISH_STOP_WORDS, that is
+    ENGLISH_STOP_WORDS is a subset of FULL_ENGLISH_STOP_WORDS.
+
+Thu Oct 12 23:04:19 JST 2006
+  * Fixed adding SortField to Sort object in Ruby. Garbage collection wasn't 
+    working.
+  * Can now set :sort => SortField#new
+
+Tue Oct 10 14:42:17 JST 2006
+  * Fixed MultiTermDocEnum bug introduced in version 0.10.10 during
+    performance enhancements. 
+  * Added Filter#bits(index_reader) method to C implemented filters so that
+    they can be used in Ruby.
+

data/MIT-LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2005-2006 David Balmain
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README

@@ -0,0 +1,90 @@
+= Ferret
+
+Ferret is a Ruby search library inspired by the Apache Lucene search engine for
+Java (http://jakarta.apache.org/lucene/). In the same way as Lucene, it is not
+a standalone application, but a library you can use to index documents and
+search for things in them later.
+
+== Requirements
+
+* Ruby 1.8
+* C compiler to build the extension. Tested with gcc, VC6
+* make (or nmake on windows)
+
+== Installation
+
+  $ sudo gem install ferret
+
+If you don't have rubygems installed you can still install Ferret. Just
+download one of the zipped up versions of Ferret, unzip it and change into the
+unzipped directory. Then run the following set of commands;
+
+  $ ruby setup.rb config
+  $ ruby setup.rb setup
+  $ sudo ruby setup.rb install
+
+== Usage
+
+You can read the TUTORIAL which you'll find in the same directory as this
+README. You can also check the following modules for more specific
+documentation.
+
+* Ferret::Analysis: for more information on how the data is processed when it
+  is tokenized. There are a number of things you can do with your data such as
+  adding stop lists or perhaps a porter stemmer. There are also a number of
+  analyzers already available and it is almost trivial to create a new one
+  with a simple regular expression.
+
+* Ferret::Search: for more information on querying the index. There are a
+  number of already available queries and it's unlikely you'll need to create
+  your own. You may however want to take advantage of the sorting or filtering
+  abilities of Ferret to present your data the best way you see fit.
+
+* Ferret::Document: to find out how to create documents. This part of Ferret
+  is relatively straightforward. If you know how Strings, Hashes and Arrays work
+  Ferret then you'll be able to create Documents.
+
+* Ferret::QueryParser: if you want to find out more about what you can do with
+  Ferret's Query Parser, this is the place to look. The query parser is one
+  area that could use a bit of work so please send your suggestions.
+
+* Ferret::Index: for more advanced access to the index you'll probably want to
+  use the Ferret::Index::IndexWriter and Ferret::Index::IndexReader. This is
+  the place to look for more information on them.
+
+* Ferret::Store: This is the module used to access the actual index storage
+  and won't be of much interest to most people.
+
+=== Performance
+
+We are unaware of any alternatives that can out-perform Ferret while still
+matching it in features.
+
+== Contact
+
+For bug reports and patches I have set up Trac here;
+
+  http://ferret.davebalmain.com/trac
+
+Queries, discussion etc should be addressed to the mailing lists here;
+
+  http://rubyforge.org/projects/ferret/
+
+Alternatively you could create a new page for discussion on the Ferret wiki;
+
+  http://ferret.davebalmain.com/trac
+
+Of course, since Ferret was ported from Apache Lucene, most of what you can
+do with Lucene you can also do with Ferret.
+
+== Authors
+
+[<b>David Balmain</b>] Port to Ruby
+
+[The Apache Software Foundation (Doug Cutting and friends)] Original Apache Lucene
+
+== License
+
+Ferret is available under an MIT-style license.
+
+:include: MIT-LICENSE

data/RELEASE_CHANGES

@@ -0,0 +1,137 @@
+(in /home/dave/w/ferret/ruby)
+------------------------------------------------------------------------
+r830 | dbalmain | 2008-03-01 14:10:47 +1100 (Sat, 01 Mar 2008) | 1 line
+
+A few more updates to the build system
+------------------------------------------------------------------------
+r829 | dbalmain | 2008-03-01 13:55:16 +1100 (Sat, 01 Mar 2008) | 1 line
+
+A few more updates to the build system
+------------------------------------------------------------------------
+r828 | dbalmain | 2008-02-29 10:48:33 +1100 (Fri, 29 Feb 2008) | 1 line
+
+Moved largefile test to a new long_running test directory so that tests can be run more easily
+------------------------------------------------------------------------
+r826 | dbalmain | 2008-02-29 10:09:48 +1100 (Fri, 29 Feb 2008) | 1 line
+
+Updated references to ferret/version.rb. Updated Rakefile to allow release task testing
+------------------------------------------------------------------------
+r825 | dbalmain | 2008-02-29 10:02:27 +1100 (Fri, 29 Feb 2008) | 1 line
+
+Updated Rakefile to clean it up (added namespaces).
+------------------------------------------------------------------------
+r824 | dbalmain | 2008-02-29 10:01:08 +1100 (Fri, 29 Feb 2008) | 1 line
+
+Updated :filter_proc so that custom PostFilter extensions can be built and applied to searches. See ruby/examples/c_extensions/age_filter
+------------------------------------------------------------------------
+r823 | dbalmain | 2008-02-26 18:44:39 +1100 (Tue, 26 Feb 2008) | 1 line
+
+Fixed ticket #277. This will also help with the correct highlighting of matching urls in queries
+------------------------------------------------------------------------
+r822 | dbalmain | 2008-02-22 12:46:48 +1100 (Fri, 22 Feb 2008) | 1 line
+
+Updated to latest posh.h => http://poshlib.hookatooka.com/poshlib/
+------------------------------------------------------------------------
+r821 | dbalmain | 2008-02-22 09:05:25 +1100 (Fri, 22 Feb 2008) | 1 line
+
+Added ruby bindings to MultiMapper for testing in Ruby
+------------------------------------------------------------------------
+r820 | dbalmain | 2008-02-09 14:30:55 +1100 (Sat, 09 Feb 2008) | 1 line
+
+Updated svn:ignore properties to handle new stemmer files
+------------------------------------------------------------------------
+r819 | dbalmain | 2008-02-09 14:27:46 +1100 (Sat, 09 Feb 2008) | 9 lines
+
+Fixed Ticket #337. StemFilter.new now works with 'English', :english or
+'EnGlIsH' and 'UTF_8' or 'utf-8' etc.
+
+Also, good news for Norwegians, Romanians, Turks and Finns. We now have 3 new
+stemmers for Norwegian, Romanian and Turkish and 2 new stop-word lists for
+Finnish and Hungarian. Please try them out and let me know if there are any
+problems.
+
+
+------------------------------------------------------------------------
+r818 | dbalmain | 2008-02-09 13:20:37 +1100 (Sat, 09 Feb 2008) | 1 line
+
+Removed old version of stemmer. Making way for new version. This will break build temporarily
+------------------------------------------------------------------------
+r817 | dbalmain | 2008-02-09 11:55:02 +1100 (Sat, 09 Feb 2008) | 1 line
+
+Added a very useful group_by example.
+------------------------------------------------------------------------
+r816 | dbalmain | 2008-02-09 09:26:20 +1100 (Sat, 09 Feb 2008) | 1 line
+
+Updated documentation for :filter_proc to indicate that you can return a Float to be used to modify the score.
+------------------------------------------------------------------------
+r815 | dbalmain | 2008-02-09 00:27:58 +1100 (Sat, 09 Feb 2008) | 1 line
+
+Made TypedRangeQuery the default range query when used from Ferret::Index::Index
+------------------------------------------------------------------------
+r814 | dbalmain | 2008-02-08 23:16:55 +1100 (Fri, 08 Feb 2008) | 1 line
+
+Made the TypedRangeQuery optional in the query parser
+------------------------------------------------------------------------
+r813 | dbalmain | 2008-02-08 23:12:13 +1100 (Fri, 08 Feb 2008) | 1 line
+
+Added TypedRangeQuery and TypedRangeFilter to the ruby bindings
+------------------------------------------------------------------------
+r812 | dbalmain | 2008-02-08 22:19:31 +1100 (Fri, 08 Feb 2008) | 1 line
+
+Added TypedRangeQuery so that you can do range queries with unpadded numbers
+------------------------------------------------------------------------
+r811 | dbalmain | 2008-02-08 16:22:06 +1100 (Fri, 08 Feb 2008) | 3 lines
+
+Whoops, quick fix. Had unnecessarily nested locks.
+
+
+------------------------------------------------------------------------
+r810 | dbalmain | 2008-02-08 16:17:33 +1100 (Fri, 08 Feb 2008) | 1 line
+
+Added patch for Ticket #340 which adds batch updating and deleting. Made significant modifications from the patch.
+------------------------------------------------------------------------
+r809 | dbalmain | 2008-02-08 13:49:07 +1100 (Fri, 08 Feb 2008) | 18 lines
+
+Added score filter. This enables you to filter the results and modify the score
+to change the sort order.
+
+For example to modify the scoring so that a document with todays date gets
+twice the score factor as a document 50 days ago and four times the score
+factor of a document 100 days ago (ie a half life of 50 days) you would do
+this;
+
+    fifty_day_half_life_filter = lambda do |doc, score, searcher|
+      days = (Date.today() - Date.parse(searcher[doc][:date])).to_i
+      1.0 / (2.0 ** (days.to_f / 50.0))
+    end
+
+    top_docs = @searcher.search(q, :filter_proc => fifty_day_half_life_filter)
+
+
+
+
+------------------------------------------------------------------------
+r808 | dbalmain | 2008-01-11 07:14:01 +1100 (Fri, 11 Jan 2008) | 1 line
+
+Changed unsigned long longs to f_u64 type to fix ticket #336
+------------------------------------------------------------------------
+r807 | dbalmain | 2008-01-11 07:12:40 +1100 (Fri, 11 Jan 2008) | 1 line
+
+Changed unsigned long longs to f_u64 type to fix ticket #336
+------------------------------------------------------------------------
+r806 | dbalmain | 2008-01-11 07:01:00 +1100 (Fri, 11 Jan 2008) | 1 line
+
+Minor comment correction
+------------------------------------------------------------------------
+r805 | dbalmain | 2007-12-12 10:28:23 +1100 (Wed, 12 Dec 2007) | 1 line
+
+Fixed Ticket #332. Added spaces so that code parses correctly.
+------------------------------------------------------------------------
+r804 | dbalmain | 2007-12-03 11:20:34 +1100 (Mon, 03 Dec 2007) | 1 line
+
+Added test for ticket #324
+------------------------------------------------------------------------
+r803 | dbalmain | 2007-12-03 11:12:55 +1100 (Mon, 03 Dec 2007) | 1 line
+
+Fixed Ferret::Index::Index#query_update for ticket #324. Was only updating a maximum of 10 records.
+------------------------------------------------------------------------

data/RELEASE_NOTES

@@ -0,0 +1,60 @@
+The most significant update in this release is that you can now alter the
+scoring, thereby altering the ordering of search results. A great application of
+this is that you can now change the weight of a document based on its age. In
+this example we have 365 day half life, ie a year-old document has half the
+weight of a new document and twice the weight of a 2-year-old document;
+
+    require 'ferret'
+
+    age_weight = lambda do |doc, score, searcher|
+      age = (Date.today - Date.parse(searcher[doc][:date])).to_i
+      1 / 2 ** (age.to_f/365)
+    end
+
+    index = Ferret::I.new
+
+    sales = [
+      { :artist => 'Giovanni Bellini',
+        :date => '2006-10-23',
+        :work => 'Transfiguration'
+      },
+      { :artist => 'Giovanni Bellini',
+        :date => '2008-01-05',
+        :work => 'Pesaro Altarpiece'
+      },
+      { :artist => 'Gentile Bellini',
+        :date => '2008-02-10',
+        :work => 'St. Dominic'
+      },
+    ].each {|doc| index << doc}
+
+    puts index.search('artist:(Giovanni Bellini)').to_s(:work)
+    # =>
+    #   TopDocs: total_hits = 3, max_score = 0.767351 [
+    #           0 "Transfiguration": 0.767351
+    #           1 "Pesaro Altarpiece": 0.767351
+    #           2 "St. Dominic": 0.129147
+    #   ]
+
+    puts index.search('artist:(Giovanni Bellini)',
+                      :filter_proc => age_weight).to_s(:work)
+    # =>
+    #   TopDocs: total_hits = 3, max_score = 0.718006 [
+    #           1 "Pesaro Altarpiece": 0.718006
+    #           0 "Transfiguration": 0.311937
+    #           2 "St. Dominic": 0.129147
+    #   ]
+
+You can also now write your own C extensions to filter the search results. You
+can see an example of this by downloading the source and looking at;
+
+    ferret_unzipped/ruby/examples/c_extensions/age_filter/
+
+Alternatively, you can view the code at;
+
+    http://ferret.davebalmain.com/trac/browser/trunk/ruby/examples/c_extensions?rev=828
+
+Also, good news for Norwegians, Romanians, Turks and Finns. We now have 3 new
+stemmers for Norwegian, Romanian and Turkish and 2 new stop-word lists for
+Finnish and Hungarian. Please try them out and let me know if there are any
+problems.

data/Rakefile

@@ -0,0 +1,443 @@
+require 'rake'
+require 'rake/clean'
+require 'rake/gempackagetask'
+require 'rake/rdoctask'
+require 'rake/testtask'
+
+$:. << 'lib'
+require 'ferret/version'
+
+
+def say(msg='')
+  STDERR.puts msg
+end
+
+def prompt(msg)
+  STDERR.print "#{msg} [Yna]: "
+  while true
+    case STDIN.gets.chomp!
+    when /^(y(es)?)?$/i then return true
+    when /^no?$/i then return false
+    when /^a(bort)?$/i then fail('aborted')
+    else
+      STDERR.print "Sorry, I don't understand. Please type y, n or a: "
+    end
+  end
+end
+
+windows = (RUBY_PLATFORM =~ /win32|cygwin/) rescue nil
+SUDO = windows ? "" : "sudo "
+
+
+task :default => 'test:unit'
+#task :default => :build do
+#  sh "ruby test/unit/index/tc_index.rb"
+#end
+
+  BZLIB_SRC = FileList["../c/lib/bzlib/*.h"] +
+              FileList["../c/lib/bzlib/*.c"].map do |fn|
+                fn.gsub(%r{/([^/]*.c)}, '/BZ_\1')
+              end
+##############################################################################
+# Building
+##############################################################################
+
+task :build => 'build:compile'
+namespace :build do
+  EXT = "ferret_ext.so"
+  # Note: libstemmer.[h] is necessary so that the file isn't included when it
+  # doesn't exist. It needs to have one regular expression element.
+  EXT_SRC = FileList["../c/src/*.[ch]", "../c/include/*.h",
+                     "../c/lib/bzlib/*.[ch]",
+                     "../c/lib/libstemmer_c/src_c/*.[ch]",
+                     "../c/lib/libstemmer_c/runtime/*.[ch]",
+                     "../c/lib/libstemmer_c/libstemmer/*.[ch]",
+                     "../c/lib/libstemmer_c/include/libstemmer.[h]"]
+  EXT_SRC.exclude('../c/**/ind.[ch]',
+                  '../c/**/symbol.[ch]',
+                  '../c/include/threading.h',
+                  '../c/include/scanner.h',
+                  '../c/include/internal.h',
+                  '../c/src/lang.c',
+                  '../c/include/lang.h')
+
+  EXT_SRC_MAP = {}
+  EXT_SRC_DEST = EXT_SRC.map do |fn|
+    ext_fn = File.join("ext", File.basename(fn))
+    if fn =~ /.c$/ and fn =~ /(bzlib|stemmer)/
+      prefix = $1.upcase
+      ext_fn.gsub!(/ext\//, "ext/#{prefix}_")
+    end
+    EXT_SRC_MAP[fn] = ext_fn
+  end
+  SRC = FileList["ext/*.[ch]", EXT_SRC_DEST, 'ext/internal.h'].uniq
+
+  CLEAN.include   ['**/*.o', '**/*.obj', '.config', 'ext/cferret.c']
+  CLOBBER.include ['doc/api', 'ext/*.so', 'ext/Makefile',
+                   'ext/internal.h', EXT_SRC_DEST]
+
+  # The following block creates file tasks for all of the c files. They
+  # belong in the ../c directory in source the working copy and they need
+  # to be linked to in the ext directory
+  EXT_SRC.each do |fn|
+    dest_fn = EXT_SRC_MAP[fn]
+    # prepend lib files to avoid conflicts
+    file dest_fn => fn do |t|
+      ln_sf File.expand_path(fn), File.expand_path(dest_fn)
+
+      if fn =~ /stemmer/
+        # flatten the directory structure for lib_stemmer
+        open(dest_fn) do |in_f|
+          open(dest_fn + ".out", "w") do |out_f|
+            in_f.each do |line|
+              out_f.write(line.sub(/(#include ["<])[.a-z_\/]*\//, '\1'))
+            end
+          end
+        end
+        mv dest_fn + ".out", dest_fn
+      end
+    end
+  end if File.exists?("../c")
+
+  file 'ext/internal.h' => '../c/include/internal.h' do
+    File.open('ext/internal.h', 'w') do |f|
+      File.readlines('../c/include/internal.h').each do |l|
+        next if l =~ /ALLOC/ and l !~ /ZERO|MP_/
+        f.puts(l)
+      end
+    end
+  end
+
+  desc "Build the extension (ferret_ext.so). You'll need a C compiler and Make."
+  task :compile => ["ext/#{EXT}"] + SRC
+
+  file "ext/#{EXT}" => "ext/Makefile" do
+    cd "ext"
+    if windows and ENV['make'].nil?
+      begin
+        sh "nmake"
+      rescue Exception => e
+        path = ':\Program Files\Microsoft Visual Studio\VC98\Bin\VCVARS32.BAT'
+        if File.exists? "f#{path}"
+          sh "f#{path}"
+        elsif File.exists? "c#{path}"
+          sh "c#{path}"
+        else
+          say
+          say "***************************************************************"
+          say "You need to have Visual C++ 6 to build Ferret on Windows."
+          say "If you have it installed, you may need to run;"
+          say ' C:\Program Files\Microsoft Visual Studio\VC98\Bin\VCVARS32.BAT'
+          say "***************************************************************"
+          say
+          raise e
+        end
+        sh "nmake"
+      end
+    else
+      sh "make"
+    end
+    cd ".."
+  end
+
+  file "ext/Makefile" => SRC do
+    cd "ext"
+    `ruby extconf.rb`
+    cd ".."
+  end
+end
+
+##############################################################################
+# Testing
+##############################################################################
+
+task :test => 'test:units'
+namespace :test do
+  desc "Run tests with Valgrind"
+  task :valgrind do
+    sh "valgrind --suppressions=ferret_valgrind.supp " +
+       "--leak-check=yes --show-reachable=yes " +
+       "-v ruby test/unit/index/tc_index_reader.rb"
+  end
+
+  desc "Run all tests"
+  task :all => [ :units ]
+
+  desc "run unit tests in test/unit"
+  Rake::TestTask.new("units" => :build) do |t|
+    t.libs << "test/unit"
+    t.pattern = 'test/unit/t[cs]_*.rb'
+    t.verbose = true
+  end
+  task :unit => :units
+
+  desc "run tests using locally installed gem"
+  Rake::TestTask.new("installed") do |t|
+    t.libs << "test/unit"
+    t.ruby_opts << '-rtest/test_installed'
+    t.pattern = 'test/unit/t[cs]_*.rb'
+    t.verbose = true
+  end
+end
+
+##############################################################################
+# Documentation
+##############################################################################
+
+desc "Generate API documentation"
+task :doc => 'doc:rdoc'
+namespace :doc do
+  if allison = Gem.cache.find_name('allison').last
+    allison_template = File.join(allison.full_gem_path, 'lib/allison.rb')
+  end
+  desc "Generate documentation for the application"
+  $rd = Rake::RDocTask.new do |rdoc|
+    rdoc.rdoc_dir = 'doc/api'
+    rdoc.title    = "Ferret Search Library Documentation"
+    rdoc.options << '--line-numbers'
+    rdoc.options << '--inline-source'
+    rdoc.options << '--charset=utf-8'
+    rdoc.template = allison_template if allison_template
+    rdoc.rdoc_files.include('README')
+    rdoc.rdoc_files.include('TODO')
+    rdoc.rdoc_files.include('TUTORIAL')
+    rdoc.rdoc_files.include('MIT-LICENSE')
+    rdoc.rdoc_files.include('lib/**/*.rb')
+    rdoc.rdoc_files.include('ext/r_*.c')
+    rdoc.rdoc_files.include('ext/ferret.c')
+  end
+
+  desc "Look for TODO and FIXME tags in the code"
+  task :todo do
+    FileList['**/*.rb', 'ext/*.[ch]'].egrep /[#*].*(FIXME|TODO|TBD)/i
+  end
+end
+
+##############################################################################
+# Packaging and Installing
+##############################################################################
+
+PKG_FILES = FileList[
+  'setup.rb',
+  '[-A-Z]*',
+  'lib/**/*.rb', 
+  'lib/**/*.rhtml', 
+  'lib/**/*.css', 
+  'lib/**/*.js', 
+  'test/**/*.rb',
+  'test/**/wordfile',
+  'rake_utils/**/*.rb',
+  'Rakefile',
+  SRC
+]
+
+spec = Gem::Specification.new do |s|
+  
+  #### Basic information.
+  s.name = 'jk-ferret'
+  s.version = Ferret::VERSION
+  s.summary = "Ruby indexing library."
+  s.description = "Ferret is a super fast, highly configurable search library."
+
+  #### Dependencies and requirements.
+  s.add_dependency('rake')
+  s.files = PKG_FILES.to_a
+  s.extensions << "ext/extconf.rb"
+  s.require_path = 'lib'
+  s.bindir = 'bin'
+  s.executables = ['ferret-browser']
+  s.default_executable = 'ferret-browser'
+
+  #### Author and project details.
+  s.author = "David Balmain"
+  s.email = "dbalmain@gmail.com"
+  #s.homepage = "http://ferret.davebalmain.com/trac"
+  s.homepage = "http://github.com/jkraemer/ferret"
+  s.rubyforge_project = "ferret"
+
+  s.has_rdoc = true
+  s.extra_rdoc_files = $rd.rdoc_files.reject { |fn| fn =~ /\.rb$/ }.to_a
+  s.rdoc_options <<
+    '--title' <<  'Ferret -- Ruby Search Library' <<
+    '--main' << 'README' << '--line-numbers' <<
+    'TUTORIAL' << 'TODO'
+
+  key_file = File.expand_path('~/.gem/gem-private_key.pem')
+  key_file = nil unless File.exists?(key_file)
+  cert_file = File.expand_path('~/.gem/gem-public_cert.pem')
+  cert_file = nil unless File.exists?(cert_file)
+  if key_file and cert_file
+    s.signing_key = key_file
+    s.cert_chain  = cert_file
+  end
+
+  if windows
+    s.files = PKG_FILES.to_a + ["ext/#{EXT}"]
+    s.extensions.clear
+    s.platform = Gem::Platform::WIN32
+  else
+    s.platform = Gem::Platform::RUBY
+  end
+end
+
+package_task = Rake::GemPackageTask.new(spec) do |pkg|
+  unless windows
+    pkg.need_zip = true
+    pkg.need_tar = true
+  end
+end
+
+desc "Run :gem and install the resulting gem"
+task :install => :gem do
+  sh "#{SUDO}gem install pkg/ferret-#{Ferret::VERSION}.gem --no-rdoc --no-ri -l"
+end
+
+desc "Run :clobber and uninstall the .gem"
+task :uninstall => :clobber do
+  sh "#{SUDO}gem uninstall ferret"
+end
+
+desc "Same as :install but you must be rootgem"
+task :root_install => :gem do
+  sh "gem install pkg/ferret-#{Ferret::VERSION}.gem --no-rdoc --no-ri -l"
+end
+
+desc "Same as :uninstall but you must be root"
+task :root_uninstall => :clobber do
+  sh "gem uninstall ferret"
+end
+
+def list_changes_since_last_release
+  tag_listing = `svn list svn://davebalmain.com/ferret/tags`
+  last_tag = tag_listing.split("\n").last
+  log = `svn log --stop-on-copy svn://davebalmain.com/ferret/tags/#{last_tag}`
+  first_log = log.split(/-------+/)[-2]
+  last_revision = /^r(\d+)\s+\|/.match(first_log)[1]
+  `svn log .. -rHEAD:#{last_revision}`
+end
+
+desc "List changes since last release"
+task :changes do
+  puts list_changes_since_last_release
+end
+
+if ENV['FERRET_DEV']
+  ##############################################################################
+  # Releasing
+  ##############################################################################
+
+  desc "Generate and upload a new release"
+  task :release => 'release:release'
+  namespace :release do
+    task :release => [:status_check, 'test:all', :package, :tag] do
+      say 
+      say "**************************************************************"
+      say "* Release #{Ferret::VERSION} Complete."
+      say "* Packages ready to upload."
+      say "**************************************************************"
+      say 
+      reversion("lib/ferret/version.rb")
+    end
+
+    # Validate that everything is ready to go for a release.
+    task :status_check do
+      # Are all source files checked in?
+      unless `svn -q --ignore-externals status` =~ /^$/
+        fail "'svn -q status' is not clean ... do you have unchecked-in files?"
+      end
+      
+      say "No outstanding checkins found ... OK"
+    end
+
+    def reversion(fn)
+      new_version = nil
+      begin
+        print "Ferret is currently at #{Ferret::VERSION}. What version now? "
+        new_version = STDIN.gets.chomp!
+      end until prompt("Change to version #{new_version}?")
+      
+      if ENV['RELTEST']
+        say "Would change the version in lib/ferret/version.rb from"
+        say "    #{Ferret::VERSION} => #{new_version}"
+        say "and then commit the changes with the command"
+        say "   svn ci -m \"Updated to version #{new_version}\" " +
+            "lib/ferret/version.rb"
+      else
+        open(fn) do |ferret_in|
+          open(fn + ".new", "w") do |ferret_out|
+            ferret_in.each do |line|
+              if line =~ /^  VERSION\s*=\s*/
+                ferret_out.puts "  VERSION = '#{new_version}'"
+              else
+                ferret_out.puts line
+              end
+            end
+          end
+        end
+        mv fn + ".new", fn
+        sh %{svn ci -m "Updated to version #{new_version}" lib/ferret/version.rb}
+      end
+    end
+
+    # Tag all the SVN files with the latest release number
+    task :tag => :status_check do
+      reltag = "REL-#{Ferret::VERSION}"
+      say "Tagging SVN with [#{reltag}]"
+      if ENV['RELTEST']
+        say "Release Task Testing, skipping SVN tagging. Would do;"
+        say %{svn copy -m "creating release #{reltag}" svn://www.davebalmain.com/ferret/trunk svn://www.davebalmain.com/ferret/tags/#{reltag}}
+      else
+        sh %{svn copy -m "creating release #{reltag}" svn://www.davebalmain.com/ferret/trunk svn://www.davebalmain.com/ferret/tags/#{reltag}}
+      end
+    end
+
+  end
+
+  ##############################################################################
+  # Publishing
+  ##############################################################################
+
+  namespace :publish do
+    PUBLISH_PROMPT = <<-EOF
+      Make sure you updated RELEASE_NOTES and RELEASE_CHANGES and that the
+      package exists. Are you sure you want to continue?
+    EOF
+    desc "Publish gem on rubyforge for download. Will only do the linux version"
+    task :release do
+      exit unless prompt(PUBLISH_PROMPT)
+      require 'rubyforge'
+      require 'rake/contrib/rubyforgepublisher'
+      version = Ferret::VERSION
+
+      packages = %w(gem tgz zip).map {|ext| "pkg/ferret-#{version}.#{ext}"}
+
+      rubyforge = RubyForge.new
+      rubyforge.login
+      rubyforge.add_release('ferret', 'ferret',
+                            "ferret-#{version}", *packages)
+    end
+
+    desc "Publish the documentation"
+    task :docs => 'doc:rdoc' do
+      sh %{rsync -rzv --delete  -e 'ssh -p 8900' doc/api/ davebalmain.com:/var/www/ferret/api}
+    end
+
+    desc "Publish the documentation and release"
+    task :all => [:doc, :release]
+  end
+end
+   
+
+
+
+#
+# In case I ever need to add another racc parser, here's how
+#
+# # Make Parsers ---------------------------------------------------------------
+# 
+# RACC_SRC = FileList["lib/**/*.y"]
+# 
+# task :parsers => RACC_OUT
+# rule(/\.tab\.rb$/ => [proc {|tn| tn.sub(/\.tab\.rb$/, '.y')}]) do |t|
+#   sh "racc #{t.source}" 
+# end