nokogiri 1.6.2.rc1-x64-mingw32

data/README.rdoc

@@ -0,0 +1,180 @@
+= Nokogiri {<img src="https://secure.travis-ci.org/sparklemotion/nokogiri.png?rvm=1.9.3" />}[http://travis-ci.org/sparklemotion/nokogiri] {<img src="https://codeclimate.com/github/sparklemotion/nokogiri.png" />}[https://codeclimate.com/github/sparklemotion/nokogiri] {<img src="https://www.versioneye.com/ruby/nokogiri/badge.png" alt="Dependency Status" />}[https://www.versioneye.com/ruby/nokogiri]
+* http://nokogiri.org
+* https://github.com/sparklemotion/nokogiri/wikis
+* https://github.com/sparklemotion/nokogiri/tree/master
+* https://groups.google.com/group/nokogiri-talk
+* https://github.com/sparklemotion/nokogiri/issues
+
+== DESCRIPTION:
+
+Nokogiri (鋸) is an HTML, XML, SAX, and Reader parser.  Among Nokogiri's
+many features is the ability to search documents via XPath or CSS3 selectors.
+
+XML is like violence - if it doesn’t solve your problems, you are not using
+enough of it.
+
+== FEATURES:
+
+* XPath 1.0 support for document searching
+* CSS3 selector support for document searching
+* XML/HTML builder
+
+Nokogiri parses and searches XML/HTML very quickly, and also has
+correctly implemented CSS3 selector support as well as XPath 1.0 support.
+
+== SUPPORT:
+
+Before filing a bug report, please read our {submission guidelines}[http://nokogiri.org/tutorials/getting_help.html] at:
+
+  * http://nokogiri.org/tutorials/getting_help.html
+
+The Nokogiri {mailing list}[https://groups.google.com/group/nokogiri-talk]
+is available here:
+
+  * https://groups.google.com/group/nokogiri-talk
+
+The {bug tracker}[https://github.com/sparklemotion/nokogiri/issues]
+is available here:
+
+  * https://github.com/sparklemotion/nokogiri/issues
+
+The IRC channel is #nokogiri on freenode.
+
+== SYNOPSIS:
+
+  require 'nokogiri'
+  require 'open-uri'
+
+  # Get a Nokogiri::HTML::Document for the page we’re interested in...
+
+  doc = Nokogiri::HTML(open('http://www.google.com/search?q=sparklemotion'))
+
+  # Do funky things with it using Nokogiri::XML::Node methods...
+
+  ####
+  # Search for nodes by css
+  doc.css('h3.r a').each do |link|
+    puts link.content
+  end
+
+  ####
+  # Search for nodes by xpath
+  doc.xpath('//h3/a').each do |link|
+    puts link.content
+  end
+
+  ####
+  # Or mix and match.
+  doc.search('h3.r a.l', '//h3/a').each do |link|
+    puts link.content
+  end
+
+
+== REQUIREMENTS:
+
+* ruby 1.9.3 or higher
+
+* in Nokogiri 1.6.0 and later libxml2 and libxslt are bundled with the
+  gem, but if you want to use them installed on the system:
+
+  * libxml2 >=2.6.17 and <2.9.0, with iconv support
+    (libxml2-dev/-devel is required too)
+
+  * libxslt, built with and supported by the given libxml2
+    (libxslt-dev/-devel is required too)
+
+== ENCODING:
+
+Strings are always stored as UTF-8 internally.  Methods that return
+text values will always return UTF-8 encoded strings.  Methods that
+return XML (like to_xml, to_html and inner_html) will return a string
+encoded like the source document.
+
+*WARNING*
+
+Some documents declare one particular encoding, but use a different
+one. So, which encoding should the parser choose?
+
+Remember that data is just a stream of bytes. Only we humans add
+meaning to that stream. Any particular set of bytes could be valid
+characters in multiple encodings, so detecting encoding with 100%
+accuracy is not possible. libxml2 does its best, but it can't be right
+100% of the time.
+
+If you want Nokogiri to handle the document encoding properly, your
+best bet is to explicitly set the encoding.  Here is an example of
+explicitly setting the encoding to EUC-JP on the parser:
+
+    doc = Nokogiri.XML('<foo><bar /><foo>', nil, 'EUC-JP')
+
+== INSTALL:
+
+* sudo gem install nokogiri
+
+=== Binary packages
+
+Binary packages are available for:
+
+* SuSE[https://download.opensuse.org/repositories/devel:/languages:/ruby:/extensions/]
+* Fedora[http://s390.koji.fedoraproject.org/koji/packageinfo?packageID=6756]
+
+== DEVELOPMENT:
+
+=== Developing on C Ruby (MRI)
+
+Developing Nokogiri requires racc and rexical to generate the parser and
+tokenizer.  To start development, make sure you have `libxml2` and `libxslt`
+installed.
+
+Then install core gems and bootstrap:
+
+    $ gem install hoe rake-compiler mini_portile
+    $ rake newb
+
+=== Developing on JRuby
+
+Currently, development with JRuby depends on CRuby being installed.  With
+CRuby, install racc and rexical:
+
+    $ gem install racc rexical
+
+Make sure hoe and rake compiler are installed with JRuby:
+
+    $ jgem install hoe rake-compiler
+
+Then run rake:
+
+    $ jruby -S rake
+
+== LICENSE:
+
+(The MIT License)
+
+Copyright (c) 2008 - 2013:
+
+* {Aaron Patterson}[http://tenderlovemaking.com]
+* {Mike Dalessio}[http://mike.daless.io]
+* {Charles Nutter}[http://blog.headius.com]
+* {Sergio Arbeo}[http://www.serabe.com]
+* {Patrick Mahoney}[http://polycrystal.org]
+* {Yoko Harada}[http://yokolet.blogspot.com]
+* {Akinori MUSHA}[https://akinori.org]
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+'Software'), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/ROADMAP.md

@@ -0,0 +1,89 @@
+# Roadmap for 2.0
+
+## overhaul serialize/pretty printing API
+
+* https://github.com/sparklemotion/nokogiri/issues/530
+  XHTML formatting can't be turned off
+
+* https://github.com/sparklemotion/nokogiri/issues/415
+  XML formatting should be no formatting
+
+
+## overhaul and optimize the SAX parsing
+
+* see fairy wing throwdown - SAX parsing is wicked slow.
+
+
+## Node should not be Enumerable; and should have a better attributes API
+
+* https://github.com/sparklemotion/nokogiri/issues/679
+  Mixing in Enumerable has some unintended consequences; plus we want to improve the attributes API
+
+* Some ideas for a better attributes API?
+  * (closed) https://github.com/sparklemotion/nokogiri/issues/666
+  * https://github.com/sparklemotion/nokogiri/issues/765
+
+
+## improve CSS query parsing
+
+* https://github.com/sparklemotion/nokogiri/issues/528
+  support `:not()` with a nontrivial argument, like `:not(div p.c)`
+
+* https://github.com/sparklemotion/nokogiri/issues/451
+  chained :not pseudoselectors
+
+* better jQuery selector and CSS pseudo-selector support:
+  * https://github.com/sparklemotion/nokogiri/issues/621
+  * https://github.com/sparklemotion/nokogiri/issues/342
+  * https://github.com/sparklemotion/nokogiri/issues/628
+  * https://github.com/sparklemotion/nokogiri/issues/652
+  * https://github.com/sparklemotion/nokogiri/issues/688
+
+* https://github.com/sparklemotion/nokogiri/issues/394
+  nth-of-type is wrong, and possibly other selectors as well
+
+* https://github.com/sparklemotion/nokogiri/issues/309
+  incorrect query being executed
+
+* https://github.com/sparklemotion/nokogiri/issues/350
+  :has is wrong?
+
+
+## DocumentFragment
+
+* there are a few tickets about searches not working properly if you
+  use or do not use the context node as part of the search.
+  - https://github.com/sparklemotion/nokogiri/issues/213
+  - https://github.com/sparklemotion/nokogiri/issues/370
+  - https://github.com/sparklemotion/nokogiri/issues/454
+  - https://github.com/sparklemotion/nokogiri/issues/572
+
+
+## Better Syntax for custom XPath function handler
+
+* https://github.com/sparklemotion/nokogiri/pull/464
+
+
+## Better Syntax around Node#xpath and NodeSet#xpath
+
+* look at those methods, and use of Node#extract_params in Node#{css,search}
+  * we should standardize on a hash of options for these and other calls
+* what should NodeSet#xpath return?
+  * https://github.com/sparklemotion/nokogiri/issues/656
+* also, clean up or unify the implementations of #xpath-and-friends in Node and NodeSet
+  * implementations are very similar, but no shared code :(
+  * decorate nodes in a consistent manner
+
+## Encoding
+
+We have a lot of issues open around encoding. How bad are things?
+Somebody who knows encoding well should head this up.
+
+* Extract EncodingReader as a real object that can be injected
+  https://groups.google.com/forum/#!msg/nokogiri-talk/arJeAtMqvkg/tGihB-iBRSAJ
+
+
+## Reader
+
+It's fundamentally broken, in that we can't stop people from crashing
+their application if they want to use object reference unsafely.

data/Rakefile

@@ -0,0 +1,351 @@
+# -*- ruby -*-
+require 'rubygems'
+require 'shellwords'
+
+gem 'hoe'
+require 'hoe'
+Hoe.plugin :debugging
+Hoe.plugin :git
+Hoe.plugin :gemspec
+Hoe.plugin :bundler
+Hoe.add_include_dirs '.'
+
+GENERATED_PARSER    = "lib/nokogiri/css/parser.rb"
+GENERATED_TOKENIZER = "lib/nokogiri/css/tokenizer.rb"
+CROSS_DIR           =  File.join(File.dirname(__FILE__), 'ports')
+
+def java?
+  /java/ === RUBY_PLATFORM
+end
+
+ENV['LANG'] = "en_US.UTF-8" # UBUNTU 10.04, Y U NO DEFAULT TO UTF-8?
+
+CrossRuby = Struct.new(:version, :host) {
+  def ver
+    @ver ||= version[/\A[^-]+/]
+  end
+
+  def api_ver_suffix
+    case ver
+    when /\A([2-9])\.([0-9])\./
+      "#{$1}#{$2}0"
+    when /\A1\.9\./
+      '191'
+    else
+      raise "unsupported version: #{ver}"
+    end
+  end
+
+  def platform
+    @platform ||=
+      case host
+      when /\Ax86_64-/
+        'x64-mingw32'
+      when /\Ai[3-6]86-/
+        'x86-mingw32'
+      else
+        raise "unsupported host: #{host}"
+      end
+  end
+
+  def tool(name)
+    (@binutils_prefix ||=
+      case platform
+      when 'x64-mingw32'
+        'x86_64-w64-mingw32-'
+      when 'x86-mingw32'
+        'i686-w64-mingw32-'
+      end) + name
+  end
+
+  def target
+    case platform
+    when 'x64-mingw32'
+      'pei-x86-64'
+    when 'x86-mingw32'
+      'pei-i386'
+    end
+  end
+
+  def libruby_dll
+    case platform
+    when 'x64-mingw32'
+      "x64-msvcrt-ruby#{api_ver_suffix}.dll"
+    when 'x86-mingw32'
+      "msvcrt-ruby#{api_ver_suffix}.dll"
+    end
+  end
+
+  def dlls
+    [
+      'kernel32.dll',
+      'msvcrt.dll',
+      'ws2_32.dll',
+      *(case
+        when ver >= '2.0.0'
+          'user32.dll'
+        end),
+      libruby_dll
+    ]
+  end
+}
+
+CROSS_RUBIES = File.read('.cross_rubies').lines.flat_map { |line|
+  case line
+  when /\A([^#]+):([^#]+)/
+    CrossRuby.new($1, $2)
+  else
+    []
+  end
+}
+
+ENV['RUBY_CC_VERSION'] ||= CROSS_RUBIES.map(&:ver).uniq.join(":")
+
+require 'tasks/nokogiri.org'
+
+HOE = Hoe.spec 'nokogiri' do
+  developer 'Aaron Patterson', 'aaronp@rubyforge.org'
+  developer 'Mike Dalessio',   'mike.dalessio@gmail.com'
+  developer 'Yoko Harada',     'yokolet@gmail.com'
+  developer 'Tim Elliott',     'tle@holymonkey.com'
+  developer 'Akinori MUSHA',   'knu@idaemons.org'
+
+  self.readme_file  = ['README',    ENV['HLANG'], 'rdoc'].compact.join('.')
+  self.history_file = ['CHANGELOG', ENV['HLANG'], 'rdoc'].compact.join('.')
+
+  self.extra_rdoc_files = FileList['*.rdoc','ext/nokogiri/*.c']
+
+
+  self.clean_globs += [
+    'nokogiri.gemspec',
+    'lib/nokogiri/nokogiri.{bundle,jar,rb,so}',
+    'lib/nokogiri/[0-9].[0-9]',
+    'ports/*.installed',
+    'ports/{i[3-6]86,x86_64}-{w64-,}mingw32*',
+    'ports/libxml2',
+    'ports/libxslt',
+    # GENERATED_PARSER,
+    # GENERATED_TOKENIZER
+  ]
+
+  unless java?
+    self.extra_deps += [
+      ["mini_portile",    "~> 0.5.2"],
+    ]
+  end
+
+  self.extra_dev_deps += [
+    ["hoe-bundler",     ">= 1.1"],
+    ["hoe-debugging",   ">= 1.0.3"],
+    ["hoe-gemspec",     ">= 1.0"],
+    ["hoe-git",         ">= 1.4"],
+    ["minitest",        "~> 2.2.2"],
+    ["rake",            ">= 0.9"],
+    ["rake-compiler",   "~> 0.9.2"],
+    ["racc",            ">= 1.4.6"],
+    ["rexical",         ">= 1.0.5"]
+  ]
+
+  if java?
+    self.spec_extras = { :platform => 'java' }
+  else
+    self.spec_extras = {
+      :extensions => ["ext/nokogiri/extconf.rb"],
+      :required_ruby_version => '>= 1.9.2'
+    }
+  end
+
+  self.testlib = :minitest
+end
+HOE.spec.licenses = ['MIT']
+
+# ----------------------------------------
+
+def add_file_to_gem relative_path
+  target_path = File.join gem_build_path, relative_path
+  target_dir = File.dirname(target_path)
+  mkdir_p target_dir unless File.directory?(target_dir)
+  rm_f target_path
+  safe_ln relative_path, target_path
+  HOE.spec.files += [relative_path]
+end
+
+def gem_build_path
+  File.join 'pkg', HOE.spec.full_name
+end
+
+if java?
+  # TODO: clean this section up.
+  require "rake/javaextensiontask"
+  Rake::JavaExtensionTask.new("nokogiri", HOE.spec) do |ext|
+    jruby_home = RbConfig::CONFIG['prefix']
+    ext.ext_dir = 'ext/java'
+    ext.lib_dir = 'lib/nokogiri'
+    ext.source_version = '1.6'
+    ext.target_version = '1.6'
+    jars = ["#{jruby_home}/lib/jruby.jar"] + FileList['lib/*.jar']
+    ext.classpath = jars.map { |x| File.expand_path x }.join ':'
+  end
+
+  task gem_build_path => [:compile] do
+    add_file_to_gem 'lib/nokogiri/nokogiri.jar'
+  end
+else
+  begin
+    require 'rake/extensioncompiler'
+    # Ensure mingw compiler is installed
+    Rake::ExtensionCompiler.mingw_host
+    mingw_available = true
+  rescue
+    puts "WARNING: cross compilation not available: #{$!}"
+    mingw_available = false
+  end
+  require "rake/extensiontask"
+
+  HOE.spec.files.reject! { |f| f =~ %r{\.(java|jar)$} }
+
+  dependencies = YAML.load_file("dependencies.yml")
+
+  task gem_build_path do
+    %w[libxml2 libxslt].each do |lib|
+      version = dependencies[lib]
+      archive = File.join("ports", "archives", "#{lib}-#{version}.tar.gz")
+      add_file_to_gem archive
+      patchesdir = File.join("ports", "patches", lib)
+      patches = `#{['git', 'ls-files', patchesdir].shelljoin}`.split("\n").grep(/\.patch\z/)
+      patches.each { |patch|
+        add_file_to_gem patch
+      }
+      (untracked = Dir[File.join(patchesdir, '*.patch')] - patches).empty? or
+        at_exit {
+          untracked.each { |patch|
+            puts "** WARNING: untracked patch file not added to gem: #{patch}"
+          }
+        }
+    end
+  end
+
+  Rake::ExtensionTask.new("nokogiri", HOE.spec) do |ext|
+    ext.lib_dir = File.join(*['lib', 'nokogiri', ENV['FAT_DIR']].compact)
+    ext.config_options << ENV['EXTOPTS']
+    if mingw_available
+      ext.cross_compile  = true
+      ext.cross_platform = CROSS_RUBIES.map(&:platform).uniq
+      ext.cross_config_options << "--enable-cross-build"
+      ext.cross_compiling do |spec|
+        libs = dependencies.map { |name, version| "#{name}-#{version}" }.join(', ')
+
+        spec.post_install_message = <<-EOS
+Nokogiri is built with the packaged libraries: #{libs}.
+        EOS
+        spec.files.reject! { |path| File.fnmatch?('ports/*', path) }
+      end
+    end
+  end
+end
+
+# ----------------------------------------
+
+desc "Generate css/parser.rb and css/tokenizer.rex"
+task 'generate' => [GENERATED_PARSER, GENERATED_TOKENIZER]
+task 'gem:spec' => 'generate' if Rake::Task.task_defined?("gem:spec")
+
+# This is a big hack to make sure that the racc and rexical
+# dependencies in the Gemfile are constrainted to ruby platforms
+# (i.e. MRI and Rubinius). There's no way to do that through hoe,
+# and any solution will require changing hoe and hoe-bundler.
+old_gemfile_task = Rake::Task['bundler:gemfile'] rescue nil
+task 'bundler:gemfile' do
+  old_gemfile_task.invoke if old_gemfile_task
+
+  lines = File.open('Gemfile', 'r') { |f| f.readlines }.map do |line|
+    line =~ /racc|rexical/ ? "#{line.strip}, :platform => :ruby" : line
+  end
+  File.open('Gemfile', 'w') { |f| lines.each { |line| f.puts line } }
+end
+
+file GENERATED_PARSER => "lib/nokogiri/css/parser.y" do |t|
+  racc = RbConfig::CONFIG['target_os'] =~ /mswin32/ ? '' : `which racc`.strip
+  racc = "#{::RbConfig::CONFIG['bindir']}/racc" if racc.empty?
+  racc = %x{command -v racc}.strip if racc.empty?
+  sh "#{racc} -l -o #{t.name} #{t.prerequisites.first}"
+end
+
+file GENERATED_TOKENIZER => "lib/nokogiri/css/tokenizer.rex" do |t|
+  sh "rex --independent -o #{t.name} #{t.prerequisites.first}"
+end
+
+[:compile, :check_manifest].each do |task_name|
+  Rake::Task[task_name].prerequisites << GENERATED_PARSER
+  Rake::Task[task_name].prerequisites << GENERATED_TOKENIZER
+end
+
+# ----------------------------------------
+
+desc "set environment variables to build and/or test with debug options"
+task :debug do
+  ENV['NOKOGIRI_DEBUG'] = "true"
+  ENV['CFLAGS'] ||= ""
+  ENV['CFLAGS'] += " -DDEBUG"
+end
+
+require 'tasks/test'
+
+task :java_debug do
+  ENV['JAVA_OPTS'] = '-Xdebug -Xrunjdwp:transport=dt_socket,address=8000,server=y,suspend=y' if java? && ENV['JAVA_DEBUG']
+end
+
+if java?
+  task :test_19 => :test
+  task :test_20 do
+    ENV['JRUBY_OPTS'] = "--2.0"
+    Rake::Task["test"].invoke
+  end
+end
+
+Rake::Task[:test].prerequisites << :compile
+Rake::Task[:test].prerequisites << :java_debug
+Rake::Task[:test].prerequisites << :check_extra_deps unless java?
+
+if Hoe.plugins.include?(:debugging)
+  ['valgrind', 'valgrind:mem', 'valgrind:mem0'].each do |task_name|
+    Rake::Task["test:#{task_name}"].prerequisites << :compile
+  end
+end
+
+# ----------------------------------------
+
+def verify_dll(dll, cross_ruby)
+  dll_imports = cross_ruby.dlls
+  dump = `#{['env', 'LANG=C', cross_ruby.tool('objdump'), '-p', dll].shelljoin}`
+  raise "unexpected file format for generated dll #{dll}" unless /file format #{Regexp.quote(cross_ruby.target)}\s/ === dump
+  raise "export function Init_nokogiri not in dll #{dll}" unless /Table.*\sInit_nokogiri\s/mi === dump
+
+  # Verify that the expected DLL dependencies match the actual dependencies
+  # and that no further dependencies exist.
+  dll_imports_is = dump.scan(/DLL Name: (.*)$/).map(&:first).map(&:downcase).uniq
+  if dll_imports_is.sort != dll_imports.sort
+    raise "unexpected dll imports #{dll_imports_is.inspect} in #{dll}"
+  end
+  puts "#{dll}: Looks good!"
+end
+
+task :cross do
+  rake_compiler_config_path = File.expand_path("~/.rake-compiler/config.yml")
+  unless File.exists? rake_compiler_config_path
+    raise "rake-compiler has not installed any cross rubies. Try using rake-compiler-dev-box for building binary windows gems.'"
+  end
+
+  CROSS_RUBIES.each do |cross_ruby|
+    task "tmp/#{cross_ruby.platform}/nokogiri/#{cross_ruby.ver}/nokogiri.so" do |t|
+      # To reduce the gem file size strip mingw32 dlls before packaging
+      sh [cross_ruby.tool('strip'), '-S', t.name].shelljoin
+      verify_dll t.name, cross_ruby
+    end
+  end
+end
+
+desc "build a windows gem without all the ceremony."
+task "gem:windows" => %w[cross native gem]
+
+# vim: syntax=Ruby