quarto 0.0.1

data/.gitignore

@@ -0,0 +1,18 @@
+*.gem
+*.rbc
+.bundle
+.config
+.yardoc
+Gemfile.lock
+InstalledFiles
+_yardoc
+coverage
+doc/
+lib/bundler/man
+pkg
+rdoc
+spec/reports
+test/tmp
+test/version_tmp
+tmp
+/scratch*

data/Gemfile

@@ -0,0 +1,4 @@
+source 'https://rubygems.org'
+
+# Specify your gem's dependencies in quarto.gemspec
+gemspec

data/LICENSE.txt

@@ -0,0 +1,22 @@
+Copyright (c) 2013 Avdi Grimm
+
+MIT License
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,53 @@
+# Quarto
+
+Yet another ebook generation toolchain.
+
+A "Quarto" is a bookbinding term, and this is my fourth attempt at an ebook toolchain.
+
+## Requirements
+
+Quarto depends on several external programs which you will need to install before using it.
+
+- Pandoc
+- Pygments
+- xmllint
+- PrinceXML
+
+## Installation/Usage
+
+1. Install the gem (`gem install quarto`)
+2. Create a `Rakefile` in your book project root.
+3. Add `require "quarto/tasks"` to the top of the Rakefile.
+4. Run `rake -T` to see the available tasks.
+
+## Concepts
+
+Quarto is a set of Rake tasks backed up by a Ruby library, which in turn relies heavily on Nokogiri and a number of external tools.
+
+### XHTML5 is king
+
+The central philosophy of Quarto is to do as much work as possible with XHTML5 files. All input formats (e.g. Markdown) are first converted to XHTML5 before any other work is done. Then various transformations occur. Finally, at the end of the line, an XHTML5 "master" file is converted to various deliverable formats such as PDF. The reason for this philosophy is simple: Nokogiri makes it really easy to perform arbitrary semantic transformations on XHTML documents, without a lot of tedious mucking about with text munging. The more of the work that is done on DOM object trees, the easier it is to do.
+
+### The assembly line
+
+Quarto is a set of Rake tasks, so execution normally starts with an end product and works backwards through the dependency chain to figure out what needs to be done to produce that product. However, it's probably easier to understand everything Quarto does by viewing it as an assembly line starting with source files and ending with deliverables. Here are the steps along the way.
+
+Note that all files generated by Quarto are placed in a `build` subdirectory of your project's root. It will be created if needed.
+
+1. **Source files**. These are manuscript files in supported source    formats (currently only Markdown). They might be in the root of your project, or in subdirectories.
+2. Source files are *exported* into **export files** in `build/export`. Export files are HTML, produced using whatever tool is appropriate for the input format. E.g. `pandoc` is used to export Markdown source files to HTML equivalents.
+3. The source files are then normalized into XHTML **section files** (in `build/sections`). During this normalization process any idiosyncrasies in the HTML produced by the export tool are dealt with.
+4. A **spine file** is generated. This XHTML file will be used to tie together all of the section files. The body of this file contains references to (but not the content of) all of the section files. It also contains stylesheets and other metadata.
+5. The spine file is then expanded into an XHTML **codex file**. This file contains the body content of all of the section files. Only body content is taken from the section files, everything else is ignored. From this point forward, all operations will be done on monolithic files rather than on partial files corresponding to the original sources.
+6. The spine file is searched for source code listings. Each listing is extracted out as text into a **listing file** (in `build/listings`). Listing files are named based on the SHA1 of the listing and its language, e.g. `build/listings/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.rb`. Using the SHA1 in naming is an optimization which ensures that only changed code listings ever need to be re-highlighted (see the next step). During this step a **skeleton file** is also created. This XHTML file mirrors the codex file, except that all of the source code listings have been replaced with references to highlight files (see next step).
+7. The next step is to perform source code highlighting on the listing files, using Pygments. This produces **highlight files**, which are HTML files in the `build/highlights` directory. They named based on the SHA1 of the corresponding code listing.
+8. The skeleton file and the highlights file are then stitched back together into a **master file**. This XHTML file is the "gold standard" from which all deliverables will be generated.
+9. **Deliverable files** suitable for distributing to end-users, such as PDF or Epub files, are produced using the master file.
+
+## Contributing
+
+1. Fork it
+2. Create your feature branch (`git checkout -b my-new-feature`)
+3. Commit your changes (`git commit -am 'Add some feature'`)
+4. Push to the branch (`git push origin my-new-feature`)
+5. Create new Pull Request

data/Rakefile

@@ -0,0 +1,6 @@
+require "bundler/gem_tasks"
+require 'rspec/core/rake_task'
+
+RSpec::Core::RakeTask.new(:spec)
+
+task :default => :spec

data/lib/quarto.rb

@@ -0,0 +1,289 @@
+require "quarto/version"
+require 'rake'
+require 'nokogiri'
+require 'open3'
+require 'digest/sha1'
+
+module Quarto
+  include Rake::DSL
+
+  def self.configure
+    yield self
+  end
+
+  def self.stylesheets
+    @stylesheets ||= [code_stylesheet]
+  end
+
+  def configuration
+    Quarto
+  end
+
+  module_function
+
+  XINCLUDE_NS = "http://www.w3.org/2001/XInclude"
+
+  EXTENSIONS_TO_SOURCE_FORMATS = {
+    "md" => "markdown",
+    "markdown" => "markdown",
+    "org" => "orgmode"
+  }
+
+  SECTION_TEMPLATE = <<-EOF
+  <!DOCTYPE html>
+  <html xmlns="http://www.w3.org/1999/xhtml">
+    <head>
+      <title></title>
+    </head>
+    <body>
+    </body>
+  </html>
+  EOF
+
+  SPINE_TEMPLATE = <<-EOF
+  <!DOCTYPE html>
+  <html xmlns="http://www.w3.org/1999/xhtml">
+    <head>
+      <title>Untitled Book</title>
+    </head>
+    <body>
+    </body>
+  </html>
+  EOF
+
+  def build_dir
+    "build"
+  end
+
+  def source_exts
+    EXTENSIONS_TO_SOURCE_FORMATS.keys
+  end
+
+  def format_of_source_file(source_file)
+    ext = source_file.pathmap("%x")[1..-1]
+    EXTENSIONS_TO_SOURCE_FORMATS.fetch(ext)
+  end
+
+  def source_files
+    FileList["**/*.{#{source_exts.join(',')}}"]
+  end
+
+  def export_dir
+    "build/exports"
+  end
+
+  def export_files
+    source_files.pathmap("#{export_dir}/%p").ext('.html')
+  end
+
+  def source_for_export_file(export_file)
+    base = export_file.sub(/^#{export_dir}\//,'').ext('')
+    pattern = "#{base}.{#{source_exts.join(',')}}"
+    FileList[pattern].first
+  end
+
+  def export_command_for(source_file, export_file)
+    %W[pandoc --no-highlight -w html5 -o #{export_file} #{source_file}]
+  end
+
+  def section_dir
+    "build/sections"
+  end
+
+  def section_files
+    export_files.pathmap("%{^#{export_dir},#{section_dir}}X%{html,xhtml}x")
+  end
+
+  def export_for_section_file(section_file)
+    section_file.pathmap("%{^#{section_dir},#{export_dir}}X%{xhtml,html}x")
+  end
+
+  def normalize_export(export_file, section_file, format)
+    format ||= "NO_FORMAT_GIVEN"
+    send("normalize_#{format}_export", export_file, section_file)
+  end
+
+  def normalize_markdown_export(export_file, section_file)
+    puts "normalize #{export_file} to #{section_file}"
+    doc = open(export_file) do |f|
+      Nokogiri::HTML(f)
+    end
+    normal_doc = Nokogiri::XML.parse(SECTION_TEMPLATE)
+    normal_doc.at_css("body").replace(doc.at_css("body"))
+    normal_doc.at_css("title").content = export_file.pathmap("%n")
+    open(section_file, "w") do |f|
+      format_xml(f) do |pipe_input|
+        normal_doc.write_xml_to(pipe_input)
+      end
+    end
+  end
+
+  def source_list_file
+    "build/sources"
+  end
+
+  def code_stylesheet
+    "#{build_dir}/code.css"
+  end
+
+  def spine_file
+    "build/spine.xhtml"
+  end
+
+  def create_spine_file(spine_file, section_files, options={})
+    options = {stylesheets: configuration.stylesheets}.merge(options)
+    puts "create #{spine_file}"
+    doc = Nokogiri::XML.parse(SPINE_TEMPLATE)
+    doc.root.add_namespace("xi", "http://www.w3.org/2001/XInclude")
+    head_elt = doc.root.at_css("head")
+    stylesheets = Array(options[:stylesheets])
+    stylesheets.each do |stylesheet|
+      head_elt.add_child(
+        doc.create_element(
+          "style",
+          File.read(stylesheet)))
+    end
+    section_files.each do |section_file|
+      doc.root["xml:base"] = ".."
+      body = doc.root.at_css("body")
+      body.add_child(doc.create_element("xi:include") do |inc_elt|
+          inc_elt["href"]     = section_file
+          inc_elt["xpointer"] = "xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)"
+          inc_elt.add_child(doc.create_element("xi:fallback") do |fallback_elt|
+              fallback_elt.add_child(doc.create_element("p",
+                  "[Missing section: #{section_file}]"))
+            end)
+        end)
+    end
+    open(spine_file, 'w') do |f|
+      format_xml(f) do |format_input|
+        doc.write_to(format_input)
+      end
+    end
+  end
+
+  def codex_file
+    "build/codex.xhtml"
+  end
+
+  def create_codex_file(codex_file, spine_file)
+    expand_xinclude(codex_file, spine_file)
+  end
+
+  def skeleton_file
+    "#{build_dir}/skeleton.xhtml"
+  end
+
+  def listings_dir
+    "#{build_dir}/listings"
+  end
+
+  def create_skeleton_file(skeleton_file, codex_file)
+    puts "scan #{codex_file} for source code listings"
+    skel_doc = open(codex_file) do |f|
+      Nokogiri::XML(f)
+    end
+    skel_doc.css("pre.sourceCode").each_with_index do |pre_elt, i|
+      lang = pre_elt["class"].split[1]
+      ext  = {"ruby" => "rb"}.fetch(lang){ lang.downcase }
+      code     = pre_elt.at_css("code").text
+      digest   = Digest::SHA1.hexdigest(code)
+      listing_path = "#{listings_dir}/#{digest}.#{ext}"
+      puts "extract listing #{i} to #{listing_path}"
+      open(listing_path, 'w') do |f|
+        f.write(strip_listing(code))
+      end
+      highlight_path = "#{highlights_dir}/#{digest}.html"
+      inc_elt = skel_doc.create_element("xi:include") do |elt|
+        elt["href"] = highlight_path
+        elt.add_child(
+          "<xi:fallback>"\
+          "<p>[Missing code listing: #{highlight_path}]</p>"\
+          "</xi:fallback>")
+      end
+      pre_elt.replace(inc_elt)
+    end
+    puts "create #{skeleton_file}"
+    open(skeleton_file, "w") do |f|
+      format_xml(f) do |format_input|
+        skel_doc.write_xml_to(format_input)
+      end
+    end
+  end
+
+  def highlights_dir
+    "#{build_dir}/highlights"
+  end
+
+  def highlights_needed_by(skeleton_file)
+    doc = open(skeleton_file) do |f|
+      Nokogiri::XML(f)
+    end
+    doc.xpath("//xi:include", "xi" => XINCLUDE_NS).map{|e| e["href"]}
+  end
+
+  def listing_for_highlight_file(highlight_file)
+    base = highlight_file.pathmap("%n")
+    FileList["#{listings_dir}/#{base}.*"].first
+  end
+
+  # Strip extraneous whitespace from around a code listing
+  def strip_listing(code)
+    code.gsub!(/\t/, "  ")
+    lines  = code.split("\n")
+    first_code_line = lines.index{|l| l =~ /\S/}
+    last_code_line  = lines.rindex{|l| l =~ /\S/}
+    lines = lines[first_code_line..last_code_line]
+    indent = lines.map{|l| l.index(/[^ ]/)}.min
+    lines.map{|l| l.slice(indent..-1)}.join("\n") + "\n"
+  end
+
+  def master_file
+    "#{build_dir}/master.xhtml"
+  end
+
+  def create_master_file(master_file, skeleton_file)
+    expand_xinclude(master_file, skeleton_file, format: false)
+  end
+
+  def deliverable_dir
+    "#{build_dir}/deliverables"
+  end
+
+  def deliverable_files
+    [pdf_file]
+  end
+
+  def pdf_file
+    "#{deliverable_dir}/book.pdf"
+  end
+
+  private
+
+  def format_xml(output_io)
+    Open3.popen2(*%W[xmllint --format --xmlout -]) do
+      |stdin, stdout, wait_thr|
+      yield(stdin)
+      stdin.close
+      IO.copy_stream(stdout, output_io)
+    end
+  end
+
+  def expand_xinclude(output_file, input_file, options={})
+    options = {format: true}.merge(options)
+    puts "expand #{input_file} to #{output_file}"
+    cleanup_args = %W[--nsclean --xmlout]
+    if options[:format]
+      cleanup_args << "--format"
+    end
+    Open3.pipeline_r(
+      %W[xmllint --xinclude --xmlout #{input_file}],
+      # In order to clean up extraneous namespace declarations we need a second
+      # xmllint process
+      ["xmllint",  *cleanup_args, "-"]) do |output, wait_thr|
+      open(output_file, 'w') do |f|
+        IO.copy_stream(output, f)
+      end
+    end
+  end
+end

data/lib/quarto/tasks.rb

@@ -0,0 +1,85 @@
+require 'quarto'
+
+include Quarto
+
+desc "Export from source formats to HTML"
+task :export => [*export_files]
+
+desc "Generate normalized XHTML versions of exports"
+task :sections => [*section_files]
+
+desc "Build a single XHTML file codex combining all sections"
+task :codex => codex_file
+
+desc "Strip out code listings for highlighting"
+task :skeleton => skeleton_file
+
+desc "Create master file suitable for conversion into deliverable formats"
+task :master => master_file
+
+desc "Create finished documents suitable for end-users"
+task :deliverables => deliverable_files
+
+desc "Perform source-code highlighting"
+task :highlight => [skeleton_file] do |t|
+  highlights_needed  = highlights_needed_by(skeleton_file)
+  missing_highlights = highlights_needed - FileList["#{highlights_dir}/*.html"]
+  sub_task = Rake::MultiTask.new("highlight_dynamic", Rake.application)
+  sub_task.enhance(missing_highlights)
+  sub_task.invoke
+end
+
+directory build_dir
+directory export_dir => [build_dir]
+
+export_files.each do |export_file|
+  file export_file => [export_dir, source_for_export_file(export_file)] do |t|
+    source_file = source_for_export_file(export_file)
+    mkdir_p export_file.pathmap("%d")
+    sh *export_command_for(source_file, export_file)
+  end
+end
+
+section_files.each do |section_file|
+  file section_file => export_for_section_file(section_file) do |t|
+    export_file   = export_for_section_file(section_file)
+    source_file   = source_for_export_file(export_file)
+    source_format = format_of_source_file(source_file)
+    mkdir_p section_file.pathmap("%d")
+    normalize_export(export_file, section_file, source_format)
+  end
+end
+
+file code_stylesheet do |t|
+  sh "pygmentize -S colorful -f html > #{t.name}"
+end
+
+file spine_file => [build_dir, code_stylesheet] do |t|
+  create_spine_file(t.name, section_files, stylesheets: Quarto.stylesheets)
+end
+
+file codex_file => [spine_file, *section_files] do |t|
+  create_codex_file(t.name, spine_file)
+end
+
+directory listings_dir
+
+file skeleton_file => [codex_file, listings_dir] do |t|
+  create_skeleton_file(t.name, codex_file)
+end
+
+rule /^#{highlights_dir}\/[[:xdigit:]]+\.html$/ =>
+  [->(highlight_file){listing_for_highlight_file(highlight_file)}] do |t|
+  dir = t.name.pathmap("%d")
+  mkdir_p dir unless File.exist?(dir)
+  sh *%W[pygmentize -o #{t.name} #{t.source}]
+end
+
+file master_file => [skeleton_file, :highlight] do |t|
+  create_master_file(t.name, skeleton_file)
+end
+
+file pdf_file => [master_file] do |t|
+  mkdir_p t.name.pathmap("%d")
+  sh *%W[prince #{master_file} -o #{t.name}]
+end

data/lib/quarto/version.rb

@@ -0,0 +1,3 @@
+module Quarto
+  VERSION = "0.0.1"
+end

data/quarto.gemspec

@@ -0,0 +1,29 @@
+# coding: utf-8
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'quarto/version'
+
+Gem::Specification.new do |spec|
+  spec.name          = "quarto"
+  spec.version       = Quarto::VERSION
+  spec.authors       = ["Avdi Grimm"]
+  spec.email         = ["avdi@avdi.org"]
+  spec.description   = %q{Yet another ebook publishing toolchain}
+  spec.summary       = %q{Yet another ebook publishing toolchain}
+  spec.homepage      = ""
+  spec.license       = "MIT"
+
+  spec.files         = `git ls-files`.split($/)
+  spec.executables   = spec.files.grep(%r{^bin/}) { |f| File.basename(f) }
+  spec.test_files    = spec.files.grep(%r{^(test|spec|features)/})
+  spec.require_paths = ["lib"]
+
+  spec.add_dependency "nokogiri", "~> 1.6"
+
+  spec.add_development_dependency "bundler", "~> 1.3"
+  spec.add_development_dependency "rake", "~> 10.0"
+  spec.add_development_dependency "rspec", "~> 2.14"
+  spec.add_development_dependency "rspec-given", "~> 3.1"
+  spec.add_development_dependency "test-construct", "~> 1.2"
+  spec.add_development_dependency "debugger"
+end

data/spec/quarto_spec.rb

@@ -0,0 +1,235 @@
+require 'spec_helper'
+require 'quarto'
+
+describe Quarto do
+  include Quarto
+  describe 'figuring out sources, exports, and section paths' do
+    Given {
+      @construct.file "ch1.md"
+      @construct.file "Rakefile"
+      @construct.directory "subdir" do |d|
+        d.file "ch2.markdown"
+        d.file "ch3.org"
+        d.file "README.txt"
+      end
+    }
+
+    Then {
+      source_files.should == [
+        "ch1.md",
+        "subdir/ch2.markdown",
+        "subdir/ch3.org"
+      ]
+    }
+
+    And {
+      export_files.should == [
+        "build/exports/ch1.html",
+        "build/exports/subdir/ch2.html",
+        "build/exports/subdir/ch3.html",
+      ]
+    }
+
+    And {
+      section_files.should == [
+        "build/sections/ch1.xhtml",
+        "build/sections/subdir/ch2.xhtml",
+        "build/sections/subdir/ch3.xhtml",
+      ]
+    }
+
+    And {
+      source_for_export_file("build/exports/ch1.html") == "ch1.md"
+    }
+
+    And {
+      source_for_export_file("build/exports/subdir/ch3.org") == "subdir/ch3.org"
+    }
+
+    And {
+      export_for_section_file("build/sections/subdir/ch3.xhtml") ==
+        "build/exports/subdir/ch3.html"
+    }
+
+  end
+
+  describe 'export commands' do
+    Given(:command) {
+      export_command_for("ch1.md", "ch1.html")
+    }
+
+    Then { command == %W[pandoc --no-highlight -w html5 -o ch1.html ch1.md] }
+  end
+
+  describe 'source formats' do
+    it 'recognizes .md and .markdown as Makdown' do
+      expect(format_of_source_file("foo.md")).to eq("markdown")
+      expect(format_of_source_file("foo.markdown")).to eq("markdown")
+    end
+
+    it 'recognizes .org as OrgMode' do
+      expect(format_of_source_file("foo.org")).to eq("orgmode")
+    end
+  end
+
+  describe 'normalizing markdown exports' do
+    Given {
+      @construct.file "export.html", <<END
+<h1>This is the title</h1>
+<p>This is the content</p>
+END
+    }
+
+    Given(:result_doc) {
+      open("section.xhtml") do |f|
+        Nokogiri::XML(f)
+      end
+    }
+
+    When { normalize_export("export.html", "section.xhtml", "markdown") }
+    Then {
+      expect(result_doc.to_s).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <title>export</title>
+  </head>
+  <body>
+    <h1>This is the title</h1>
+    <p>This is the content</p>
+  </body>
+</html>
+END
+    }
+  end
+
+  describe 'creating a spine file' do
+    Given(:sources) {
+      %W[ch1.xhtml ch2.xhtml]
+    }
+
+    When{ create_spine_file("spine.xhtml", sources, stylesheets: []) }
+    Then {
+      expect(File.read("spine.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude" xml:base="..">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <xi:include href="ch1.xhtml" xpointer="xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)">
+      <xi:fallback>
+        <p>[Missing section: ch1.xhtml]</p>
+      </xi:fallback>
+    </xi:include>
+    <xi:include href="ch2.xhtml" xpointer="xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)">
+      <xi:fallback>
+        <p>[Missing section: ch2.xhtml]</p>
+      </xi:fallback>
+    </xi:include>
+  </body>
+</html>
+END
+    }
+  end
+
+
+  describe 'creating a codex file' do
+    Given {
+      @construct.file("ch1.xhtml", <<EOF)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <title>ch1</title>
+  </head>
+  <body>
+    <p>This is chapter 1</p>
+    <p>Also chapter 1</p>
+  </body>
+</html>
+EOF
+      @construct.file("ch2.xhtml", <<EOF)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <title>ch1</title>
+  </head>
+  <body>
+    <p>This is chapter 2</p>
+  </body>
+</html>
+EOF
+      @construct.file("spine.xhtml", <<EOF)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <xi:include href="ch1.xhtml" xpointer="xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)">
+      <xi:fallback>
+        <p>[Missing section: ch1.xhtml]</p>
+      </xi:fallback>
+    </xi:include>
+    <xi:include href="ch2.xhtml" xpointer="xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)">
+      <xi:fallback>
+        <p>[Missing section: ch2.xhtml]</p>
+      </xi:fallback>
+    </xi:include>
+    <xi:include href="ch3.xhtml" xpointer="xmlns(ns=http://www.w3.org/1999/xhtml)xpointer(//ns:body/*)">
+      <xi:fallback>
+        <p>[Missing section: ch3.xhtml]</p>
+      </xi:fallback>
+    </xi:include>
+  </body>
+</html>
+EOF
+    }
+
+    When{ create_codex_file("codex.xhtml", "spine.xhtml") }
+    Then {
+      expect(File.read("codex.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <p>This is chapter 1</p>
+    <p>Also chapter 1</p>
+    <p>This is chapter 2</p>
+    <p>[Missing section: ch3.xhtml]</p>
+  </body>
+</html>
+END
+    }
+  end
+
+  describe "stripping source code" do
+    Given(:code) {
+      code = <<END
+
+
+    puts "hello, world
+    if true
+      puts "goodbye, world
+    end
+
+END
+    }
+    Then{
+      expect(strip_listing(code)).to eq(<<END)
+puts "hello, world
+if true
+  puts "goodbye, world
+end
+END
+    }
+  end
+end

data/spec/spec_helper.rb

@@ -0,0 +1,38 @@
+$LOAD_PATH.unshift(File.expand_path('../../lib', __FILE__))
+
+begin
+  # use `bundle install --standalone' to get this...
+  require_relative '../bundle/bundler/setup'
+rescue LoadError
+  # fall back to regular bundler if the developer hasn't bundled standalone
+  require 'bundler'
+  Bundler.setup
+end
+
+require 'rspec/given'
+require 'construct'
+
+module TaskSpecHelpers
+  def run(command)
+    @output, @status = Open3.capture2e(command)
+    unless @status.success?
+      raise "Command `#{command}` failed with output:\n#{@output}"
+    end
+  end
+
+  def contents(filename)
+    File.read(filename)
+  end
+end
+
+RSpec.configure do |config|
+  config.include Construct::Helpers
+  config.include TaskSpecHelpers, task: true
+
+  config.around :each do |example|
+    within_construct do |c|
+      @construct = c
+      example.run
+    end
+  end
+end

data/spec/tasks/codex_spec.rb

@@ -0,0 +1,49 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'sections task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+Quarto.configure do |config|
+  config.stylesheets.clear
+end
+END
+    @construct.file "intro.md", <<END
+# Hello, world
+
+This is the intro
+END
+    @construct.directory "section1" do |d|
+      d.file "ch1.md", <<END
+# Hello again
+
+This is chapter 1
+END
+    end
+  }
+
+  When {
+    run "rake codex"
+  }
+
+  Then {
+    expect(contents("build/codex.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude" xml:base="..">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <h1 id="hello-world" xml:base="build/sections/intro.xhtml">Hello, world</h1>
+    <p xml:base="build/sections/intro.xhtml">This is the intro</p>
+    <h1 id="hello-again" xml:base="build/sections/section1/ch1.xhtml">Hello again</h1>
+    <p xml:base="build/sections/section1/ch1.xhtml">This is chapter 1</p>
+  </body>
+</html>
+END
+  }
+
+
+end

data/spec/tasks/export_spec.rb

@@ -0,0 +1,40 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'export task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+
+END
+    @construct.file "intro.md", <<END
+# Hello, world
+
+This is the intro
+END
+    @construct.directory "section1" do |d|
+      d.file "ch1.md", <<END
+# Hello again
+
+This is chapter 1
+END
+    end
+  }
+
+  When {
+    run "rake export"
+  }
+
+  Then {
+    expect(contents("build/exports/intro.html")).to eq(<<END)
+<h1 id="hello-world">Hello, world</h1>
+<p>This is the intro</p>
+END
+  }
+  And {
+    expect(contents("build/exports/section1/ch1.html")).to eq(<<END)
+<h1 id="hello-again">Hello again</h1>
+<p>This is chapter 1</p>
+END
+  }
+end

data/spec/tasks/highlight_spec.rb

@@ -0,0 +1,42 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'highlight task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+END
+    @construct.file "ch1.md", <<END
+```ruby
+puts "hello, world"
+```
+END
+    @construct.file "ch2.md", <<END
+```c
+int main(int argc, char** argv) {
+  printf("Hello, world\n")
+}
+```
+END
+  }
+
+  When {
+    run "rake highlight"
+  }
+
+  Then {
+    expect(contents("build/highlights/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.html")).to eq(<<END)
+<div class="highlight"><pre><span class="nb">puts</span> <span class="s2">&quot;hello, world&quot;</span>
+</pre></div>
+END
+  }
+  And {
+    expect(contents("build/highlights/e7b17ea0eeebbd00d08674cf9070d287e24dc68e.html")).to eq(<<END)
+<div class="highlight"><pre><span class="kt">int</span> <span class="nf">main</span><span class="p">(</span><span class="kt">int</span> <span class="n">argc</span><span class="p">,</span> <span class="kt">char</span><span class="o">**</span> <span class="n">argv</span><span class="p">)</span> <span class="p">{</span>
+  <span class="n">printf</span><span class="p">(</span><span class="s">&quot;Hello, world</span>
+<span class="s">&quot;)</span>
+<span class="p">}</span>
+</pre></div>
+END
+  }
+end

data/spec/tasks/master_spec.rb

@@ -0,0 +1,58 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'master task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+Quarto.configure do |config|
+  config.stylesheets.clear
+end
+END
+    @construct.file "ch1.md", <<END
+<p>Before listing 0</p>
+```ruby
+puts "hello, world"
+```
+<p>After listing 0</p>
+END
+    @construct.file "ch2.md", <<END
+```c
+int main(int argc, char** argv) {
+  printf("Hello, world\n")
+}
+```
+END
+  }
+
+  When {
+    run "rake master"
+  }
+
+  Then {
+    expect(contents("build/master.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude" xml:base="..">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <p xml:base="build/sections/ch1.xhtml">
+Before listing 0
+</p>
+    <div class="highlight" xml:base="build/highlights/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.html"><pre><span class="nb">puts</span> <span class="s2">"hello, world"</span>
+</pre></div>
+    <p xml:base="build/sections/ch1.xhtml">
+After listing 0
+</p>
+    <div class="highlight" xml:base="build/highlights/e7b17ea0eeebbd00d08674cf9070d287e24dc68e.html"><pre><span class="kt">int</span> <span class="nf">main</span><span class="p">(</span><span class="kt">int</span> <span class="n">argc</span><span class="p">,</span> <span class="kt">char</span><span class="o">**</span> <span class="n">argv</span><span class="p">)</span> <span class="p">{</span>
+  <span class="n">printf</span><span class="p">(</span><span class="s">"Hello, world</span>
+<span class="s">")</span>
+<span class="p">}</span>
+</pre></div>
+  </body>
+</html>
+END
+  }
+end

data/spec/tasks/sections_spec.rb

@@ -0,0 +1,59 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'sections task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+END
+    @construct.file "intro.md", <<END
+# Hello, world
+
+This is the intro
+END
+    @construct.directory "section1" do |d|
+      d.file "ch1.md", <<END
+# Hello again
+
+This is chapter 1
+END
+    end
+  }
+
+  When {
+    run "rake sections"
+  }
+
+  Then {
+    expect(contents("build/sections/intro.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <title>intro</title>
+  </head>
+  <body>
+    <h1 id="hello-world">Hello, world</h1>
+    <p>This is the intro</p>
+  </body>
+</html>
+END
+  }
+  And {
+    expect(contents("build/sections/section1/ch1.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml">
+  <head>
+    <title>ch1</title>
+  </head>
+  <body>
+    <h1 id="hello-again">Hello again</h1>
+    <p>This is chapter 1</p>
+  </body>
+</html>
+END
+    }
+
+
+end

data/spec/tasks/skeleton_spec.rb

@@ -0,0 +1,66 @@
+require 'spec_helper'
+require 'open3'
+
+describe 'skeleton task', task: true do
+  Given {
+    @construct.file "Rakefile", <<END
+require 'quarto/tasks'
+Quarto.configure do |config|
+  config.stylesheets.clear
+end
+END
+    @construct.file "ch1.md", <<END
+```ruby
+puts "hello, world"
+```
+END
+    @construct.file "ch2.md", <<END
+```c
+int main(int argc, char** argv) {
+  printf("Hello, world\n")
+}
+```
+END
+  }
+
+  When {
+    run "rake skeleton"
+  }
+
+  Then {
+    expect(contents("build/skeleton.xhtml")).to eq(<<END)
+<?xml version="1.0"?>
+<!DOCTYPE html>
+<html xmlns="http://www.w3.org/1999/xhtml" xmlns:xi="http://www.w3.org/2001/XInclude" xml:base="..">
+  <head>
+    <title>Untitled Book</title>
+  </head>
+  <body>
+    <xi:include href="build/highlights/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.html">
+      <xi:fallback>
+        <p>[Missing code listing: build/highlights/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.html]</p>
+      </xi:fallback>
+    </xi:include>
+    <xi:include href="build/highlights/e7b17ea0eeebbd00d08674cf9070d287e24dc68e.html">
+      <xi:fallback>
+        <p>[Missing code listing: build/highlights/e7b17ea0eeebbd00d08674cf9070d287e24dc68e.html]</p>
+      </xi:fallback>
+    </xi:include>
+  </body>
+</html>
+END
+  }
+
+  And {
+    expect(contents("build/listings/3361c5f02e08bd44bde2d42633a2c9be201f7ec4.rb")).to eq(<<END)
+puts "hello, world"
+END
+  }
+  And {
+    expect(contents("build/listings/e7b17ea0eeebbd00d08674cf9070d287e24dc68e.c")).to eq(<<END)
+int main(int argc, char** argv) {
+  printf("Hello, world\n")
+}
+END
+  }
+end

metadata

@@ -0,0 +1,184 @@
+--- !ruby/object:Gem::Specification
+name: quarto
+version: !ruby/object:Gem::Version
+  version: 0.0.1
+  prerelease: 
+platform: ruby
+authors:
+- Avdi Grimm
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2013-08-01 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: nokogiri
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.6'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.6'
+- !ruby/object:Gem::Dependency
+  name: bundler
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.3'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.3'
+- !ruby/object:Gem::Dependency
+  name: rake
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '10.0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '10.0'
+- !ruby/object:Gem::Dependency
+  name: rspec
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '2.14'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '2.14'
+- !ruby/object:Gem::Dependency
+  name: rspec-given
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '3.1'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '3.1'
+- !ruby/object:Gem::Dependency
+  name: test-construct
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.2'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '1.2'
+- !ruby/object:Gem::Dependency
+  name: debugger
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+description: Yet another ebook publishing toolchain
+email:
+- avdi@avdi.org
+executables: []
+extensions: []
+extra_rdoc_files: []
+files:
+- .gitignore
+- Gemfile
+- LICENSE.txt
+- README.md
+- Rakefile
+- lib/quarto.rb
+- lib/quarto/tasks.rb
+- lib/quarto/version.rb
+- quarto.gemspec
+- spec/quarto_spec.rb
+- spec/spec_helper.rb
+- spec/tasks/codex_spec.rb
+- spec/tasks/export_spec.rb
+- spec/tasks/highlight_spec.rb
+- spec/tasks/master_spec.rb
+- spec/tasks/sections_spec.rb
+- spec/tasks/skeleton_spec.rb
+homepage: ''
+licenses:
+- MIT
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  none: false
+  requirements:
+  - - ! '>='
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  none: false
+  requirements:
+  - - ! '>='
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 1.8.24
+signing_key: 
+specification_version: 3
+summary: Yet another ebook publishing toolchain
+test_files:
+- spec/quarto_spec.rb
+- spec/spec_helper.rb
+- spec/tasks/codex_spec.rb
+- spec/tasks/export_spec.rb
+- spec/tasks/highlight_spec.rb
+- spec/tasks/master_spec.rb
+- spec/tasks/sections_spec.rb
+- spec/tasks/skeleton_spec.rb
+has_rdoc: