bibtex_to_scrapbox 0.1.0

data/gems/gems/latex-decode-0.2.2/README.md

@@ -0,0 +1,65 @@
+LaTeX::Decode
+=============
+
+[![Build Status](https://travis-ci.org/inukshuk/latex-decode.png?branch=master)](https://travis-ci.org/inukshuk/latex-decode)
+
+LaTeX::Decode is a Ruby gem to convert LaTeX input to Unicode. Its original
+use was as an input filter for [BibTeX-Ruby](http://rubygems.org/gems/bibtex-ruby)
+but can be used independently to decode LaTeX. Many of the patterns used by
+this Ruby gem are based on François Charette's equivalent Perl module
+[LaTeX::Decode](https://github.com/fc7/LaTeX-Decode).
+
+Quickstart
+----------
+
+    $ [sudo] gem install latex-decode
+    $ irb
+    >> require 'latex/decode'
+    >> LaTeX.decode "dipl\\^{o}me d'\\'{e}tudes sup\\'erieures"
+    => "diplôme d'études supérieures"
+
+Compatibility
+-------------
+
+Unicode handling is one of the major differences between Ruby 1.8 and newer
+version; LaTeX::Decode; nevertheless, we try to support 1.8 as best as possible.
+
+Issues
+------
+
+Please use the tracker of the project's
+[GitHub repository](https://github.com/inukshuk/latex-decode) to report any
+issues. When describing intended behaviour, please use the extremely simple
+syntax of the Cucumber features used by LaTeX::Decode; for instance, you could
+describe the example above as:
+
+    Feature: Decode LaTeX accents
+      As a hacker who works with LaTeX
+      I want to be able to decode LaTeX accents
+
+      Scenario: A French sentence
+        When I decode the string "dipl\\^{o}me d'\\'{e}tudes sup\\'erieures"
+        Then the result should be "diplôme d'études supérieures"
+
+Credits
+-------
+
+Kudos and thanks to all [contributors](https://github.com/inukshuk/latex-decode/contributors)
+who have made LaTeX::Decode possible!
+
+Copyright (C) 2011-2015 [Sylvester Keil](sylvester.keil.or.at)
+
+Copyright (C) 2010 François Charette
+
+This program is free software: you can redistribute it and/or modify
+it under the terms of the GNU General Public License as published by
+the Free Software Foundation, either version 3 of the License, or
+(at your option) any later version.
+
+This program is distributed in the hope that it will be useful,
+but WITHOUT ANY WARRANTY; without even the implied warranty of
+MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+GNU General Public License for more details.
+
+You should have received a copy of the GNU General Public License
+along with this program.  If not, see <http://www.gnu.org/licenses/>.

data/gems/gems/latex-decode-0.2.2/Rakefile

@@ -0,0 +1,41 @@
+# encoding: utf-8
+
+require 'bundler'
+begin
+  Bundler.setup
+rescue Bundler::BundlerError => e
+  $stderr.puts e.message
+  $stderr.puts "Run `bundle install` to install missing gems"
+  exit e.status_code
+end
+
+$:.unshift(File.join(File.dirname(__FILE__), './lib'))
+require 'latex/decode/version'
+
+
+desc 'Run an IRB session with LaTeX-Decode loaded'
+task :console, [:script] do |t,args|
+  ARGV.clear
+
+  require 'irb'
+  require 'latex/decode'
+
+  IRB.conf[:SCRIPT] = args.script
+  IRB.start
+end
+
+require 'cucumber/rake/task'
+Cucumber::Rake::Task.new(:cucumber)
+
+task :release do |t|
+  system "gem build latex-decode.gemspec"
+  system "git tag #{LaTeX::Decode::VERSION}"
+  system "git push --tags"
+  system "gem push latex-decode-#{LaTeX::Decode::VERSION}.gem"
+  system "rm latex-decode-#{LaTeX::Decode::VERSION}.gem"
+  system "jgem build latex-decode.gemspec"
+  system "jgem push latex-decode-#{LaTeX::Decode::VERSION}.gem"
+  system "rm latex-decode-#{LaTeX::Decode::VERSION}-java.gem"
+end
+
+task :default => :cucumber

data/gems/gems/latex-decode-0.2.2/cucumber.yml

@@ -0,0 +1 @@
+default: --format progress --require features --color

data/gems/gems/latex-decode-0.2.2/features/brackets.feature

@@ -0,0 +1,11 @@
+Feature: Decode LaTeX umlauts
+  As a hacker who works with LaTeX
+  I want to be able to remove brackets around single characters
+
+  Scenario: Single character in curly brackets
+    When I decode the string '{a}'
+    Then the result should be 'a'
+
+  Scenario: German umlauts in curly brackets
+    When I decode the string '{\"A}{\"o}{\"u}'
+    Then the result should be 'Äöü'

data/gems/gems/latex-decode-0.2.2/features/diacritics.feature

@@ -0,0 +1,40 @@
+Feature: Decode LaTeX diacritics
+	As a hacker who works with LaTeX
+	I want to be able to decode LaTeX diacritics
+	
+	Scenario Outline: LaTeX to Unicode transformation
+		When I decode the string '<latex>'
+		Then the result should be '<unicode>'
+
+	Scenarios: Diacritics
+		| latex   | unicode | description                                  |
+		| \\\`{o} | ò       | grave accent                                 |
+		| \\\'{o} | ó       | acute accent                                 |
+		| \\^{o}  | ô       | circumflex                                   |
+		| \\"{o}  | ö       | umlaut or dieresis                           |
+		| \\H{o}  | ő       | long Hungarian umlaut (double acute)         |
+		| \\~{o}  | õ       | tilde                                        |
+		| \\c{c}  | ç       | cedilla                                      |
+		| \\c c   | ç       |                                              |
+		| \\c cb  | çb      |                                              |
+		| \\c {cb}| \\c cb  |                                              |
+		| \\c C   | Ç       |                                              |
+		| {\\c c} | ç       |                                              |
+		| \\k{a}  | ą       | ogonek                                       |
+		| \\l     | ł       | l with stroke                                |
+		| \\L     | Ł       | l with stroke                                |
+		| \\={o}  | ō       | macron accent (a bar over the letter)        |
+		| \\b{o}  | o̱      | bar under the letter                         |
+		| \\.{o}  | ȯ       | dot over the letter                          |
+		| \\d{u}  | ụ       | dot under the letter                         |
+		| \\r{a}  | å       | ring over the letter                         |
+		| \\u{o}  | ŏ       | breve over the letter                        |
+		| \\v{s}  | š       | caron/hacek ("v") over the letter            |
+		| \\t{oo} | o͡o     | "tie" (inverted u) over the two letters      |
+		| \\aa    | å       | ring over the letter a                       |
+		| \\AA    | Å       | ring over the letter A                       |
+		| \\o     | ø       | slashed o                                    |
+		| \\O     | Ø       | slashed O                                    |
+		| \\ae    | æ       | ae                                           |
+		| \\AE    | Æ       | AE                                           |
+	

data/gems/gems/latex-decode-0.2.2/features/greek.feature

@@ -0,0 +1,13 @@
+Feature: Decode LaTeX Greek Letters
+  As a hacker who works with LaTeX
+  I want to be able to decode Greek letters
+
+  Scenario Outline: LaTeX to Unicode transformation
+    When I decode the string '<latex>'
+    Then the result should be '<unicode>'
+
+  Scenarios: Greek
+    | latex                | unicode |
+    | \\alpha              | α       |
+    | \\lambda             | λ       |
+    | \\Lambda             | Λ       |

data/gems/gems/latex-decode-0.2.2/features/maths.feature

@@ -0,0 +1,9 @@
+# Feature: Convert LaTeX maths to MathML
+#   As a maths-inclined hacker who works with LaTeX
+#   I want to convert LaTeX maths to MathML
+#
+#   Scenario: Inline maths environment
+#     When I decode the string '$I_{S}A$'
+#     Then the result should be '<msub><mi>I</mi><mrow><mi>S</mi></mrow></msub><mi>A</mi>'
+#     When I decode the string '\underline{firstName LastName$3^g$}'
+#     Then the result should be ''

data/gems/gems/latex-decode-0.2.2/features/non-latex.feature

@@ -0,0 +1,15 @@
+Feature: Keep non-LaTeX markup as it is
+  As a hacker who works with LaTeX
+  I want to preserve non-LaTeX text as it is
+
+  Scenario: Standalone escape characters
+    When I decode the string '\\'
+    Then the result should be '\\'
+
+  Scenario: Common markup in Regular Expressions
+    When I decode the string '.*'
+    Then the result should be '.*'
+    When I decode the string '^x$'
+    Then the result should be '^x$'
+    When I decode the string '\\\\2'
+    Then the result should be '\\\\2'

data/gems/gems/latex-decode-0.2.2/features/punctuation.feature

@@ -0,0 +1,50 @@
+Feature: Decode LaTeX punctuation directives
+  As a hacker who works with LaTeX
+  I want to be able to decode LaTeX punctuation marks
+
+  Scenario Outline: LaTeX to Unicode transformation
+    When I decode the string '<latex>'
+    Then the result should be '<unicode>'
+
+  Scenarios: Punctuation macros
+    | latex                | unicode |
+    | \\textendash         | –       |
+    | \\textemdash         | —       |
+    | \\textquoteleft      | ‘       |
+    | \\textquoteright     | ’       |
+    | \\quotesinglbase     | ‚       |
+    | \\textquotedblleft   | “       |
+    | \\textquotedblright  | ”       |
+    | \\quotedblbase       | „       |
+    | \\dag                | †       |
+    | \\ddag               | ‡       |
+    | \\textbullet         | •       |
+    | \\dots               | …       |
+    | \\textperthousand    | ‰       |
+    | \\textpertenthousand | ‱       |
+    | \\guilsinglleft      | ‹       |
+    | \\guilsinglright     | ›       |
+    | \\textreferencemark  | ※       |
+    | \\textinterrobang    | ‽       |
+    | \\textoverline       | ‾       |
+    | \\langle             | ⟨       |
+    | \\rangle             | ⟩       |
+    | \\textquotesingle    | ’       |
+
+
+  Scenarios: Punctuation symbols
+    | latex              | unicode | description |
+    | -                  | -       | hyphen      |
+    | --                 | –       | en-dash     |
+    | ---                | —       | em-dash     |
+    | \\~{}              | ~       | tilde       |
+    | \\textasciitilde{} | ~       | tilde       |
+    | \\textasciitilde   | ~       | tilde       |
+    | X\\ X              | X X     | space       |
+
+  Scenarios: Quotation marks
+    | latex   | unicode | description         |
+    | ``      | “       | left double quotes  |
+    | ''      | ”       | right double quotes |
+    | `       | ‘       | left single quotes  |
+    | '       | ’       | right single quotes |

data/gems/gems/latex-decode-0.2.2/features/special_characters.feature

@@ -0,0 +1,21 @@
+Feature: Decode LaTeX special characters
+  As a hacker who works with LaTeX
+  I want to be able to decode a few special characters which are escaped by LaTeX
+
+  Scenario Outline: LaTeX to Unicode transformation
+    When I decode the string '<latex>'
+    Then the result should be '<unicode>'
+
+  Scenarios: Special characters
+    | latex                | unicode |
+    | \\\&                 | &       |
+    | \\#                  | #       |
+    | \\$                  | $       |
+    | \\;                  | ;       |
+    | \\%                  | %       |
+    | \\{                  | {       |
+    | \\}                  | }       |
+    | \\_                  | _       |
+    | \\textasciitilde{}   | ~       |
+    | \\textbackslash{}    | \\      |
+    | \\textasciicircum{}  | ^       |

data/gems/gems/latex-decode-0.2.2/features/step_definitions/latex.rb

@@ -0,0 +1,7 @@
+When /^I decode the string ('|")(.*)\1$/ do |quote,string|
+  @result = LaTeX.decode(string)
+end
+
+Then /^the result should be ('|")(.*)\1$/ do |quote,value|
+  expect(@result).to eq(value)
+end

data/gems/gems/latex-decode-0.2.2/features/support/env.rb

@@ -0,0 +1,14 @@
+begin
+  case
+  when defined?(RUBY_ENGINE) && RUBY_ENGINE == 'rbx'
+    require 'rubinius/debugger'
+  when RUBY_VERSION > '2.0'
+    require 'byebug'
+  else
+    require 'debugger'
+  end
+rescue LoadError
+  # ignore
+end
+
+require 'latex/decode'

data/gems/gems/latex-decode-0.2.2/features/symbols.feature

@@ -0,0 +1,21 @@
+Feature: Decode LaTeX symbol directives
+  As a hacker who works with LaTeX
+  I want to be able to decode LaTeX symbol directives
+
+  Scenario Outline: LaTeX to Unicode transformation
+    When I decode the string '<latex>'
+    Then the result should be '<unicode>'
+
+  Scenarios: Arrows
+    | latex                | unicode |
+    | \\leftarrow          | ←       |
+    | \\uparrow            | ↑       |
+    | \\downarrow          | ↓       |
+    | \\rightarrow         | →       |
+
+  Scenarios: Whitespace
+    | latex | unicode | description        |
+    | x\\,x | x x     | small space        |
+    | x~x   | x x     | non-breaking space |
+    | ~x    |  x      | non-breaking space |
+

data/gems/gems/latex-decode-0.2.2/features/umlauts.feature

@@ -0,0 +1,11 @@
+Feature: Decode LaTeX umlauts
+	As a hacker who works with LaTeX
+	I want to be able to decode LaTeX umlauts
+	
+  Scenario: Lowercase german umlauts
+    When I decode the string '\"a\"o\"u'
+    Then the result should be 'äöü'
+
+  Scenario: Uppercase german umlauts
+    When I decode the string '\"A\"O\"U'
+    Then the result should be 'ÄÖÜ'

data/gems/gems/latex-decode-0.2.2/latex-decode.gemspec

@@ -0,0 +1,33 @@
+# -*- encoding: utf-8 -*-
+lib = File.expand_path('../lib/', __FILE__)
+$:.unshift lib unless $:.include?(lib)
+
+require 'latex/decode/version'
+
+Gem::Specification.new do |s|
+  s.name        = 'latex-decode'
+  s.version     = LaTeX::Decode::VERSION.dup
+  s.authors     = ['Sylvester Keil']
+  s.email       = ['http://sylvester.keil.or.at']
+  s.homepage    = 'http://github.com/inukshuk/latex-decode'
+  s.summary     = 'Decodes LaTeX to Unicode.'
+  s.description = 'Decodes strings formatted in LaTeX to equivalent Unicode strings.'
+  s.license     = 'GPL-3'
+
+  if RUBY_PLATFORM =~ /java/
+    s.platform    = 'java'
+  else
+    s.add_dependency('unicode', '~> 0.4')
+    s.platform    = 'ruby'
+  end
+
+  s.files        = `git ls-files`.split("\n")
+  s.test_files   = `git ls-files -- {test,spec,features}/*`.split("\n")
+  s.executables  = []
+  s.require_path = 'lib'
+
+  s.rdoc_options     = %w{--line-numbers --inline-source --title "LaTeX-Decode\ Documentation" --main README.md --webcvs=http://github.com/inukshuk/latex-decode/tree/master/}
+  s.extra_rdoc_files = %w{README.md LICENSE}
+end
+
+# vim: syntax=ruby

data/gems/gems/latex-decode-0.2.2/lib/latex/decode.rb

@@ -0,0 +1,54 @@
+#--
+# LaTeX::Decode
+# Copyright (C) 2011-2013 Sylvester Keil <sylvester.keil.or.at>
+# Copyright (C) 2010 François Charette
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#++
+
+require 'latex/decode/version'
+require 'latex/decode/compatibility'
+require 'latex/decode/base'
+
+require 'latex/decode/accents'
+require 'latex/decode/diacritics'
+require 'latex/decode/maths'
+require 'latex/decode/punctuation'
+require 'latex/decode/symbols'
+require 'latex/decode/greek'
+
+module LaTeX
+
+  class << self
+    def decode (string)
+      return string unless string.respond_to?(:to_s)
+
+      string = string.is_a?(String) ? string.dup : string.to_s
+
+      Decode::Base.normalize(string)
+
+      Decode::Maths.decode!(string)
+
+      Decode::Accents.decode!(string)
+      Decode::Diacritics.decode!(string)
+      Decode::Punctuation.decode!(string)
+      Decode::Symbols.decode!(string)
+      Decode::Greek.decode!(string)
+
+      Decode::Base.strip_braces(string)
+
+      LaTeX.normalize_C(string)
+    end
+  end
+end

data/gems/gems/latex-decode-0.2.2/lib/latex/decode/accents.rb

@@ -0,0 +1,36 @@
+# -*- coding: utf-8 -*-
+
+module LaTeX
+  module Decode
+    
+    class Accents < Decoder
+      @map = Hash[*%W{
+        `  \u0300
+        '  \u0301
+        ^  \u0302
+        ~  \u0303
+        =  \u0304
+        .  \u0307
+        '' \u0308
+        "  \u0308  
+      }.map { |s| LaTeX.to_unicode(s) }].freeze
+
+      @patterns = [
+        ruby_18 {
+          /\\(#{ map.keys.map { |k| Regexp.escape(k) }.join('|') })\{([[:alpha:]]+)\}/ou
+        } ||
+        ruby_19 {
+          /\\(#{ map.keys.map { |k| Regexp.escape(k) }.join('|') })\{(\p{L}\p{M}*)\}/ou
+        },
+        ruby_18 {
+          /\\(#{ map.keys.map { |k| Regexp.escape(k) }.join('|') })([[:alpha:]])/ou          
+        } ||
+        ruby_19 {
+          /\\(#{ map.keys.map { |k| Regexp.escape(k) }.join('|') })(\p{L}\p{M}*)/ou
+        }
+      ].freeze
+      
+    end
+
+  end
+end