unidecoder 1.1.0 → 1.1.1

data/Changelog.md

@@ -1,5 +1,16 @@
 # Unidecoder Changelog
 
+## 1.1.1 2010-08-11
+
+* Added some missing transliterations.
+* Fixed some other incorrect transliterations.
+
+## 1.1.0 2010-06-23
+
+* Ability to override transliterations.
+* Better Unicode validation.
+* Cleanups and refactoring.
+
 ## 1.0.0 2009-02-20
 
 * Unidecoder extracted from Stringex and released as independent gem.

data/README.md

@@ -10,7 +10,7 @@ separate library with some added functionality.
 
 The Unidecoder component of Stringex is itself a port of Sean M. Burke's
 [Unidecode](http://search.cpan.org/dist/Text-Unidecode/lib/Text/Unidecode.pm)
-Unidecode Perl module.
+Perl module.
 
 ## Installation
 
@@ -29,3 +29,23 @@ If you also install either the [Unicode](http://github.com/blackwinter/unicode)
 **or** [Active Support](http://github.com/rails/rails) gems, Unidecoder will
 also perform Unicode normalization before attempting to transliterate strings
 to ASCII.
+
+## Warnings
+
+While this is a neat trick, in practice many transliterations end up being
+fairly useless. For example, all Chinese characters are transliterated to
+Mandarin Chinese. Since Japanese uses Chinese characters writing, but
+pronounces them differently from Mandarin, this makes the transliteration of
+Japanese with this library useless.
+
+Some languages, like Russian, would most correctly transliterate some letters
+based on context, rather than a 1-1 mapping with ASCII. This library does not
+do that.
+
+Other languages, like Hebrew and Arabic, don't write vowels, but assume them
+from context, so the ASCII representation of these langages given by this
+library will look fairly ugly to native speakers.
+
+Basically, your milage may vary. I don't speak every language used by this
+library, so there are certain to be limitations and errors. Your feedback is
+most appreciated!

data/lib/unidecoder/data/x00.yml

@@ -220,7 +220,7 @@
 - U
 - U
 - U
-- U
+- Y
 - Th
 - ss
 - a

data/lib/unidecoder/data/x02.yml

@@ -31,8 +31,8 @@
 - y
 - H
 - h
-- '[?]'
-- '[?]'
+- N
+- d
 - OU
 - ou
 - Z
@@ -51,34 +51,34 @@
 - o
 - Y
 - y
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
-- '[?]'
+- l
+- n
+- t
+- j
+- db
+- qp
+- A
+- C
+- c
+- L
+- T
+- s
+- z
+- '?'
+- '?'
+- B
+- U
+- V
+- E
+- e
+- J
+- j
+- Q
+- q
+- R
+- r
+- Y
+- y
 - a
 - a
 - a
@@ -173,8 +173,8 @@
 - lz
 - WW
 - ']]'
-- '[?]'
-- '[?]'
+- h
+- h
 - k
 - h
 - j

data/lib/unidecoder/version.rb

@@ -2,7 +2,7 @@ module Unidecoder
   module Version
     MAJOR = 1
     MINOR = 1
-    TINY = 0
+    TINY = 1
     BUILD = nil
     STRING = [MAJOR, MINOR, TINY, BUILD].compact.join('.')
   end

metadata

@@ -5,8 +5,8 @@ version: !ruby/object:Gem::Version
   segments: 
   - 1
   - 1
-  - 0
-  version: 1.1.0
+  - 1
+  version: 1.1.1
 platform: ruby
 authors: 
 - Russell Norris
@@ -15,7 +15,7 @@ autorequire:
 bindir: bin
 cert_chain: []
 
-date: 2010-06-23 00:00:00 -03:00
+date: 2010-08-11 00:00:00 -03:00
 default_executable: 
 dependencies: []