twitter_cldr 4.0.0 → 4.1.0

data/History.txt

@@ -1,282 +0,0 @@
-== 4.0.0
-* Upgrade to Unicode v8.0.0, CLDR v29, and ICU 57.1.
-* Add support for fields.
-* Update plural rules with several bug fixes.
-* Add support for hyphenation (uses LibreOffice/Hunspell data).
-* Add support for transliteration.
-
-== 3.6.0
-* Override South Korean postal code format, which changed recently.
-
-== 3.5.0
-* Only add JSON as a dependency if running under Ruby < 2 (#191).
-
-== 3.4.0
-* Add units support, eg. "12 degrees Celsius", etc.
-
-== 3.3.0
-* Added `#as_territory` convenience method to LocalizedSymbol (@Anthony-Gaudino).
-* Improved documentation for world territories (@Anthony-Gaudino).
-* Fixed issues with Unicode regular expressions
-  - Unicode properties not recognized correctly
-  - Unicode properties not unioned correctly when placed side-by-side
-  - Inverted unicode properties not unioned correctly
-  - Leading dashes in character classes now treated as literals instead of as
-    denoting a range
-
-== 3.2.1
-* Fix units for Gujarati, Kannada, Marathi
-
-== 3.2.0
-* Add Gujarati, Kannada, Marathi
-
-== 3.1.2
-* Add 'short' as a valid weekday names form in Shared::Calendar.
-
-== 3.1.1
-* Fixed an issue with single quotes appearing in dates formatting.
-* Added support for locale codes that have region code in lower case.
-* Fixed time zone formatting for DateTime objects.
-
-== 3.1.0
-
-* Updated resources from CLDR v26 (except the collation data).
-* Added support for ordinal plurals.
-* Added PostalCodes#find_all method.
-* Added negative numbers abbreviation.
-* Fixed pluralization for abbreviated numbers.
-* Fixed pluralization rules by not merging 'en' rules into every locale.
-
-== 3.0.10
-
-* Adding Date back in as a localizable object.
-
-== 3.0.9
-
-* Fixing date and time formatting issue where calling `to_additional_s` on an instance of `LocalizedDate` could raise an error.
-
-== 3.0.8
-
-* Fixing issue causing extraneous single quotes to appear in formatted dates and times.
-
-== 3.0.7
-
-* Territories containment support.
-
-== 3.0.6
-
-* Add en-150 and es-419 locales.
-
-== 3.0.5
-
-* Fixed short numbers formatting for ru and other locales that use patterns
-  with literal periods.
-
-== 3.0.4
-
-* Fixed short numbers formatting for ja, ko, af, and a few other locales.
-* Added more locales: de-CH, en-AU, en-CA, en-GB, en-IE, en-SG, en-ZA,
-  es-CO, es-MX, es-US, fr-BE, fr-CA, fr-CH, it-CH.
-
-== 3.0.3
-
-* Rubinius support.
-
-== 3.0.2
-
-* Adding ability to generate sample postal codes from their regexes.
-
-== 3.0.1
-
-* Fixing abbreviated timespan formats for en-GB (backport from 2.4.3).
-
-== 3.0.0
-
-* Adding maximum_level option to SortKeyBuilder to limit the size of collation sort keys (@jrochkind).
-* Significant performance enhancements for normalization via the eprun gem.
-* Adding the rule-based number formatters (123 becomes "one hundred twenty-three").
-* Major overhaul of most formatters, now using data readers to encapsulate format options and read pattern data.
-* Adding support for different numbering systems (eg. arab, latn, etc), number formatter updated accordingly.
-* Partial upgrade to CLDR v24 (missing units).
-* Support for simple/full/Turkic casefolding. Upper/lowercasing support still needed.
-* Support for Unicode regular expressions. Requires oniguruma for use in Ruby 1.8.
-* Text segmentation by sentence (word and line support coming soon).
-* Executable README.
-
-== 2.4.3
-
-* Fixing abbreviated timespan formats for en-GB.
-
-== 2.4.2
-
-* Fixing non-quoted symbol error in en-GB plural resource file.
-
-== 2.4.1
-
-* Upgrade to CLDR v23.1, ICU4J 51.2.
-* Adding en-GB locale (British English).
-* Partial support for Ruby 2.0 (yaml no longer breaks, may not dump correctly).
-
-== 2.4.0
-
-* Upgrade to CLDR v23.
-* Ability to disable loading of any custom locale resources.
-* Long and short decimal formatters now respect the :precision option.
-
-== 2.3.0
-
-* Adding timezone support to date/time formatting.
-* Removing the localize method from Date objects.  Call to_date on a LocalizedDateTime or LocalizedTime object instead.
-
-== 2.2.0
-
-* Relaxing JSON dependency to give users more version flexibility. JSON gem now has no version number in twitter-cldr-rb.
-
-== 2.1.1
-
-* Modified AdditionalDateFormatSelector to return the correct format on exact format match.
-
-== 2.1.0
-
-* Significant performance improvements (memoization, resource preloading).
-* Number parsing.
-* Custom Hebrew units (thanks @yarons!)
-* Icelandic and Croatian support.
-* Global locale setter and fallbacks.
-* Support for territories from CLDR.
-
-== 2.0.2
-
-* Added support for Vietnamese.
-
-== 2.0.1
-
-* Fixed bug for additional date formats that was causing the wrong format to be returned.
-
-== 2.0.0
-
-* Added locales ga, ta, gl, cy, sr, bg, ku, ro, lv, be, sq, sk, and bn.
-* Added additional date formats.
-* Upgraded to CLDR 22.1.
-* Imported currency symbols and formatting rules from CLDR.
-* Added support for short/long numbers (eg. 1M for 1,000,000).
-* Improved RCov/Simplecov support.
-* Added custom Hungarian plurals rule.
-* Added support for approximate timespans (relative times).
-
-=== 1.9.1
-
-* Locale resources now exported without Unicode escape sequences.
-
-=== 1.9.0
-
-* Included Unicode-safe YAML dumping support via an adaptation of the ya2yaml gem.
-* Implemented the Unicode Bidirectional Algorithm to help reorder mixed right-to-left and left-to-right text.
-* Added list formatting support.
-
-=== 1.8.1
-
-* Improved, more accurate Finnish and Chinese collation support.
-* Moved JavaScript build environment to twitter-cldr-js.
-
-=== 1.8.0
-
-* Added support for language code conversion.
-* `#localize` methods (eg. for Hash, String, etc) now dynamically generated, part of the `TwitterCldr::Localized` namespace.
-* New convenience method `TwitterCldr::Normalization#normalize`.
-
-=== 1.7.0
-
-* Wrote rake tasks to update CLDR and ICU resources.
-* All resource files now written with symbolized keys so the gem doesn't have to recursively symbolize them on load.
-* Unicode code points now represented internally with integers instead of strings for better performance.
-* Added number formatting in JavaScript.
-* Added telephone code lookup functionality (per country) and postal code validation.
-
-=== 1.6.2
-
-* Collation tries now loaded from marshal dumps, collation running time improved by ~80%.
-
-=== 1.6.1
-
-* Added case-first collation element tailoring support for languages like Danish.
-* Included a missing development dependency (ruby_parser).
-
-=== 1.6.0
-
-* Added locale-aware collation via fractional collation element tailoring.
-* Added #sort and #sort! methods to LocalizedArray.
-* Added JavaScript relative time functionality, eg. "2 seconds ago".
-
-=== 1.5.0
-
-* Added collation (sorting) support via the Unicode Collation Algorithm.
-* Added Catalan, Basque, Greek, Afrikaans, Ukrainian, and Czech support along with calendar fixes for existing locales.
-* DateTimeTokenizer now falls back on English if the given locale isn't supported.
-
-=== 1.4.1
-
-* Added ability to use NFC and NFKC in core_ext/string
-
-=== 1.4.0
-
-* Added NFC and NFKC algorithms.
-* Refactored Shared::UnicodeData::Attributes into Shared::CodePoint.
-
-=== 1.3.6
-
-* Added relative time functionality, eg. "2 seconds ago".
-
-=== 1.3.0
-
-* Reorganized locale resources.
-* Added explicit specs for examples in the README.
-* ArgumentError now raised if a resource can't be found.
-* Fixed behavior of the :precision option for number formatting.
-* Updated CLDR data to v21 (http://cldr.unicode.org/index/downloads/cldr-21).
-* Added support for localized arrays (i.e. arrays of Unicode code points).
-
-=== 1.2.0
-
-* Added NFKD normalization algorithm.
-* Formatter tokens now cached for better performance.
-* Improvements to core extensions (Symbol, Date, etc).
-* Added full normalization test from unicode.org.
-* Autoload classes to improve performance.
-
-=== 1.1.0
-
-* Plural support [@KL-7]
-* Unicode data, decomposition [@timothyandrew]
-
-=== 1.0.1
-
-* Fixed a US-ASCII bug that caused rake errors. This fix applies to both Ruby 1.8 and 1.9.
-* Fixed a regexp error in a test function, as well as a tokenizer bug. All tests now pass.
-* Added support for Travis, a distributed build platform.
-
-=== 1.0.0
-
-* Look ma, I'm open source!
-
-=== 0.1.4
-
-* Added functionality to gracefully fall back on default locale if chosen locale is unsupported.
-
-=== 0.1.3
-
-* Added support for Arabic, Hebrew, Farsi, Thai, and Urdu.
-
-=== 0.1.2
-
-* Added world language support.
-
-=== 0.1.1
-
-* Localized dates, times, and datetimes can now be interchangeably converted to each other.
-* Fixed a bug that would not allow lookup of resource data by string (only symbol).
-* Added really basic plural support.
-
-=== 0.1.0
-
-* Birthday!

data/lib/twitter_cldr/resources/collation_tries_dumper.rb

@@ -1,43 +0,0 @@
-# encoding: UTF-8
-
-# Copyright 2012 Twitter, Inc
-# http://www.apache.org/licenses/LICENSE-2.0
-
-module TwitterCldr
-  module Resources
-
-    module CollationTriesDumper
-
-      class << self
-
-        def update_dumps
-          update_default_trie_dump
-          TwitterCldr.supported_locales.each { |locale| update_tailoring_trie_dump(locale) }
-        end
-
-        private
-
-        def update_default_trie_dump
-          save_trie_dump(TwitterCldr::Collation::TrieLoader::DEFAULT_TRIE_LOCALE, default_trie)
-        end
-
-        def update_tailoring_trie_dump(locale)
-          save_trie_dump(locale, TwitterCldr::Collation::TrieBuilder.load_tailored_trie(locale, @default_trie))
-        end
-
-        def save_trie_dump(locale, trie)
-          path = TwitterCldr::Collation::TrieLoader.dump_path(locale)
-          FileUtils.mkdir_p(File.dirname(path))
-
-          File.open(path, 'w') { |f| f.write(Marshal.dump(trie)) }
-        end
-
-        def default_trie
-          @default_trie ||= TwitterCldr::Collation::TrieBuilder.load_default_trie
-        end
-      end
-
-    end
-
-  end
-end

data/lib/twitter_cldr/resources/custom_locales_resources_importer.rb

@@ -1,80 +0,0 @@
-# encoding: UTF-8
-
-# Copyright 2012 Twitter, Inc
-# http://www.apache.org/licenses/LICENSE-2.0
-
-require 'json'
-require 'open-uri'
-
-module TwitterCldr
-  module Resources
-
-    class CustomLocalesResourcesImporter
-
-      API_ENDPOINT = "http://translate.twitter.com/api/2/twitter/phrase/%s/translations.json"
-
-      TIME_PERIODS = {
-        day:    19636,
-        hour:   19638,
-        minute: 19634,
-        second: 19639
-      }
-
-      # Arguments:
-      #
-      #   output_path - output directory for imported YAML files
-      #
-      def initialize(output_path)
-        @output_path = output_path
-      end
-
-      def import
-        import_units
-      end
-
-      private
-
-      def import_units
-        fetch_units_data.each do |locale, data|
-          dir_path = File.join(@output_path, locale.to_s)
-
-          FileUtils.mkpath(dir_path)
-
-          File.open(File.join(dir_path, 'units.yml'), 'w:utf-8') do |output|
-            output.write(YAML.dump({ locale => data }))
-          end
-        end
-      end
-
-      def fetch_units_data
-        TIME_PERIODS.inject({}) do |result, (label, id)|
-          api_response = JSON.parse(open(API_ENDPOINT % id).read)
-
-          TwitterCldr.supported_locales.each do |locale|
-            twitter_locale = TwitterCldr.twitter_locale(locale).to_s
-
-            next unless api_response[twitter_locale]
-
-            patterns = TwitterCldr::Formatters::Plurals::Rules.all_for(locale).inject({}) do |memo, rule|
-              memo[rule] = api_response[twitter_locale].gsub("%{number}", "{0}"); memo
-            end
-
-            set_value(result, patterns, locale, :units, label, :abbreviated)
-          end
-
-          result
-        end
-      end
-
-      def set_value(hash, value, *path)
-        last = path[0..-2].inject(hash) do |current, level|
-          current[level] ||= {}
-        end
-
-        last[path.last] = value
-      end
-
-    end
-
-  end
-end

data/lib/twitter_cldr/resources/download.rb

@@ -1,64 +0,0 @@
-# encoding: UTF-8
-
-# Copyright 2012 Twitter, Inc
-# http://www.apache.org/licenses/LICENSE-2.0
-
-module TwitterCldr
-  module Resources
-
-    CLDR_URL    = "http://unicode.org/Public/cldr/#{Versions.cldr_version}/core.zip"
-    ICU4J_URL   = "http://download.icu-project.org/files/icu4j/#{Versions.icu_version}/icu4j-#{Versions.icu_version.gsub('.', '_')}.jar"
-    UNICODE_URL = "ftp://ftp.unicode.org/Public/#{Versions.unicode_version}"
-
-    class << self
-
-      def download_if_necessary(path, url)
-        if File.file?(path)
-          puts "Using '#{path}'."
-        else
-          puts "Downloading '#{url}' to '#{path}'."
-          FileUtils.mkdir_p(File.dirname(path))
-          system("curl #{url} -o #{path}")
-        end
-
-        path
-      end
-
-      def download_cldr_if_necessary(path, url = CLDR_URL)
-        if File.directory?(path)
-          puts "Using CLDR data from '#{path}'."
-        else
-          begin
-            require 'zip'
-          rescue LoadError
-            raise StandardError.new("Unable to require 'zip'. Please switch to at least Ruby 1.9, then rebundle and try again.")
-          end
-
-          require 'cldr/download'
-
-          puts "Downloading CLDR data from '#{url}' to '#{path}'."
-          Cldr.download(url, path)
-        end
-
-        path
-      end
-
-      def download_icu4j_if_necessary(path, url = ICU4J_URL)
-        download_if_necessary(path, url)
-        path
-      end
-
-      def download_unicode_data_if_necessary(path, url)
-        download_if_necessary(path, join_urls(UNICODE_URL, url))
-      end
-
-      private
-
-      def join_urls(*urls)
-        urls.map { |u| u.chomp('/') }.join('/')
-      end
-
-    end
-
-  end
-end