unicode-blocks 1.0.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 5b38f5df5fa5d73b475767811ca6d9c10c696843
+  data.tar.gz: c2d05210ad71351f206a61fa3caba9ae634c1fa2
+SHA512:
+  metadata.gz: 4635d1b9bd0e9dfd88aacf2dd6290255f5130d17efa9d7f615f18e70262822617d6bde4403d430762c80de8fc3f32a095747090eedba375ea0cd34ebac3726f9
+  data.tar.gz: ae83eaedb564caa8c3cda41c4b412c271e8844c22b0ee0ad44d9269da4ef860549edaa31dddfbed992524c9af9e330e366c2195c9b0ddb682ddf05e29f081121

data/.gitignore

@@ -0,0 +1,2 @@
+Gemfile.lock
+/pkg

data/.travis.yml

@@ -0,0 +1,21 @@
+sudo: false
+language: ruby
+
+script: bundle exec ruby spec/unicode_blocks_spec.rb
+
+rvm:
+- 2.3.0
+- 2.2
+- 2.1
+- ruby-head
+- rbx-2
+- jruby-head
+- jruby-9.0.5.0
+
+cache:
+- bundler
+
+matrix:
+  allow_failures:
+    - rvm: jruby-head
+    - rvm: rbx-2

data/CHANGELOG.md

@@ -0,0 +1,6 @@
+## CHANGELOG
+
+### 1.0.0
+
+* Inital release
+

data/CODE_OF_CONDUCT.md

@@ -0,0 +1,74 @@
+# Contributor Covenant Code of Conduct
+
+## Our Pledge
+
+In the interest of fostering an open and welcoming environment, we as
+contributors and maintainers pledge to making participation in our project and
+our community a harassment-free experience for everyone, regardless of age, body
+size, disability, ethnicity, gender identity and expression, level of experience,
+nationality, personal appearance, race, religion, or sexual identity and
+orientation.
+
+## Our Standards
+
+Examples of behavior that contributes to creating a positive environment
+include:
+
+* Using welcoming and inclusive language
+* Being respectful of differing viewpoints and experiences
+* Gracefully accepting constructive criticism
+* Focusing on what is best for the community
+* Showing empathy towards other community members
+
+Examples of unacceptable behavior by participants include:
+
+* The use of sexualized language or imagery and unwelcome sexual attention or
+advances
+* Trolling, insulting/derogatory comments, and personal or political attacks
+* Public or private harassment
+* Publishing others' private information, such as a physical or electronic
+  address, without explicit permission
+* Other conduct which could reasonably be considered inappropriate in a
+  professional setting
+
+## Our Responsibilities
+
+Project maintainers are responsible for clarifying the standards of acceptable
+behavior and are expected to take appropriate and fair corrective action in
+response to any instances of unacceptable behavior.
+
+Project maintainers have the right and responsibility to remove, edit, or
+reject comments, commits, code, wiki edits, issues, and other contributions
+that are not aligned to this Code of Conduct, or to ban temporarily or
+permanently any contributor for other behaviors that they deem inappropriate,
+threatening, offensive, or harmful.
+
+## Scope
+
+This Code of Conduct applies both within project spaces and in public spaces
+when an individual is representing the project or its community. Examples of
+representing a project or community include using an official project e-mail
+address, posting via an official social media account, or acting as an appointed
+representative at an online or offline event. Representation of a project may be
+further defined and clarified by project maintainers.
+
+## Enforcement
+
+Instances of abusive, harassing, or otherwise unacceptable behavior may be
+reported by contacting the project team at opensource@janlelis.com. All
+complaints will be reviewed and investigated and will result in a response that
+is deemed necessary and appropriate to the circumstances. The project team is
+obligated to maintain confidentiality with regard to the reporter of an incident.
+Further details of specific enforcement policies may be posted separately.
+
+Project maintainers who do not follow or enforce the Code of Conduct in good
+faith may face temporary or permanent repercussions as determined by other
+members of the project's leadership.
+
+## Attribution
+
+This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,
+available at [http://contributor-covenant.org/version/1/4][version]
+
+[homepage]: http://contributor-covenant.org
+[version]: http://contributor-covenant.org/version/1/4/

data/Gemfile

@@ -0,0 +1,5 @@
+source 'https://rubygems.org'
+
+gemspec
+
+gem 'minitest'

data/MIT-LICENSE.txt

@@ -0,0 +1,20 @@
+Copyright (c) 2016 Jan Lelis, mail@janlelis.de
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,324 @@
+# Unicode::Blocks [![[version]](https://badge.fury.io/rb/unicode-blocks.svg)](http://badge.fury.io/rb/unicode-blocks)  [![[travis]](https://travis-ci.org/janlelis/unicode-blocks.png)](https://travis-ci.org/janlelis/unicode-blocks)
+
+Each unicode character belongs to a [block](https://en.wikipedia.org/wiki/Unicode_block). This gem returns the all blocks asociated with the given string.
+
+Unicode version: **8.0.0**
+
+Supported Rubies: **2.3**, **2.2**, **2.1**
+
+## Gemfile
+
+```ruby
+gem "unicode-blocks"
+```
+
+## Usage
+
+```ruby
+require "unicode/blocks"
+
+# All blocks of a string
+Unicode::Blocks.blocks("Abc") # => ["Basic Latin"]
+Unicode::Blocks.blocks("СC") # => ["Cyrillic", "Basic Latin"]
+Unicode::Blocks.blocks("⧉⪥⟤") # => ["Miscellaneous Mathematical Symbols-A",
+                                    "Miscellaneous Mathematical Symbols-B",
+                                    "Supplemental Mathematical Operators"]
+
+# Also aliased as .of
+Unicode::Blocks.of("🃉🂹") # => ["Playing Cards"]
+Unicode::Blocks.of("\u{10c50}") # => ["No_Block"]
+
+# Single character
+Unicode::Blocks.block("☼") # => "Miscellaneous Symbols"
+```
+
+The list of blocks is always sorted alphabetically.
+
+## Hints
+
+### Regex Matching
+
+If you have a string and want to match a substring/character from a specific Unicode block, you actually won't need this gem. Instead, you can use the [Regexp Unicode Property Syntax `\p{}`](http://ruby-doc.org/core-2.3.0/Regexp.html#class-Regexp-label-Character+Properties) with blocks by prefixing the block name with "In":
+
+```ruby
+"⧉⪥⟤".scan(/\p{In Miscellaneous Mathematical Symbols-B}/) # => ["⧉"]
+```
+
+### Block Names
+
+You can retrieve all block names (except for **No_Block**) like this:
+
+```ruby
+require "unicode/blocks"
+puts Unicode::Blocks.names
+
+# # # Output # # #
+
+Basic Latin
+Latin-1 Supplement
+Latin Extended-A
+Latin Extended-B
+IPA Extensions
+Spacing Modifier Letters
+Combining Diacritical Marks
+Greek and Coptic
+Cyrillic
+Cyrillic Supplement
+Armenian
+Hebrew
+Arabic
+Syriac
+Arabic Supplement
+Thaana
+NKo
+Samaritan
+Mandaic
+Arabic Extended-A
+Devanagari
+Bengali
+Gurmukhi
+Gujarati
+Oriya
+Tamil
+Telugu
+Kannada
+Malayalam
+Sinhala
+Thai
+Lao
+Tibetan
+Myanmar
+Georgian
+Hangul Jamo
+Ethiopic
+Ethiopic Supplement
+Cherokee
+Unified Canadian Aboriginal Syllabics
+Ogham
+Runic
+Tagalog
+Hanunoo
+Buhid
+Tagbanwa
+Khmer
+Mongolian
+Unified Canadian Aboriginal Syllabics Extended
+Limbu
+Tai Le
+New Tai Lue
+Khmer Symbols
+Buginese
+Tai Tham
+Combining Diacritical Marks Extended
+Balinese
+Sundanese
+Batak
+Lepcha
+Ol Chiki
+Sundanese Supplement
+Vedic Extensions
+Phonetic Extensions
+Phonetic Extensions Supplement
+Combining Diacritical Marks Supplement
+Latin Extended Additional
+Greek Extended
+General Punctuation
+Superscripts and Subscripts
+Currency Symbols
+Combining Diacritical Marks for Symbols
+Letterlike Symbols
+Number Forms
+Arrows
+Mathematical Operators
+Miscellaneous Technical
+Control Pictures
+Optical Character Recognition
+Enclosed Alphanumerics
+Box Drawing
+Block Elements
+Geometric Shapes
+Miscellaneous Symbols
+Dingbats
+Miscellaneous Mathematical Symbols-A
+Supplemental Arrows-A
+Braille Patterns
+Supplemental Arrows-B
+Miscellaneous Mathematical Symbols-B
+Supplemental Mathematical Operators
+Miscellaneous Symbols and Arrows
+Glagolitic
+Latin Extended-C
+Coptic
+Georgian Supplement
+Tifinagh
+Ethiopic Extended
+Cyrillic Extended-A
+Supplemental Punctuation
+CJK Radicals Supplement
+Kangxi Radicals
+Ideographic Description Characters
+CJK Symbols and Punctuation
+Hiragana
+Katakana
+Bopomofo
+Hangul Compatibility Jamo
+Kanbun
+Bopomofo Extended
+CJK Strokes
+Katakana Phonetic Extensions
+Enclosed CJK Letters and Months
+CJK Compatibility
+CJK Unified Ideographs Extension A
+Yijing Hexagram Symbols
+CJK Unified Ideographs
+Yi Syllables
+Yi Radicals
+Lisu
+Vai
+Cyrillic Extended-B
+Bamum
+Modifier Tone Letters
+Latin Extended-D
+Syloti Nagri
+Common Indic Number Forms
+Phags-pa
+Saurashtra
+Devanagari Extended
+Kayah Li
+Rejang
+Hangul Jamo Extended-A
+Javanese
+Myanmar Extended-B
+Cham
+Myanmar Extended-A
+Tai Viet
+Meetei Mayek Extensions
+Ethiopic Extended-A
+Latin Extended-E
+Cherokee Supplement
+Meetei Mayek
+Hangul Syllables
+Hangul Jamo Extended-B
+High Surrogates
+High Private Use Surrogates
+Low Surrogates
+Private Use Area
+CJK Compatibility Ideographs
+Alphabetic Presentation Forms
+Arabic Presentation Forms-A
+Variation Selectors
+Vertical Forms
+Combining Half Marks
+CJK Compatibility Forms
+Small Form Variants
+Arabic Presentation Forms-B
+Halfwidth and Fullwidth Forms
+Specials
+Linear B Syllabary
+Linear B Ideograms
+Aegean Numbers
+Ancient Greek Numbers
+Ancient Symbols
+Phaistos Disc
+Lycian
+Carian
+Coptic Epact Numbers
+Old Italic
+Gothic
+Old Permic
+Ugaritic
+Old Persian
+Deseret
+Shavian
+Osmanya
+Elbasan
+Caucasian Albanian
+Linear A
+Cypriot Syllabary
+Imperial Aramaic
+Palmyrene
+Nabataean
+Hatran
+Phoenician
+Lydian
+Meroitic Hieroglyphs
+Meroitic Cursive
+Kharoshthi
+Old South Arabian
+Old North Arabian
+Manichaean
+Avestan
+Inscriptional Parthian
+Inscriptional Pahlavi
+Psalter Pahlavi
+Old Turkic
+Old Hungarian
+Rumi Numeral Symbols
+Brahmi
+Kaithi
+Sora Sompeng
+Chakma
+Mahajani
+Sharada
+Sinhala Archaic Numbers
+Khojki
+Multani
+Khudawadi
+Grantha
+Tirhuta
+Siddham
+Modi
+Takri
+Ahom
+Warang Citi
+Pau Cin Hau
+Cuneiform
+Cuneiform Numbers and Punctuation
+Early Dynastic Cuneiform
+Egyptian Hieroglyphs
+Anatolian Hieroglyphs
+Bamum Supplement
+Mro
+Bassa Vah
+Pahawh Hmong
+Miao
+Kana Supplement
+Duployan
+Shorthand Format Controls
+Byzantine Musical Symbols
+Musical Symbols
+Ancient Greek Musical Notation
+Tai Xuan Jing Symbols
+Counting Rod Numerals
+Mathematical Alphanumeric Symbols
+Sutton SignWriting
+Mende Kikakui
+Arabic Mathematical Alphabetic Symbols
+Mahjong Tiles
+Domino Tiles
+Playing Cards
+Enclosed Alphanumeric Supplement
+Enclosed Ideographic Supplement
+Miscellaneous Symbols and Pictographs
+Emoticons
+Ornamental Dingbats
+Transport and Map Symbols
+Alchemical Symbols
+Geometric Shapes Extended
+Supplemental Arrows-C
+Supplemental Symbols and Pictographs
+CJK Unified Ideographs Extension B
+CJK Unified Ideographs Extension C
+CJK Unified Ideographs Extension D
+CJK Unified Ideographs Extension E
+CJK Compatibility Ideographs Supplement
+Tags
+Variation Selectors Supplement
+Supplementary Private Use Area-A
+Supplementary Private Use Area-B
+```
+
+## MIT License
+
+- Copyright (C) 2016 Jan Lelis <http://janlelis.com>. Released under the MIT license.
+- Unicode data: http://www.unicode.org/copyright.html#Exhibit1

data/Rakefile

@@ -0,0 +1,37 @@
+# # #
+# Get gemspec info
+
+gemspec_file = Dir['*.gemspec'].first
+gemspec = eval File.read(gemspec_file), binding, gemspec_file
+info = "#{gemspec.name} | #{gemspec.version} | " \
+       "#{gemspec.runtime_dependencies.size} dependencies | " \
+       "#{gemspec.files.size} files"
+
+# # #
+# Gem build and install task
+
+desc info
+task :gem do
+  puts info + "\n\n"
+  print "  "; sh "gem build #{gemspec_file}"
+  FileUtils.mkdir_p 'pkg'
+  FileUtils.mv "#{gemspec.name}-#{gemspec.version}.gem", 'pkg'
+  puts; sh %{gem install --no-document pkg/#{gemspec.name}-#{gemspec.version}.gem}
+end
+
+# # #
+# Start an IRB session with the gem loaded
+
+desc "#{gemspec.name} | IRB"
+task :irb do
+  sh "irb -I ./lib -r #{gemspec.name.gsub '-','/'}"
+end
+
+# # #
+# Run Specs
+
+desc "#{gemspec.name} | Spec"
+task :spec do
+  sh "for file in spec/*.rb; do ruby $file; done"
+end
+task default: :spec

data/lib/unicode/blocks.rb

@@ -0,0 +1,28 @@
+require_relative "blocks/constants"
+
+module Unicode
+  module Blocks
+    def self.blocks(string)
+      res = []
+      string.each_char{ |char|
+        block_name = block(char)
+        res << block_name unless res.include?(block_name)
+      }
+      res.sort
+    end
+    class << self; alias of blocks; end
+
+    def self.block(char)
+      require_relative 'blocks/index' unless defined? ::Unicode::Blocks::INDEX
+      codepoint = char.unpack("U")[0] or raise(ArgumentError, "Unicode::Blocks.block must be given a valid char")
+      block_info = INDEX.bsearch{ |block_info| codepoint <= block_info[1] }
+      codepoint >= block_info[0] ? block_info[2] : "No_Block"
+    end
+
+    def self.names
+      require_relative 'blocks/index' unless defined? ::Unicode::Blocks::INDEX
+      INDEX.map(&:last)
+    end
+  end
+end
+

data/lib/unicode/blocks/constants.rb

@@ -0,0 +1,9 @@
+module Unicode
+  module Blocks
+    VERSION = "1.0.0".freeze
+    UNICODE_VERSION = "8.0.0".freeze
+    DATA_DIRECTORY = File.expand_path(File.dirname(__FILE__) + '/../../../data/').freeze
+    INDEX_FILENAME = (DATA_DIRECTORY + '/blocks.marshal.gz').freeze
+  end
+end
+

data/lib/unicode/blocks/index.rb

@@ -0,0 +1,7 @@
+require_relative 'constants'
+
+module Unicode
+  module Blocks
+    INDEX = Marshal.load(Gem.gunzip(File.binread(INDEX_FILENAME)))
+  end
+end

data/lib/unicode/blocks/string_ext.rb

@@ -0,0 +1,8 @@
+require_relative "../blocks"
+
+class String
+  # Optional string extension for your convenience
+  def unicode_blocks
+    Unicode::Blocks.of(self)
+  end
+end

data/spec/unicode_blocks_spec.rb

@@ -0,0 +1,47 @@
+require_relative "../lib/unicode/blocks"
+require "minitest/autorun"
+
+describe Unicode::Blocks do
+  describe ".blocks (alias .of)" do
+    it "will always return an Array" do
+      assert_equal [], Unicode::Blocks.of("")
+    end
+
+    it "will return all blocks that characters in the string belong to" do
+      assert_equal ["Basic Latin", "Cyrillic"], Unicode::Blocks.of("СC")
+    end
+
+    it "will return all blocks in sorted order" do
+      assert_equal ["Basic Latin", "Cyrillic"], Unicode::Blocks.of("СA")
+      assert_equal ["Basic Latin", "Cyrillic"], Unicode::Blocks.of("AС")
+    end
+
+    it "will call .block for every character" do
+      mocked_method = MiniTest::Mock.new
+      mocked_method.expect :call, "first block",  ["С"]
+      mocked_method.expect :call, "second block", ["A"]
+      Unicode::Blocks.stub :block, mocked_method do
+        Unicode::Blocks.of("СA")
+      end
+      mocked_method.verify
+    end
+  end
+
+  describe ".block" do
+    it "will return block for that character" do
+      assert_equal "Specials", Unicode::Blocks.block("�")
+    end
+
+    it "will return No_Block for characters not in any block" do
+      assert_equal "No_Block", Unicode::Blocks.block("\u{10c50}")
+    end
+  end
+
+  describe ".names" do
+    it "will return a list of all block names" do
+      assert_kind_of Array, Unicode::Blocks.names
+      assert_includes Unicode::Blocks.names, "Ancient Symbols"
+    end
+  end
+end
+

data/unicode-blocks.gemspec

@@ -0,0 +1,21 @@
+# -*- encoding: utf-8 -*-
+
+require File.dirname(__FILE__) + "/lib/unicode/blocks/constants"
+
+Gem::Specification.new do |gem|
+  gem.name          = "unicode-blocks"
+  gem.version       = Unicode::Blocks::VERSION
+  gem.summary       = "Return Unicode blocks of a string."
+  gem.description   = "[Unicode version: #{Unicode::Blocks::UNICODE_VERSION}] Determine to which Unicode block characters belong to."
+  gem.authors       = ["Jan Lelis"]
+  gem.email         = ["mail@janlelis.de"]
+  gem.homepage      = "https://github.com/janlelis/unicode-blocks"
+  gem.license       = "MIT"
+
+  gem.files         = Dir["{**/}{.*,*}"].select{ |path| File.file?(path) && path !~ /^pkg/ }
+  gem.executables   = gem.files.grep(%r{^bin/}).map{ |f| File.basename(f) }
+  gem.test_files    = gem.files.grep(%r{^(test|spec|features)/})
+  gem.require_paths = ["lib"]
+
+  gem.required_ruby_version = "~> 2.0"
+end

metadata

@@ -0,0 +1,62 @@
+--- !ruby/object:Gem::Specification
+name: unicode-blocks
+version: !ruby/object:Gem::Version
+  version: 1.0.0
+platform: ruby
+authors:
+- Jan Lelis
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2016-04-13 00:00:00.000000000 Z
+dependencies: []
+description: "[Unicode version: 8.0.0] Determine to which Unicode block characters
+  belong to."
+email:
+- mail@janlelis.de
+executables: []
+extensions: []
+extra_rdoc_files: []
+files:
+- ".gitignore"
+- ".travis.yml"
+- CHANGELOG.md
+- CODE_OF_CONDUCT.md
+- Gemfile
+- MIT-LICENSE.txt
+- README.md
+- Rakefile
+- data/blocks.marshal.gz
+- lib/unicode/blocks.rb
+- lib/unicode/blocks/constants.rb
+- lib/unicode/blocks/index.rb
+- lib/unicode/blocks/string_ext.rb
+- spec/unicode_blocks_spec.rb
+- unicode-blocks.gemspec
+homepage: https://github.com/janlelis/unicode-blocks
+licenses:
+- MIT
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - "~>"
+    - !ruby/object:Gem::Version
+      version: '2.0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 2.6.3
+signing_key: 
+specification_version: 4
+summary: Return Unicode blocks of a string.
+test_files:
+- spec/unicode_blocks_spec.rb
+has_rdoc: