unicode-types 1.0.0

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA1:
3
+ metadata.gz: 9b93d80fe62f3f1218284bf85048338b0d684c4c
4
+ data.tar.gz: 5eba94569c06428ceddf928034f85662fb0b1e13
5
+ SHA512:
6
+ metadata.gz: 56e416f18e96a487038868b11dc39b5f18674d503a5b71af3a411d54a8e25aa652841465125d2d0519d3225dfdb79bb872abe4f789d47b70a6bd082dc75aae34
7
+ data.tar.gz: bfd61c8ca952d317d6a895bceffe1d4181e543e9f48e8add9eb0f6ca3035b9337115f3d81bbb07bd560f3aa8876d30de0f288beb5239a03259c5791b8d119b45
data/.gitignore ADDED
@@ -0,0 +1,2 @@
1
+ Gemfile.lock
2
+ /pkg
data/.travis.yml ADDED
@@ -0,0 +1,21 @@
1
+ sudo: false
2
+ language: ruby
3
+
4
+ script: bundle exec ruby spec/unicode_types_spec.rb
5
+
6
+ rvm:
7
+ - 2.3.0
8
+ - 2.2
9
+ - 2.1
10
+ - ruby-head
11
+ - rbx-2
12
+ - jruby-head
13
+ - jruby-9.0.5.0
14
+
15
+ cache:
16
+ - bundler
17
+
18
+ matrix:
19
+ allow_failures:
20
+ - rvm: jruby-head
21
+ - rvm: rbx-2
data/CHANGELOG.md ADDED
@@ -0,0 +1,6 @@
1
+ ## CHANGELOG
2
+
3
+ ### 1.0.0
4
+
5
+ * Inital release
6
+
@@ -0,0 +1,74 @@
1
+ # Contributor Covenant Code of Conduct
2
+
3
+ ## Our Pledge
4
+
5
+ In the interest of fostering an open and welcoming environment, we as
6
+ contributors and maintainers pledge to making participation in our project and
7
+ our community a harassment-free experience for everyone, regardless of age, body
8
+ size, disability, ethnicity, gender identity and expression, level of experience,
9
+ nationality, personal appearance, race, religion, or sexual identity and
10
+ orientation.
11
+
12
+ ## Our Standards
13
+
14
+ Examples of behavior that contributes to creating a positive environment
15
+ include:
16
+
17
+ * Using welcoming and inclusive language
18
+ * Being respectful of differing viewpoints and experiences
19
+ * Gracefully accepting constructive criticism
20
+ * Focusing on what is best for the community
21
+ * Showing empathy towards other community members
22
+
23
+ Examples of unacceptable behavior by participants include:
24
+
25
+ * The use of sexualized language or imagery and unwelcome sexual attention or
26
+ advances
27
+ * Trolling, insulting/derogatory comments, and personal or political attacks
28
+ * Public or private harassment
29
+ * Publishing others' private information, such as a physical or electronic
30
+ address, without explicit permission
31
+ * Other conduct which could reasonably be considered inappropriate in a
32
+ professional setting
33
+
34
+ ## Our Responsibilities
35
+
36
+ Project maintainers are responsible for clarifying the standards of acceptable
37
+ behavior and are expected to take appropriate and fair corrective action in
38
+ response to any instances of unacceptable behavior.
39
+
40
+ Project maintainers have the right and responsibility to remove, edit, or
41
+ reject comments, commits, code, wiki edits, issues, and other contributions
42
+ that are not aligned to this Code of Conduct, or to ban temporarily or
43
+ permanently any contributor for other behaviors that they deem inappropriate,
44
+ threatening, offensive, or harmful.
45
+
46
+ ## Scope
47
+
48
+ This Code of Conduct applies both within project spaces and in public spaces
49
+ when an individual is representing the project or its community. Examples of
50
+ representing a project or community include using an official project e-mail
51
+ address, posting via an official social media account, or acting as an appointed
52
+ representative at an online or offline event. Representation of a project may be
53
+ further defined and clarified by project maintainers.
54
+
55
+ ## Enforcement
56
+
57
+ Instances of abusive, harassing, or otherwise unacceptable behavior may be
58
+ reported by contacting the project team at opensource@janlelis.com. All
59
+ complaints will be reviewed and investigated and will result in a response that
60
+ is deemed necessary and appropriate to the circumstances. The project team is
61
+ obligated to maintain confidentiality with regard to the reporter of an incident.
62
+ Further details of specific enforcement policies may be posted separately.
63
+
64
+ Project maintainers who do not follow or enforce the Code of Conduct in good
65
+ faith may face temporary or permanent repercussions as determined by other
66
+ members of the project's leadership.
67
+
68
+ ## Attribution
69
+
70
+ This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,
71
+ available at [http://contributor-covenant.org/version/1/4][version]
72
+
73
+ [homepage]: http://contributor-covenant.org
74
+ [version]: http://contributor-covenant.org/version/1/4/
data/Gemfile ADDED
@@ -0,0 +1,5 @@
1
+ source 'https://rubygems.org'
2
+
3
+ gemspec
4
+
5
+ gem 'minitest'
data/MIT-LICENSE.txt ADDED
@@ -0,0 +1,20 @@
1
+ Copyright (c) 2016 Jan Lelis, mail@janlelis.de
2
+
3
+ Permission is hereby granted, free of charge, to any person obtaining
4
+ a copy of this software and associated documentation files (the
5
+ "Software"), to deal in the Software without restriction, including
6
+ without limitation the rights to use, copy, modify, merge, publish,
7
+ distribute, sublicense, and/or sell copies of the Software, and to
8
+ permit persons to whom the Software is furnished to do so, subject to
9
+ the following conditions:
10
+
11
+ The above copyright notice and this permission notice shall be
12
+ included in all copies or substantial portions of the Software.
13
+
14
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
15
+ EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
16
+ MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
17
+ NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
18
+ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
19
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
20
+ WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
data/README.md ADDED
@@ -0,0 +1,46 @@
1
+ # Unicode::Types [![[version]](https://badge.fury.io/rb/unicode-types.svg)](http://badge.fury.io/rb/unicode-types) [![[travis]](https://travis-ci.org/janlelis/unicode-types.png)](https://travis-ci.org/janlelis/unicode-types)
2
+
3
+ Determine the basic type of codepoints. This can be one of:
4
+
5
+ - Graphic
6
+ - Format
7
+ - Control
8
+ - Private-use
9
+ - Surrogate
10
+ - Noncharacter
11
+ - Reserved
12
+
13
+ Unicode version: **8.0.0**
14
+
15
+ Supported Rubies: **2.3**, **2.2**, **2.1**
16
+
17
+ ## Gemfile
18
+
19
+ ```ruby
20
+ gem "unicode-types"
21
+ ```
22
+
23
+ ## Usage
24
+
25
+ ```ruby
26
+ require "unicode/types"
27
+
28
+ # All general types of a string
29
+ Unicode::Types.types("A\tb") # => ["Control", "Graphic"]
30
+
31
+ # Also aliased as .of
32
+ Unicode::Types.of("\u{FFFFF}") # => ["Noncharacter"]
33
+
34
+ # Single codepoint
35
+ Unicode::Types.type("\u{FFFFD}") # => "Reserved"
36
+ ```
37
+
38
+ The list of types is always sorted alphabetically.
39
+
40
+ See [unicode-x](https://github.com/janlelis/unicode-x) for more Unicode related micro libraries.
41
+
42
+ ## MIT License
43
+
44
+ - Copyright (C) 2016 Jan Lelis <http://janlelis.com>. Released under the MIT license.
45
+ - Unicode data: http://www.unicode.org/copyright.html#Exhibit1
46
+
data/Rakefile ADDED
@@ -0,0 +1,37 @@
1
+ # # #
2
+ # Get gemspec info
3
+
4
+ gemspec_file = Dir['*.gemspec'].first
5
+ gemspec = eval File.read(gemspec_file), binding, gemspec_file
6
+ info = "#{gemspec.name} | #{gemspec.version} | " \
7
+ "#{gemspec.runtime_dependencies.size} dependencies | " \
8
+ "#{gemspec.files.size} files"
9
+
10
+ # # #
11
+ # Gem build and install task
12
+
13
+ desc info
14
+ task :gem do
15
+ puts info + "\n\n"
16
+ print " "; sh "gem build #{gemspec_file}"
17
+ FileUtils.mkdir_p 'pkg'
18
+ FileUtils.mv "#{gemspec.name}-#{gemspec.version}.gem", 'pkg'
19
+ puts; sh %{gem install --no-document pkg/#{gemspec.name}-#{gemspec.version}.gem}
20
+ end
21
+
22
+ # # #
23
+ # Start an IRB session with the gem loaded
24
+
25
+ desc "#{gemspec.name} | IRB"
26
+ task :irb do
27
+ sh "irb -I ./lib -r #{gemspec.name.gsub '-','/'}"
28
+ end
29
+
30
+ # # #
31
+ # Run Specs
32
+
33
+ desc "#{gemspec.name} | Spec"
34
+ task :spec do
35
+ sh "for file in spec/*.rb; do ruby $file; done"
36
+ end
37
+ task default: :spec
Binary file
@@ -0,0 +1,35 @@
1
+ require_relative "types/constants"
2
+
3
+ module Unicode
4
+ module Types
5
+ def self.types(string)
6
+ res = []
7
+ string.each_char{ |char|
8
+ type_name = type(char)
9
+ res << type_name unless res.include?(type_name)
10
+ }
11
+ res.sort
12
+ end
13
+ class << self; alias of types; end
14
+
15
+ def self.type(char)
16
+ require_relative 'types/index' unless defined? ::Unicode::Types::INDEX
17
+ codepoint_depth_offset = char.unpack("U")[0] or
18
+ raise(ArgumentError, "Unicode::Types.type must be given a valid char")
19
+ index_or_value = INDEX[:TYPES]
20
+ [0x10000, 0x1000, 0x100, 0x10].each{ |depth|
21
+ index_or_value = index_or_value[codepoint_depth_offset / depth]
22
+ codepoint_depth_offset = codepoint_depth_offset % depth
23
+ unless index_or_value.is_a? Array
24
+ return INDEX[:TYPE_NAMES][index_or_value.to_i]
25
+ end
26
+ }
27
+ INDEX[:TYPE_NAMES][index_or_value[codepoint_depth_offset].to_i]
28
+ end
29
+
30
+ def self.names
31
+ require_relative 'types/index' unless defined? ::Unicode::Types::INDEX
32
+ INDEX[:TYPE_NAMES].dup
33
+ end
34
+ end
35
+ end
@@ -0,0 +1,9 @@
1
+ module Unicode
2
+ module Types
3
+ VERSION = "1.0.0".freeze
4
+ UNICODE_VERSION = "8.0.0".freeze
5
+ DATA_DIRECTORY = File.expand_path(File.dirname(__FILE__) + '/../../../data/').freeze
6
+ INDEX_FILENAME = (DATA_DIRECTORY + '/types.marshal.gz').freeze
7
+ end
8
+ end
9
+
@@ -0,0 +1,8 @@
1
+ require_relative 'constants'
2
+
3
+ module Unicode
4
+ module Types
5
+ INDEX = Marshal.load(Gem.gunzip(File.binread(INDEX_FILENAME)))
6
+ end
7
+ end
8
+
@@ -0,0 +1,8 @@
1
+ require_relative "../types"
2
+
3
+ class String
4
+ # Optional string extension for your convenience
5
+ def unicode_types
6
+ Unicode::Types.of(self)
7
+ end
8
+ end
@@ -0,0 +1,58 @@
1
+ require_relative "../lib/unicode/types"
2
+ require "minitest/autorun"
3
+
4
+ describe Unicode::Types do
5
+ describe ".types (alias .of)" do
6
+ it "will always return an Array" do
7
+ assert_equal [], Unicode::Types.of("")
8
+ end
9
+
10
+ it "will return all types that characters in the string belong to" do
11
+ assert_equal ["Control", "Graphic"], Unicode::Types.of("A\tb")
12
+ end
13
+
14
+ it "will return all types sorted order" do
15
+ assert_equal ["Control", "Graphic"], Unicode::Types.of("A\t")
16
+ assert_equal ["Control", "Graphic"], Unicode::Types.of("\tA")
17
+ end
18
+
19
+ it "will call .type for every character" do
20
+ mocked_method = MiniTest::Mock.new
21
+ mocked_method.expect :call, "first type", ["A"]
22
+ mocked_method.expect :call, "second type", ["2"]
23
+ Unicode::Types.stub :type, mocked_method do
24
+ Unicode::Types.of("A2")
25
+ end
26
+ mocked_method.verify
27
+ end
28
+ end
29
+
30
+ describe ".type" do
31
+ it "will return type for that character" do
32
+ assert_equal "Format", Unicode::Types.type("­")
33
+ end
34
+
35
+ it "will return Noncharacter for codepoints defined as noncharacter" do
36
+ assert_equal "Noncharacter", Unicode::Types.type("\u{10ffff}")
37
+ end
38
+
39
+ it "will return Reserved for unassigned codepoints" do
40
+ assert_equal "Reserved", Unicode::Types.type("\u{10c50}")
41
+ end
42
+ end
43
+
44
+ describe ".names" do
45
+ it "will return a list of all types" do
46
+ assert_equal %w[
47
+ Graphic
48
+ Format
49
+ Control
50
+ Private-use
51
+ Surrogate
52
+ Noncharacter
53
+ Reserved
54
+ ], Unicode::Types.names
55
+ end
56
+ end
57
+ end
58
+
@@ -0,0 +1,21 @@
1
+ # -*- encoding: utf-8 -*-
2
+
3
+ require File.dirname(__FILE__) + "/lib/unicode/types/constants"
4
+
5
+ Gem::Specification.new do |gem|
6
+ gem.name = "unicode-types"
7
+ gem.version = Unicode::Types::VERSION
8
+ gem.summary = "Determine the basic type of codepoints."
9
+ gem.description = "[Unicode version: #{Unicode::Types::UNICODE_VERSION}] Determine the basic type of codepoints (Graphic, Format, Control, Private-use, Surrogate, Noncharacter, Reserved)"
10
+ gem.authors = ["Jan Lelis"]
11
+ gem.email = ["mail@janlelis.de"]
12
+ gem.homepage = "https://github.com/janlelis/unicode-types"
13
+ gem.license = "MIT"
14
+
15
+ gem.files = Dir["{**/}{.*,*}"].select{ |path| File.file?(path) && path !~ /^pkg/ }
16
+ gem.executables = gem.files.grep(%r{^bin/}).map{ |f| File.basename(f) }
17
+ gem.test_files = gem.files.grep(%r{^(test|spec|features)/})
18
+ gem.require_paths = ["lib"]
19
+
20
+ gem.required_ruby_version = "~> 2.0"
21
+ end
metadata ADDED
@@ -0,0 +1,62 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: unicode-types
3
+ version: !ruby/object:Gem::Version
4
+ version: 1.0.0
5
+ platform: ruby
6
+ authors:
7
+ - Jan Lelis
8
+ autorequire:
9
+ bindir: bin
10
+ cert_chain: []
11
+ date: 2016-04-15 00:00:00.000000000 Z
12
+ dependencies: []
13
+ description: "[Unicode version: 8.0.0] Determine the basic type of codepoints (Graphic,
14
+ Format, Control, Private-use, Surrogate, Noncharacter, Reserved)"
15
+ email:
16
+ - mail@janlelis.de
17
+ executables: []
18
+ extensions: []
19
+ extra_rdoc_files: []
20
+ files:
21
+ - ".gitignore"
22
+ - ".travis.yml"
23
+ - CHANGELOG.md
24
+ - CODE_OF_CONDUCT.md
25
+ - Gemfile
26
+ - MIT-LICENSE.txt
27
+ - README.md
28
+ - Rakefile
29
+ - data/types.marshal.gz
30
+ - lib/unicode/types.rb
31
+ - lib/unicode/types/constants.rb
32
+ - lib/unicode/types/index.rb
33
+ - lib/unicode/types/string_ext.rb
34
+ - spec/unicode_types_spec.rb
35
+ - unicode-types.gemspec
36
+ homepage: https://github.com/janlelis/unicode-types
37
+ licenses:
38
+ - MIT
39
+ metadata: {}
40
+ post_install_message:
41
+ rdoc_options: []
42
+ require_paths:
43
+ - lib
44
+ required_ruby_version: !ruby/object:Gem::Requirement
45
+ requirements:
46
+ - - "~>"
47
+ - !ruby/object:Gem::Version
48
+ version: '2.0'
49
+ required_rubygems_version: !ruby/object:Gem::Requirement
50
+ requirements:
51
+ - - ">="
52
+ - !ruby/object:Gem::Version
53
+ version: '0'
54
+ requirements: []
55
+ rubyforge_project:
56
+ rubygems_version: 2.6.3
57
+ signing_key:
58
+ specification_version: 4
59
+ summary: Determine the basic type of codepoints.
60
+ test_files:
61
+ - spec/unicode_types_spec.rb
62
+ has_rdoc: