linkify-it-rb 0.1.0.0 → 1.0.0.2

Sign up to get free protection for your applications and to get access to all the features.
Files changed (7) hide show
  1. checksums.yaml +4 -4
  2. data/README.md +66 -73
  3. data/lib/linkify-it-rb/index.rb +18 -26
  4. data/lib/linkify-it-rb/re.rb +28 -29
  5. data/lib/linkify-it-rb/version.rb +1 -1
  6. data/spec/linkify-it-rb/test_spec.rb +153 -166
  7. metadata +2 -2
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
2
  SHA1:
3
- metadata.gz: 8899eb2fafae9f6ce4105221dc2342c93de1ca5c
4
- data.tar.gz: 493bb38504a90c6f6c9dfa870364758370ee548e
3
+ metadata.gz: 6c47469712f3d6de315f05caeca61b4c02c52a32
4
+ data.tar.gz: 3b51dd1d0651a17efb07cacb27df11615f17683e
5
5
  SHA512:
6
- metadata.gz: 01ebcaaaa3238631990a3212f5058d69bd58b7f336576e82ac101745f25ddf7dbd948b81013eda800a388d845ab99fa23f75d2d6d90db35368d90a9b92e5f6b2
7
- data.tar.gz: 0b9c9fbfe357d9b3c78c2def0bd9f51f08cb0b39335e85c8bb791d483c4e589bf3a5d860357584591e3fe8277f6226310dff04a5235ed0c783472d7ac7803663
6
+ metadata.gz: 5ace911d1c5873013966ad4c0438e6d933270d126adf686d2544205b906bd2364fd4290b5585967fa06716798061943161af029d3ece148809eef4f47261fa54
7
+ data.tar.gz: 3c3fdf523803ce1641a40ae659fd8d40508469f44843c2d435ef4fc775c7bc6423638a8c32c66cd03f149b3df35f48ea46671e799b0f2c42af61dbfc6299451f
data/README.md CHANGED
@@ -1,115 +1,108 @@
1
1
  # linkify-it-rb
2
2
 
3
- Links recognition library with FULL unicode support. Focused on high quality link patterns detection in plain text. For use with both Ruby and RubyMotion.
3
+ [![Gem Version](https://badge.fury.io/rb/linkify-it-rb.svg)](http://badge.fury.io/rb/linkify-it-rb)
4
+
5
+ Links recognition library with full unicode support. Focused on high quality link pattern detection in plain text. For use with both Ruby and RubyMotion.
4
6
 
5
7
  This gem is a port of the [linkify-it javascript package](https://github.com/markdown-it/linkify-it) by Vitaly Puzrin, that is used for the [markdown-it](https://github.com/markdown-it/markdown-it) package.
6
8
 
7
9
  __[Javascript Demo](http://markdown-it.github.io/linkify-it/)__
8
10
 
9
- _Note:_ This gem is still in progress - some of the Unicode support is still being worked on.
11
+ Features:
10
12
 
13
+ - Full unicode support, with astral characters
14
+ - International domain support
15
+ - Allows rules extension & custom normalizers
11
16
 
12
- ## To be updated: Original Javascript package documentation
13
17
 
14
- Why it's awesome:
18
+ Install
19
+ -------
15
20
 
16
- - Full unicode support, _with astral characters_!
17
- - International domains support.
18
- - Allows rules extension & custom normalizers.
21
+ ### Ruby
19
22
 
23
+ Add it to your project's `Gemfile`
20
24
 
21
- Install
22
- -------
25
+ gem 'linkify-it-rb'
23
26
 
24
- ```bash
25
- npm install linkify-it --save
26
- ```
27
+ and run `bundle install`
28
+
29
+ ### RubyMotion
27
30
 
28
- Browserification is also supported.
31
+ Add it to your project's `Gemfile`
29
32
 
33
+ gem 'linkify-it-rb'
34
+
35
+ Edit your `Rakefile` and add
36
+
37
+ require 'linkify-it-rb'
38
+
39
+ and run `bundle install`
30
40
 
31
41
  Usage examples
32
42
  --------------
33
43
 
34
44
  ##### Example 1
35
45
 
36
- ```js
37
- var linkify = require('linkify-it')();
38
-
39
- // Reload full tlds list & add uniffocial `.onion` domain.
40
- linkify
41
- .tlds(require('tlds')) // Reload with full tlds list
42
- .tlds('.onion', true); // Add uniffocial `.onion` domain
43
- .linkify.add('git:', 'http:'); // Add `git:` ptotocol as "alias"
44
- .linkify.add('ftp:', null); // Disable `ftp:` ptotocol
45
-
46
- console.log(linkify.test('Site github.com!')); // true
47
-
48
- console.log(linkify.match('Site github.com!')); // [ {
49
- // schema: "",
50
- // index: 5,
51
- // lastIndex: 15,
52
- // raw: "github.com",
53
- // text: "github.com",
54
- // url: "http://github.com",
55
- // } ]
46
+ ```ruby
47
+ linkify = Linkify.new
48
+
49
+ # add unoffocial `.mydomain` domain.
50
+ linkify.tlds('.mydomain', true) # Add unofficial `.mydomain` domain
51
+ linkify.add('git:', 'http:') # Add `git:` ptotocol as "alias"
52
+ linkify.add('ftp:', null) # Disable `ftp:` ptotocol
53
+
54
+ linkify.test('Site github.com!'))
55
+ => true
56
+
57
+ linkify.match('Site github.com!'))
58
+ => [#<Linkify::Match @schema="", @index=5, @lastIndex=15, @raw="github.com", @text="github.com", @url="github.com">]
56
59
  ```
57
60
 
58
61
  ##### Exmple 2. Add twitter mentions handler
59
62
 
60
- ```js
63
+ ```ruby
61
64
  linkify.add('@', {
62
- validate: function (text, pos, self) {
63
- var tail = text.slice(pos);
64
-
65
- if (!self.re.twitter) {
66
- self.re.twitter = new RegExp(
67
- '^([a-zA-Z0-9_]){1,15}(?!_)(?=$|' + self.re.src_ZPCcCf + ')'
68
- );
69
- }
70
- if (self.re.twitter.test(tail)) {
71
- // Linkifier allows punctuation chars before prefix,
72
- // but we additionally disable `@` ("@@mention" is invalid)
73
- if (pos >= 2 && tail[pos - 2] === '@') {
74
- return false;
75
- }
76
- return tail.match(self.re.twitter)[0].length;
77
- }
78
- return 0;
79
- },
80
- normalize: function (match) {
81
- match.url = 'https://twitter.com/' + match.url.replace(/^@/, '');
82
- }
83
- });
65
+ validate: lambda do |text, pos, obj|
66
+ tail = text.slice(pos..-1)
67
+ if (!obj.re[:twitter])
68
+ obj.re[:twitter] = Regexp.new('^([a-zA-Z0-9_]){1,15}(?!_)(?=$|' + LinkifyRe::SRC_Z_P_CC + ')')
69
+ end
70
+ if (obj.re[:twitter] =~ tail)
71
+ return 0 if (pos >= 2 && text[pos - 2] == '@')
72
+ return tail.match(obj.re[:twitter])[0].length
73
+ end
74
+ return 0
75
+ end,
76
+ normalize: lambda do |m, obj|
77
+ m.url = 'https://twitter.com/' + m.url.sub(/^@/, '')
78
+ end
79
+ })
84
80
  ```
85
81
 
86
82
 
87
83
  API
88
84
  ---
89
85
 
90
- __[API documentation](http://markdown-it.github.io/linkify-it/doc)__
91
-
92
- ### new LinkifyIt(schemas)
86
+ ### LinkifyIt.new(schemas)
93
87
 
94
88
  Creates new linkifier instance with optional additional schemas.
95
- Can be called without `new` keyword for convenience.
96
89
 
97
90
  By default understands:
98
91
 
99
92
  - `http(s)://...` , `ftp://...`, `mailto:...` & `//...` links
100
93
  - "fuzzy" links and emails (google.com, foo@bar.com).
101
94
 
102
- `schemas` is an object, where each key/value describes protocol/rule:
95
+ `schemas` is a Hash, where each key/value describes protocol/rule:
103
96
 
104
97
  - __key__ - link prefix (usually, protocol name with `:` at the end, `skype:`
105
- for example). `linkify-it` makes shure that prefix is not preceeded with
98
+ for example). `linkify-it-rb` makes shure that prefix is not preceeded with
106
99
  alphanumeric char.
107
100
  - __value__ - rule to check tail after link prefix
108
101
  - _String_ - just alias to existing rule
109
- - _Object_
110
- - _validate_ - validator function (should return matched length on success),
102
+ - _Hash_
103
+ - _validate_ - validator block (should return matched length on success),
111
104
  or `RegExp`.
112
- - _normalize_ - optional function to normalize text & url of matched result
105
+ - _normalize_ - optional block to normalize text & url of matched result
113
106
  (for example, for twitter mentions).
114
107
 
115
108
 
@@ -120,20 +113,20 @@ Searches linkifiable pattern and returns `true` on success or `false` on fail.
120
113
 
121
114
  ### .pretest(text)
122
115
 
123
- Quick check if link MAY BE can exist. Can be used to optimize more expensive
124
- `.test()` calls. Return `false` if link can not be found, `true` - if `.test()`
116
+ Quick check if link MAYBE can exist. Can be used to optimize more expensive
117
+ `.test` calls. Return `false` if link can not be found, `true` - if `.test`
125
118
  call needed to know exactly.
126
119
 
127
120
 
128
121
  ### .testSchemaAt(text, name, offset)
129
122
 
130
- Similar to `.test()` but checks only specific protocol tail exactly at given
123
+ Similar to `.test` but checks only specific protocol tail exactly at given
131
124
  position. Returns length of found pattern (0 on fail).
132
125
 
133
126
 
134
127
  ### .match(text)
135
128
 
136
- Returns `Array` of found link matches or null if nothing found.
129
+ Returns `Array` of found link matches or nil if nothing found.
137
130
 
138
131
  Each match has:
139
132
 
@@ -148,8 +141,8 @@ Each match has:
148
141
 
149
142
  ### .tlds(list[, keepOld])
150
143
 
151
- Load (or merge) new tlds list. Those are user for fuzzy links (without prefix)
152
- to avoid false positives. By default this algorythm used:
144
+ Load (or merge) new tlds list. These are used for fuzzy links (without prefix)
145
+ to avoid false positives. By default this algorithm uses:
153
146
 
154
147
  - hostname with any 2-letter root zones are ok.
155
148
  - biz|com|edu|gov|net|org|pro|web|xxx|aero|asia|coop|info|museum|name|shop|рф
@@ -162,9 +155,9 @@ If list is replaced, then exact match for 2-chars root zones will be checked.
162
155
  ### .add(schema, definition)
163
156
 
164
157
  Add new rule with `schema` prefix. For definition details see constructor
165
- description. To disable existing rule use `.add(name, null)`
158
+ description. To disable existing rule use `.add(name, nil)`
166
159
 
167
160
 
168
161
  ## License
169
162
 
170
- [MIT](https://github.com/markdown-it/linkify-it/blob/master/LICENSE)
163
+ [MIT](https://github.com/digitalmoksha/linkify-it-rb/blob/master/LICENSE)
data/lib/linkify-it-rb/index.rb CHANGED
@@ -87,25 +87,17 @@ class Linkify
87
87
  #
88
88
  #------------------------------------------------------------------------------
89
89
  def compile
90
-
91
- # Load & clone RE patterns.
92
- re = @re = {} #.merge!(require('./lib/re'))
90
+ @re = { src_xn: LinkifyRe::SRC_XN }
93
91
 
94
92
  # Define dynamic patterns
95
93
  tlds = @__tlds__.dup
94
+ tlds.push('[a-z]{2}') if (!@__tlds_replaced__)
95
+ tlds.push(@re[:src_xn])
96
96
 
97
- if (!@__tlds_replaced__)
98
- tlds.push('[a-z]{2}')
99
- end
100
- tlds.push(re[:src_xn])
101
-
102
- re[:src_tlds] = tlds.join('|')
103
-
104
- untpl = lambda { |tpl| tpl.gsub('%TLDS%', re[:src_tlds]) }
105
-
106
- re[:email_fuzzy] = Regexp.new(LinkifyRe::TPL_EMAIL_FUZZY.gsub('%TLDS%', re[:src_tlds]), true)
107
- re[:link_fuzzy] = Regexp.new(LinkifyRe::TPL_LINK_FUZZY.gsub('%TLDS%', re[:src_tlds]), true)
108
- re[:host_fuzzy_test] = Regexp.new(LinkifyRe::TPL_HOST_FUZZY_TEST.gsub('%TLDS%', re[:src_tlds]), true)
97
+ @re[:src_tlds] = tlds.join('|')
98
+ @re[:email_fuzzy] = Regexp.new(LinkifyRe::TPL_EMAIL_FUZZY.gsub('%TLDS%', @re[:src_tlds]), true)
99
+ @re[:link_fuzzy] = Regexp.new(LinkifyRe::TPL_LINK_FUZZY.gsub('%TLDS%', @re[:src_tlds]), true)
100
+ @re[:host_fuzzy_test] = Regexp.new(LinkifyRe::TPL_HOST_FUZZY_TEST.gsub('%TLDS%', @re[:src_tlds]), true)
109
101
 
110
102
  #
111
103
  # Compile each schema
@@ -180,8 +172,8 @@ class Linkify
180
172
  slist = @__compiled__.select {|name, val| name.length > 0 && !val.nil? }.keys.map {|str| escapeRE(str)}.join('|')
181
173
 
182
174
  # (?!_) cause 1.5x slowdown
183
- @re[:schema_test] = Regexp.new('(^|(?!_)(?:>|' + LinkifyRe::SRC_Z_P_CC_CF + '))(' + slist + ')', 'i')
184
- @re[:schema_search] = Regexp.new('(^|(?!_)(?:>|' + LinkifyRe::SRC_Z_P_CC_CF + '))(' + slist + ')', 'ig')
175
+ @re[:schema_test] = Regexp.new('(^|(?!_)(?:>|' + LinkifyRe::SRC_Z_P_CC + '))(' + slist + ')', 'i')
176
+ @re[:schema_search] = Regexp.new('(^|(?!_)(?:>|' + LinkifyRe::SRC_Z_P_CC + '))(' + slist + ')', 'ig')
185
177
 
186
178
  @re[:pretest] = Regexp.new(
187
179
  '(' + @re[:schema_test].source + ')|' +
@@ -318,14 +310,15 @@ class Linkify
318
310
  @__index__ = -1
319
311
 
320
312
  return false if (!text.length)
321
-
313
+
322
314
  # try to scan for link with schema - that's the most simple rule
323
315
  if @re[:schema_test] =~ text
324
316
  re = @re[:schema_search]
325
- # re[:lastIndex] = 0
326
- while ((m = re.match(text)) != nil)
327
- len = testSchemaAt(text, m[2], m.end(0)) #re[:lastIndex])
328
- if (len)
317
+ lastIndex = 0
318
+ while ((m = re.match(text, lastIndex)) != nil)
319
+ lastIndex = m.end(0)
320
+ len = testSchemaAt(text, m[2], lastIndex)
321
+ if len > 0
329
322
  @__schema__ = m[2]
330
323
  @__index__ = m.begin(0) + m[1].length
331
324
  @__last_index__ = m.begin(0) + m[0].length + len
@@ -334,9 +327,8 @@ class Linkify
334
327
  end
335
328
  end
336
329
 
330
+ # guess schemaless links
337
331
  if (@__compiled__['http:'])
338
- # guess schemaless links
339
-
340
332
  tld_pos = text.index(@re[:host_fuzzy_test])
341
333
  if !tld_pos.nil?
342
334
  # if tld is located after found link - no need to check fuzzy pattern
@@ -355,8 +347,8 @@ class Linkify
355
347
  end
356
348
  end
357
349
 
350
+ # guess schemaless emails
358
351
  if (@__compiled__['mailto:'])
359
- # guess schemaless emails
360
352
  at_pos = text.index('@')
361
353
  if !at_pos.nil?
362
354
  # We can't skip this check, because this cases are possible:
@@ -410,7 +402,7 @@ class Linkify
410
402
 
411
403
  # LinkifyIt#match(text) -> Array|null
412
404
  #
413
- # Returns array of found link descriptions or `null` on fail. We strongly
405
+ # Returns array of found link descriptions or `null` on fail. We strongly suggest
414
406
  # to use [[LinkifyIt#test]] first, for best speed.
415
407
  #
416
408
  # ##### Result match description
data/lib/linkify-it-rb/re.rb CHANGED
@@ -1,58 +1,57 @@
1
1
  module LinkifyRe
2
2
 
3
3
  # Use direct extract instead of `regenerate` to reduce size
4
- SRC_ANY = UCMicro::Properties::Any::REGEX
5
- SRC_CC = UCMicro::Categories::Cc::REGEX
6
- SRC_CF = UCMicro::Categories::Cf::REGEX
7
- SRC_Z = UCMicro::Categories::Z::REGEX
8
- SRC_P = UCMicro::Categories::P::REGEX
4
+ SRC_ANY = UCMicro::Properties::Any::REGEX.source
5
+ SRC_CC = UCMicro::Categories::Cc::REGEX.source
6
+ SRC_Z = UCMicro::Categories::Z::REGEX.source
7
+ SRC_P = UCMicro::Categories::P::REGEX.source
9
8
 
10
- # \p{\Z\P\Cc\CF} (white spaces + control + format + punctuation)
11
- SRC_Z_P_CC_CF = [ SRC_Z, SRC_P, SRC_CC, SRC_CF ].join('|')
9
+ # \p{\Z\P\Cc} (white spaces + control + punctuation)
10
+ SRC_Z_P_CC = [ SRC_Z, SRC_P, SRC_CC ].join('|')
12
11
 
13
- # \p{\Z\Cc\CF} (white spaces + control + format)
14
- SRC_Z_CC_CF = [ SRC_Z, SRC_CC, SRC_CF ].join('|')
12
+ # \p{\Z\Cc} (white spaces + control)
13
+ SRC_Z_CC = [ SRC_Z, SRC_CC ].join('|')
15
14
 
16
15
  # All possible word characters (everything without punctuation, spaces & controls)
17
16
  # Defined via punctuation & spaces to save space
18
17
  # Should be something like \p{\L\N\S\M} (\w but without `_`)
19
- SRC_PSEUDO_LETTER = '(?:(?!' + SRC_Z_P_CC_CF + ')' + SRC_ANY.source + ')'
18
+ SRC_PSEUDO_LETTER = '(?:(?!' + SRC_Z_P_CC + ')' + SRC_ANY + ')'
20
19
  # The same as above but without [0-9]
21
- SRC_PSEUDO_LETTER_NON_D = '(?:(?![0-9]|' + SRC_Z_P_CC_CF + ')' + SRC_ANY.source + ')'
20
+ SRC_PSEUDO_LETTER_NON_D = '(?:(?![0-9]|' + SRC_Z_P_CC + ')' + SRC_ANY + ')'
22
21
 
23
22
  #------------------------------------------------------------------------------
24
23
 
25
24
  SRC_IP4 = '(?:(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)'
26
- SRC_AUTH = '(?:(?:(?!' + SRC_Z_CC_CF + ').)+@)?'
25
+ SRC_AUTH = '(?:(?:(?!' + SRC_Z_CC + ').)+@)?'
27
26
 
28
27
  SRC_PORT = '(?::(?:6(?:[0-4]\\d{3}|5(?:[0-4]\\d{2}|5(?:[0-2]\\d|3[0-5])))|[1-5]?\\d{1,4}))?'
29
28
 
30
- SRC_HOST_TERMINATOR = '(?=$|' + SRC_Z_P_CC_CF + ')(?!-|_|:\\d|\\.-|\\.(?!$|' + SRC_Z_P_CC_CF + '))'
29
+ SRC_HOST_TERMINATOR = '(?=$|' + SRC_Z_P_CC + ')(?!-|_|:\\d|\\.-|\\.(?!$|' + SRC_Z_P_CC + '))'
31
30
 
32
31
  SRC_PATH =
33
32
  '(?:' +
34
33
  '[/?#]' +
35
34
  '(?:' +
36
- '(?!' + SRC_Z_CC_CF + '|[()\\[\\]{}.,"\'?!\\-]).|' +
37
- '\\[(?:(?!' + SRC_Z_CC_CF + '|\\]).)*\\]|' +
38
- '\\((?:(?!' + SRC_Z_CC_CF + '|[)]).)*\\)|' +
39
- '\\{(?:(?!' + SRC_Z_CC_CF + '|[}]).)*\\}|' +
40
- '\\"(?:(?!' + SRC_Z_CC_CF + '|["]).)+\\"|' +
41
- "\\'(?:(?!" + SRC_Z_CC_CF + "|[']).)+\\'|" +
35
+ '(?!' + SRC_Z_CC + '|[()\\[\\]{}.,"\'?!\\-]).|' +
36
+ '\\[(?:(?!' + SRC_Z_CC + '|\\]).)*\\]|' +
37
+ '\\((?:(?!' + SRC_Z_CC + '|[)]).)*\\)|' +
38
+ '\\{(?:(?!' + SRC_Z_CC + '|[}]).)*\\}|' +
39
+ '\\"(?:(?!' + SRC_Z_CC + '|["]).)+\\"|' +
40
+ "\\'(?:(?!" + SRC_Z_CC + "|[']).)+\\'|" +
42
41
  "\\'(?=" + SRC_PSEUDO_LETTER + ').|' + # allow `I'm_king` if no pair found
43
42
  '\\.{2,3}[a-zA-Z0-9%]|' + # github has ... in commit range links. Restrict to
44
43
  # english & percent-encoded only, until more examples found.
45
- '\\.(?!' + SRC_Z_CC_CF + '|[.]).|' +
46
- '\\-(?!' + SRC_Z_CC_CF + '|--(?:[^-]|$))(?:[-]+|.)|' + # `---` => long dash, terminate
47
- '\\,(?!' + SRC_Z_CC_CF + ').|' + # allow `,,,` in paths
48
- '\\!(?!' + SRC_Z_CC_CF + '|[!]).|' +
49
- '\\?(?!' + SRC_Z_CC_CF + '|[?]).' +
44
+ '\\.(?!' + SRC_Z_CC + '|[.]).|' +
45
+ '\\-(?!' + SRC_Z_CC + '|--(?:[^-]|$))(?:[-]+|.)|' + # `---` => long dash, terminate
46
+ '\\,(?!' + SRC_Z_CC + ').|' + # allow `,,,` in paths
47
+ '\\!(?!' + SRC_Z_CC + '|[!]).|' +
48
+ '\\?(?!' + SRC_Z_CC + '|[?]).' +
50
49
  ')+' +
51
50
  '|\\/' +
52
51
  ')?'
53
52
 
54
53
  SRC_EMAIL_NAME = '[\\-;:&=\\+\\$,\\"\\.a-zA-Z0-9_]+'
55
- SRC_XN = 'xn--[a-z0-9\\-]{1,59}';
54
+ SRC_XN = 'xn--[a-z0-9\\-]{1,59}'
56
55
 
57
56
  # More to read about domain names
58
57
  # http://serverfault.com/questions/638260/
@@ -89,7 +88,7 @@ module LinkifyRe
89
88
  SRC_IP4 +
90
89
  '|' +
91
90
  '(?:(?:(?:' + SRC_DOMAIN + ')\\.)+(?:%TLDS%))' +
92
- ')';
91
+ ')'
93
92
 
94
93
  SRC_HOST_STRICT = SRC_HOST + SRC_HOST_TERMINATOR
95
94
  TPL_HOST_FUZZY_STRICT = TPL_HOST_FUZZY + SRC_HOST_TERMINATOR
@@ -100,12 +99,12 @@ module LinkifyRe
100
99
  # Main rules
101
100
 
102
101
  # Rude test fuzzy links by host, for quick deny
103
- TPL_HOST_FUZZY_TEST = 'localhost|\\.\\d{1,3}\\.|(?:\\.(?:%TLDS%)(?:' + SRC_Z_P_CC_CF + '|$))'
104
- TPL_EMAIL_FUZZY = '(^|>|' + SRC_Z_CC_CF + ')(' + SRC_EMAIL_NAME + '@' + TPL_HOST_FUZZY_STRICT + ')'
102
+ TPL_HOST_FUZZY_TEST = 'localhost|\\.\\d{1,3}\\.|(?:\\.(?:%TLDS%)(?:' + SRC_Z_P_CC + '|$))'
103
+ TPL_EMAIL_FUZZY = '(^|>|' + SRC_Z_CC + ')(' + SRC_EMAIL_NAME + '@' + TPL_HOST_FUZZY_STRICT + ')'
105
104
  TPL_LINK_FUZZY =
106
105
  # Fuzzy link can't be prepended with .:/\- and non punctuation.
107
106
  # but can start with > (markdown blockquote)
108
- '(^|(?![.:/\\-_@])(?:[$+<=>^`|]|' + SRC_Z_P_CC_CF + '))' +
107
+ '(^|(?![.:/\\-_@])(?:[$+<=>^`|]|' + SRC_Z_P_CC + '))' +
109
108
  '((?![$+<=>^`|])' + TPL_HOST_PORT_FUZZY_STRICT + SRC_PATH + ')'
110
109
 
111
110
  end
data/lib/linkify-it-rb/version.rb CHANGED
@@ -1,5 +1,5 @@
1
1
  module LinkifyIt
2
2
 
3
- VERSION = '0.1.0.0'
3
+ VERSION = '1.0.0.2'
4
4
 
5
5
  end
data/spec/linkify-it-rb/test_spec.rb CHANGED
@@ -1,49 +1,43 @@
1
+ fixture_dir = File.join(File.dirname(__FILE__), 'fixtures')
2
+
1
3
  #------------------------------------------------------------------------------
2
4
  describe 'links' do
3
5
 
4
- # TODO tests which can't seem to get passing at the moment, so skip them
5
- failing_test = [
6
- 95, # GOOGLE.COM. unable to get final . to be removed
7
- 214 # xn--d1abbgf6aiiy.xn--p1ai
8
- ]
9
-
10
6
  l = Linkify.new
11
7
  l.bypass_normalizer = true # kill the normalizer
12
-
8
+
13
9
  skipNext = false
14
- linkfile = File.join(File.dirname(__FILE__), 'fixtures/links.txt')
10
+ linkfile = File.join(fixture_dir, 'links.txt')
15
11
  lines = File.read(linkfile).split(/\r?\n/)
16
12
  lines.each_with_index do |line, idx|
17
13
  if skipNext
18
14
  skipNext = false
19
15
  next
20
16
  end
21
-
17
+
22
18
  line = line.sub(/^%.*/, '')
23
19
  next_line = (lines[idx + 1] || '').sub(/^%.*/, '')
24
20
 
25
21
  next if line.strip.empty?
26
22
 
27
- unless failing_test.include?(idx + 1)
28
- if !next_line.strip.empty?
23
+ if !next_line.strip.empty?
29
24
 
30
- it "line #{idx + 1}" do
31
- expect(l.pretest(line)).to eq true # "(pretest failed in `#{line}`)"
32
- expect(l.test("\n#{line}\n")).to eq true # "(link not found in `\n#{line}\n`)"
33
- expect(l.test(line)).to eq true # "(link not found in `#{line}`)"
34
- expect(l.match(line)[0].url).to eq next_line
35
- end
25
+ it "line #{idx + 1}" do
26
+ expect(l.pretest(line)).to eq true # "(pretest failed in `#{line}`)"
27
+ expect(l.test("\n#{line}\n")).to eq true # "(link not found in `\n#{line}\n`)"
28
+ expect(l.test(line)).to eq true # "(link not found in `#{line}`)"
29
+ expect(l.match(line)[0].url).to eq next_line
30
+ end
36
31
 
37
- skipNext = true
38
-
39
- else
32
+ skipNext = true
40
33
 
41
- it "line #{idx + 1}" do
42
- expect(l.pretest(line)).to eq true # "(pretest failed in `#{line}`)"
43
- expect(l.test("\n#{line}\n")).to eq true # "(link not found in `\n#{line}\n`)"
44
- expect(l.test(line)).to eq true # "(link not found in `#{line}`)"
45
- expect(l.match(line)[0].url).to eq line
46
- end
34
+ else
35
+
36
+ it "line #{idx + 1}" do
37
+ expect(l.pretest(line)).to eq true # "(pretest failed in `#{line}`)"
38
+ expect(l.test("\n#{line}\n")).to eq true # "(link not found in `\n#{line}\n`)"
39
+ expect(l.test(line)).to eq true # "(link not found in `#{line}`)"
40
+ expect(l.match(line)[0].url).to eq line
47
41
  end
48
42
  end
49
43
  end
@@ -54,26 +48,18 @@ end
54
48
  #------------------------------------------------------------------------------
55
49
  describe 'not links' do
56
50
 
57
- # TODO tests which can't seem to get passing at the moment, so skip them
58
- failing_test = [ 6, 7, 8, 12, 16, 19, 22, 23, 24, 25, 26, 27, 28, 29, 48 ]
59
-
60
51
  l = Linkify.new
61
52
  l.bypass_normalizer = true # kill the normalizer
62
53
 
63
- linkfile = File.join(File.dirname(__FILE__), 'fixtures/not_links.txt')
54
+ linkfile = File.join(fixture_dir, 'not_links.txt')
64
55
  lines = File.read(linkfile).split(/\r?\n/)
65
56
  lines.each_with_index do |line, idx|
66
57
  line = line.sub(/^%.*/, '')
67
58
 
68
59
  next if line.strip.empty?
69
60
 
70
- unless failing_test.include?(idx + 1)
71
- it "line #{idx + 1}" do
72
- # assert.notOk(l.test(line),
73
- # '(should not find link in `' + line + '`, but found `' +
74
- # JSON.stringify((l.match(line) || [])[0]) + '`)');
75
- expect(l.test(line)).not_to eq true
76
- end
61
+ it "line #{idx + 1}" do
62
+ expect(l.test(line)).not_to eq true
77
63
  end
78
64
  end
79
65
 
@@ -93,142 +79,143 @@ describe 'API' do
93
79
  expect(l.test('google.myroot')).to eq true
94
80
  expect(l.test('google.xyz')).to_not eq true
95
81
 
96
- # this is some other package of tlds which we don't have
82
+ # TODO this is some other package of tlds which we don't have
83
+ # https://github.com/stephenmathieson/node-tlds
84
+ # instead we should be using Public Suffix List
85
+ # https://github.com/weppos/publicsuffix-ruby
97
86
  # l.tlds(require('tlds'));
98
87
  # assert.ok(l.test('google.xyz'));
99
88
  # assert.notOk(l.test('google.myroot'));
100
89
  end
101
90
 
102
91
 
103
- # TODO Tests not passing
104
92
  #------------------------------------------------------------------------------
105
- # it 'add rule as regexp, with default normalizer' do
106
- # l = Linkify.new.add('my:', {validate: /^\/\/[a-z]+/} )
107
- #
108
- # match = l.match('google.com. my:// my://asdf!')
109
- #
110
- # expect(match[0].text).to eq 'google.com'
111
- # expect(match[1].text).to eq 'my://asdf'
112
- # end
113
-
114
- # TODO Tests not passing
93
+ it 'add rule as regexp, with default normalizer' do
94
+ l = Linkify.new.add('my:', {validate: /^\/\/[a-z]+/} )
95
+
96
+ match = l.match('google.com. my:// my://asdf!')
97
+
98
+ expect(match[0].text).to eq 'google.com'
99
+ expect(match[1].text).to eq 'my://asdf'
100
+ end
101
+
102
+ #------------------------------------------------------------------------------
103
+ it 'add rule with normalizer' do
104
+ l = Linkify.new.add('my:', {
105
+ validate: /^\/\/[a-z]+/,
106
+ normalize: lambda do |m, obj|
107
+ m.text = m.text.sub(/^my:\/\//, '').upcase
108
+ m.url = m.url.upcase
109
+ end
110
+ })
111
+
112
+ match = l.match('google.com. my:// my://asdf!')
113
+
114
+ expect(match[1].text).to eq 'ASDF'
115
+ expect(match[1].url).to eq 'MY://ASDF'
116
+ end
117
+
115
118
  #------------------------------------------------------------------------------
116
- # it 'add rule with normalizer'
117
- # l = Linkify.new.add('my:', {
118
- # validate: /^\/\/[a-z]+/,
119
- # normalize: lambda {|m|
120
- # m.text = m.text.sub(/^my:\/\//, '').upcase
121
- # m.url = m.url.upcase
122
- # }
123
- # })
124
- #
125
- # match = l.match('google.com. my:// my://asdf!')
126
- #
127
- # expect(match[1].text).to eq 'ASDF'
128
- # expect(match[1].url).to eq 'MY://ASDF'
129
- # end
130
-
131
- # it('disable rule', function () {
132
- # var l = linkify();
133
- #
134
- # assert.ok(l.test('http://google.com'));
135
- # assert.ok(l.test('foo@bar.com'));
136
- # l.add('http:', null);
137
- # l.add('mailto:', null);
138
- # assert.notOk(l.test('http://google.com'));
139
- # assert.notOk(l.test('foo@bar.com'));
140
- # });
141
- #
142
- #
143
- # it('add bad definition', function () {
144
- # var l;
145
- #
146
- # l = linkify();
147
- #
148
- # assert.throw(function () {
149
- # l.add('test:', []);
150
- # });
151
- #
152
- # l = linkify();
153
- #
154
- # assert.throw(function () {
155
- # l.add('test:', { validate: [] });
156
- # });
157
- #
158
- # l = linkify();
159
- #
160
- # assert.throw(function () {
161
- # l.add('test:', {
162
- # validate: function () { return false; },
163
- # normalize: 'bad'
164
- # });
165
- # });
166
- # });
167
- #
168
- #
169
- # it('test at position', function () {
170
- # var l = linkify();
171
- #
172
- # assert.ok(l.testSchemaAt('http://google.com', 'http:', 5));
173
- # assert.ok(l.testSchemaAt('http://google.com', 'HTTP:', 5));
174
- # assert.notOk(l.testSchemaAt('http://google.com', 'http:', 6));
175
- #
176
- # assert.notOk(l.testSchemaAt('http://google.com', 'bad_schema:', 6));
177
- # });
178
- #
179
- #
180
- # it('correct cache value', function () {
181
- # var l = linkify();
182
- #
183
- # var match = l.match('.com. http://google.com google.com ftp://google.com');
184
- #
185
- # assert.equal(match[0].text, 'http://google.com');
186
- # assert.equal(match[1].text, 'google.com');
187
- # assert.equal(match[2].text, 'ftp://google.com');
188
- # });
189
- #
190
- # it('normalize', function () {
191
- # var l = linkify(), m;
192
- #
193
- # m = l.match('mailto:foo@bar.com')[0];
194
- #
195
- # // assert.equal(m.text, 'foo@bar.com');
196
- # assert.equal(m.url, 'mailto:foo@bar.com');
197
- #
198
- # m = l.match('foo@bar.com')[0];
199
- #
200
- # // assert.equal(m.text, 'foo@bar.com');
201
- # assert.equal(m.url, 'mailto:foo@bar.com');
202
- # });
203
- #
204
- #
205
- # it('test @twitter rule', function () {
206
- # var l = linkify().add('@', {
207
- # validate: function (text, pos, self) {
208
- # var tail = text.slice(pos);
209
- #
210
- # if (!self.re.twitter) {
211
- # self.re.twitter = new RegExp(
212
- # '^([a-zA-Z0-9_]){1,15}(?!_)(?=$|' + self.re.src_ZPCcCf + ')'
213
- # );
214
- # }
215
- # if (self.re.twitter.test(tail)) {
216
- # if (pos >= 2 && tail[pos - 2] === '@') {
217
- # return false;
218
- # }
219
- # return tail.match(self.re.twitter)[0].length;
220
- # }
221
- # return 0;
222
- # },
223
- # normalize: function (m) {
224
- # m.url = 'https://twitter.com/' + m.url.replace(/^@/, '');
225
- # }
226
- # });
227
- #
228
- # assert.equal(l.match('hello, @gamajoba_!')[0].text, '@gamajoba_');
229
- # assert.equal(l.match(':@givi')[0].text, '@givi');
230
- # assert.equal(l.match(':@givi')[0].url, 'https://twitter.com/givi');
231
- # assert.notOk(l.test('@@invalid'));
232
- # });
119
+ it 'disable rule' do
120
+ l = Linkify.new
121
+
122
+ expect(l.test('http://google.com')).to eq true
123
+ expect(l.test('foo@bar.com')).to eq true
124
+ l.add('http:', nil)
125
+ l.add('mailto:', nil)
126
+ expect(l.test('http://google.com')).to eq false
127
+ expect(l.test('foo@bar.com')).to eq false
128
+ end
129
+
130
+ #------------------------------------------------------------------------------
131
+ it 'add bad definition' do
132
+ l = Linkify.new
133
+
134
+ expect {
135
+ l.add('test:', [])
136
+ }.to raise_error(StandardError)
137
+
138
+ l = Linkify.new
139
+
140
+ expect {
141
+ l.add('test:', {validate: []})
142
+ }.to raise_error(StandardError)
143
+
144
+ l = Linkify.new
145
+
146
+ expect {
147
+ l.add('test:', {validate: []})
148
+ }.to raise_error(StandardError)
149
+
150
+ expect {
151
+ l.add('test:', {
152
+ validate: lambda { return false },
153
+ normalize: 'bad'
154
+ })
155
+ }.to raise_error(StandardError)
156
+ end
157
+
158
+
159
+ #------------------------------------------------------------------------------
160
+ it 'test at position' do
161
+ l = Linkify.new
162
+ expect(l.testSchemaAt('http://google.com', 'http:', 5) > 0).to eq true
163
+ expect(l.testSchemaAt('http://google.com', 'HTTP:', 5) > 0).to eq true
164
+ expect(l.testSchemaAt('http://google.com', 'http:', 6) > 0).to eq false
165
+ expect(l.testSchemaAt('http://google.com', 'bad_schema:', 6) > 0).to eq false
166
+ end
167
+
168
+ #------------------------------------------------------------------------------
169
+ it 'correct cache value' do
170
+ l = Linkify.new
171
+ match = l.match('.com. http://google.com google.com ftp://google.com')
172
+
173
+ expect(match[0].text).to eq 'http://google.com'
174
+ expect(match[1].text).to eq 'google.com'
175
+ expect(match[2].text).to eq 'ftp://google.com'
176
+ end
177
+
178
+ #------------------------------------------------------------------------------
179
+ it 'normalize' do
180
+ l = Linkify.new
181
+ m = l.match('mailto:foo@bar.com')[0]
182
+
183
+ # assert.equal(m.text, 'foo@bar.com');
184
+ expect(m.url).to eq 'mailto:foo@bar.com'
185
+
186
+ m = l.match('foo@bar.com')[0]
187
+
188
+ # assert.equal(m.text, 'foo@bar.com');
189
+ expect(m.url).to eq 'mailto:foo@bar.com'
190
+ end
191
+
192
+ #------------------------------------------------------------------------------
193
+ it 'test @twitter rule' do
194
+ l = Linkify.new.add('@', {
195
+ validate: lambda do |text, pos, obj|
196
+ tail = text.slice(pos..-1)
197
+ if (!obj.re[:twitter])
198
+ obj.re[:twitter] = Regexp.new(
199
+ '^([a-zA-Z0-9_]){1,15}(?!_)(?=$|' + LinkifyRe::SRC_Z_P_CC + ')'
200
+ )
201
+ end
202
+ if (obj.re[:twitter] =~ tail)
203
+ if (pos >= 2 && text[pos - 2] == '@')
204
+ return 0
205
+ end
206
+ return tail.match(obj.re[:twitter])[0].length
207
+ end
208
+ return 0
209
+ end,
210
+ normalize: lambda do |m, obj|
211
+ m.url = 'https://twitter.com/' + m.url.sub(/^@/, '')
212
+ end
213
+ })
214
+
215
+ expect(l.match('hello, @gamajoba_!')[0].text).to eq '@gamajoba_'
216
+ expect(l.match(':@givi')[0].text).to eq '@givi'
217
+ expect(l.match(':@givi')[0].url).to eq 'https://twitter.com/givi'
218
+ expect(l.test('@@invalid')).to eq false
219
+ end
233
220
 
234
221
  end
metadata CHANGED
@@ -1,7 +1,7 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: linkify-it-rb
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.1.0.0
4
+ version: 1.0.0.2
5
5
  platform: ruby
6
6
  authors:
7
7
  - Brett Walker
@@ -9,7 +9,7 @@ authors:
9
9
  autorequire:
10
10
  bindir: bin
11
11
  cert_chain: []
12
- date: 2015-03-26 00:00:00.000000000 Z
12
+ date: 2015-04-01 00:00:00.000000000 Z
13
13
  dependencies:
14
14
  - !ruby/object:Gem::Dependency
15
15
  name: uc.micro-rb