edouard-rchardet 1.3.3 → 1.3.4.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (39) hide show
  1. data/COPYING +0 -0
  2. data/README.md +28 -0
  3. data/lib/rchardet/big5freq.rb +887 -887
  4. data/lib/rchardet/big5prober.rb +6 -6
  5. data/lib/rchardet/chardistribution.rb +59 -59
  6. data/lib/rchardet/charsetgroupprober.rb +51 -51
  7. data/lib/rchardet/charsetprober.rb +12 -14
  8. data/lib/rchardet/codingstatemachine.rb +9 -8
  9. data/lib/rchardet/constants.rb +2 -2
  10. data/lib/rchardet/escprober.rb +36 -35
  11. data/lib/rchardet/escsm.rb +208 -208
  12. data/lib/rchardet/eucjpprober.rb +34 -34
  13. data/lib/rchardet/euckrfreq.rb +557 -557
  14. data/lib/rchardet/euckrprober.rb +3 -3
  15. data/lib/rchardet/euctwfreq.rb +386 -386
  16. data/lib/rchardet/euctwprober.rb +3 -3
  17. data/lib/rchardet/gb2312freq.rb +430 -430
  18. data/lib/rchardet/gb2312prober.rb +3 -3
  19. data/lib/rchardet/hebrewprober.rb +70 -70
  20. data/lib/rchardet/jisfreq.rb +527 -527
  21. data/lib/rchardet/jpcntx.rb +42 -42
  22. data/lib/rchardet/langbulgarianmodel.rb +189 -189
  23. data/lib/rchardet/langcyrillicmodel.rb +290 -290
  24. data/lib/rchardet/langgreekmodel.rb +16 -16
  25. data/lib/rchardet/langhebrewmodel.rb +169 -169
  26. data/lib/rchardet/langhungarianmodel.rb +193 -193
  27. data/lib/rchardet/langthaimodel.rb +169 -169
  28. data/lib/rchardet/latin1prober.rb +25 -25
  29. data/lib/rchardet/mbcharsetprober.rb +29 -29
  30. data/lib/rchardet/mbcsgroupprober.rb +10 -10
  31. data/lib/rchardet/mbcssm.rb +397 -397
  32. data/lib/rchardet/sbcharsetprober.rb +45 -45
  33. data/lib/rchardet/sbcsgroupprober.rb +16 -16
  34. data/lib/rchardet/sjisprober.rb +35 -35
  35. data/lib/rchardet/universaldetector.rb +76 -78
  36. data/lib/rchardet/utf8prober.rb +30 -29
  37. data/lib/rchardet.rb +8 -4
  38. metadata +25 -10
  39. data/README +0 -17
data/COPYING CHANGED
File without changes
data/README.md ADDED
@@ -0,0 +1,28 @@
1
+ rchardet
2
+ ========
3
+
4
+ rchardet is an encoding auto-detection library in Ruby. This library is a port of the auto-detection code in Mozilla. It means taking a sequence of bytes in an unknown character encoding, and attempting to determine the encoding so you can read the text. It’s like cracking a code when you don’t have the decryption key.
5
+
6
+ This fork is compatible with ruby 1.9.
7
+
8
+ Usage
9
+ -----
10
+
11
+ require 'rubygems'
12
+ require 'rchardet'
13
+
14
+ cd = CharDet.detect(some_data)
15
+ encoding = cd['encoding']
16
+ confidence = cd['confidence'] # 0.0 <= confidence <= 1.0
17
+
18
+ Running tests
19
+ -------------
20
+
21
+ ruby spec/all.rb
22
+
23
+ Project page
24
+ ------------
25
+
26
+ http://rubyforge.org/projects/rchardet
27
+
28
+ Made for rFeedParser <http://rfeedparser.rubyforge.org>.