cchardet 0.2.0

data/ext/uchardet/script/BuildLangModelLogs/LangSloveneModel.log

@@ -0,0 +1,148 @@
+= Logs of language model for Slovene (sl) =
+
+- Generated by BuildLangModel.py
+- Started: 2016-09-28 22:00:35.243966
+- Maximum depth: 5
+- Max number of pages: 100
+
+== Parsed pages ==
+
+XCOM: Enemy Unknown (revision 4704271)
+1UP.com (revision 4547348)
+2K Games (revision 4110089)
+Android (operacijski sistem) (revision 4619359)
+Animator videoigre (revision 4702643)
+App Store (revision 3903089)
+Artefakt (revision 4484504)
+Athlon (revision 4524746)
+Avstralazija (revision 4623530)
+Avtopsija (revision 4541344)
+Bralno-pisalni pomnilnik (revision 4256388)
+Civilization (serija) (revision 4645770)
+Deus Ex: Human Revolution (revision 4694860)
+Digitalna distribucija (revision 4696215)
+DirectX (revision 4477913)
+Dishonored (revision 4619444)
+Edge (magazine) (revision 4690049)
+Electronic Entertainment Expo (revision 4538691)
+Enoigralska videoigra (revision 4610359)
+Eurogamer (revision 4694860)
+Evropa (revision 4687833)
+Fantasy Flight Games (revision 4649361)
+Firaxis Games (revision 4110089)
+GameRankings (revision 3934020)
+GameSpot (revision 4238015)
+GameSpy (revision 4538691)
+GameTrailers (revision 4704271)
+Game Informer (revision 4704271)
+GamesTM (revision 4704271)
+Grafična kartica (revision 4257980)
+Granata (revision 3859332)
+Holograf (revision 4477482)
+IGN (revision 4576233)
+IOS (revision 4597264)
+Igra igranja vlog (revision 4642276)
+Igra na deski (revision 4649363)
+Igralna konzola (revision 4649866)
+Igralni pogon (revision 4622773)
+Intel (revision 4626025)
+International Standard Book Number (revision 4015087)
+Izdelovalec videoigre (revision 3851747)
+Joker (revija) (revision 3867772)
+Kotaku (revision 4613535)
+Kristal (revision 4156234)
+Linux (revision 4524740)
+Lovec prestreznik (revision 4102792)
+MTV (revision 4621758)
+Mac OS X (revision 4601645)
+Machinima (revision 4601716)
+Major (revision 4245802)
+Mednarodna različica (revision 4116054)
+Metacritic (revision 3934020)
+Michael McCann (skladatelj) (revision 4694860)
+MicroProse (revision 4382810)
+Microsoft Windows (revision 4691357)
+Nezemeljsko življenje (revision 4620576)
+NowGamer (revision 4704271)
+OS X (revision 4601645)
+Ognjena ekipa (revision 4694450)
+Operacijski sistem (revision 4698515)
+Ostrostrelec (revision 4529694)
+Pilot (revision 4069093)
+PlayStation 3 (revision 4382944)
+PlayStation Network (revision 4382944)
+PlayStation Vita (revision 3944025)
+Pogon igre (revision 4622773)
+Procesor (revision 4702518)
+Producent videoiger (revision 4599904)
+Razvijalec videoiger (revision 4093281)
+Računalniška miška (revision 4385579)
+Računalniška platforma (revision 4673669)
+Severna Amerika (revision 4643798)
+Sid Meier (revision 4061487)
+Stealth (revision 4618630)
+Steam (revision 4696215)
+Strateška videoigra (revision 4236795)
+Tablični računalnik (revision 4409985)
+Take-Two Interactive (revision 4110089)
+Telepatija (revision 4481192)
+The Bureau: XCOM Declassified (revision 4704271)
+The Guardian (revision 3929479)
+Trdi disk (revision 4644623)
+UFO: Enemy Unknown (revision 4704271)
+Unreal Engine (revision 4622773)
+Unreal Engine 3 (revision 4622773)
+Uporabniški vmesnik (revision 4552473)
+Valve Corporation (revision 4110105)
+Večigralska videoigra (revision 4618639)
+VideoGamer.com (revision 4704271)
+Vohunski satelit (revision 4215166)
+Vojaška taktika (revision 3970259)
+Vojaški čini (revision 4363026)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2016-09-28 22:06:46.133919
+
+41 characters appeared 411226 times.
+
+First 29 characters:
+[ 0] Char a: 10.090315301075321 %
+[ 1] Char e: 9.90477255815537 %
+[ 2] Char i: 9.666703953543793 %
+[ 3] Char o: 9.177921629468953 %
+[ 4] Char n: 7.28309980400072 %
+[ 5] Char r: 5.808241696779873 %
+[ 6] Char s: 4.575586174025961 %
+[ 7] Char t: 4.4963110309173056 %
+[ 8] Char j: 4.343840126840229 %
+[ 9] Char l: 4.2672399118732764 %
+[10] Char v: 3.802775116359374 %
+[11] Char p: 3.5216644861949393 %
+[12] Char k: 3.5136397017698293 %
+[13] Char d: 3.0387183689747244 %
+[14] Char m: 2.9487435132992563 %
+[15] Char z: 2.350775485985808 %
+[16] Char u: 1.9719083910064055 %
+[17] Char g: 1.9342162217369525 %
+[18] Char b: 1.5392995579073308 %
+[19] Char c: 1.2924766430138173 %
+[20] Char h: 1.1864522184881305 %
+[21] Char č: 1.137087635509428 %
+[22] Char š: 0.6932927392723223 %
+[23] Char ž: 0.45303555709026183 %
+[24] Char f: 0.40707542811009034 %
+[25] Char x: 0.19381070263067024 %
+[26] Char y: 0.19040624863213904 %
+[27] Char w: 0.18919037220409216 %
+[28] Char q: 0.011186063138031156 %
+
+The first 29 characters have an accumulated ratio of 0.9998978663800442.
+
+727 sequences found.
+
+First 512 (typical positive ratio): 0.9983524317161332
+Next 512 (512-1024): 2.4317528560937295e-06
+Rest: -3.859759734048396e-17
+
+- Processing end: 2016-09-28 22:06:46.601266

data/ext/uchardet/script/BuildLangModelLogs/LangSpanishModel.log

@@ -0,0 +1,109 @@
+= Logs of language model for Spanish (es) =
+
+- Generated by BuildLangModel.py
+- Started: 2015-12-12 18:37:37.085123
+- Maximum depth: 2
+- Max number of pages: 50
+
+== Parsed pages ==
+
+Wikipedia:Portada (revision 84894710)
+11 de diciembre (revision 87735970)
+12 de diciembre (revision 87742023)
+13 de diciembre (revision 87697780)
+1474 (revision 66715698)
+1915 (revision 86935345)
+2000 (revision 87686385)
+2015 (revision 87743360)
+Actuación (revision 87459085)
+Akiyuki Nosaka (revision 87726149)
+Alberto Podestá (revision 87729965)
+Alejandro Magno (revision 87717064)
+Argentina (revision 87742018)
+Arnold Peralta (revision 87733100)
+Atentados del 11 de diciembre de 2007 (revision 87720544)
+Cantante (revision 86761085)
+Canto (revision 87664585)
+Carlo Furno (revision 87726011)
+Ciencia ficción (revision 87662615)
+Copa Mundial de Clubes de la FIFA 2015 (revision 87734956)
+Corona de Castilla (revision 87209578)
+Crisis migratoria en Europa (revision 87609406)
+Dictadura de Primo de Rivera (revision 87371131)
+Dionisio Miguel Recio (revision 87724426)
+Disneyland (revision 87665192)
+Dolph Schayes (revision 87730770)
+Día Internacional de las Montañas (revision 87739490)
+El discurso del rey (revision 87570241)
+Elecciones regionales de Francia de 2015 (revision 87744011)
+Estados Unidos (revision 87510736)
+Fiction House (revision 87732511)
+Filoxeno de Eretria (revision 83958621)
+Frank Sinatra (revision 87742871)
+Fundación Wikimedia (revision 87703852)
+Geoffrey Marcy (revision 87706505)
+Gheorghe Gruia (revision 87737327)
+Grupo de Acción Republicana (revision 87739104)
+Guerra contra el Estado Islámico (revision 87648946)
+Here We Go Again (canción) (revision 87680365)
+Isaac Asimov (revision 87591711)
+Isabel I de Castilla (revision 87743713)
+John "Hot Rod" Williams (revision 87730438)
+José Subirà-Puig (revision 87740413)
+Julio Terrazas Sandoval (revision 87736542)
+Libertad Lamarque (revision 87508996)
+Mosaico de Issos (revision 87731652)
+Museo Arqueológico Nacional de Nápoles (revision 87302262)
+Philip K. Dick (revision 87725371)
+Planet Comics (revision 86698920)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2015-12-12 18:39:02.288858
+
+52 characters appeared 991829 times.
+
+First 33 characters:
+[ 0] Char e: 12.571925200815867 %
+[ 1] Char a: 11.81988024145291 %
+[ 2] Char o: 8.07941691561751 %
+[ 3] Char n: 7.234513207417812 %
+[ 4] Char s: 7.042242160695039 %
+[ 5] Char i: 7.040528155559072 %
+[ 6] Char r: 6.8208330266608455 %
+[ 7] Char l: 5.722559029832763 %
+[ 8] Char d: 5.275707808503281 %
+[ 9] Char t: 4.668647518876742 %
+[10] Char c: 4.466999855821921 %
+[11] Char u: 3.673717949364255 %
+[12] Char m: 2.710547886782903 %
+[13] Char p: 2.4541528832086983 %
+[14] Char b: 1.3867309788280036 %
+[15] Char g: 1.2748165258325779 %
+[16] Char f: 0.925058654263991 %
+[17] Char y: 0.9045914164639268 %
+[18] Char v: 0.8877538365988492 %
+[19] Char ó: 0.8641610600214351 %
+[20] Char h: 0.7369213846338432 %
+[21] Char q: 0.5913317719082624 %
+[22] Char í: 0.5612862701130941 %
+[23] Char j: 0.43283670874717317 %
+[24] Char z: 0.38071078784750195 %
+[25] Char á: 0.37587124393418625 %
+[26] Char é: 0.29632124085905936 %
+[27] Char k: 0.2001353055819098 %
+[28] Char x: 0.18743150280945606 %
+[29] Char ñ: 0.17462687620547493 %
+[30] Char ú: 0.12865120902897575 %
+[31] Char w: 0.0972949974239511 %
+[32] Char ü: 0.004436248587206061 %
+
+The first 33 characters have an accumulated ratio of 0.9999263986029848.
+
+897 sequences found.
+
+First 512 (typical positive ratio): 0.9970385677528184
+Next 512 (512-1024): 1.0082383152741046e-06
+Rest: 4.597017211338539e-17
+
+- Processing end: 2015-12-12 18:39:02.460105

data/ext/uchardet/script/BuildLangModelLogs/LangSwedishModel.log

@@ -0,0 +1,151 @@
+= Logs of language model for Swedish (sv) =
+
+- Generated by BuildLangModel.py
+- Started: 2016-09-28 22:26:37.221506
+- Maximum depth: 5
+- Max number of pages: 100
+
+== Parsed pages ==
+
+Kakapo (revision 36509929)
+Akut hotad (revision 32517788)
+Aotearoa (revision 36575359)
+Art (revision 36771341)
+Artepitet (revision 36771341)
+Auckland (revision 35752058)
+Auktorsnamn (revision 35976965)
+BBC (revision 36508743)
+Basalomsättning (revision 30567523)
+Beilschmiedia tawa (revision 29101923)
+Berguv (revision 36295501)
+Betesmark (revision 34292168)
+Biotop (revision 35528052)
+BirdLife International (revision 36124283)
+Bonaparte (revision 37325183)
+British Museum (revision 36420244)
+Bröstben (revision 30602527)
+Dacrydium cupressinum (revision 32986501)
+Digital object identifier (revision 27637223)
+Djur (revision 37300775)
+Djurpark (revision 37147093)
+Domän (biologi) (revision 33377709)
+Don Merton (revision 36509929)
+Douglas Adams (revision 36556245)
+Däggdjur (revision 37328286)
+Ekologisk nisch (revision 33898643)
+Ekosystem (revision 36598266)
+Endemisk (revision 30647109)
+Eukaryoter (revision 37095313)
+Evolution (revision 37093592)
+Familj (biologi) (revision 30280200)
+Femininum (revision 30597527)
+Fjäder (biologi) (revision 36364943)
+Fjäderdräkt (revision 36364943)
+Fladdermöss (revision 37307257)
+Flygg (revision 36479633)
+Frukter (revision 34088588)
+Frö (revision 37333131)
+Fågelläte (revision 34034723)
+Fåglar (revision 37387306)
+Fåglarnas liv (revision 36509929)
+Genitiv (revision 37388438)
+George Edward Grey (revision 36509929)
+George Robert Gray (revision 20426710)
+Haasts örn (revision 29175076)
+Hauturu/Little Barrier Island (revision 36509929)
+Hermelin (revision 36578682)
+Hertz (revision 37104488)
+Hjortdjur (revision 36493550)
+Hund (revision 37351832)
+Husdjur (revision 37384850)
+Huskatt (revision 32922967)
+Hāngi (revision 29609696)
+IUCN (revision 30570280)
+Iller (revision 30663158)
+Infraröd (revision 36770733)
+Internationella naturvårdsunionen (revision 30570280)
+Jordbruk (revision 37352625)
+Kahurangi National Park (revision 35956142)
+Kamouflage (revision 36579595)
+Kaniner (revision 36877621)
+Kapiti Island (revision 37395588)
+Katt (revision 36734686)
+Kelp (revision 30312471)
+Kivier (revision 36373234)
+Klass (biologi) (revision 30280201)
+Kroppsfett (revision 35066611)
+Könsdimorfism (revision 30816932)
+Könsfördelning (revision 24769321)
+Lamm- och fårkött (revision 36187205)
+Lek (fortplantningsbeteende) (revision 30508235)
+Mandel (revision 36577529)
+Maori (revision 32560474)
+Maorier (revision 35862066)
+Maoripapegojor (revision 36545138)
+Mark Carwardine (revision 20375916)
+Markpapegoja (revision 36295722)
+Maskulinum (revision 32704551)
+Masterton (revision 29859631)
+Metrosideros umbellata (revision 29071212)
+Milford Sound (revision 20284758)
+Morrhår (revision 36533839)
+Muskelmage (revision 31196380)
+Mustela (revision 20934105)
+Mårddjur (revision 37306347)
+Māori (revision 32560474)
+NHNZ (revision 36509929)
+Nattpapegoja (revision 33486517)
+Nordön (revision 24810231)
+Nya Zeeland (revision 36575359)
+Näbb (revision 23648463)
+Ollonår (revision 36509929)
+Ordning (biologi) (revision 30280196)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2016-09-28 22:29:21.480287
+
+48 characters appeared 594415 times.
+
+First 31 characters:
+[ 0] Char a: 10.070741821791172 %
+[ 1] Char e: 9.737136512369304 %
+[ 2] Char r: 9.110638190489809 %
+[ 3] Char n: 8.378826240925951 %
+[ 4] Char t: 7.481305148759705 %
+[ 5] Char s: 5.828587771169974 %
+[ 6] Char i: 5.359891658184939 %
+[ 7] Char l: 5.173489901836259 %
+[ 8] Char o: 4.694195133029954 %
+[ 9] Char d: 4.597293136949774 %
+[10] Char k: 3.297359588839447 %
+[11] Char m: 3.1898589369379975 %
+[12] Char g: 3.004466576381821 %
+[13] Char v: 2.2324470277499726 %
+[14] Char f: 2.1988005013332437 %
+[15] Char p: 2.06017681249632 %
+[16] Char u: 2.0499146219392173 %
+[17] Char ä: 2.0475593650900468 %
+[18] Char h: 2.028380845032511 %
+[19] Char å: 1.5443755625278637 %
+[20] Char c: 1.442594820117258 %
+[21] Char ö: 1.3515809661600062 %
+[22] Char b: 1.268642278542769 %
+[23] Char j: 0.7302978558751041 %
+[24] Char y: 0.6699023409570755 %
+[25] Char x: 0.2111319532649748 %
+[26] Char w: 0.10262190557102362 %
+[27] Char z: 0.09151855185350302 %
+[28] Char é: 0.021197311642539303 %
+[29] Char ā: 0.011103353717520588 %
+[30] Char q: 0.007570468443764037 %
+
+The first 31 characters have an accumulated ratio of 0.999936071599808.
+
+748 sequences found.
+
+First 512 (typical positive ratio): 0.997323508584682
+Next 512 (512-1024): 1.6823263208364526e-06
+Rest: 1.7780915628762273e-17
+
+- Processing end: 2016-09-28 22:29:21.590354

data/ext/uchardet/script/BuildLangModelLogs/LangThaiModel.log

@@ -0,0 +1,141 @@
+= Logs of language model for Thai (th) =
+
+- Generated by BuildLangModel.py
+- Started: 2015-12-04 03:01:52.148282
+- Maximum depth: 3
+- Max number of pages: 50
+
+== Parsed pages ==
+
+หน้าหลัก (revision 5512633)
+26 พฤศจิกายน (revision 5570053)
+27 พฤศจิกายน (revision 5888433)
+28 พฤศจิกายน (revision 6110206)
+กล้องโทรทรรศน์อวกาศฮับเบิล (revision 5830742)
+การประชุมสภาสงฆ์แห่งแคลมงต์ (revision 5463877)
+ความเอนเอียงเพื่อยืนยัน (revision 6231756)
+คัมภีร์พระเวท (revision 6109417)
+คาบสมุทรไซนาย (revision 5661104)
+จักรวรรดิโรมันตะวันออก (revision 6150148)
+ชาวมุสลิม (revision 6242838)
+ซุคฮอย ซู-24 (revision 6015891)
+ดาวอังคาร (revision 6235017)
+ดาวเคราะห์นอกระบบ (revision 5823077)
+ดินแดนศักดิ์สิทธิ์ (revision 6179072)
+ทฤษฎี (revision 5606447)
+ทะกะอะกิ คะจิตะ (revision 6177601)
+ท่าอากาศยานนานาชาติตริภูวัน (revision 6010470)
+นกกาเหว่า (revision 6142782)
+ประเทศอัฟกานิสถาน (revision 6216996)
+ประเทศเนปาล (revision 6206980)
+ปรากฏการณ์การวางกรอบ (revision 6046655)
+ปารีส (revision 6222115)
+พ.ศ. 1638 (revision 4723508)
+พ.ศ. 2438 (revision 5737055)
+พ.ศ. 2515 (revision 6197082)
+พ.ศ. 2544 (revision 6189598)
+พินัยกรรม (revision 5607889)
+มูลนิธิวิกิมีเดีย (revision 5816103)
+ระบบสุริยะ (revision 6201228)
+รางวัลโนเบล (revision 5828030)
+รางวัลโนเบลสาขาฟิสิกส์ (revision 6177103)
+รายชื่อบทความวันนี้ในอดีต (revision 5410610)
+ลักกีสไตรก์ (เพลง) (revision 6195816)
+ลุฟต์ฮันซา (revision 6116038)
+วิกฤตการณ์ผู้ย้ายถิ่นยุโรป (revision 6219634)
+วิกิพีเดีย (revision 6086299)
+วิกิพีเดียภาษาไทย (revision 6209148)
+สงครามครูเสด (revision 6228828)
+สงครามอังกฤษ–แซนซิบาร์ (revision 5829349)
+สติ (จิตวิทยา) (revision 6039161)
+สมมติฐาน (revision 6221744)
+สมเด็จพระราชินีมารีแห่งโรมาเนีย (revision 6211695)
+สมเด็จพระสันตะปาปาเออร์บันที่ 2 (revision 5828365)
+สารานุกรม (revision 6070482)
+อัลเฟรด โนเบล (revision 6214514)
+อาร์เธอร์ แมคโดนัลด์ (revision 6188035)
+เซนต์ปีเตอร์สเบิร์ก (revision 6162201)
+เทือกเขาฮินดูกูช (revision 5218921)
+เนื้อหาเสรี (revision 6160507)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2015-12-04 03:05:06.181487
+
+105 characters appeared 401052 times.
+
+First 64 characters:
+[ 0] Char า: 8.857704237854442 %
+[ 1] Char น: 6.7679502907353655 %
+[ 2] Char ร: 6.739026360671434 %
+[ 3] Char ก: 5.388079351306065 %
+[ 4] Char อ: 5.099837427565503 %
+[ 5] Char ง: 4.861713692987443 %
+[ 6] Char เ: 4.5198627609387305 %
+[ 7] Char ม: 4.133628556895365 %
+[ 8] Char ว: 3.864336794231172 %
+[ 9] Char ด: 3.3152808114658447 %
+[10] Char ย: 3.195844927839781 %
+[11] Char ล: 3.1312647736453125 %
+[12] Char ท: 2.69615910156289 %
+[13] Char ส: 2.6001615750575984 %
+[14] Char ะ: 2.392457835891605 %
+[15] Char ค: 2.384229476476866 %
+[16] Char บ: 2.3321165335168503 %
+[17] Char ต: 2.196473275285998 %
+[18] Char ห: 1.983782651626223 %
+[19] Char ป: 1.9192024974317545 %
+[20] Char แ: 1.7813151411787 %
+[21] Char จ: 1.76261432432702 %
+[22] Char พ: 1.5075351824701035 %
+[23] Char ข: 1.3519443862641254 %
+[24] Char ใ: 1.3295034060421091 %
+[25] Char ไ: 1.2227840778751882 %
+[26] Char ช: 1.0407627938521689 %
+[27] Char โ: 0.9382823175049619 %
+[28] Char ศ: 0.8078752879925796 %
+[29] Char ำ: 0.7393056262030859 %
+[30] Char ถ: 0.599672860377208 %
+[31] Char ซ: 0.541076967575277 %
+[32] Char e: 0.43734977010462484 %
+[33] Char ผ: 0.43585370475649043 %
+[34] Char ณ: 0.4019428901987772 %
+[35] Char a: 0.3897250231890129 %
+[36] Char i: 0.3657879776188624 %
+[37] Char ษ: 0.3647906007201061 %
+[38] Char ภ: 0.34185093204871186 %
+[39] Char ธ: 0.3181632307032505 %
+[40] Char o: 0.3176645422538723 %
+[41] Char n: 0.3139243788835363 %
+[42] Char ญ: 0.29248077556027646 %
+[43] Char r: 0.28350438347147006 %
+[44] Char t: 0.2705384837876385 %
+[45] Char s: 0.2488455362396896 %
+[46] Char l: 0.19598456060560726 %
+[47] Char ฟ: 0.19473783948216192 %
+[48] Char c: 0.16356981139602844 %
+[49] Char ฐ: 0.15833358267755804 %
+[50] Char ฤ: 0.15284800973439852 %
+[51] Char ๆ: 0.14910784636406252 %
+[52] Char d: 0.13090571796176056 %
+[53] Char ฮ: 0.1244227681198448 %
+[54] Char h: 0.12043326052481973 %
+[55] Char u: 0.12043326052481973 %
+[56] Char m: 0.09599752650529109 %
+[57] Char y: 0.08951457666337533 %
+[58] Char ฏ: 0.08677179019179557 %
+[59] Char p: 0.08253293837208142 %
+[60] Char f: 0.08153556147332515 %
+[61] Char S: 0.07604998853016566 %
+[62] Char ฝ: 0.07330720205858592 %
+[63] Char ฉ: 0.0673229406660483 %
+
+The first 64 characters have an accumulated ratio of 0.989480167160368.
+
+2324 sequences found.
+
+First 512 (typical positive ratio): 0.8815720594354438
+Next 512 (512-1024): 7.480326740672033e-06
+Rest: 0.026341928296264486
+
+- Processing end: 2015-12-04 03:05:06.800467