cchardet 0.2.0

data/ext/uchardet/script/BuildLangModelLogs/LangPortugueseModel.log

@@ -0,0 +1,166 @@
+= Logs of language model for Portuguese (pt) =
+
+- Generated by BuildLangModel.py
+- Started: 2016-09-20 23:44:39.722451
+- Maximum depth: 5
+- Max number of pages: 100
+
+== Parsed pages ==
+
+Papagaio-das-mascarenhas (revision 46763149)
+Albinismo (revision 46498446)
+Alfred Newton (revision 43617011)
+Alphonse Milne-Edwards (revision 39740747)
+Animalia (revision 46727732)
+Asa (revision 46338820)
+August von Pelzeln (revision 34726241)
+Aves (revision 46728980)
+Bico (revision 45311553)
+Carl Wilhelm Hahn (revision 45025566)
+Carlos Lineu (revision 46625396)
+Carolus Linnaeus (revision 46625396)
+Cauda (revision 43275401)
+Charles Lucien Bonaparte (revision 45529712)
+Chordata (revision 46640101)
+Cladograma (revision 46700307)
+Classe (biologia) (revision 46701409)
+Classificação científica (revision 46306288)
+Coleção Leverian (revision 45026647)
+Comores (revision 46181501)
+Coracopsinae (revision 36946101)
+Coracopsis nigra (revision 44338845)
+Coracopsis vasa (revision 42905822)
+Cylindraspis indica (revision 42905410)
+Cúlmen (revision 45311553)
+Digital object identifier (revision 42172651)
+Eclectus roratus (revision 44380798)
+Edward Newton (revision 39261469)
+Endemismo (revision 45260961)
+Epíteto específico (revision 35101647)
+Espécie (revision 45685675)
+Esquilo-vermelho (revision 43489595)
+Estado de conservação (revision 46662839)
+Extinção (revision 46526607)
+Família (biologia) (revision 46636004)
+Filo (revision 46704246)
+França (revision 46740839)
+François-Nicolas Martinet (revision 43679514)
+François Levaillant (revision 40142351)
+Fredrik Hasselqvist (revision 44381122)
+Fregilupus varius (revision 46555765)
+Fumigação (revision 42458244)
+George Robert Gray (revision 39047844)
+Georges-Louis Leclerc, conde de Buffon (revision 45622418)
+Género (biologia) (revision 45296588)
+Hermann Schlegel (revision 43137605)
+Herpetologista (revision 46207704)
+Histoire Naturelle (revision 44293456)
+Holótipo (revision 44029660)
+Ilha da Reunião (revision 45458206)
+Ilha vulcânica (revision 37924535)
+Ilhas Mascarenhas (revision 45858660)
+Ilhas Molucas (revision 45476933)
+International Standard Book Number (revision 46326494)
+Jacques Barraband (revision 45007769)
+Jean Feuilley (revision 43140791)
+Johann Georg Wagler (revision 34585234)
+John Gerrard Keulemans (revision 39664498)
+Julian Hume (revision 41876605)
+Leiolopisma (revision 43997173)
+Lionel Walter Rothschild (revision 46022922)
+Lista Vermelha da IUCN (revision 46569884)
+Lista Vermelha da União Internacional para a Conservação da Natureza e dos Recursos Naturais (revision 46569884)
+Lista Vermelha de Espécies Ameaçadas da IUCN (revision 46569884)
+Lista de aves extintas (revision 45507420)
+Londres (revision 46310311)
+Língua inglesa (revision 46609785)
+Madagascar (revision 46617630)
+Mascarenotus grucheti (revision 43145662)
+Mathurin Jacques Brisson (revision 36018826)
+Maurício (revision 46723599)
+Maximiliano I José da Baviera (revision 46372080)
+Melanina (revision 46762903)
+Museu Nacional de História Natural (França) (revision 43731807)
+Naturhistorisches Museum (revision 46694247)
+Nesoenas duboisi (revision 43995805)
+Nome científico (revision 46671641)
+Nomenclatura binomial (revision 46671641)
+Nycticorax duboisi (revision 43816214)
+Nível do mar (revision 46414695)
+Ordem (biologia) (revision 46360024)
+Otto Finsch (revision 42362273)
+Papagaio (revision 46738207)
+Papagaio-cinzento (revision 46673943)
+Papagaio-cinzento-de-maurício (revision 46664408)
+Pedro Mascarenhas (c. 1484-1555) (revision 45541977)
+Periquito-de-maurício (revision 43010883)
+Periquito-de-reunião (revision 43048764)
+Peter Mundy (revision 43563846)
+Piton des Neiges (revision 45632497)
+Pleistoceno (revision 45916874)
+Plumagem (revision 34951058)
+Ponto quente (revision 45375495)
+Porphyrio coerulescens (revision 43672493)
+Praslin (revision 40728143)
+Psitacídeos (revision 46598835)
+Psittaciformes (revision 46598835)
+Psittacula (revision 42856453)
+Psittaculinae (revision 46760737)
+Psittaculini (revision 43015966)
+Psittrichasiidae (revision 44385977)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2016-09-20 23:47:27.346826
+
+51 characters appeared 558324 times.
+
+First 38 characters:
+[ 0] Char a: 11.864795351802895 %
+[ 1] Char e: 11.44604208309154 %
+[ 2] Char o: 9.868284365350585 %
+[ 3] Char s: 8.346587286235232 %
+[ 4] Char i: 7.118089138206489 %
+[ 5] Char r: 6.394136737808154 %
+[ 6] Char n: 5.568272186042513 %
+[ 7] Char d: 5.243192125002687 %
+[ 8] Char t: 4.80061756256224 %
+[ 9] Char m: 4.498105042949971 %
+[10] Char c: 3.9747530107965985 %
+[11] Char u: 3.7229279056605127 %
+[12] Char l: 3.207814817202914 %
+[13] Char p: 2.77562848811801 %
+[14] Char g: 1.3850380782484721 %
+[15] Char v: 1.3210967108703908 %
+[16] Char f: 1.122466524813549 %
+[17] Char b: 0.9702251739133549 %
+[18] Char h: 0.9130898904578704 %
+[19] Char é: 0.7026386112723079 %
+[20] Char ã: 0.7022803963290133 %
+[21] Char q: 0.5903382265494588 %
+[22] Char ç: 0.5856814322866293 %
+[23] Char í: 0.41391736697688086 %
+[24] Char x: 0.3913498255493226 %
+[25] Char á: 0.34567742027926435 %
+[26] Char z: 0.3170202248156984 %
+[27] Char ó: 0.22925756370852768 %
+[28] Char j: 0.20454073262120204 %
+[29] Char ê: 0.20239144296143458 %
+[30] Char õ: 0.16155493942585308 %
+[31] Char y: 0.15080849112701586 %
+[32] Char w: 0.09241945537000021 %
+[33] Char ú: 0.08794176857881804 %
+[34] Char k: 0.08364318925928313 %
+[35] Char â: 0.07898639499645367 %
+[36] Char à: 0.06859816164091102 %
+[37] Char ô: 0.031164700066627977 %
+
+The first 38 characters have an accumulated ratio of 0.9998137282294869.
+
+891 sequences found.
+
+First 512 (typical positive ratio): 0.9953179582313172
+Next 512 (512-1024): 1.7910747164728723e-06
+Rest: 2.42861286636753e-17
+
+- Processing end: 2016-09-20 23:47:27.489355

data/ext/uchardet/script/BuildLangModelLogs/LangRomanianModel.log

@@ -0,0 +1,153 @@
+= Logs of language model for Romanian (ro) =
+
+- Generated by BuildLangModel.py
+- Started: 2016-09-28 18:53:56.086095
+- Maximum depth: 5
+- Max number of pages: 100
+
+== Parsed pages ==
+
+The Loving Kind (revision 10166481)
+12 ianuarie (revision 10711676)
+13 decembrie (revision 9938353)
+2007 (revision 10716321)
+2008 (revision 10752084)
+2009 (revision 10654003)
+21 noiembrie (revision 10447643)
+25 ianuarie (revision 10228199)
+31 ianuarie (revision 10718063)
+4 Music (revision 9701591)
+Billboard (revision 10505294)
+Biology (revision 10112430)
+Bulgaria (revision 10481051)
+CD (revision 10477531)
+Call The Shots (revision 10101027)
+Call the Shots (revision 10101027)
+Can't Speak French (revision 9721506)
+Casă de discuri (revision 10611348)
+Channel 4 (revision 7953101)
+Chemistry (revision 10112479)
+Cheryl Cole (revision 10475016)
+Chitară (revision 10468266)
+Croația (revision 10737746)
+Dance (revision 10231736)
+Descărcare digitală (revision 10100743)
+Digital Spy (revision 9044016)
+Discografia Girls Aloud (revision 10172788)
+Estonia (revision 10749810)
+Europa (revision 10752724)
+Fascination Records (revision 9655292)
+Fiona Phillips (revision 5384082)
+Gen muzical (revision 10534645)
+Girls A Live (revision 10112444)
+Girls Aloud (revision 10112446)
+Good Morning Television (revision 10166481)
+Heat World (revision 10166481)
+I'll Stand By You (cântec de Girls Aloud) (revision 10112432)
+ITunes (revision 10744174)
+I Think We're Alone Now (revision 10112427)
+Irlanda (revision 10573806)
+Jump (cântec de Girls Aloud) (revision 10112438)
+Lady GaGa (revision 10753010)
+Life Got Cold (revision 10112437)
+Limba engleză (revision 10756676)
+Long Hot Summer (revision 10112429)
+Love Machine (revision 10112433)
+MSN Search (revision 10653298)
+MTV (revision 10170766)
+Mixed Up (revision 10112443)
+Muzică electronică (revision 10608432)
+Muzică pop (revision 10740529)
+Nadine Coyle (revision 10316187)
+Neil Tennant (revision 10499980)
+No Good Advice (revision 10112436)
+Out Of Control (revision 10112484)
+Out of Control (revision 10112484)
+Pet Shop Boys (revision 10612741)
+Poker Face (revision 10496402)
+PopJustice (revision 10625677)
+Regatul Unit (revision 10752338)
+Regatul Unit al Marii Britanii și Irlandei de Nord (revision 10752338)
+Regatul Unit al Marii Britanii și al Irlandei de Nord (revision 10752338)
+Republica Irlanda (revision 10573806)
+Romanian Top 100 (revision 10736281)
+România (revision 10732435)
+Sarah Harding (revision 10633651)
+Sarah Hearding (revision 10112425)
+See the Day (revision 10112431)
+Sexy! No No No... (revision 10112425)
+Slant Magazine (revision 7697473)
+Slovenia (revision 10521499)
+Something Kinda Ooooh (revision 10112426)
+Sound of the Underground (album) (revision 10112476)
+Sound of the Underground (cântec) (revision 10112434)
+Tangled Up (revision 10112482)
+The Guardian (revision 9752334)
+The Paul O'Grady Show (revision 10101027)
+The Promise (revision 10166482)
+The Show (revision 10112441)
+The Sound of Girls Aloud (revision 10112480)
+Tonalitate (revision 9966362)
+Turneul Out of Control (revision 10112446)
+UK Mix (revision 9721468)
+UK Singles Chart (revision 10226705)
+Ungaria (revision 10737745)
+Uniunea Europeană (revision 10751590)
+Untouchable (revision 10112410)
+Wake Me Up (revision 10112439)
+What Will The Neighbours Say? (revision 10112478)
+Whole Lotta History (revision 10475020)
+Wideboys (revision 10166481)
+Wikimedia Commons (revision 9703907)
+Xenomania (revision 10112484)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2016-09-28 18:58:13.756622
+
+60 characters appeared 883554 times.
+
+First 33 characters:
+[ 0] Char e: 11.67014127036944 %
+[ 1] Char i: 10.97567324690964 %
+[ 2] Char a: 10.080198833348046 %
+[ 3] Char r: 7.490657050955572 %
+[ 4] Char n: 7.18246988865423 %
+[ 5] Char t: 6.516296683620921 %
+[ 6] Char l: 5.595130574928075 %
+[ 7] Char u: 5.551217016730161 %
+[ 8] Char o: 4.922732509840938 %
+[ 9] Char c: 4.495707110148333 %
+[10] Char s: 3.8308920563994957 %
+[11] Char d: 3.590499279048027 %
+[12] Char m: 2.971408651876399 %
+[13] Char p: 2.902369294915761 %
+[14] Char ă: 2.1349006399156134 %
+[15] Char g: 1.2248261000459508 %
+[16] Char f: 1.1199089133205216 %
+[17] Char b: 1.0781457613230203 %
+[18] Char ț: 1.0323081554721047 %
+[19] Char ș: 0.9732285745975912 %
+[20] Char î: 0.97017273420753 %
+[21] Char v: 0.9693804792915882 %
+[22] Char z: 0.7369102510995367 %
+[23] Char h: 0.533413916976212 %
+[24] Char â: 0.4986678799484808 %
+[25] Char x: 0.22081276300033725 %
+[26] Char j: 0.20055367300696958 %
+[27] Char k: 0.1901411798260208 %
+[28] Char y: 0.15471606715605385 %
+[29] Char w: 0.11827234102273318 %
+[30] Char á: 0.016297815413658927 %
+[31] Char é: 0.013355154297303842 %
+[32] Char q: 0.00520624659047438 %
+
+The first 33 characters have an accumulated ratio of 0.9996661211425673.
+
+981 sequences found.
+
+First 512 (typical positive ratio): 0.997762564143313
+Next 512 (512-1024): 1.1317927370596478e-06
+Rest: 3.0357660829594124e-18
+
+- Processing end: 2016-09-28 18:58:13.862425

data/ext/uchardet/script/BuildLangModelLogs/LangSlovakModel.log

@@ -0,0 +1,158 @@
+= Logs of language model for Slovak (sk) =
+
+- Generated by BuildLangModel.py
+- Started: 2016-09-21 13:26:28.712674
+- Maximum depth: 5
+- Max number of pages: 100
+
+== Parsed pages ==
+
+Dôkaz (matematika) (revision 6358810)
+1825 (revision 6122752)
+1839 (revision 6165808)
+1847 (revision 5941780)
+1852 (revision 5941777)
+1878 (revision 6221358)
+1955 (revision 6226609)
+1976 (revision 6310709)
+1983 (revision 6356952)
+1993 (revision 6348358)
+1995 (revision 6277350)
+2012 (revision 6291145)
+Adrien-Marie Legendre (revision 6060342)
+Algebra (revision 6319238)
+Algebraická geometria (revision 5964212)
+Algebraická rovnica (revision 5288111)
+Algebrické číslo (revision 6106622)
+Algoritmus (revision 6286937)
+Andrew Wiles (revision 5791970)
+Arabi (revision 6044956)
+Arabčina (revision 6322514)
+Aristoteles (revision 6359959)
+Arthur Cayley (revision 6332355)
+Axióma (revision 6338092)
+Babylonia (revision 6168813)
+Bernard Bolzano (revision 6261374)
+Boh (revision 6282272)
+Bolzanova veta (revision 6345299)
+Bytie (revision 5274918)
+Byzantská ríša (revision 6359782)
+Caroline Blundenová (revision 6358810)
+Cauchyho postupnosť (revision 6215169)
+Celé číslo (revision 6302805)
+Charles Hermite (revision 5751036)
+Daniel Marcus (revision 5657431)
+David Hilbert (revision 5968866)
+Dedukcia (revision 6338099)
+Definícia (revision 6106684)
+Derivácia (funkcia) (revision 5970574)
+Desiatková číselná sústava (revision 5924486)
+Diofantická rovnica (revision 6327292)
+Dynastia Chan (revision 6342042)
+Dôkaz (logika) (revision 5495754)
+Dôkaz sporom (revision 5940134)
+Dôkaz výpočtom (revision 6358810)
+Energia (revision 6277761)
+Eric Weisstein (revision 6054413)
+Ernst Kummer (revision 6001344)
+Európa (revision 6295124)
+Experiment (revision 6354302)
+Fenomén (filozofia) (revision 5420897)
+Filozofia (revision 6296369)
+Formula (logika) (revision 3916562)
+Formálny dôkaz (revision 6358810)
+Formálny jazyk (revision 5623029)
+Gabriel Cramer (revision 5923903)
+Galoisova teória (revision 6353573)
+Gentzenovský kalkul (revision 6358810)
+Geometria (revision 5970028)
+Geometrický dôkaz (revision 6358810)
+Georg Ferdinand Cantor (revision 6186696)
+Giordano Bruno (revision 6312876)
+Gottlob Frege (revision 5968855)
+Gödelova veta o neúplnosti (revision 5323549)
+Hardvér (revision 6214401)
+Henri Poincaré (revision 6315506)
+Hilbertovský kalkul (revision 6358810)
+Hmotnosť (revision 5979540)
+Hypotéza (revision 5983410)
+Idea (revision 5960449)
+India (revision 6362189)
+Intuícia (revision 5837951)
+Jazyk (lingvistika) (revision 6073293)
+John Taylor (revision 6355518)
+Kardinálne číslo (revision 6090126)
+Kenneth Appel (revision 5968422)
+Klasická mechanika (revision 6295646)
+Konečná množina (revision 5276494)
+Konfucianizmus (revision 5968816)
+Kresťanstvo (revision 6289571)
+Langlandsov program (revision 6088475)
+Latinčina (revision 6121105)
+Leonhard Euler (revision 6339382)
+Lineárna algebra (revision 5473535)
+Logická axióma (revision 5495754)
+Logický kalkul (revision 1608550)
+
+== End of Parsed pages ==
+
+- Wikipedia parsing ended at: 2016-09-21 13:33:10.330458
+
+62 characters appeared 550293 times.
+
+First 45 characters:
+[ 0] Char o: 8.867094438780795 %
+[ 1] Char a: 8.59705647718579 %
+[ 2] Char e: 8.562347694773512 %
+[ 3] Char n: 6.0867574183207855 %
+[ 4] Char i: 5.828531346028389 %
+[ 5] Char t: 5.366595613609477 %
+[ 6] Char r: 4.977711873492848 %
+[ 7] Char k: 4.264273759615332 %
+[ 8] Char s: 4.257731790155426 %
+[ 9] Char v: 4.117079446767449 %
+[10] Char l: 3.5979014815743615 %
+[11] Char d: 3.416361829061972 %
+[12] Char m: 3.2513588215732345 %
+[13] Char p: 2.878466562358598 %
+[14] Char u: 2.5987973679476206 %
+[15] Char c: 2.419438371921867 %
+[16] Char z: 2.127412124086623 %
+[17] Char h: 2.0687161203213558 %
+[18] Char j: 2.0312815173007834 %
+[19] Char y: 1.6700194260148686 %
+[20] Char b: 1.6574806512167153 %
+[21] Char á: 1.6422160558102683 %
+[22] Char ý: 1.2564215790497062 %
+[23] Char í: 1.1326693234331529 %
+[24] Char č: 0.9473135220691523 %
+[25] Char é: 0.8913433389121795 %
+[26] Char ž: 0.7668641978000811 %
+[27] Char ú: 0.6949025337411161 %
+[28] Char š: 0.6785476100913513 %
+[29] Char f: 0.6514711253822963 %
+[30] Char g: 0.6096752093884531 %
+[31] Char ť: 0.46375294615777407 %
+[32] Char ô: 0.4172322744428877 %
+[33] Char ľ: 0.36053520579036985 %
+[34] Char x: 0.23114958758334195 %
+[35] Char ó: 0.2251527822450949 %
+[36] Char ň: 0.09304134342977287 %
+[37] Char w: 0.09013380144759246 %
+[38] Char ä: 0.0694175648245571 %
+[39] Char ď: 0.06560141597294532 %
+[40] Char q: 0.01726353051919614 %
+[41] Char ě: 0.009994675563745132 %
+[42] Char ĺ: 0.009267790068200032 %
+[43] Char ö: 0.008904347320427481 %
+[44] Char ŕ: 0.00599680533824708 %
+
+The first 45 characters have an accumulated ratio of 0.9998128269848972.
+
+1181 sequences found.
+
+First 512 (typical positive ratio): 0.9733303573968434
+Next 512 (512-1024): 1.8172137388627513e-06
+Rest: 0.0003522983638913346
+
+- Processing end: 2016-09-21 13:33:10.831531