PgsFile 0.3.8__py3-none-any.whl → 0.4.0__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Potentially problematic release.
This version of PgsFile might be problematic. Click here for more details.
- PgsFile/Corpora/Stopwords/english.txt +97 -91
- PgsFile/PgsFile.py +106 -1
- PgsFile/__init__.py +2 -2
- PgsFile/models/dics/unigram_freq_only.json +1 -0
- {PgsFile-0.3.8.dist-info → PgsFile-0.4.0.dist-info}/METADATA +4 -4
- {PgsFile-0.3.8.dist-info → PgsFile-0.4.0.dist-info}/RECORD +9 -8
- {PgsFile-0.3.8.dist-info → PgsFile-0.4.0.dist-info}/LICENSE +0 -0
- {PgsFile-0.3.8.dist-info → PgsFile-0.4.0.dist-info}/WHEEL +0 -0
- {PgsFile-0.3.8.dist-info → PgsFile-0.4.0.dist-info}/top_level.txt +0 -0
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: PgsFile
|
|
3
|
-
Version: 0.
|
|
4
|
-
Summary: This module simplifies Python package management, script execution, file handling, web scraping, and multimedia downloads. The module supports LLM-based NLP tasks such as tokenization, lemmatization, POS tagging, NER, dependency parsing, MDD, WSD, LIWC, and MIP analysis. It also generates word lists and plots data, aiding literary students. Ideal for scraping data, cleaning text, and analyzing language, it offers user-friendly tools to streamline workflows.
|
|
3
|
+
Version: 0.4.0
|
|
4
|
+
Summary: This module simplifies Python package management, script execution, file handling, web scraping, and multimedia downloads. The module supports (LLM-based) NLP tasks such as tokenization, lemmatization, POS tagging, NER, keywords extraction, dependency parsing, MDD, WSD, LIWC, and MIP analysis. It also generates word lists, and plots data, aiding literary students. Ideal for scraping data, cleaning text, and analyzing language, it offers user-friendly tools to streamline workflows.
|
|
5
5
|
Home-page: https://mp.weixin.qq.com/s/12-KVLfaPszoZkCxuRd-nQ?token=1589547443&lang=zh_CN
|
|
6
6
|
Author: Pan Guisheng
|
|
7
7
|
Author-email: 895284504@qq.com
|
|
@@ -34,9 +34,9 @@ Key Features:
|
|
|
34
34
|
4. **Data Storage:** Write and append data to text files, Excel, JSON, and JSON lines.
|
|
35
35
|
5. **File and Folder Processing:** Manage file paths, create directories, move or copy files, and search for files with specific keywords.
|
|
36
36
|
6. **Data Cleaning:** Clean text, handle punctuation, remove stopwords, and prepare data for analysis, utilizing valuable corpora and dictionaries such as CET-4/6 vocabulary and BNC-COCA word lists.
|
|
37
|
-
7. **NLP:** Perform word tokenization, lemmatization, POS tagging, NER, dependency parsing, MDD, WSD, LIWC, and MIP analysis using prepared LLM prompts.
|
|
37
|
+
7. **NLP:** Perform word tokenization, lemmatization, POS tagging, NER, dependency parsing, keywords extraction, MDD, WSD, LIWC, and MIP analysis using prepared LLM prompts.
|
|
38
38
|
8. **Math Operations:** Format numbers, convert decimals to percentages, and validate data.
|
|
39
|
-
9. **Visualization:** Process images (e.g., make white pixels transparent) and manage fonts for rendering text.
|
|
39
|
+
9. **Visualization:** Process images (e.g., make white pixels transparent, resize images) and manage fonts for rendering text.
|
|
40
40
|
|
|
41
41
|
Author: Pan Guisheng, a PhD student at the Graduate Institute of Interpretation and Translation of Shanghai International Studies University
|
|
42
42
|
Email: 895284504@qq.com
|
|
@@ -1,5 +1,5 @@
|
|
|
1
|
-
PgsFile/PgsFile.py,sha256=
|
|
2
|
-
PgsFile/__init__.py,sha256=
|
|
1
|
+
PgsFile/PgsFile.py,sha256=Ko2HpUkWdNM8vAQy9wCkbFNDMuAQ2fQCCQy-IEeBWy4,161852
|
|
2
|
+
PgsFile/__init__.py,sha256=nsKnjOskNjAsmtC88W62ARm5k9OGAqpo7_si66Mw0nM,3500
|
|
3
3
|
PgsFile/Corpora/Idioms/English_Idioms_8774.txt,sha256=qlsP0yI_XGECBRiPZuLkGZpdasc77sWSKexANu7v8_M,175905
|
|
4
4
|
PgsFile/Corpora/Monolingual/Chinese/People's Daily 20130605/Raw/00000000.txt,sha256=SLGGSMSb7Ff1RoBstsTW3yX2wNZpqEUchFNpcI-mrR4,1513
|
|
5
5
|
PgsFile/Corpora/Monolingual/Chinese/People's Daily 20130605/Raw/00000001.txt,sha256=imOa6UoCOIZoPXT4_HNHgCUJtd4FTIdk2FZNHNBgJyg,3372
|
|
@@ -2548,7 +2548,7 @@ PgsFile/Corpora/Stopwords/chinese.txt,sha256=hOUmRU2wJFyrDRZ98GfwApjSca0shjkdRfX
|
|
|
2548
2548
|
PgsFile/Corpora/Stopwords/czech.txt,sha256=MAEEJt63x7_dEjvYNxPFhtJTsRiY0HpqbaFbHwFFxJg,1518
|
|
2549
2549
|
PgsFile/Corpora/Stopwords/danish.txt,sha256=a47uI-x5zVxV6Q7dvoNtfUmEdKsEPpp_7PEh-aZ9tng,424
|
|
2550
2550
|
PgsFile/Corpora/Stopwords/dutch.txt,sha256=XWG2jK3qfTwVLUloMvpRPhN1s795xjL6iGz-7W-QPOw,453
|
|
2551
|
-
PgsFile/Corpora/Stopwords/english.txt,sha256=
|
|
2551
|
+
PgsFile/Corpora/Stopwords/english.txt,sha256=M_AkXqS5lm0bSajo3f5GLebCu0ftjKKKjuqI03MwBXo,7671
|
|
2552
2552
|
PgsFile/Corpora/Stopwords/finnish.txt,sha256=wZEmnbyhsM0OvcPFU8zyuZWpFwEf849RVpBWip7Vi3Y,1579
|
|
2553
2553
|
PgsFile/Corpora/Stopwords/french.txt,sha256=iOap3qKohIjlv7eadFoxYISE74M5x9SpWKq_odv8cFY,1345
|
|
2554
2554
|
PgsFile/Corpora/Stopwords/german.txt,sha256=JMY6_U4MFrSa3twPQ_BPbI2072Tc16Zw-hrOhS27lPs,1363
|
|
@@ -2577,6 +2577,7 @@ PgsFile/models/model_reviews_ReadMe.txt,sha256=Q9uLJwudMmsTKfd11l1tOcIP8lwsemIwn
|
|
|
2577
2577
|
PgsFile/models/dics/BNC_COCA_lists.xlsx,sha256=ua5iQzEf5UQpsCezbsliNF6e_PYHIHGSJUjn9MyEEks,1229313
|
|
2578
2578
|
PgsFile/models/dics/CET-4 2016 (6314).txt,sha256=NZ3ai_OqIJJLPTPIs4Mc6170gzBIoC0Jgm4cF3tjMdc,57411
|
|
2579
2579
|
PgsFile/models/dics/CET-6 2016 (1726).txt,sha256=6Bk-R_qVxJRNV8McXqK9Q1uoFvpokB1foK9bUpHxRzE,14914
|
|
2580
|
+
PgsFile/models/dics/unigram_freq_only.json,sha256=pr1OFOnAUfdzjHEHayhm-6-ZboQK7hPjB0DIqZztrn4,6289555
|
|
2580
2581
|
PgsFile/models/fonts/DejaVuSans.ttf,sha256=faGVp0xVvvmI0NSPlQi9XYSUJcF3Dbpde_xs6e2EiVQ,757076
|
|
2581
2582
|
PgsFile/models/fonts/书体坊赵九江钢笔行书体.ttf,sha256=fTOv4FFMnYtN1zCZghJ6-P1pzznA5qqoujwpDFY63Ek,3140656
|
|
2582
2583
|
PgsFile/models/fonts/全新硬笔楷书简.ttf,sha256=mPemGYMpgQxvFL1pFjjnyUMIprHzcoOaw8oeZQ4k1x0,2397296
|
|
@@ -2585,8 +2586,8 @@ PgsFile/models/fonts/博洋行书3500.TTF,sha256=VrgeHr8cgOL6JD05QyuD9ZSyw4J2aIV
|
|
|
2585
2586
|
PgsFile/models/fonts/陆柬之行书字体.ttf,sha256=Zpd4Z7E9w-Qy74yklXHk4vM7HOtHuQgllvygxZZ1Hvs,1247288
|
|
2586
2587
|
PgsFile/models/prompts/1. MIP prompt.txt,sha256=4lHlHmleayRytqr1n9jtt6vn1rQvyf4BKeThpbwI8o8,1638
|
|
2587
2588
|
PgsFile/models/prompts/2. WSD prompt.txt,sha256=o-ZFtCRUCDrXgm040WTQch9v2Y_r2SIlrZaquilJjgQ,2348
|
|
2588
|
-
PgsFile-0.
|
|
2589
|
-
PgsFile-0.
|
|
2590
|
-
PgsFile-0.
|
|
2591
|
-
PgsFile-0.
|
|
2592
|
-
PgsFile-0.
|
|
2589
|
+
PgsFile-0.4.0.dist-info/LICENSE,sha256=cE5c-QToSkG1KTUsU8drQXz1vG0EbJWuU4ybHTRb5SE,1138
|
|
2590
|
+
PgsFile-0.4.0.dist-info/METADATA,sha256=OuxX_yi0yRKRnXyqS-QL5JEBbrbALHjEXvGg2w_gikY,2985
|
|
2591
|
+
PgsFile-0.4.0.dist-info/WHEEL,sha256=eOLhNAGa2EW3wWl_TU484h7q1UNgy0JXjjoqKoxAAQc,92
|
|
2592
|
+
PgsFile-0.4.0.dist-info/top_level.txt,sha256=028hCfwhF3UpfD6X0rwtWpXI1RKSTeZ1ALwagWaSmX8,8
|
|
2593
|
+
PgsFile-0.4.0.dist-info/RECORD,,
|
|
File without changes
|
|
File without changes
|
|
File without changes
|