tumblrbot 1.9.7__py3-none-any.whl → 1.10.1__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- tumblrbot/__main__.py +47 -43
- tumblrbot/flow/download.py +55 -55
- tumblrbot/flow/examples.py +94 -97
- tumblrbot/flow/fine_tune.py +141 -137
- tumblrbot/flow/generate.py +97 -97
- tumblrbot/utils/common.py +62 -57
- tumblrbot/utils/models.py +225 -225
- tumblrbot/utils/tumblr.py +83 -68
- {tumblrbot-1.9.7.dist-info → tumblrbot-1.10.1.dist-info}/METADATA +27 -40
- tumblrbot-1.10.1.dist-info/RECORD +16 -0
- {tumblrbot-1.9.7.dist-info → tumblrbot-1.10.1.dist-info}/WHEEL +2 -1
- tumblrbot-1.10.1.dist-info/entry_points.txt +2 -0
- tumblrbot-1.10.1.dist-info/top_level.txt +1 -0
- tumblrbot-1.9.7.dist-info/RECORD +0 -15
- tumblrbot-1.9.7.dist-info/entry_points.txt +0 -3
|
@@ -1,9 +1,12 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: tumblrbot
|
|
3
|
-
Version: 1.
|
|
3
|
+
Version: 1.10.1
|
|
4
4
|
Summary: An updated bot that posts to Tumblr, based on your very own blog!
|
|
5
|
-
|
|
5
|
+
Project-URL: Funding, https://ko-fi.com/maidscientistizutsumimarin
|
|
6
|
+
Project-URL: Source, https://github.com/MaidScientistIzutsumiMarin/tumblrbot
|
|
7
|
+
Requires-Python: >=3.14
|
|
6
8
|
Description-Content-Type: text/markdown
|
|
9
|
+
Requires-Dist: CurrencyConverter
|
|
7
10
|
Requires-Dist: openai
|
|
8
11
|
Requires-Dist: pydantic
|
|
9
12
|
Requires-Dist: requests
|
|
@@ -12,15 +15,9 @@ Requires-Dist: rich
|
|
|
12
15
|
Requires-Dist: tenacity
|
|
13
16
|
Requires-Dist: tiktoken
|
|
14
17
|
Requires-Dist: tomlkit
|
|
15
|
-
Requires-Dist: pyinstaller ; extra == "dev"
|
|
16
|
-
Project-URL: Funding, https://ko-fi.com/maidscientistizutsumimarin
|
|
17
|
-
Project-URL: Source, https://github.com/MaidScientistIzutsumiMarin/tumblrbot
|
|
18
|
-
Provides-Extra: dev
|
|
19
18
|
|
|
20
19
|
# tumblrbot
|
|
21
20
|
|
|
22
|
-
[tumblrbot.exe]: https://github.com/MaidScientistIzutsumiMarin/tumblrbot/releases/latest/download/tumblrbot.exe
|
|
23
|
-
|
|
24
21
|
[OAuth]: https://oauth.net/1
|
|
25
22
|
[Python]: https://python.org/download
|
|
26
23
|
|
|
@@ -30,11 +27,11 @@ Provides-Extra: dev
|
|
|
30
27
|
[pip]: https://pypi.org
|
|
31
28
|
[Rich]: https://pypi.org/project/rich
|
|
32
29
|
|
|
33
|
-
[OpenAI]: https://
|
|
30
|
+
[OpenAI]: https://openai.com
|
|
34
31
|
[OpenAI Pricing]: https://platform.openai.com/docs/pricing#fine-tuning
|
|
35
32
|
[OpenAI Tokens]: https://platform.openai.com/settings/organization/api-keys
|
|
36
33
|
[OpenAI Moderation API]: https://platform.openai.com/docs/guides/moderation
|
|
37
|
-
[Flags]: https://platform.openai.com/docs/guides/moderation
|
|
34
|
+
[Flags]: https://platform.openai.com/docs/guides/moderation#content-classifications
|
|
38
35
|
[Fine-Tuning Portal]: https://platform.openai.com/finetune
|
|
39
36
|
|
|
40
37
|
[Tumblr]: https://tumblr.com
|
|
@@ -53,6 +50,19 @@ Provides-Extra: dev
|
|
|
53
50
|
[Fine-Tuning]: #manual-fine-tuning
|
|
54
51
|
[](https://python.org/pypi/tumblrbot)
|
|
55
52
|
|
|
53
|
+
## Installation & Usage
|
|
54
|
+
|
|
55
|
+
1. Install the latest version of [Python]:
|
|
56
|
+
- Windows: `winget install python3`
|
|
57
|
+
- Linux (apt): `apt install python-pip`
|
|
58
|
+
- Linux (pacman): `pacman install python-pip`
|
|
59
|
+
1. Install the [pip] package: `pip install tumblrbot`
|
|
60
|
+
- Alternatively, you can install from this repository: `pip install git+https://github.com/MaidScientistIzutsumiMarin/tumblrbot.git`
|
|
61
|
+
- On Linux, you will have to make a virtual environment or use the flag to install packages system-wide.
|
|
62
|
+
1. Run `tumblrbot` from anywhere. Run `tumblrbot --help` for command-line options. Every command-line option corresponds to a value from the [config][configurable].
|
|
63
|
+
|
|
64
|
+
---
|
|
65
|
+
|
|
56
66
|
Description of original project:
|
|
57
67
|
> 4tv-tumblrbot was a collaborative project I embarked on with my close friend Dima, who goes by @smoqueen on Tumblr. The aim of this endeavor was straightforward yet silly: to develop a Tumblr bot powered by a machine-learning model. This bot would be specifically trained on the content from a particular Tumblr blog or a selected set of blogs, allowing it to mimic the style, tone, and thematic essence of the original posts.
|
|
58
68
|
|
|
@@ -93,39 +103,17 @@ Features:
|
|
|
93
103
|
- You can use regular expressions to filter out training data in the [config][configurable]. This is more of a brute-force solution, but it can work if the other solutions do not.
|
|
94
104
|
- You can try limiting your dataset by specifying fewer blogs to download from or limiting the number of posts taken from each one in the [config][configurable].
|
|
95
105
|
- If all else fails, you can manually remove data from the examples file until it passes. It is unfortunately not a definitive resource, but it can help to read about what the [OpenAI moderation API flags][Flags].
|
|
96
|
-
-
|
|
97
|
-
- *We are unsure if this is still happening.*
|
|
98
|
-
- Post counts are incorrect when downloading posts. Our tests suggest this is a [Tumblr] API problem that is giving inaccurate numbers, so treat them as estimates.
|
|
106
|
+
- Post counts can be incorrect when downloading posts. Our tests suggest this is a [Tumblr] API problem that is giving inaccurate numbers, so treat them as estimates.
|
|
99
107
|
|
|
100
|
-
**
|
|
101
|
-
|
|
102
|
-
## Installation & Usage
|
|
103
|
-
|
|
104
|
-
### Downloadable Binary
|
|
108
|
+
**To-Do:**
|
|
105
109
|
|
|
106
|
-
|
|
107
|
-
|
|
108
|
-
|
|
109
|
-
| No risk of dependencies breaking | Dependencies may be older |
|
|
110
|
+
- Add selection menus to make it easier to pick a particular operation.
|
|
111
|
+
- Add retrying to the fine-tuning process (if necessary).
|
|
112
|
+
- Add an option to filter newest posts by a specific date.
|
|
110
113
|
|
|
111
|
-
|
|
112
|
-
1. Launch `tumblrbot.exe` in the install location.
|
|
113
|
-
|
|
114
|
-
### PyPi
|
|
115
|
-
|
|
116
|
-
| Pros | Cons |
|
|
117
|
-
| --- | --- |
|
|
118
|
-
| Easier to update | Harder to install |
|
|
119
|
-
| Dependencies may be newer | Dependencies may break |
|
|
114
|
+
**Please submit an issue or contact us for features you want added/reimplemented.**
|
|
120
115
|
|
|
121
|
-
|
|
122
|
-
- Windows: `winget install python3`
|
|
123
|
-
- Linux (apt): `apt install python-pip`
|
|
124
|
-
- Linux (pacman): `pacman install python-pip`
|
|
125
|
-
1. Install the [pip] package: `pip install tumblrbot`
|
|
126
|
-
- Alternatively, you can install from this repository: `pip install git+https://github.com/MaidScientistIzutsumiMarin/tumblrbot.git`
|
|
127
|
-
- On Linux, you will have to make a virtual environment or use the flag to install packages system-wide.
|
|
128
|
-
1. Run `tumblrbot` from anywhere. Run `tumblrbot --help` for command-line options. Every command-line option corresponds to a value from the [config][configurable].
|
|
116
|
+
---
|
|
129
117
|
|
|
130
118
|
## Obtaining Tokens
|
|
131
119
|
|
|
@@ -207,4 +195,3 @@ You can manually upload the examples file to [OpenAI] and start the fine-tuning
|
|
|
207
195
|
1. Press `Create`.
|
|
208
196
|
1. (Optional) Copy the value next to `Job ID` and paste it into the [config][configurable] under `job_id`. You can then run the program and monitor its progress as usual.
|
|
209
197
|
1. If you do not do the above, you will have to copy the value next to `Output model` once the job is complete and paste it into the [config][configurable] under `fine_tuned_model`.
|
|
210
|
-
|
|
@@ -0,0 +1,16 @@
|
|
|
1
|
+
tumblrbot/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
2
|
+
tumblrbot/__main__.py,sha256=19p7kIMBfEXFRGOJdMGhriPkoLQ9Pi5fOzqYowr_s-M,1819
|
|
3
|
+
tumblrbot/flow/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
4
|
+
tumblrbot/flow/download.py,sha256=SYO235ztgXXnh4BNoy_o3MwEd4k73LIIAI0eTxtQBfI,1997
|
|
5
|
+
tumblrbot/flow/examples.py,sha256=-jqLGGuQOT85g2xt7xb_XbudCZKB-Nuf5nygTpIuH5Y,4308
|
|
6
|
+
tumblrbot/flow/fine_tune.py,sha256=ZdXRvGZ7prgkwrnjpxzEOGQpxx35k9FbpPPpXED_26M,5673
|
|
7
|
+
tumblrbot/flow/generate.py,sha256=b-MO5jxISPbJUcXZ1H1YPt_-O5a9RI9LWB24SLcydGo,4256
|
|
8
|
+
tumblrbot/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
9
|
+
tumblrbot/utils/common.py,sha256=o1T-hmMZw7fbzJVMHtCLJ--HxLZ-sRuXSNWjCIwKlbA,1859
|
|
10
|
+
tumblrbot/utils/models.py,sha256=qy5ejzQjI0e7aGgvkqTfRPDHF-Ckf0VykPdlwHW5UPE,10835
|
|
11
|
+
tumblrbot/utils/tumblr.py,sha256=pOtcgq58mC_5oBa9LH_SDJlRTg3_euzQjp1KArDO0O8,2982
|
|
12
|
+
tumblrbot-1.10.1.dist-info/METADATA,sha256=ZeFDRmke5YpinsQpq40M6_yzawWwW1kznkWfNxi31aw,13528
|
|
13
|
+
tumblrbot-1.10.1.dist-info/WHEEL,sha256=wUyA8OaulRlbfwMtmQsvNngGrxQHAvkKcvRmdizlJi0,92
|
|
14
|
+
tumblrbot-1.10.1.dist-info/entry_points.txt,sha256=1UrMpccLrT88RIDNCSm9uocdRcVgEpHQWYIVnVpJWnI,54
|
|
15
|
+
tumblrbot-1.10.1.dist-info/top_level.txt,sha256=nZBBqnmypfVVkZojtb6afxQqBg8mFD8adlT5ur40r4s,10
|
|
16
|
+
tumblrbot-1.10.1.dist-info/RECORD,,
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
tumblrbot
|
tumblrbot-1.9.7.dist-info/RECORD
DELETED
|
@@ -1,15 +0,0 @@
|
|
|
1
|
-
tumblrbot/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
2
|
-
tumblrbot/__main__.py,sha256=DYHfOs5oyOIT4c0cdEd4o0p7UPo39EnTMJHyOrsVWBg,1753
|
|
3
|
-
tumblrbot/flow/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
4
|
-
tumblrbot/flow/download.py,sha256=r_4Bc_SNnIDbilT18YypBjJ4xhrg0AJAfvOezUL-p2c,2052
|
|
5
|
-
tumblrbot/flow/examples.py,sha256=30FVJQomjwpUBKeeAJDfdkr8ZcQlykoXZ6uL3tqxgOg,4465
|
|
6
|
-
tumblrbot/flow/fine_tune.py,sha256=KaC37_RNsbfAh1_ZdsiAELvRbYkJrrH8QPJPGuZtzOM,5483
|
|
7
|
-
tumblrbot/flow/generate.py,sha256=WQEG_85_nuRp91Le6lvZ0FeIWnBA1a012MlI3_YMq-8,4302
|
|
8
|
-
tumblrbot/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
|
9
|
-
tumblrbot/utils/common.py,sha256=4n3kcdgTP_HHjCg5Z7GjNyBZzBLUGrTu4fwxaOFYGt4,1676
|
|
10
|
-
tumblrbot/utils/models.py,sha256=s5Hm1AEEtnz4mi_apUlu2x4NuXeZtMAOH8DHSYgbv1E,11050
|
|
11
|
-
tumblrbot/utils/tumblr.py,sha256=HfaoRr0YikP0uJdnwCxdhyK5wUBOuvaC9unNWa1Erk8,2526
|
|
12
|
-
tumblrbot-1.9.7.dist-info/entry_points.txt,sha256=lTiN7PxAbyGY1fpCWApEw6NUIUgobfcOKhvn6cu3IQA,53
|
|
13
|
-
tumblrbot-1.9.7.dist-info/WHEEL,sha256=G2gURzTEtmeR8nrdXUJfNiB3VYVxigPQ-bEQujpNiNs,82
|
|
14
|
-
tumblrbot-1.9.7.dist-info/METADATA,sha256=s21DxgfmBLtlK03NSZktVB0UZWc6MUCZ8YHpFGM-MkU,14195
|
|
15
|
-
tumblrbot-1.9.7.dist-info/RECORD,,
|