tasksource 0.0.42__tar.gz → 0.0.45__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {tasksource-0.0.42 → tasksource-0.0.45}/PKG-INFO +16 -13
- {tasksource-0.0.42 → tasksource-0.0.45}/README.md +15 -12
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/.ipynb_checkpoints/tasks-checkpoint.py +230 -85
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/preprocess.py +1 -1
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/tasks.py +213 -85
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource.egg-info/PKG-INFO +16 -13
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource.egg-info/SOURCES.txt +0 -1
- tasksource-0.0.45/tasks.md +660 -0
- tasksource-0.0.42/src/tasksource/.ipynb_checkpoints/recast-checkpoint.py +0 -113
- tasksource-0.0.42/tasks.md +0 -621
- {tasksource-0.0.42 → tasksource-0.0.45}/.github/scripts/release.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/.github/workflows/python-publish.yml +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/.github/workflows/release.yml +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/.gitignore +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/CITATION.cff +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/LICENSE +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/mtasks.md +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/pyproject.toml +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/setup.cfg +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/__init__.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/access.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/metadata/__init__.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/metadata/bigbench_groups.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/metadata/blimp_groups.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/metadata/original.txt +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/metadata/popularity.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/mtasks.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource/recast.py +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource.egg-info/dependency_links.txt +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource.egg-info/requires.txt +0 -0
- {tasksource-0.0.42 → tasksource-0.0.45}/src/tasksource.egg-info/top_level.txt +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: tasksource
|
|
3
|
-
Version: 0.0.
|
|
3
|
+
Version: 0.0.45
|
|
4
4
|
Summary: Preprocessings to prepare datasets for a task
|
|
5
5
|
Home-page: https://github.com/sileod/tasksource/
|
|
6
6
|
Classifier: Programming Language :: Python :: 3
|
|
@@ -36,7 +36,7 @@ for id in df[df.task_type=="MultipleChoice"].id:
|
|
|
36
36
|
dataset = load_task(id) # all yielded datasets can be used interchangeably
|
|
37
37
|
```
|
|
38
38
|
|
|
39
|
-
Browse the 500+ curated tasks in tasks.md (200+ MultipleChoice tasks, 200+ Classification tasks), and feel free to request a new task. Datasets are downloaded to
|
|
39
|
+
Browse the 500+ curated tasks in tasks.md (200+ MultipleChoice tasks, 200+ Classification tasks), and feel free to request a new task. Datasets are downloaded to `$HF_DATASETS_CACHE` (like any Hugging Face dataset), so ensure you have more than 100GB of space available.
|
|
40
40
|
|
|
41
41
|
You can now also use:
|
|
42
42
|
```python
|
|
@@ -47,9 +47,7 @@ load_dataset("tasksource/data", "glue/rte",max_rows=30_000)
|
|
|
47
47
|
|
|
48
48
|
Text encoder pretrained on tasksource reached state-of-the-art results: [🤗/deberta-v3-base-tasksource-nli](https://hf.co/sileod/deberta-v3-base-tasksource-nli)
|
|
49
49
|
|
|
50
|
-
Tasksource pretraining is notably helpful for RLHF reward modeling or any kind of classification, including zero-shot. You can also find a large
|
|
51
|
-
|
|
52
|
-
[u/conceptofmind](https://github.com/conceptofmind) also trained Llama on tasksource: [🤗/conceptofmind/Tasksource-Open-Llama-13b](https://hf.co/conceptofmind/Tasksource-Open-Llama-13b)
|
|
50
|
+
Tasksource pretraining is notably helpful for RLHF reward modeling or any kind of classification, including zero-shot. You can also find a large and a multilingual version.
|
|
53
51
|
|
|
54
52
|
### tasksource-instruct
|
|
55
53
|
|
|
@@ -78,17 +76,22 @@ winogrande = MultipleChoice('sentence',['option1','option2'],'answer',
|
|
|
78
76
|
tasks = [winogrande.load(), codah.load()]) # Aligned datasets (same columns) can be used interchangably
|
|
79
77
|
```
|
|
80
78
|
|
|
81
|
-
###
|
|
82
|
-
For help integrating tasksource into your experiments, please contact [damien.sileo@inria.fr](mailto:damien.sileo@inria.fr).
|
|
79
|
+
### Citation and contact
|
|
83
80
|
|
|
84
81
|
For more details, refer to this [article:](https://arxiv.org/abs/2301.05948)
|
|
85
82
|
```bib
|
|
86
|
-
@
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
83
|
+
@inproceedings{sileo-2024-tasksource,
|
|
84
|
+
title = "tasksource: A Large Collection of {NLP} tasks with a Structured Dataset Preprocessing Framework",
|
|
85
|
+
author = "Sileo, Damien",
|
|
86
|
+
booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
|
|
87
|
+
month = may,
|
|
88
|
+
year = "2024",
|
|
89
|
+
address = "Torino, Italia",
|
|
90
|
+
publisher = "ELRA and ICCL",
|
|
91
|
+
url = "https://aclanthology.org/2024.lrec-main.1361",
|
|
92
|
+
pages = "15655--15684",
|
|
92
93
|
}
|
|
93
94
|
```
|
|
95
|
+
For help integrating tasksource into your experiments, please contact [damien.sileo@inria.fr](mailto:damien.sileo@inria.fr).
|
|
96
|
+
|
|
94
97
|
|
|
@@ -15,7 +15,7 @@ for id in df[df.task_type=="MultipleChoice"].id:
|
|
|
15
15
|
dataset = load_task(id) # all yielded datasets can be used interchangeably
|
|
16
16
|
```
|
|
17
17
|
|
|
18
|
-
Browse the 500+ curated tasks in tasks.md (200+ MultipleChoice tasks, 200+ Classification tasks), and feel free to request a new task. Datasets are downloaded to
|
|
18
|
+
Browse the 500+ curated tasks in tasks.md (200+ MultipleChoice tasks, 200+ Classification tasks), and feel free to request a new task. Datasets are downloaded to `$HF_DATASETS_CACHE` (like any Hugging Face dataset), so ensure you have more than 100GB of space available.
|
|
19
19
|
|
|
20
20
|
You can now also use:
|
|
21
21
|
```python
|
|
@@ -26,9 +26,7 @@ load_dataset("tasksource/data", "glue/rte",max_rows=30_000)
|
|
|
26
26
|
|
|
27
27
|
Text encoder pretrained on tasksource reached state-of-the-art results: [🤗/deberta-v3-base-tasksource-nli](https://hf.co/sileod/deberta-v3-base-tasksource-nli)
|
|
28
28
|
|
|
29
|
-
Tasksource pretraining is notably helpful for RLHF reward modeling or any kind of classification, including zero-shot. You can also find a large
|
|
30
|
-
|
|
31
|
-
[u/conceptofmind](https://github.com/conceptofmind) also trained Llama on tasksource: [🤗/conceptofmind/Tasksource-Open-Llama-13b](https://hf.co/conceptofmind/Tasksource-Open-Llama-13b)
|
|
29
|
+
Tasksource pretraining is notably helpful for RLHF reward modeling or any kind of classification, including zero-shot. You can also find a large and a multilingual version.
|
|
32
30
|
|
|
33
31
|
### tasksource-instruct
|
|
34
32
|
|
|
@@ -57,17 +55,22 @@ winogrande = MultipleChoice('sentence',['option1','option2'],'answer',
|
|
|
57
55
|
tasks = [winogrande.load(), codah.load()]) # Aligned datasets (same columns) can be used interchangably
|
|
58
56
|
```
|
|
59
57
|
|
|
60
|
-
###
|
|
61
|
-
For help integrating tasksource into your experiments, please contact [damien.sileo@inria.fr](mailto:damien.sileo@inria.fr).
|
|
58
|
+
### Citation and contact
|
|
62
59
|
|
|
63
60
|
For more details, refer to this [article:](https://arxiv.org/abs/2301.05948)
|
|
64
61
|
```bib
|
|
65
|
-
@
|
|
66
|
-
|
|
67
|
-
|
|
68
|
-
|
|
69
|
-
|
|
70
|
-
|
|
62
|
+
@inproceedings{sileo-2024-tasksource,
|
|
63
|
+
title = "tasksource: A Large Collection of {NLP} tasks with a Structured Dataset Preprocessing Framework",
|
|
64
|
+
author = "Sileo, Damien",
|
|
65
|
+
booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
|
|
66
|
+
month = may,
|
|
67
|
+
year = "2024",
|
|
68
|
+
address = "Torino, Italia",
|
|
69
|
+
publisher = "ELRA and ICCL",
|
|
70
|
+
url = "https://aclanthology.org/2024.lrec-main.1361",
|
|
71
|
+
pages = "15655--15684",
|
|
71
72
|
}
|
|
72
73
|
```
|
|
74
|
+
For help integrating tasksource into your experiments, please contact [damien.sileo@inria.fr](mailto:damien.sileo@inria.fr).
|
|
75
|
+
|
|
73
76
|
|