pearmut 0.2.1__tar.gz → 0.2.2__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (25) hide show
  1. {pearmut-0.2.1 → pearmut-0.2.2}/PKG-INFO +8 -5
  2. {pearmut-0.2.1 → pearmut-0.2.2}/README.md +7 -4
  3. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/PKG-INFO +8 -5
  4. {pearmut-0.2.1 → pearmut-0.2.2}/pyproject.toml +2 -9
  5. {pearmut-0.2.1 → pearmut-0.2.2}/server/cli.py +2 -2
  6. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/dashboard.html +1 -1
  7. pearmut-0.2.2/server/static/index.html +1 -0
  8. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/listwise.html +1 -1
  9. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/pointwise.html +1 -1
  10. pearmut-0.2.1/server/static/index.html +0 -1
  11. {pearmut-0.2.1 → pearmut-0.2.2}/LICENSE +0 -0
  12. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/SOURCES.txt +0 -0
  13. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/dependency_links.txt +0 -0
  14. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/entry_points.txt +0 -0
  15. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/requires.txt +0 -0
  16. {pearmut-0.2.1 → pearmut-0.2.2}/pearmut.egg-info/top_level.txt +0 -0
  17. {pearmut-0.2.1 → pearmut-0.2.2}/server/app.py +0 -0
  18. {pearmut-0.2.1 → pearmut-0.2.2}/server/assignment.py +0 -0
  19. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/assets/favicon.svg +0 -0
  20. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/assets/style.css +0 -0
  21. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/dashboard.bundle.js +0 -0
  22. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/listwise.bundle.js +0 -0
  23. {pearmut-0.2.1 → pearmut-0.2.2}/server/static/pointwise.bundle.js +0 -0
  24. {pearmut-0.2.1 → pearmut-0.2.2}/server/utils.py +0 -0
  25. {pearmut-0.2.1 → pearmut-0.2.2}/setup.cfg +0 -0
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: pearmut
3
- Version: 0.2.1
3
+ Version: 0.2.2
4
4
  Summary: A tool for evaluation of model outputs, primarily MT.
5
5
  Author-email: Vilém Zouhar <vilem.zouhar@gmail.com>
6
6
  License: apache-2.0
@@ -33,7 +33,7 @@ Supports multimodality (text, video, audio, images) and a variety of annotation
33
33
  &nbsp;
34
34
  [![build status](https://github.com/zouharvi/pearmut/actions/workflows/test.yml/badge.svg)](https://github.com/zouharvi/pearmut/actions/workflows/test.yml)
35
35
 
36
- <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/f14c91a5-44d7-4248-ada9-387e95ca59d0" />
36
+ <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/4fb9a1cb-78ac-47e0-99cd-0870a368a0ad" />
37
37
 
38
38
  ## Quick start
39
39
 
@@ -234,12 +234,14 @@ and independently of that select your protocol template:
234
234
  When adding new campaigns or launching pearmut, a management link is shown that gives an overview of annotator progress but also an easy access to the annotation links or resetting the task progress (no data will be lost).
235
235
  This is also the place where you can download all progress and collected annotations (these files exist also locally but this might be more convenient).
236
236
 
237
- <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/057899d7-2291-46c7-876f-407c4050a9cb" />
237
+ <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/82470693-a5ec-4d0e-8989-e93d5b0bb840" />
238
+
238
239
 
239
240
  Additionally, at the end of an annotation, a token of completion is shown which can be compared to the correct one that you can download in metadat from the dashboard.
240
241
  An intentionally incorrect token can be shown if the annotations don't pass quality control.
241
242
 
242
- <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/4b4d2aa9-7bab-44d6-894b-6c789cd3bc6e" />
243
+ <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/40eb904c-f47a-4011-aa63-9a4f1c501549" />
244
+
243
245
 
244
246
  ## Multimodal Annotations
245
247
 
@@ -248,7 +250,8 @@ This includes embedded YouTube videos, or even simple `<video ` tags that point
248
250
  For an example, try [examples/multimodal.json](examples/multimodal.json).
249
251
  Tip: make sure the elements are already appropriately styled.
250
252
 
251
- <img width="800" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/f34a1a3e-ad95-4114-95ee-8a49e8003faf" />
253
+ <img width="1000" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/77c4fa96-ee62-4e46-8e78-fd16e9007956" />
254
+
252
255
 
253
256
  ## Development
254
257
 
@@ -12,7 +12,7 @@ Supports multimodality (text, video, audio, images) and a variety of annotation
12
12
  &nbsp;
13
13
  [![build status](https://github.com/zouharvi/pearmut/actions/workflows/test.yml/badge.svg)](https://github.com/zouharvi/pearmut/actions/workflows/test.yml)
14
14
 
15
- <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/f14c91a5-44d7-4248-ada9-387e95ca59d0" />
15
+ <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/4fb9a1cb-78ac-47e0-99cd-0870a368a0ad" />
16
16
 
17
17
  ## Quick start
18
18
 
@@ -213,12 +213,14 @@ and independently of that select your protocol template:
213
213
  When adding new campaigns or launching pearmut, a management link is shown that gives an overview of annotator progress but also an easy access to the annotation links or resetting the task progress (no data will be lost).
214
214
  This is also the place where you can download all progress and collected annotations (these files exist also locally but this might be more convenient).
215
215
 
216
- <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/057899d7-2291-46c7-876f-407c4050a9cb" />
216
+ <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/82470693-a5ec-4d0e-8989-e93d5b0bb840" />
217
+
217
218
 
218
219
  Additionally, at the end of an annotation, a token of completion is shown which can be compared to the correct one that you can download in metadat from the dashboard.
219
220
  An intentionally incorrect token can be shown if the annotations don't pass quality control.
220
221
 
221
- <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/4b4d2aa9-7bab-44d6-894b-6c789cd3bc6e" />
222
+ <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/40eb904c-f47a-4011-aa63-9a4f1c501549" />
223
+
222
224
 
223
225
  ## Multimodal Annotations
224
226
 
@@ -227,7 +229,8 @@ This includes embedded YouTube videos, or even simple `<video ` tags that point
227
229
  For an example, try [examples/multimodal.json](examples/multimodal.json).
228
230
  Tip: make sure the elements are already appropriately styled.
229
231
 
230
- <img width="800" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/f34a1a3e-ad95-4114-95ee-8a49e8003faf" />
232
+ <img width="1000" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/77c4fa96-ee62-4e46-8e78-fd16e9007956" />
233
+
231
234
 
232
235
  ## Development
233
236
 
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: pearmut
3
- Version: 0.2.1
3
+ Version: 0.2.2
4
4
  Summary: A tool for evaluation of model outputs, primarily MT.
5
5
  Author-email: Vilém Zouhar <vilem.zouhar@gmail.com>
6
6
  License: apache-2.0
@@ -33,7 +33,7 @@ Supports multimodality (text, video, audio, images) and a variety of annotation
33
33
  &nbsp;
34
34
  [![build status](https://github.com/zouharvi/pearmut/actions/workflows/test.yml/badge.svg)](https://github.com/zouharvi/pearmut/actions/workflows/test.yml)
35
35
 
36
- <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/f14c91a5-44d7-4248-ada9-387e95ca59d0" />
36
+ <img width="1000" alt="Screenshot of ESA/MQM interface" src="https://github.com/user-attachments/assets/4fb9a1cb-78ac-47e0-99cd-0870a368a0ad" />
37
37
 
38
38
  ## Quick start
39
39
 
@@ -234,12 +234,14 @@ and independently of that select your protocol template:
234
234
  When adding new campaigns or launching pearmut, a management link is shown that gives an overview of annotator progress but also an easy access to the annotation links or resetting the task progress (no data will be lost).
235
235
  This is also the place where you can download all progress and collected annotations (these files exist also locally but this might be more convenient).
236
236
 
237
- <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/057899d7-2291-46c7-876f-407c4050a9cb" />
237
+ <img width="800" alt="Management dashboard" src="https://github.com/user-attachments/assets/82470693-a5ec-4d0e-8989-e93d5b0bb840" />
238
+
238
239
 
239
240
  Additionally, at the end of an annotation, a token of completion is shown which can be compared to the correct one that you can download in metadat from the dashboard.
240
241
  An intentionally incorrect token can be shown if the annotations don't pass quality control.
241
242
 
242
- <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/4b4d2aa9-7bab-44d6-894b-6c789cd3bc6e" />
243
+ <img width="500" alt="Token on completion" src="https://github.com/user-attachments/assets/40eb904c-f47a-4011-aa63-9a4f1c501549" />
244
+
243
245
 
244
246
  ## Multimodal Annotations
245
247
 
@@ -248,7 +250,8 @@ This includes embedded YouTube videos, or even simple `<video ` tags that point
248
250
  For an example, try [examples/multimodal.json](examples/multimodal.json).
249
251
  Tip: make sure the elements are already appropriately styled.
250
252
 
251
- <img width="800" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/f34a1a3e-ad95-4114-95ee-8a49e8003faf" />
253
+ <img width="1000" alt="Preview of multimodal elements in Pearmut" src="https://github.com/user-attachments/assets/77c4fa96-ee62-4e46-8e78-fd16e9007956" />
254
+
252
255
 
253
256
  ## Development
254
257
 
@@ -1,6 +1,6 @@
1
1
  [project]
2
2
  name = "pearmut"
3
- version = "0.2.1"
3
+ version = "0.2.2"
4
4
  description = "A tool for evaluation of model outputs, primarily MT."
5
5
  readme = "README.md"
6
6
  license = { text = "apache-2.0" }
@@ -38,11 +38,4 @@ requires = ["setuptools>=61.0", "wheel"]
38
38
  build-backend = "setuptools.build_meta"
39
39
 
40
40
  [tool.setuptools.package-data]
41
- "pearmut" = ["static/**"]
42
-
43
- # managed by .github/workflows/publish.yml now but still can be built and pushed lcoally
44
- # rm -rf server/static/; npm install web/ --prefix web/; npm run build --prefix web/
45
- # rm -rf {build,dist,pearmut.egg-info}/*; python3 -m build
46
- # python3 -m twine upload dist/* -u __token__
47
-
48
- # pip install -e . --config-settings editable_mode=strict
41
+ "pearmut" = ["static/**"]
@@ -162,7 +162,7 @@ def _add_campaign(args_unknown):
162
162
  "time_end": None,
163
163
  "time": 0,
164
164
  "url": (
165
- f"{args.server}/{campaign_data["info"]["template"]}.html"
165
+ f"{campaign_data["info"]["template"]}.html"
166
166
  f"?campaign_id={urllib.parse.quote_plus(campaign_data['campaign_id'])}"
167
167
  f"&user_id={user_id}"
168
168
  ),
@@ -188,7 +188,7 @@ def _add_campaign(args_unknown):
188
188
  print("-"*10)
189
189
  for user_id, user_val in user_progress.items():
190
190
  # point to the protocol URL
191
- print(user_val["url"])
191
+ print(f"{args.server}/{user_val["url"]}")
192
192
 
193
193
 
194
194
  def main():
@@ -1,4 +1,4 @@
1
- <html><head><meta charset="UTF-8"><meta name="viewport" content="width=device-width,initial-scale=1"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.white-box {
1
+ <html><head><meta charset="UTF-8"><meta name="viewport" content="width=900px"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.white-box {
2
2
  margin-bottom: 20px;
3
3
  }
4
4
 
@@ -0,0 +1 @@
1
+ <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=900px"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"></head><body><div class="white-box" style="width: max-content; font-size: large; position: absolute; top: 50%; left: 50%; transform: translate(-50%, -50%);">You have reached the Pearmut🍐 evaluation interface.<ul><li>If you are an annotator, you should have received a specialized link that takes you to the annotations.</li><li>If you are annotation manager, then you should distribute these links.</li></ul><br><br>See the <a href="https://github.com/zouharvi/pearmut">Pearmut project on GitHub</a>. Made with 💚 by Vilém Zouhar and others in 2025-2026.</div></body></html>
@@ -1,4 +1,4 @@
1
- <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=device-width,initial-scale=1"><title>Pearmut Listwise Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.output_srctgt {
1
+ <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=900px"><title>Pearmut Listwise Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.output_srctgt {
2
2
  display: flex;
3
3
  width: calc(100% - 10px);
4
4
  padding-right: 10px;
@@ -1,4 +1,4 @@
1
- <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=device-width,initial-scale=1"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.output_srctgt {
1
+ <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=900px"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"><style>.output_srctgt {
2
2
  display: inline-block;
3
3
  width: calc(100% - 140px);
4
4
  vertical-align: top;
@@ -1 +0,0 @@
1
- <!doctype html><html lang="en" style="height: 100%;"><head><meta charset="UTF-8"><meta name="viewport" content="width=device-width,initial-scale=1"><title>Pearmut Evaluation</title><link rel="icon" type="image/svg+xml" href="assets/favicon.svg"><link rel="stylesheet" href="assets/style.css"></head><body><div class="white-box" style="width: max-content; font-size: large; position: absolute; top: 50%; left: 50%; transform: translate(-50%, -50%);">You have reached the Pearmut🍐 evaluation interface.<ul><li>If you are an annotator, you should have received a specialized link that takes you to the annotations.</li><li>If you are annotation manager, then you should distribute these links.</li></ul><br><br>See the <a href="https://github.com/zouharvi/pearmut">Pearmut project on GitHub</a>. Made with 💚 by Vilém Zouhar and others in 2025-2026.</div></body></html>
File without changes
File without changes
File without changes
File without changes
File without changes