EuroEval 15.12.0__py3-none-any.whl → 16.7.1__py3-none-any.whl

euroeval-15.12.0.dist-info/METADATA

@@ -1,285 +0,0 @@
-Metadata-Version: 2.4
-Name: EuroEval
-Version: 15.12.0
-Summary: The robust European language model benchmark.
-Project-URL: Repository, https://github.com/EuroEval/EuroEval
-Project-URL: Issues, https://github.com/EuroEval/EuroEval/issues
-Author-email: Dan Saattrup Smart <dan.smart@alexandra.dk>
-Maintainer-email: Dan Saattrup Smart <dan.smart@alexandra.dk>
-License: MIT License
-        
-        Copyright (c) 2022-2025 Dan Saattrup Smart
-        
-        Permission is hereby granted, free of charge, to any person obtaining a copy
-        of this software and associated documentation files (the "Software"), to deal
-        in the Software without restriction, including without limitation the rights
-        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
-        copies of the Software, and to permit persons to whom the Software is
-        furnished to do so, subject to the following conditions:
-        
-        The above copyright notice and this permission notice shall be included in all
-        copies or substantial portions of the Software.
-        
-        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
-        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
-        SOFTWARE.
-License-File: LICENSE
-Requires-Python: <4.0,>=3.10
-Requires-Dist: accelerate>=0.34.2
-Requires-Dist: bert-score>=0.3.13
-Requires-Dist: click>=8.1.3
-Requires-Dist: datasets>=3.5.0
-Requires-Dist: demjson3>=3.0.6
-Requires-Dist: evaluate>=0.4.1
-Requires-Dist: huggingface-hub>=0.30.1
-Requires-Dist: levenshtein>=0.24.0
-Requires-Dist: litellm>=1.72.2
-Requires-Dist: more-itertools>=10.5.0
-Requires-Dist: numpy<2.0.0,>=1.23.0
-Requires-Dist: ollama>=0.5.1
-Requires-Dist: pandas>=2.2.0
-Requires-Dist: peft>=0.15.0
-Requires-Dist: protobuf>=2.0.0
-Requires-Dist: pydantic>=2.6.0
-Requires-Dist: pyinfer>=0.0.3
-Requires-Dist: python-dotenv>=1.0.1
-Requires-Dist: rouge-score>=0.1.2
-Requires-Dist: sacremoses>=0.1.1
-Requires-Dist: scikit-learn<1.6.0
-Requires-Dist: sentencepiece>=0.1.96
-Requires-Dist: seqeval>=1.2.2
-Requires-Dist: setuptools>=75.8.2
-Requires-Dist: tenacity>=9.0.0
-Requires-Dist: termcolor>=2.0.0
-Requires-Dist: torch>=2.6.0
-Requires-Dist: transformers>=4.51.0
-Provides-Extra: all
-Requires-Dist: bitsandbytes>=0.43.1; (platform_system == 'Linux') and extra == 'all'
-Requires-Dist: fbgemm-gpu>=1.0.0; (platform_system == 'Linux') and extra == 'all'
-Requires-Dist: gradio>=4.26.0; extra == 'all'
-Requires-Dist: outlines>=0.1.11; extra == 'all'
-Requires-Dist: vllm>=0.9.1; (platform_system == 'Linux') and extra == 'all'
-Provides-Extra: generative
-Requires-Dist: bitsandbytes>=0.43.1; (platform_system == 'Linux') and extra == 'generative'
-Requires-Dist: fbgemm-gpu>=1.0.0; (platform_system == 'Linux') and extra == 'generative'
-Requires-Dist: outlines>=0.1.11; extra == 'generative'
-Requires-Dist: vllm>=0.9.1; (platform_system == 'Linux') and extra == 'generative'
-Provides-Extra: human-evaluation
-Requires-Dist: gradio>=4.26.0; extra == 'human-evaluation'
-Provides-Extra: test
-Requires-Dist: gradio>=4.26.0; extra == 'test'
-Description-Content-Type: text/markdown
-
-<div align='center'>
-<img src="https://raw.githubusercontent.com/EuroEval/EuroEval/main/gfx/euroeval.png" height="500" width="372">
-</div>
-
-### The robust European language model benchmark.
-
-_(formerly known as ScandEval)_
-
-______________________________________________________________________
-[![Documentation](https://img.shields.io/badge/docs-passing-green)](https://euroeval.com)
-[![PyPI Status](https://badge.fury.io/py/euroeval.svg)](https://pypi.org/project/euroeval/)
-[![First paper](https://img.shields.io/badge/arXiv-2304.00906-b31b1b.svg)](https://arxiv.org/abs/2304.00906)
-[![Second paper](https://img.shields.io/badge/arXiv-2406.13469-b31b1b.svg)](https://arxiv.org/abs/2406.13469)
-[![License](https://img.shields.io/github/license/EuroEval/EuroEval)](https://github.com/EuroEval/EuroEval/blob/main/LICENSE)
-[![LastCommit](https://img.shields.io/github/last-commit/EuroEval/EuroEval)](https://github.com/EuroEval/EuroEval/commits/main)
-[![Code Coverage](https://img.shields.io/badge/Coverage-67%25-yellow.svg)](https://github.com/EuroEval/EuroEval/tree/main/tests)
-[![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.0-4baaaa.svg)](https://github.com/EuroEval/EuroEval/blob/main/CODE_OF_CONDUCT.md)
-
-
-## Maintainer
-
-- Dan Saattrup Smart ([@saattrupdan](https://github.com/saattrupdan), dan.smart@alexandra.dk)
-
-
-## Installation
-To install the package simply write the following command in your favorite terminal:
-```
-$ pip install euroeval[all]
-```
-
-This will install the EuroEval package with all extras. You can also install the
-minimal version by leaving out the `[all]`, in which case the package will let you know
-when an evaluation requires a certain extra dependency, and how you install it.
-
-## Quickstart
-### Benchmarking from the Command Line
-The easiest way to benchmark pretrained models is via the command line interface. After
-having installed the package, you can benchmark your favorite model like so:
-```
-$ euroeval --model <model-id>
-```
-
-Here `model` is the HuggingFace model ID, which can be found on the [HuggingFace
-Hub](https://huggingface.co/models). By default this will benchmark the model on all
-the tasks available. If you want to benchmark on a particular task, then use the
-`--task` argument:
-```
-$ euroeval --model <model-id> --task sentiment-classification
-```
-
-We can also narrow down which languages we would like to benchmark on. This can be done
-by setting the `--language` argument. Here we thus benchmark the model on the Danish
-sentiment classification task:
-```
-$ euroeval --model <model-id> --task sentiment-classification --language da
-```
-
-Multiple models, datasets and/or languages can be specified by just attaching multiple
-arguments. Here is an example with two models:
-```
-$ euroeval --model <model-id1> --model <model-id2>
-```
-
-The specific model version/revision to use can also be added after the suffix '@':
-```
-$ euroeval --model <model-id>@<commit>
-```
-
-This can be a branch name, a tag name, or a commit id. It defaults to 'main' for latest.
-
-See all the arguments and options available for the `euroeval` command by typing
-```
-$ euroeval --help
-```
-
-### Benchmarking from a Script
-In a script, the syntax is similar to the command line interface. You simply initialise
-an object of the `Benchmarker` class, and call this benchmark object with your favorite
-model:
-```
->>> from euroeval import Benchmarker
->>> benchmark = Benchmarker()
->>> benchmark(model="<model>")
-```
-
-To benchmark on a specific task and/or language, you simply specify the `task` or
-`language` arguments, shown here with same example as above:
-```
->>> benchmark(model="<model>", task="sentiment-classification", language="da")
-```
-
-If you want to benchmark a subset of all the models on the Hugging Face Hub, you can
-simply leave out the `model` argument. In this example, we're benchmarking all Danish
-models on the Danish sentiment classification task:
-```
->>> benchmark(task="sentiment-classification", language="da")
-```
-
-### Benchmarking from Docker
-A Dockerfile is provided in the repo, which can be downloaded and run, without needing
-to clone the repo and installing from source. This can be fetched programmatically by
-running the following:
-```
-$ wget https://raw.githubusercontent.com/EuroEval/EuroEval/main/Dockerfile.cuda
-```
-
-Next, to be able to build the Docker image, first ensure that the NVIDIA Container
-Toolkit is
-[installed](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#installation)
-and
-[configured](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#configuring-docker).
-Ensure that the the CUDA version stated at the top of the Dockerfile matches the CUDA
-version installed (which you can check using `nvidia-smi`). After that, we build the
-image as follows:
-```
-$ docker build --pull -t euroeval -f Dockerfile.cuda .
-```
-
-With the Docker image built, we can now evaluate any model as follows:
-```
-$ docker run -e args="<euroeval-arguments>" --gpus 1 --name euroeval --rm euroeval
-```
-
-Here `<euroeval-arguments>` consists of the arguments added to the `euroeval` CLI
-argument. This could for instance be `--model <model-id> --task
-sentiment-classification`.
-
-
-### Reproducing the datasets
-All datasets used in this project are generated using the scripts located in the
-[src/scripts](src/scripts) folder. To reproduce a dataset, run the corresponding script
-with the following command
-
-```shell
-$ uv run src/scripts/<name-of-script>.py
-```
-
-Replace <name-of-script> with the specific script you wish to execute, e.g.,
-
-```shell
-$ uv run src/scripts/create_allocine.py
-```
-
-## Contributors :pray:
-
-A huge thank you to all the contributors who have helped make this project a success!
-
-<a href="https://github.com/peter-sk"><img src="https://avatars.githubusercontent.com/u/6168908" width=50 alt="Contributor avatar for peter-sk"/></a>
-<a href="https://github.com/AJDERS"><img src="https://avatars.githubusercontent.com/u/38854604" width=50 alt="Contributor avatar for AJDERS"/></a>
-<a href="https://github.com/oliverkinch"><img src="https://avatars.githubusercontent.com/u/71556498" width=50 alt="Contributor avatar for oliverkinch"/></a>
-<a href="https://github.com/versae"><img src="https://avatars.githubusercontent.com/u/173537" width=50 alt="Contributor avatar for versae"/></a>
-<a href="https://github.com/viggo-gascou"><img src="https://avatars.githubusercontent.com/u/94069687" width=50 alt="Contributor avatar for viggo-gascou"/></a>
-<a href="https://github.com/mathiasesn"><img src="https://avatars.githubusercontent.com/u/27091759" width=50 alt="Contributor avatar for mathiasesn"/></a>
-<a href="https://github.com/Alkarex"><img src="https://avatars.githubusercontent.com/u/1008324" width=50 alt="Contributor avatar for Alkarex"/></a>
-<a href="https://github.com/marksverdhei"><img src="https://avatars.githubusercontent.com/u/46672778" width=50 alt="Contributor avatar for marksverdhei"/></a>
-<a href="https://github.com/Mikeriess"><img src="https://avatars.githubusercontent.com/u/19728563" width=50 alt="Contributor avatar for Mikeriess"/></a>
-<a href="https://github.com/pakagronglb"><img src="https://avatars.githubusercontent.com/u/178713124" width=50 alt="Contributor avatar for pakagronglb"/></a>
-<a href="https://github.com/ThomasKluiters"><img src="https://avatars.githubusercontent.com/u/8137941" width=50 alt="Contributor avatar for ThomasKluiters"/></a>
-<a href="https://github.com/BramVanroy"><img src="https://avatars.githubusercontent.com/u/2779410" width=50 alt="Contributor avatar for BramVanroy"/></a>
-<a href="https://github.com/peregilk"><img src="https://avatars.githubusercontent.com/u/9079808" width=50 alt="Contributor avatar for peregilk"/></a>
-<a href="https://github.com/Rijgersberg"><img src="https://avatars.githubusercontent.com/u/8604946" width=50 alt="Contributor avatar for Rijgersberg"/></a>
-
-
-### Contribute to EuroEval
-
-We welcome contributions to EuroEval! Whether you're fixing bugs, adding features, or
-contributing new datasets, your help makes this project better for everyone.
-
-- **General contributions**: Check out our [contribution guidelines](CONTRIBUTING.md)
-  for information on how to get started.
-- **Adding datasets**: If you're interested in adding a new dataset to EuroEval, we have
-  a [dedicated guide](NEW_DATASET_GUIDE.md) with step-by-step instructions.
-
-
-### Special Thanks
-- Thanks to [Google](https://google.com/) for sponsoring Gemini credits as part of their
-  [Google Cloud for Researchers Program](https://cloud.google.com/edu/researchers).
-- Thanks [@Mikeriess](https://github.com/Mikeriess) for evaluating many of the larger
-  models on the leaderboards.
-- Thanks to [OpenAI](https://openai.com/) for sponsoring OpenAI credits as part of their
-  [Researcher Access Program](https://openai.com/form/researcher-access-program/).
-- Thanks to [UWV](https://www.uwv.nl/) and [KU
-  Leuven](https://www.arts.kuleuven.be/ling/ccl) for sponsoring the Azure OpenAI
-  credits used to evaluate GPT-4-turbo in Dutch.
-- Thanks to [Miðeind](https://mideind.is/english.html) for sponsoring the OpenAI
-  credits used to evaluate GPT-4-turbo in Icelandic and Faroese.
-- Thanks to [CHC](https://chc.au.dk/) for sponsoring the OpenAI credits used to
-  evaluate GPT-4-turbo in German.
-
-
-## Citing EuroEval
-If you want to cite the framework then feel free to use this:
-
-```
-@article{smart2024encoder,
-  title={Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks},
-  author={Smart, Dan Saattrup and Enevoldsen, Kenneth and Schneider-Kamp, Peter},
-  journal={arXiv preprint arXiv:2406.13469},
-  year={2024}
-}
-@inproceedings{smart2023scandeval,
-  author = {Smart, Dan Saattrup},
-  booktitle = {Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)},
-  month = may,
-  pages = {185--201},
-  title = {{ScandEval: A Benchmark for Scandinavian Natural Language Processing}},
-  year = {2023}
-}
-```

euroeval-15.12.0.dist-info/RECORD

@@ -1,63 +0,0 @@
-euroeval/__init__.py,sha256=fZyR9R3C3vwGJS3CrCJ6ySr_FDnMu_Aqnz0FdadWEEs,3399
-euroeval/benchmark_config_factory.py,sha256=jKC8bEzJSGGCcG8aWsPxiyHX6fjOQYQWvkp1MIUuHYM,11564
-euroeval/benchmarker.py,sha256=SDBzdCa4I8u1XDeN_1mKTFzfaaQbbY_oWcHt3niADxk,48497
-euroeval/callbacks.py,sha256=5BTlDvBJ60xRvj01EpXZSZu3MFdKa3LgVuhxoLb3i3E,2565
-euroeval/cli.py,sha256=h81Lswm_q9htkYz-GQQQVIsdsUPnfe3LDH8AZdBcpKs,8602
-euroeval/constants.py,sha256=0KHrH74zGM8vNF4uZG_a5qFJRZH5YgyQULYZtCKlo68,2452
-euroeval/data_loading.py,sha256=DP-cqwN_d0Y-KaN8P8c3fDr6PX80UYROHgRwX82ix4w,4156
-euroeval/data_models.py,sha256=gPHyIoN2A5_O-cJgyb6jhn6enH8zsiIBI09W_wdHMQs,22031
-euroeval/enums.py,sha256=L9LcNeruuhHvze9vKRogXY9vonRzoBqDzWSP6hxKQ7A,3195
-euroeval/exceptions.py,sha256=5kQ-YvHyFO3aaA-zfOTaS07LRFH8xlSqlOiATvnIObY,5116
-euroeval/finetuning.py,sha256=BrPZ-6qFY8K-dwfaRwNetVYfYburoQwLQty6pn6iP_s,11340
-euroeval/generation.py,sha256=1fqFEWwM2RzI3uPZem95VFWbN8EfrKZQTrHEP34ihHs,11622
-euroeval/generation_utils.py,sha256=zRsaOHcbhysbMa983BZXxfd-qMe4NYts-ZbQxfvNTK4,13310
-euroeval/human_evaluation.py,sha256=Jtz3K5Lqne48wPZWf4EAd3d-n_wX27nGJHigjhV1D7s,27537
-euroeval/languages.py,sha256=cr_Z5jtaHb2XY0zeOhuk3ATHX74PODzt6gMPC2zMD7c,8594
-euroeval/metrics.py,sha256=nxosyoRjlk7TcoAOkjU7zx2TB43b9tA8M1m4V1s5eKU,15516
-euroeval/model_cache.py,sha256=HgXTgn4RMBqIjKaTmYzxu0f4NIwbXx1XJFbvbITqy4E,8686
-euroeval/model_config.py,sha256=64KKHPTrpsFhFAANtBnAKkOs7PWZ50GXkXeDl4jICgs,2748
-euroeval/model_loading.py,sha256=B6dyjYO0Dg7NOcUXls8Sjwe6W0c2UqJ1OGw-RkzoSSQ,2239
-euroeval/scores.py,sha256=TatSbjia7Zwj71gQFyV_gCHyppMbOgeaZgNCib8G86k,2849
-euroeval/speed_benchmark.py,sha256=6bFGeMmtdl_6owkxNQ3ZKiyQQS58k0NApzlsbDgBW5s,4037
-euroeval/tasks.py,sha256=btxf29M5rUP7JjBl6u9aQlHQAxrJNP4bRbdEQtDnmDA,3376
-euroeval/tokenization_utils.py,sha256=LxgGs7juS5PuMYt5LL2X6eVXdtnpi-A2jFxqcWpF6NA,17931
-euroeval/types.py,sha256=EIYMNOqqHqibnbNw-fvdst6HwTvq32gtxhr7jL7i-xM,2511
-euroeval/utils.py,sha256=5R7y67xe0ODaje7k8nOu2AFS3Ph2gcsiWpIq5rjSSuA,11613
-euroeval/benchmark_modules/__init__.py,sha256=TNO-sNDwlXE-LMFXfwwqjQqUy55gywSmwRBcoPUFuaU,236
-euroeval/benchmark_modules/base.py,sha256=D1oKD16KBvxEoBUfqwvzvcDc1hx6letdD3v1PnBmF4A,10669
-euroeval/benchmark_modules/fresh.py,sha256=sg_AXNPApFObCzCRWhCgKxfr-eqQsT6Ri0xx0_Yy5JM,10293
-euroeval/benchmark_modules/hf.py,sha256=-W_bWEdm0zePkn4nDz4l0T4hhJJnlfwHrtIO3m5BrUs,44725
-euroeval/benchmark_modules/litellm.py,sha256=_gKBbJsXzo_cHJVaeuQpHRBENEZUGS_vcC-uGIhhmHA,52111
-euroeval/benchmark_modules/vllm.py,sha256=kq3PMUuRT0NOky6XSHl1JeHTDGehwcub0HcGC5S_Wv4,38834
-euroeval/dataset_configs/__init__.py,sha256=EbjEyHwBtSztASl8_xblD8hessruDdV4Eg1vXrmGOuY,1935
-euroeval/dataset_configs/danish.py,sha256=MTt9EcriSer0QaFQ7_6evYxh-g9OPjroWegYdFpiKag,3395
-euroeval/dataset_configs/dutch.py,sha256=r21nxEvMmBkKqPXVW082batPsxJ9d0RB4DzngOTMJSk,3185
-euroeval/dataset_configs/english.py,sha256=1q8XJqIVWBBNkldL7t-cVnU2O9EUb9_xoVRSN8arN90,2561
-euroeval/dataset_configs/faroese.py,sha256=QQgLe5gv0f3AtXe5rV65xZ98gFgyITQPDr3UwO4Bnv4,1350
-euroeval/dataset_configs/finnish.py,sha256=_8YWIlZNpO8Qi233bH7cKwm3tq3WETLfC_6mzg7LLog,2045
-euroeval/dataset_configs/french.py,sha256=ATsj8_9_GxFTQgmfrniPQFZ1R9hoQCI1_ieWTnscFHU,2382
-euroeval/dataset_configs/german.py,sha256=QO6PrBQY6kyZeQMU1vg6KrC_sKyj9U2ukS9nbKO19is,2560
-euroeval/dataset_configs/icelandic.py,sha256=mncl7X4yO9gBmYqXMBfm7FKU1jcKryerSgd0dqlIA_4,4198
-euroeval/dataset_configs/italian.py,sha256=KNjCvTzsEqH_EEk3At8slKqNwWWiIdbv_t5ke7n9nZI,2660
-euroeval/dataset_configs/norwegian.py,sha256=30YGdDPtDszG10BNDVHb-XXTGgGIIgDUNGoeM9q0K_E,5385
-euroeval/dataset_configs/portuguese.py,sha256=-HSDsujWfK__nV2SCu-z0ne0AXLDszOT05oYphQUDTw,2063
-euroeval/dataset_configs/spanish.py,sha256=Yzm1kiilEKoHyd3xD2wrw596Ac9UcaWhlE93GlOFjlc,2558
-euroeval/dataset_configs/swedish.py,sha256=SOD2nKQTVwTpTvr362mDPHon42kr9vWs5C0mK02Fh-o,2811
-euroeval/prompt_templates/__init__.py,sha256=HWMZpybxs2xHPnVeJ43893conARahIVLWNXeRhXEGZw,357
-euroeval/prompt_templates/linguistic_acceptability.py,sha256=ZN71BEt4HAhSYY-GWjh-S-iVvq5AODQJThkrjDhy4oM,7138
-euroeval/prompt_templates/multiple_choice.py,sha256=F9ItGQtnaaez15A8MQ1UCpKRDsLM-AZyRdYetGAofa0,5494
-euroeval/prompt_templates/named_entity_recognition.py,sha256=ga21s9T4_Hhbf88boWm7gnL7OgD7txuS_EeDgXaxEoE,13602
-euroeval/prompt_templates/reading_comprehension.py,sha256=yLqryWQAW04GULz_EyNDLOS7ZrDUeasuLFt-dtqCnYk,6585
-euroeval/prompt_templates/sentiment_classification.py,sha256=2Xsmj8lbaAXACHhwbbR4dWhoKyKB87TqpMO-ssQ-Djo,7649
-euroeval/prompt_templates/summarization.py,sha256=I98LlUOBVa_xo02npq7BWKKZOXGqm-_15i64QzbEsb0,5334
-euroeval/task_group_utils/__init__.py,sha256=CorGVkixkoEDOQuDsrOGlTmF1zmM0wnGHs8psWTfD28,72
-euroeval/task_group_utils/multiple_choice_classification.py,sha256=yfy8lczpZ_MY-Y4FQx3Et9vEUpuD3YMFjF3wQGCfMNw,6632
-euroeval/task_group_utils/question_answering.py,sha256=agwtWOmctgat98yqgFiMSPY6zmoaPgYVyzMmOkNjr58,27284
-euroeval/task_group_utils/sequence_classification.py,sha256=igmD24aMNN7QBJ8NDzgEnGwM-jq_zhC37QxazNm7GZ4,12711
-euroeval/task_group_utils/text_to_text.py,sha256=xOpja-W4E-1peMjZX8G-3G5iRgmFHHygrQ5WN1hB3FI,4550
-euroeval/task_group_utils/token_classification.py,sha256=wCy3aI-Sn9f-87tHzAnYDA6EbY3ah3xao1SnfnoRNz4,17490
-euroeval-15.12.0.dist-info/METADATA,sha256=8cY6HWgAZgrCkIA20lVKuf42y-e7U1MZQZSTdF3e7ig,13479
-euroeval-15.12.0.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
-euroeval-15.12.0.dist-info/entry_points.txt,sha256=tKQRxN0HX2mGtbZbZQdCRFUDZIecA_z4mZduueor3Ug,135
-euroeval-15.12.0.dist-info/licenses/LICENSE,sha256=guvz_zBHgkQSY_QiUU0Bkc1k-L_PFZuLjIPfuKne2OY,1080
-euroeval-15.12.0.dist-info/RECORD,,