ScandEval 16.11.0__py3-none-any.whl → 16.13.0__py3-none-any.whl

scandeval-16.13.0.dist-info/METADATA

@@ -0,0 +1,334 @@
+Metadata-Version: 2.4
+Name: ScandEval
+Version: 16.13.0
+Summary: The robust European language model benchmark.
+Project-URL: Repository, https://github.com/EuroEval/EuroEval
+Project-URL: Issues, https://github.com/EuroEval/EuroEval/issues
+Author-email: Dan Saattrup Smart <dan.smart@alexandra.dk>
+Maintainer-email: Dan Saattrup Smart <dan.smart@alexandra.dk>
+License: MIT License
+        
+        Copyright (c) 2022-2026 Dan Saattrup Smart
+        
+        Permission is hereby granted, free of charge, to any person obtaining a copy
+        of this software and associated documentation files (the "Software"), to deal
+        in the Software without restriction, including without limitation the rights
+        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+        copies of the Software, and to permit persons to whom the Software is
+        furnished to do so, subject to the following conditions:
+        
+        The above copyright notice and this permission notice shall be included in all
+        copies or substantial portions of the Software.
+        
+        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+        SOFTWARE.
+License-File: LICENSE
+Requires-Python: <4.0,>=3.12
+Requires-Dist: accelerate>=1.9.0
+Requires-Dist: bert-score>=0.3.13
+Requires-Dist: click>=8.1.3
+Requires-Dist: cloudpickle>=3.1.1
+Requires-Dist: datasets>=3.5.0
+Requires-Dist: demjson3>=3.0.6
+Requires-Dist: evaluate>=0.4.1
+Requires-Dist: huggingface-hub>=0.30.1
+Requires-Dist: levenshtein>=0.24.0
+Requires-Dist: litellm>=1.75.6
+Requires-Dist: mistral-common[soundfile]
+Requires-Dist: more-itertools>=10.5.0
+Requires-Dist: numpy>=2.0.0
+Requires-Dist: ollama>=0.5.1
+Requires-Dist: pandas>=2.2.0
+Requires-Dist: peft>=0.15.0
+Requires-Dist: protobuf>=2.0.0
+Requires-Dist: pydantic>=2.6.0
+Requires-Dist: pyinfer>=0.0.3
+Requires-Dist: python-dotenv>=1.0.1
+Requires-Dist: rouge-score>=0.1.2
+Requires-Dist: sacrebleu>=2.5.1
+Requires-Dist: sacremoses>=0.1.1
+Requires-Dist: scikit-learn==1.6.1
+Requires-Dist: sentencepiece>=0.1.96
+Requires-Dist: seqeval>=1.2.2
+Requires-Dist: setuptools>=75.8.2
+Requires-Dist: tenacity>=9.0.0
+Requires-Dist: termcolor>=2.0.0
+Requires-Dist: torch>=2.6.0
+Requires-Dist: transformers[mistral-common]<5.0.0,>=4.56.0
+Provides-Extra: all
+Requires-Dist: bitsandbytes>=0.43.1; (platform_system == 'Linux') and extra == 'all'
+Requires-Dist: fbgemm-gpu>=1.0.0; (platform_system == 'Linux') and extra == 'all'
+Requires-Dist: ray>=2.53.0; (platform_system == 'Linux') and extra == 'all'
+Requires-Dist: timm>=1.0.19; extra == 'all'
+Requires-Dist: vllm-metal>=0.1.0; (platform_system == 'Darwin') and extra == 'all'
+Requires-Dist: vllm==0.11.0; (platform_system == 'Darwin') and extra == 'all'
+Requires-Dist: vllm[flashinfer]>=0.14.1; (platform_system == 'Linux') and extra == 'all'
+Provides-Extra: generative
+Requires-Dist: bitsandbytes>=0.43.1; (platform_system == 'Linux') and extra == 'generative'
+Requires-Dist: fbgemm-gpu>=1.0.0; (platform_system == 'Linux') and extra == 'generative'
+Requires-Dist: ray>=2.53.0; (platform_system == 'Linux') and extra == 'generative'
+Requires-Dist: timm>=1.0.19; extra == 'generative'
+Requires-Dist: vllm-metal>=0.1.0; (platform_system == 'Darwin') and extra == 'generative'
+Requires-Dist: vllm==0.11.0; (platform_system == 'Darwin') and extra == 'generative'
+Requires-Dist: vllm[flashinfer]>=0.14.1; (platform_system == 'Linux') and extra == 'generative'
+Description-Content-Type: text/markdown
+
+<!-- This disables the requirement that the first line is a top-level heading -->
+<!-- markdownlint-configure-file { "MD041": false } -->
+
+<div align='center'>
+<img
+    src="https://raw.githubusercontent.com/EuroEval/EuroEval/main/gfx/euroeval.png"
+    height="500"
+    width="372"
+>
+</div>
+
+### The robust European language model benchmark
+
+(formerly known as ScandEval)
+
+______________________________________________________________________
+[![Documentation](https://img.shields.io/badge/docs-passing-green)](https://euroeval.com)
+[![PyPI Status](https://badge.fury.io/py/euroeval.svg)](https://pypi.org/project/euroeval/)
+[![First paper](https://img.shields.io/badge/arXiv-2304.00906-b31b1b.svg)](https://arxiv.org/abs/2304.00906)
+[![Second paper](https://img.shields.io/badge/arXiv-2406.13469-b31b1b.svg)](https://arxiv.org/abs/2406.13469)
+[![License](https://img.shields.io/github/license/EuroEval/EuroEval)](https://github.com/EuroEval/EuroEval/blob/main/LICENSE)
+[![LastCommit](https://img.shields.io/github/last-commit/EuroEval/EuroEval)](https://github.com/EuroEval/EuroEval/commits/main)
+[![Code Coverage](https://img.shields.io/badge/Coverage-73%25-yellow.svg)](https://github.com/EuroEval/EuroEval/tree/main/tests)
+[![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.0-4baaaa.svg)](https://github.com/EuroEval/EuroEval/blob/main/CODE_OF_CONDUCT.md)
+
+## Maintainer
+
+- Dan Saattrup Smart ([@saattrupdan](https://github.com/saattrupdan), <dan.smart@alexandra.dk>)
+
+## Installation and usage
+
+See the [documentation](https://euroeval.com/python-package/) for more information.
+
+## Reproducing the evaluation datasets
+
+All datasets used in this project are generated using the scripts located in the
+[src/scripts](src/scripts) folder. To reproduce a dataset, run the corresponding script
+with the following command
+
+```bash
+uv run src/scripts/<name-of-script>.py
+```
+
+Replace <name-of-script> with the specific script you wish to execute, e.g.,
+
+```bash
+uv run src/scripts/create_allocine.py
+```
+
+## Contributors :pray:
+
+A huge thank you to all the contributors who have helped make this project a success!
+
+<a href="https://github.com/peter-sk">
+    <img
+        src="https://avatars.githubusercontent.com/u/6168908"
+        width=50
+        alt="Contributor avatar for peter-sk"
+    />
+</a>
+<a href="https://github.com/AJDERS">
+    <img
+        src="https://avatars.githubusercontent.com/u/38854604"
+        width=50
+        alt="Contributor avatar for AJDERS"
+    />
+</a>
+<a href="https://github.com/oliverkinch">
+    <img
+        src="https://avatars.githubusercontent.com/u/71556498"
+        width=50
+        alt="Contributor avatar for oliverkinch"
+    />
+</a>
+<a href="https://github.com/versae">
+    <img
+        src="https://avatars.githubusercontent.com/u/173537"
+        width=50
+        alt="Contributor avatar for versae"
+    />
+</a>
+<a href="https://github.com/KennethEnevoldsen">
+    <img
+        src="https://avatars.githubusercontent.com/u/23721977"
+        width=50
+        alt="Contributor avatar for KennethEnevoldsen"
+    />
+</a>
+<a href="https://github.com/viggo-gascou">
+    <img
+        src="https://avatars.githubusercontent.com/u/94069687"
+        width=50
+        alt="Contributor avatar for viggo-gascou"
+    />
+</a>
+<a href="https://github.com/mathiasesn">
+    <img
+        src="https://avatars.githubusercontent.com/u/27091759"
+        width=50
+        alt="Contributor avatar for mathiasesn"
+    />
+</a>
+<a href="https://github.com/Alkarex">
+    <img
+        src="https://avatars.githubusercontent.com/u/1008324"
+        width=50
+        alt="Contributor avatar for Alkarex"
+    />
+</a>
+<a href="https://github.com/marksverdhei">
+    <img
+        src="https://avatars.githubusercontent.com/u/46672778"
+        width=50
+        alt="Contributor avatar for marksverdhei"
+    />
+</a>
+<a href="https://github.com/Mikeriess">
+    <img
+        src="https://avatars.githubusercontent.com/u/19728563"
+        width=50
+        alt="Contributor avatar for Mikeriess"
+    />
+</a>
+<a href="https://github.com/ThomasKluiters">
+    <img
+        src="https://avatars.githubusercontent.com/u/8137941"
+        width=50
+        alt="Contributor avatar for ThomasKluiters"
+    />
+</a>
+<a href="https://github.com/BramVanroy">
+    <img
+        src="https://avatars.githubusercontent.com/u/2779410"
+        width=50
+        alt="Contributor avatar for BramVanroy"
+    />
+</a>
+<a href="https://github.com/peregilk">
+    <img
+        src="https://avatars.githubusercontent.com/u/9079808"
+        width=50
+        alt="Contributor avatar for peregilk"
+    />
+</a>
+<a href="https://github.com/Rijgersberg">
+    <img
+        src="https://avatars.githubusercontent.com/u/8604946"
+        width=50
+        alt="Contributor avatar for Rijgersberg"
+    />
+</a>
+<a href="https://github.com/duarteocarmo">
+    <img
+        src="https://avatars.githubusercontent.com/u/26342344"
+        width=50
+        alt="Contributor avatar for duarteocarmo"
+    />
+</a>
+<a href="https://github.com/slowwavesleep">
+    <img
+        src="https://avatars.githubusercontent.com/u/44175589"
+        width=50
+        alt="Contributor avatar for slowwavesleep"
+    />
+</a>
+<a href="https://github.com/mrkowalski">
+    <img
+        src="https://avatars.githubusercontent.com/u/6357044"
+        width=50
+        alt="Contributor avatar for mrkowalski"
+    />
+</a>
+<a href="https://github.com/simonevanbruggen">
+    <img
+        src="https://avatars.githubusercontent.com/u/24842609"
+        width=50
+        alt="Contributor avatar for simonevanbruggen"
+    />
+</a>
+<a href="https://github.com/tvosch">
+    <img
+        src="https://avatars.githubusercontent.com/u/110661769"
+        width=50
+        alt="Contributor avatar for tvosch"
+    />
+</a>
+<a href="https://github.com/Touzen">
+    <img
+        src="https://avatars.githubusercontent.com/u/1416265"
+        width=50
+        alt="Contributor avatar for Touzen"
+    />
+</a>
+<a href="https://github.com/caldaibis">
+    <img
+        src="https://avatars.githubusercontent.com/u/16032437"
+        width=50
+        alt="Contributor avatar for caldaibis"
+    />
+</a>
+<a href="https://github.com/SwekeR-463">
+    <img
+        src="https://avatars.githubusercontent.com/u/114919896?v=4"
+        width=50
+        alt="Contributor avatar for SwekeR-463"
+    />
+</a>
+
+### Contribute to EuroEval
+
+We welcome contributions to EuroEval! Whether you're fixing bugs, adding features, or
+contributing new datasets, your help makes this project better for everyone.
+
+- **General contributions**: Check out our [contribution guidelines](CONTRIBUTING.md)
+  for information on how to get started.
+- **Adding datasets**: If you're interested in adding a new dataset to EuroEval, we have
+  a [dedicated guide](NEW_DATASET_GUIDE.md) with step-by-step instructions.
+
+### Special thanks
+
+- Thanks to [Google](https://google.com/) for sponsoring Gemini credits as part of their
+  [Google Cloud for Researchers Program](https://cloud.google.com/edu/researchers).
+- Thanks [@Mikeriess](https://github.com/Mikeriess) for evaluating many of the larger
+  models on the leaderboards.
+- Thanks to [OpenAI](https://openai.com/) for sponsoring OpenAI credits as part of their
+  [Researcher Access Program](https://openai.com/form/researcher-access-program/).
+- Thanks to [UWV](https://www.uwv.nl/) and [KU
+  Leuven](https://www.arts.kuleuven.be/ling/ccl) for sponsoring the Azure OpenAI
+  credits used to evaluate GPT-4-turbo in Dutch.
+- Thanks to [Miðeind](https://mideind.is/en) for sponsoring the OpenAI
+  credits used to evaluate GPT-4-turbo in Icelandic and Faroese.
+- Thanks to [CHC](https://chc.au.dk/) for sponsoring the OpenAI credits used to
+  evaluate GPT-4-turbo in German.
+
+## Citing EuroEval
+
+If you want to cite the framework then feel free to use this:
+
+```bibtex
+@article{smart2024encoder,
+  title={Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks},
+  author={Smart, Dan Saattrup and Enevoldsen, Kenneth and Schneider-Kamp, Peter},
+  journal={arXiv preprint arXiv:2406.13469},
+  year={2024}
+}
+@inproceedings{smart2023scandeval,
+  author = {Smart, Dan Saattrup},
+  booktitle = {Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)},
+  month = may,
+  pages = {185--201},
+  title = {{ScandEval: A Benchmark for Scandinavian Natural Language Processing}},
+  year = {2023}
+}
+```

scandeval-16.13.0.dist-info/RECORD

@@ -0,0 +1,94 @@
+scandeval/__init__.py,sha256=wHhEEQ8wLNLAN9ULdAkWZpGSo08IpTx_w_gaya0FnVQ,3896
+scandeval/async_utils.py,sha256=tVrpSZVpEohIWCwpwroF9IZO2eeUIYSNU_ixvqTgUZ8,1128
+scandeval/benchmark_config_factory.py,sha256=62DY4M0NILR-36Tu8xt2Qrkzz7sJ0iAOIw4cVT5zS_Y,9758
+scandeval/benchmarker.py,sha256=Qa-87CExA7yGa8RENKWxkfBUWogmPrDsL61nhxQGiL0,54077
+scandeval/caching_utils.py,sha256=lLUbkpDdJZy4xodIpwIz5d-WNKGuszbr_d9dyiJ5kZc,2591
+scandeval/callbacks.py,sha256=l8f6Zr8EoHfVFsI1ZnMUK0Y8uZB00Nvaz_I6XDn6avE,2515
+scandeval/cli.py,sha256=9tW6gfpIEnApSlt5KIp28gZ2sG7TKbXzLjusKrnRiQo,9783
+scandeval/constants.py,sha256=IJg0VpHpsCNSvkgNDwc9aHJtwEQk7TtYygk7gj0c27I,4763
+scandeval/custom_dataset_configs.py,sha256=SpRctMzD1hNNGJp6JdAnblIqkaR3exOd6gQ-eYmQ32s,5340
+scandeval/data_loading.py,sha256=XIYfNYLJL8FfTnoizLa7LskVYpnkXd-a-0rDxU0JSQc,8923
+scandeval/data_models.py,sha256=DIHjKi7prg2EaUZV7UlcJGg_CNQls7kACNbTLbH0o-8,38111
+scandeval/enums.py,sha256=SeFek-Lre2Q5sxbP5svqjDZFZR2vlJhg9dkRH4JvU1g,3436
+scandeval/exceptions.py,sha256=4-N2OIo5PJ2aciLjagNAVhdHPxpq2QxywbBqJ8lkKj0,5780
+scandeval/finetuning.py,sha256=dTjchPHLFRD65ZrEmtj5TfMTPZ6PODn77t372fgTNwE,11983
+scandeval/generation.py,sha256=ccE-S0jxkM99XziIdeaBbk8yRGv4YBkzZkoabhFCSKA,13382
+scandeval/generation_utils.py,sha256=todDO4UfFw-pNWjv795HLLlz4UcX3RhRPcEep76xxNk,20124
+scandeval/languages.py,sha256=gUSosFbvf1eEQHjVsKhXdJ4jiGXC-9lMkOL8AsBG33Q,37295
+scandeval/logging_utils.py,sha256=Qnni11ngHrjCf_fgkk6lp6gs-tGSgUS3d5zRR83y6ec,9507
+scandeval/model_cache.py,sha256=K7gmYPNAmvi-BcQbUWg8DUiqQBwYbBqU-euqu7myaf0,11138
+scandeval/model_config.py,sha256=fxHfgpw-9vj3hwke28DguVGvG9TU06nkTXT0V6KAMpQ,2761
+scandeval/model_loading.py,sha256=DsX7et18Epcv8kHATZgwPJnwH17GHmh3JCzrSoI3GAE,2377
+scandeval/scores.py,sha256=9a1XtppFbp8GJFc9JdThGxqBY0YUE7-92oyrlxScjNk,3281
+scandeval/speed_benchmark.py,sha256=VUOvauc9tuAegThNT2g1a-Z1l7DEmKq57dHI4t16o5A,4068
+scandeval/string_utils.py,sha256=h9IFUkbmPWYQ-1VwdrJT82a32GVFr-ihwOcM3N8nyg0,5034
+scandeval/tasks.py,sha256=FQvnl28iudjIA2V_G3gHpSsyKaSs7r1i-T5c2pLAuF4,6656
+scandeval/tokenisation_utils.py,sha256=K9ovIi5WNqLrFKkafl16R3K-2PallGwV_zeIFw_AM_k,21553
+scandeval/types.py,sha256=CHQjLzqKYDXPCyZas7rKg6wD1pNiYuaOFMWimrj5H64,4374
+scandeval/utils.py,sha256=jXHAOh_iON_7Oed-dAAiT6wG-o3b7PveOka1HoschQs,7545
+scandeval/benchmark_modules/__init__.py,sha256=TNO-sNDwlXE-LMFXfwwqjQqUy55gywSmwRBcoPUFuaU,236
+scandeval/benchmark_modules/base.py,sha256=5YAsCMILKTRXFx_ylGQ7iS5AFKN25iFdkBjj8KzzElw,11445
+scandeval/benchmark_modules/fresh.py,sha256=8jmx3zMMp6IxDp44T3P7FJJGPMbj3vSyIfukUSUNS4k,10759
+scandeval/benchmark_modules/hf.py,sha256=tSnM6aJzB0K0kro7il-ijyD959da47E2gs9dM3BDGoM,49948
+scandeval/benchmark_modules/litellm.py,sha256=owdA_qfTcbhzVJDC6VCM1ipEYoOerLynUReMbJxZu-s,76229
+scandeval/benchmark_modules/vllm.py,sha256=qwhDqbX7mXPJs34FVybi79Q0ATqVHDMMgdF3hPnXqyE,61801
+scandeval/dataset_configs/__init__.py,sha256=O8STCjVRlBfPi-7wxfZDQ1dX2mEXbRSmnJNlmik0JRs,4416
+scandeval/dataset_configs/albanian.py,sha256=KE82ZtmkrOyf0U7Tf4Mlw-q8ZI5tN4qrZvgs9uNFg7Q,1472
+scandeval/dataset_configs/belarusian.py,sha256=AwEzNpi8x8_BZ1LaMSK_nYKCfKzJ7jvj_LJ1tlv6UAI,1048
+scandeval/dataset_configs/bosnian.py,sha256=golIWqwW1pFwSkuBM1v0yhHDblB2FoJgK24aO7kKm7M,877
+scandeval/dataset_configs/bulgarian.py,sha256=yuuXwi0GvYSNjgYbfa1RRjhQu-0DL0Rf7ayDXdFfrRs,1283
+scandeval/dataset_configs/catalan.py,sha256=Tcgi0ucpumkZXROMgdwE0Mb2CySiY3vOU0aQKXeYNA8,1426
+scandeval/dataset_configs/croatian.py,sha256=rcUcfb2kcY1Ojhg86cCpcMYxR9MNLdXL-vRbG2nQLTM,1259
+scandeval/dataset_configs/czech.py,sha256=ghv2yNw839G-utll8PQRSjyKYbM5gfoQhFKy664GTCI,1562
+scandeval/dataset_configs/danish.py,sha256=mcRZm3crLqFzkbNmQkMdNUbjiUooJS01p0qJWqmbgIo,3313
+scandeval/dataset_configs/dutch.py,sha256=Z1el5JHNBZw3SX9orqLak1fGvYV-ogOA7CN08Ex0y24,3758
+scandeval/dataset_configs/english.py,sha256=18hhSXkYlfIGDx3KGD1Q576pRRFK2jwIGNdbCvCnaR0,2836
+scandeval/dataset_configs/estonian.py,sha256=C0bRCdKj5YChlquUWRZm1RxzdGCN1iyFRAHjJRkpb68,2772
+scandeval/dataset_configs/faroese.py,sha256=MxSrvqux0ekQ11jqK2wjQqBt6qqPLz5qzUYcB6gkWP0,1246
+scandeval/dataset_configs/finnish.py,sha256=EdLNQRhqC3DpzcKMoUaPt9XHriddVpkPDnlEkOW-3IU,2462
+scandeval/dataset_configs/french.py,sha256=xsHizw6C9GNZ6AH4iP6IXe4OLS8vprkJzMSj0a85XNU,2628
+scandeval/dataset_configs/german.py,sha256=cPiPxAEpEJtnE51xVPg1ZH61TwlgPzCDc4dRdyMGpzQ,2877
+scandeval/dataset_configs/greek.py,sha256=ZmCVeHVZbP_vjkRLVBNVzB8BHh1f_8Lkk1BYXYpctmk,1474
+scandeval/dataset_configs/hungarian.py,sha256=iHePTXYQOUEwzGuhwTftLeX0Vlf3AB38igwp1N8DljE,1420
+scandeval/dataset_configs/icelandic.py,sha256=vbo-2NQeRH1zW0hishEvcIZkqUzmIh1TOOHcg74Ax7Q,3571
+scandeval/dataset_configs/italian.py,sha256=A0hZcrYddFHJapefHgbvlqFqHL2IPVhx-PZXKTInf-U,2780
+scandeval/dataset_configs/latvian.py,sha256=CwkbuFss9Ph7GETubPmx3qKCup5dXthoFgNwZkQl2nw,1926
+scandeval/dataset_configs/lithuanian.py,sha256=zMdbB4Bx1wmjUK53Wnfu8Lx7W201nNR6zJSZIzHfckQ,1723
+scandeval/dataset_configs/norwegian.py,sha256=sWzLQn2svAjp5FJCQe94Oyk3AKMu4U0bYzg1xhmw6S4,5504
+scandeval/dataset_configs/polish.py,sha256=llFqr3WycBItPHgqs2zPYU5uTQYMhIcUM-mEZE1vGZU,2093
+scandeval/dataset_configs/portuguese.py,sha256=T7PkSkGnENFn7GuDSjqmvZZgnEyVQINzgBZ3r8utPH4,2419
+scandeval/dataset_configs/romanian.py,sha256=vtZnM3RhAj_Y05XYiip_0Nc1rO-7nNsizFUKFM_LmkE,1470
+scandeval/dataset_configs/serbian.py,sha256=KxHL6CdSVbOecfYG-4fN8GLN3poi3m3LV7GnrQ79wvY,1410
+scandeval/dataset_configs/slovak.py,sha256=7JQj2GlRj1giACKqVZ6QJxiFBzP9byoowm0DjPaZ5u8,1252
+scandeval/dataset_configs/slovene.py,sha256=x1MZp_8gI5W-R-3StButdMGwaX0PD6miYRBWAael_V0,1270
+scandeval/dataset_configs/spanish.py,sha256=zYAccY2LCdPg25O23lFidx77iTjFvLME9PecnDQoTGQ,2947
+scandeval/dataset_configs/swedish.py,sha256=BP7F_6WumaFgZPS5qQst9EKzr6__gO4Nsz8IoLUF8DY,3288
+scandeval/dataset_configs/ukrainian.py,sha256=mbmgyf-yIfarrWA4EDlEg3CkmH5A091_pc1jN76fX2I,1526
+scandeval/metrics/__init__.py,sha256=nrjFjTK7NO5I8U6acULNzqezmMWN21aWd4faW4oYGHo,233
+scandeval/metrics/base.py,sha256=dUBby-ZzettMjdcjek6rw0JTZMuScX4cQ2Rd6untKHY,2525
+scandeval/metrics/bias.py,sha256=sV87PLzjc3XPsSAz2HJ4hmlLZ_IcHDsIUr7gYmp9HKc,7765
+scandeval/metrics/huggingface.py,sha256=eKXn5wBcNdzs23cgJ64XG8LIwen1wDxXy2kAOw3bjoQ,9579
+scandeval/metrics/llm_as_a_judge.py,sha256=vxKH8uz2gm4Mw50xAfXFZHHbbfPH_KAyjWbS4N139Lc,12140
+scandeval/metrics/pipeline.py,sha256=9QrsFKS_Qjs71DR6Pw7O7QS523SpWrWPrfEwTa99MdQ,10883
+scandeval/metrics/speed.py,sha256=G5hEQcrtqxF070ZZwLDh61iZnq2CSW2o6ZM7zR4lOTY,1298
+scandeval/prompt_templates/__init__.py,sha256=p3CUcSaJiiUm6EQyhceDUjotH7GdyHolMznAn2f44as,519
+scandeval/prompt_templates/classification.py,sha256=QuZh6hTMaqMYTsoruAhwjVP9381zzlQmDIwSeyGnav0,10121
+scandeval/prompt_templates/linguistic_acceptability.py,sha256=HgzVDsv5PzM-5cZL-JWzDHakgsxs7gsTF9LtiS9oqFU,16101
+scandeval/prompt_templates/multiple_choice.py,sha256=itD1enLOlwr3aKGTo0Ra_Jg65v6z060qxkPq0HlYNTE,13513
+scandeval/prompt_templates/named_entity_recognition.py,sha256=ZPe5cLCnCUgVDF249y9WkGi9BZlzD8DA6vRQHEYpPo8,31418
+scandeval/prompt_templates/reading_comprehension.py,sha256=4FHsOSn5jhmaz3enmxHn9oWaxnkAAtoMYeGLEgHe-v0,16941
+scandeval/prompt_templates/sentiment_classification.py,sha256=cSicNEfPxOdyquIqN9Mf3U_PDI3JOlp30PmajV4HXJs,18076
+scandeval/prompt_templates/simplification.py,sha256=DF50F1JSxy00ZOO3OJJZOtoTlkGjE35krjjbDaW7RUk,900
+scandeval/prompt_templates/summarization.py,sha256=LKiz5fd6A0J5NyoLBeyrZ4ir1skDB2pytKCEeF4zbmw,10770
+scandeval/prompt_templates/token_classification.py,sha256=8Uw34mN2xQ_5es-nz7vCK-GgDg_oE-zsAzPJPzAxFrQ,15531
+scandeval/task_group_utils/__init__.py,sha256=CorGVkixkoEDOQuDsrOGlTmF1zmM0wnGHs8psWTfD28,72
+scandeval/task_group_utils/multiple_choice_classification.py,sha256=PWUXeGn-9RsXxdVRYHJASyBVQ8L5Jla981eot0GLooY,7316
+scandeval/task_group_utils/question_answering.py,sha256=tuMwr-RnvJap5jkTrluxC1tfQVS6rKN8_ifNwis-auw,29064
+scandeval/task_group_utils/sequence_classification.py,sha256=U3wTU6eRVUvQlgfSeaug55y_UloPq8G6H7d1Qb2xqW0,16838
+scandeval/task_group_utils/text_to_text.py,sha256=p6zzjob70qQUpfUOs0LToSzavE1ERqRAHu_727Jb2mM,5476
+scandeval/task_group_utils/token_classification.py,sha256=h4b9tZy7WxFgBCtFj8neZtdS4zy7FLN-nwDXaS-gMqI,17334
+scandeval-16.13.0.dist-info/METADATA,sha256=sLxqkvR0o_DGkrLUfkTaZySb4dcg8Cmey7hJ1qyp7aQ,12312
+scandeval-16.13.0.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
+scandeval-16.13.0.dist-info/entry_points.txt,sha256=-mtBu-10bFWeZ2bS32gVK6-s-LNCQLxvnNUPBLd5ud4,87
+scandeval-16.13.0.dist-info/licenses/LICENSE,sha256=vb2c84xITVnhnVFsBS8AWXl-4S-KpxN6VMxTqqYlV3s,1080
+scandeval-16.13.0.dist-info/RECORD,,