PyPI - ai2-olmo-eval - Versions diffs - 0.7.1__tar.gz → 0.7.2__tar.gz - Mend

ai2-olmo-eval 0.7.1tar.gz → 0.7.2tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (727) hide show

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: ai2-olmo-eval
-Version: 0.7.1
+Version: 0.7.2
 Summary: In-loop evaluation tasks for language modeling
 Author-email: Allen Institute for Artificial Intelligence <olmo@allenai.org>
 License:                                  Apache License

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/ai2_olmo_eval.egg-info/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: ai2-olmo-eval
-Version: 0.7.1
+Version: 0.7.2
 Summary: In-loop evaluation tasks for language modeling
 Author-email: Allen Institute for Artificial Intelligence <olmo@allenai.org>
 License:                                  Apache License

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/ai2_olmo_eval.egg-info/SOURCES.txt RENAMED Viewed

@@ -607,6 +607,18 @@ src/olmo_eval/oe_eval_tasks/arc_easy/val_mc_5shot/config.json
 src/olmo_eval/oe_eval_tasks/arc_easy/val_mc_5shot/requests.jsonl.gz
 src/olmo_eval/oe_eval_tasks/arc_easy/val_rc_5shot/config.json
 src/olmo_eval/oe_eval_tasks/arc_easy/val_rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_arithmetic/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_arithmetic/rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_coding/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_coding/rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_common_knowledge/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_common_knowledge/rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_logical_reasoning/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_logical_reasoning/rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_pattern/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_pattern/rc_5shot/requests.jsonl.gz
+src/olmo_eval/oe_eval_tasks/basic_skills_string_operations/rc_5shot/config.json
+src/olmo_eval/oe_eval_tasks/basic_skills_string_operations/rc_5shot/requests.jsonl.gz
 src/olmo_eval/oe_eval_tasks/boolq/mc_5shot/config.json
 src/olmo_eval/oe_eval_tasks/boolq/mc_5shot/requests.jsonl.gz
 src/olmo_eval/oe_eval_tasks/boolq/rc_0shot/config.json

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_arithmetic/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_arithmetic",
+  "task_hash": "56711b967c78d896ef51ba00aef5cfb0",
+  "task_config": {
+    "dataset_path": "basic_skills_arithmetic",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_arithmetic:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "arithmetic",
+    "task_name": "basic_skills_arithmetic",
+    "version": 0,
+    "task_core": "basic_skills_arithmetic"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_arithmetic/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_coding/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_coding",
+  "task_hash": "d748d1d8ba506d3d234eed529ef62c3e",
+  "task_config": {
+    "dataset_path": "basic_skills_coding",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_coding:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "coding",
+    "task_name": "basic_skills_coding",
+    "version": 0,
+    "task_core": "basic_skills_coding"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_coding/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_common_knowledge/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_common_knowledge",
+  "task_hash": "51e88e759602f9085a8c779da375d833",
+  "task_config": {
+    "dataset_path": "basic_skills_common_knowledge",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_common_knowledge:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "common_knowledge",
+    "task_name": "basic_skills_common_knowledge",
+    "version": 0,
+    "task_core": "basic_skills_common_knowledge"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_common_knowledge/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_logical_reasoning/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_logical_reasoning",
+  "task_hash": "a3d406a2f4224604b7e6bbf68050691d",
+  "task_config": {
+    "dataset_path": "basic_skills_logical_reasoning",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_logical_reasoning:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "logical_reasoning",
+    "task_name": "basic_skills_logical_reasoning",
+    "version": 0,
+    "task_core": "basic_skills_logical_reasoning"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_logical_reasoning/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_pattern/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_pattern",
+  "task_hash": "67983750bfb70a3b5cc34dcd67ee3c6a",
+  "task_config": {
+    "dataset_path": "basic_skills_pattern",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_pattern:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "pattern",
+    "task_name": "basic_skills_pattern",
+    "version": 0,
+    "task_core": "basic_skills_pattern"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_pattern/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_string_operations/rc_5shot/config.json ADDED Viewed

@@ -0,0 +1,23 @@
+{
+  "task_name": "basic_skills_string_operations",
+  "task_hash": "8e5fdc7697f1bc7b0c9487a6fa682e45",
+  "task_config": {
+    "dataset_path": "basic_skills_string_operations",
+    "primary_metric": "acc_per_token",
+    "split": "validation",
+    "num_shots": 5,
+    "metadata": {
+      "regimes": [
+        "OLMES-v0.1"
+      ],
+      "alias": "basic_skills_string_operations:rc::olmes"
+    },
+    "generation_kwargs": {},
+    "context_kwargs": {},
+    "dataset_name": "string_operations",
+    "task_name": "basic_skills_string_operations",
+    "version": 0,
+    "task_core": "basic_skills_string_operations"
+  },
+  "current_date": "2025-05-12 00:06:28 UTC"
+}

ai2_olmo_eval-0.7.2/src/olmo_eval/oe_eval_tasks/basic_skills_string_operations/rc_5shot/requests.jsonl.gz ADDED Viewed

Binary file

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/tasks.py RENAMED Viewed

@@ -1704,6 +1704,46 @@ LABEL_TO_TASK_MAP_ORIG = {
         OEEvalTask,
         {"dataset_path": "arc_easy", "dataset_name": "rc_5shot", "metric_type": "acc"},
     ),
+    "basic_skills_arithmetic_rc_5shot": (
+        OEEvalTask,
+        {
+            "dataset_path": "basic_skills_arithmetic",
+            "dataset_name": "rc_5shot",
+            "metric_type": "acc",
+        },
+    ),
+    "basic_skills_coding_rc_5shot": (
+        OEEvalTask,
+        {"dataset_path": "basic_skills_coding", "dataset_name": "rc_5shot", "metric_type": "acc"},
+    ),
+    "basic_skills_common_knowledge_rc_5shot": (
+        OEEvalTask,
+        {
+            "dataset_path": "basic_skills_common_knowledge",
+            "dataset_name": "rc_5shot",
+            "metric_type": "acc",
+        },
+    ),
+    "basic_skills_logical_reasoning_rc_5shot": (
+        OEEvalTask,
+        {
+            "dataset_path": "basic_skills_logical_reasoning",
+            "dataset_name": "rc_5shot",
+            "metric_type": "acc",
+        },
+    ),
+    "basic_skills_pattern_rc_5shot": (
+        OEEvalTask,
+        {"dataset_path": "basic_skills_pattern", "dataset_name": "rc_5shot", "metric_type": "acc"},
+    ),
+    "basic_skills_string_operations_rc_5shot": (
+        OEEvalTask,
+        {
+            "dataset_path": "basic_skills_string_operations",
+            "dataset_name": "rc_5shot",
+            "metric_type": "acc",
+        },
+    ),
     "boolq_mc_5shot": (
         OEEvalTask,
         {"dataset_path": "boolq", "dataset_name": "mc_5shot", "metric_type": "acc"},

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/version.py RENAMED Viewed

@@ -1,6 +1,6 @@
 _MAJOR = "0"
 _MINOR = "7"
-_PATCH = "1"
+_PATCH = "2"
 _SUFFIX = ""
 VERSION_SHORT = "{0}.{1}".format(_MAJOR, _MINOR)

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/LICENSE RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/README.md RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/pyproject.toml RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/setup.cfg RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/ai2_olmo_eval.egg-info/dependency_links.txt RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/ai2_olmo_eval.egg-info/requires.txt RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/ai2_olmo_eval.egg-info/top_level.txt RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/__init__.py RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Challenge/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Challenge/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Challenge/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Easy/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Easy/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/ai2_arc/ARC-Easy/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/allenai/basic_arithmetic/none/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/allenai/basic_arithmetic/none/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/allenai/basic_arithmetic/none/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/boolq/none/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/boolq/none/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/boolq/none/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/mrpc/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/mrpc/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/mrpc/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/rte/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/rte/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/rte/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/sst2/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/sst2/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/glue/sst2/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/abstract_algebra/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/anatomy/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/astronomy/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/business_ethics/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/clinical_knowledge/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_biology/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_chemistry/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_computer_science/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_mathematics/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_medicine/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/dev/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/dev/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/test/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/test/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/test/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/validation/data-00000-of-00001.arrow RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/validation/dataset_info.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/college_physics/validation/state.json RENAMED Viewed

File without changes

{ai2_olmo_eval-0.7.1 → ai2_olmo_eval-0.7.2}/src/olmo_eval/hf_datasets/hails/mmlu_no_train/computer_security/dev/data-00000-of-00001.arrow RENAMED Viewed

File without changes

ai2-olmo-eval 0.7.1__tar.gz → 0.7.2__tar.gz

ai2-olmo-eval 0.7.1tar.gz → 0.7.2tar.gz