benchmark-reliability 0.3.2__tar.gz → 0.3.4__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (139) hide show
  1. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/MANIFEST.in +0 -5
  2. {benchmark_reliability-0.3.2/src/benchmark_reliability.egg-info → benchmark_reliability-0.3.4}/PKG-INFO +1 -1
  3. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/pyproject.toml +1 -1
  4. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/setup.py +1 -1
  5. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4/src/benchmark_reliability.egg-info}/PKG-INFO +1 -1
  6. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/__init__.py +1 -1
  7. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/assistments.yaml +1 -1
  8. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/college_scorecard.yaml +1 -1
  9. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/colleges_aaup.yaml +1 -1
  10. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/colleges_usnews.yaml +1 -1
  11. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/customer_churn.yaml +1 -1
  12. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/electricity.yaml +1 -1
  13. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/entrance_exam.yaml +1 -1
  14. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/german_credit.yaml +1 -1
  15. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/higher_ed.yaml +1 -1
  16. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/law_school.yaml +1 -1
  17. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/mathe.yaml +1 -1
  18. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/mm_tba.yaml +1 -1
  19. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/oli.yaml +1 -1
  20. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/oulad.yaml +1 -1
  21. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/pisa2015.yaml +1 -1
  22. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_depression.yaml +1 -1
  23. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_dropout.yaml +1 -1
  24. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/tae.yaml +1 -1
  25. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/turkiye.yaml +1 -1
  26. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/uci_student.yaml +1 -1
  27. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/xapi_edu.yaml +1 -1
  28. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/version_policy.yaml +1 -1
  29. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/README.md +0 -0
  30. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/setup.cfg +0 -0
  31. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/benchmark_reliability.egg-info/SOURCES.txt +0 -0
  32. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/benchmark_reliability.egg-info/dependency_links.txt +0 -0
  33. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/benchmark_reliability.egg-info/entry_points.txt +0 -0
  34. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/benchmark_reliability.egg-info/requires.txt +0 -0
  35. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/benchmark_reliability.egg-info/top_level.txt +0 -0
  36. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/analyzer.py +0 -0
  37. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/cli.py +0 -0
  38. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/metrics/__init__.py +0 -0
  39. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/metrics/baseline_gap.py +0 -0
  40. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/metrics/instability.py +0 -0
  41. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/metrics/metadata.py +0 -0
  42. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/metrics/null_test.py +0 -0
  43. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/phase/__init__.py +0 -0
  44. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/phase/classifier.py +0 -0
  45. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/phase/embedding.py +0 -0
  46. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/phase/visualization.py +0 -0
  47. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/__init__.py +0 -0
  48. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/abalone.yaml +0 -0
  49. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/air_quality.yaml +0 -0
  50. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/airfoil.yaml +0 -0
  51. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/auto_mpg.yaml +0 -0
  52. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/bike_sharing.yaml +0 -0
  53. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/boston_housing.yaml +0 -0
  54. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/breast_cancer.yaml +0 -0
  55. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/california_housing.yaml +0 -0
  56. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/ccpp.yaml +0 -0
  57. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/climate_weather.yaml +0 -0
  58. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/concrete.yaml +0 -0
  59. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/cpu_act.yaml +0 -0
  60. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/credit_card.yaml +0 -0
  61. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/diabetes.yaml +0 -0
  62. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/energy_building.yaml +0 -0
  63. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/energy_efficiency.yaml +0 -0
  64. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/kaggle_students_performance.yaml +0 -0
  65. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/kdd_cup_2010.yaml +0 -0
  66. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/linnerud.yaml +0 -0
  67. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/nursery.yaml +0 -0
  68. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/olympics.yaml +0 -0
  69. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/pollution.yaml +0 -0
  70. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/real_estate.yaml +0 -0
  71. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/seoul_bike.yaml +0 -0
  72. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_absences.yaml +0 -0
  73. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_health.yaml +0 -0
  74. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/students_exam_scores.yaml +0 -0
  75. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/uci_student_math.yaml +0 -0
  76. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/wine_quality.yaml +0 -0
  77. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/yacht.yaml +0 -0
  78. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cli.py +0 -0
  79. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/manifest.yaml +0 -0
  80. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/prepare_hashes.json +0 -0
  81. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/registry_v2.1.json +0 -0
  82. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/__init__.py +0 -0
  83. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/abalone.py +0 -0
  84. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/air_quality_uci.py +0 -0
  85. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/assistments.py +0 -0
  86. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/auto_mpg.py +0 -0
  87. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/boston_housing.py +0 -0
  88. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/climate_weather.py +0 -0
  89. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/college_scorecard.py +0 -0
  90. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/colleges_aaup.py +0 -0
  91. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/colleges_usnews.py +0 -0
  92. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/cpu_act.py +0 -0
  93. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/credit_card.py +0 -0
  94. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/cross_domain_batch.py +0 -0
  95. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/customer_churn.py +0 -0
  96. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/electricity.py +0 -0
  97. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/energy_building.py +0 -0
  98. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/energy_efficiency.py +0 -0
  99. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/entrance_exam.py +0 -0
  100. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/external_validation.py +0 -0
  101. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/german_credit.py +0 -0
  102. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/higher_ed.py +0 -0
  103. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/kaggle_students_performance.py +0 -0
  104. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/kdd_cup_2010.py +0 -0
  105. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/law_school.py +0 -0
  106. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/mathe.py +0 -0
  107. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/mm_tba.py +0 -0
  108. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/nursery.py +0 -0
  109. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/oli.py +0 -0
  110. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/olympics.py +0 -0
  111. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/oulad.py +0 -0
  112. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/pisa2015.py +0 -0
  113. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/pollution.py +0 -0
  114. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/real_estate.py +0 -0
  115. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/seoul_bike.py +0 -0
  116. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/student_absences.py +0 -0
  117. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/student_depression.py +0 -0
  118. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/student_dropout.py +0 -0
  119. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/student_health.py +0 -0
  120. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/students_exam_scores.py +0 -0
  121. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/tae.py +0 -0
  122. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/turkiye.py +0 -0
  123. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/uci_student.py +0 -0
  124. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/uci_student_math.py +0 -0
  125. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/wine_quality.py +0 -0
  126. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/xapi_edu.py +0 -0
  127. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/sources/yacht.py +0 -0
  128. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/taxonomy.yaml +0 -0
  129. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/verify.py +0 -0
  130. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/report/__init__.py +0 -0
  131. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/report/json_export.py +0 -0
  132. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/report/latex_export.py +0 -0
  133. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/tests/test_analyzer.py +0 -0
  134. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/tests/test_metrics.py +0 -0
  135. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/tests/test_phase.py +0 -0
  136. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/verification/README.md +0 -0
  137. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/verification/prepare_verify_py313.txt +0 -0
  138. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/verification/prepare_verify_py38.txt +0 -0
  139. {benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/verification/prepare_verify_py38_legacy.txt +0 -0
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/MANIFEST.in RENAMED
@@ -6,8 +6,3 @@
6
6
  # than via package-data.
7
7
  include verification/*.txt
8
8
  include verification/*.md
9
-
10
- # The alternate reference style stays available for reuse of the class file
11
- # even though the manuscript selects sn-nature.
12
- include sn-nature.bst
13
- include sn-mathphys-num.bst
{benchmark_reliability-0.3.2/src/benchmark_reliability.egg-info → benchmark_reliability-0.3.4}/PKG-INFO RENAMED
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: benchmark-reliability
3
- Version: 0.3.2
3
+ Version: 0.3.4
4
4
  Summary: Benchmark Reliability Framework (BRF) - dataset-level reliability auditing with built-in benchmark registry
5
5
  Author-email: zhanglizhuo <zhanglizhuo@gmail.com>
6
6
  License: MIT
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/pyproject.toml RENAMED
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
4
4
 
5
5
  [project]
6
6
  name = "benchmark-reliability"
7
- version = "0.3.2"
7
+ version = "0.3.4"
8
8
  description = "Benchmark Reliability Framework (BRF) - dataset-level reliability auditing with built-in benchmark registry"
9
9
  readme = "README.md"
10
10
  license = { text = "MIT" }
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/setup.py RENAMED
@@ -2,7 +2,7 @@ from setuptools import setup, find_packages
2
2
 
3
3
  setup(
4
4
  name="benchmark-reliability",
5
- version="0.3.0",
5
+ version="0.3.4",
6
6
  packages=find_packages(where="src"),
7
7
  package_dir={"": "src"},
8
8
  package_data={
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4/src/benchmark_reliability.egg-info}/PKG-INFO RENAMED
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: benchmark-reliability
3
- Version: 0.3.2
3
+ Version: 0.3.4
4
4
  Summary: Benchmark Reliability Framework (BRF) - dataset-level reliability auditing with built-in benchmark registry
5
5
  Author-email: zhanglizhuo <zhanglizhuo@gmail.com>
6
6
  License: MIT
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/__init__.py RENAMED
@@ -1,6 +1,6 @@
1
1
  from .analyzer import BRFAnalyzer
2
2
 
3
- __version__ = "0.3.2"
3
+ __version__ = "0.3.4"
4
4
 
5
5
  __all__ = ["BRFAnalyzer", "__version__"]
6
6
 
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/assistments.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: 2009-2010
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (overall accuracy)
14
14
  features:
15
15
  count: 5
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/college_scorecard.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: 2015-2016
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (admission rate)
14
14
  features:
15
15
  count: 30
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/colleges_aaup.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '1995'
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (avg faculty salary)
14
14
  features:
15
15
  count: 9
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/colleges_usnews.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '1995'
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (graduation rate)
14
14
  features:
15
15
  count: 31
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/customer_churn.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: ''
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (churn)
14
14
  features:
15
15
  count: 18
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/electricity.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: ''
10
10
  country: Australia
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (peak/off-peak)
14
14
  features:
15
15
  count: 6
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/entrance_exam.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2021'
10
10
  country: India
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: ordinal 4-class (0-3)
14
14
  features:
15
15
  count: 49
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/german_credit.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: ''
10
10
  country: Germany
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (good/bad credit)
14
14
  features:
15
15
  count: 19
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/higher_ed.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2020'
10
10
  country: Turkey
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (0-7)
14
14
  features:
15
15
  count: 31
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/law_school.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '1991'
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (bar exam pass)
14
14
  features:
15
15
  count: 10
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/mathe.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: 2019-2023
10
10
  country: International (EU)
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (question difficulty)
14
14
  features:
15
15
  count: 26
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/mm_tba.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2025'
10
10
  country: International
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (GPT-4 rubric mean)
14
14
  features:
15
15
  count: 13
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/oli.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2011'
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (first attempt correctness)
14
14
  features:
15
15
  count: 2
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/oulad.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: 2013-2014
10
10
  country: UK
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (pass/fail)
14
14
  features:
15
15
  count: 44
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/pisa2015.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2015'
10
10
  country: International (73)
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (score)
14
14
  features:
15
15
  count: 3
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_depression.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2023'
10
10
  country: India
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (depression yes/no)
14
14
  features:
15
15
  count: 21
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/student_dropout.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2022'
10
10
  country: Portugal
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: binary (Graduate/Dropout)
14
14
  features:
15
15
  count: 36
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/tae.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '1997'
10
10
  country: US
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: ordinal 3-class (Low/Medium/High)
14
14
  features:
15
15
  count: 4
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/turkiye.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2013'
10
10
  country: Turkey
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: ordinal 5-class (difficulty 1-5)
14
14
  features:
15
15
  count: 28
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/uci_student.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2008'
10
10
  country: Portugal
11
11
  task:
12
- type: ''
12
+ type: 'regression'
13
13
  target: continuous (0-20)
14
14
  features:
15
15
  count: 56
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/cards/xapi_edu.yaml RENAMED
@@ -9,7 +9,7 @@ collection:
9
9
  year: '2016'
10
10
  country: International
11
11
  task:
12
- type: ''
12
+ type: 'classification'
13
13
  target: ordinal 3-class (L/M/H)
14
14
  features:
15
15
  count: 72
{benchmark_reliability-0.3.2 → benchmark_reliability-0.3.4}/src/brf/registry/version_policy.yaml RENAMED
@@ -70,5 +70,5 @@ version_policy:
70
70
  - "SHA-256 coverage: 42/51 (82%). The 42 file-backed datasets declare verified checksums; the remaining 9 are scikit-learn-bundled or OpenML-API-sourced (no single raw file to checksum). They are instead pinned at the prepare level in registry/prepare_hashes.json, which covers all 51. (Corrected 2026-09-30: this entry previously said 35/51, a pre-PISA-upgrade figure that no longer matched results/registry_v2.1.json.)"
71
71
  - "DatasetSource modules in cross_domain_batch.py and the individual v2.1 cross-domain modules use compact single-file format; consider splitting for discoverability."
72
72
  - "higher_ed n_features corrected from 31 to 30 (actual UCI data has 30 feature columns). BRF results changed: S=-1.03→-5.25, I=2.00→6.18. Old v1.6 values likely from different UCI data version."
73
- - "mm_tba figshare download requires proxy in China mainland. Direct access returns HTTP 403."
73
+ - "mm_tba is hosted on figshare. Its metadata endpoint returned HTTP 403 when last checked (2026-10-01), so download() needs a reachable network path; a cached extraction is present in the working tree from a 2026-09-12 successful fetch."
74
74
  - "Linnerud (n=20) and TAE (n=151) have very small samples; their split-level R^2 estimates are high-variance, so their BRF metrics (extreme I, E) should be read with that in mind."