learning-commons-evaluators 1.0.0__tar.gz → 1.2.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (254) hide show
  1. learning_commons_evaluators-1.2.0/PKG-INFO +320 -0
  2. learning_commons_evaluators-1.2.0/README.md +279 -0
  3. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/pyproject.toml +8 -3
  4. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/__init__.py +36 -1
  5. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/output_schema.json +9 -1
  6. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/config.json +25 -6
  7. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/input_schema.json +59 -0
  8. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/system.txt +3 -3
  9. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/config.json +118 -0
  10. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/input_schema.json +49 -0
  11. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/output_schema.json +233 -0
  12. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/system.txt +84 -0
  13. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/user.txt +4 -0
  14. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/config.json +66 -0
  15. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/input_schema.json +35 -0
  16. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/output_schema.json +42 -0
  17. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/system.txt +35 -0
  18. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/user.txt +3 -0
  19. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/loader.py +26 -0
  20. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/knowledge_graph.py +5 -5
  21. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/errors.py +10 -5
  22. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/__init__.py +14 -0
  23. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/mathematics/math_standards_alignment.py +199 -81
  24. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/base.py +7 -7
  25. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/__init__.py +1 -0
  26. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/ela_writing/__init__.py +1 -0
  27. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/ela_writing/critical_thinking.py +31 -0
  28. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/__init__.py +1 -0
  29. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/ela/__init__.py +1 -0
  30. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/ela/graphics_complexity.py +65 -0
  31. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/math/__init__.py +1 -0
  32. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/math/graphics_accuracy.py +61 -0
  33. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/inputs.py +243 -0
  34. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/multi_step.py +21 -2
  35. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/registry.py +12 -0
  36. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/single_step.py +511 -0
  37. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/source_passages.py +45 -0
  38. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/__init__.py +12 -1
  39. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/features/image_source.py +188 -0
  40. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/preprocessing.py +23 -6
  41. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/__init__.py +6 -0
  42. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/providers/_common.py +118 -0
  43. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/providers/anthropic_sdk.py +201 -0
  44. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/base.py +44 -0
  45. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/google_genai.py +68 -15
  46. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/openai_sdk.py +64 -10
  47. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/retry.py +12 -5
  48. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/mathematics/math_standards_alignment.py +2 -1
  49. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/ela_writing/critical_thinking.py +55 -4
  50. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/__init__.py +2 -0
  51. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/ela/__init__.py +2 -0
  52. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/ela/graphics_complexity.py +141 -0
  53. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/math/__init__.py +2 -0
  54. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/math/graphics_accuracy.py +42 -0
  55. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/outcome.py +115 -0
  56. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/version.py +1 -1
  57. learning_commons_evaluators-1.2.0/src/learning_commons_evaluators.egg-info/PKG-INFO +320 -0
  58. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/SOURCES.txt +25 -0
  59. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/requires.txt +2 -1
  60. learning_commons_evaluators-1.0.0/PKG-INFO +0 -353
  61. learning_commons_evaluators-1.0.0/README.md +0 -313
  62. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/input_schema.json +0 -35
  63. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/evaluators/inputs.py +0 -118
  64. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/evaluators/single_step.py +0 -262
  65. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/providers/_common.py +0 -61
  66. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/providers/anthropic_sdk.py +0 -130
  67. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/schemas/outcome.py +0 -59
  68. learning_commons_evaluators-1.0.0/src/learning_commons_evaluators.egg-info/PKG-INFO +0 -353
  69. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/LICENSE +0 -0
  70. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/setup.cfg +0 -0
  71. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/config.py +0 -0
  72. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/__init__.py +0 -0
  73. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/coarse-filter-user.txt +0 -0
  74. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/config.json +0 -0
  75. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/input_schema.json +0 -0
  76. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/system.txt +0 -0
  77. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/user.txt +0 -0
  78. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/output_schema.json +0 -0
  79. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/user.txt +0 -0
  80. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/config.json +0 -0
  81. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/input_schema.json +0 -0
  82. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/output_schema.json +0 -0
  83. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/system.txt +0 -0
  84. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/user.txt +0 -0
  85. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/config.json +0 -0
  86. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/input_schema.json +0 -0
  87. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/output_schema.json +0 -0
  88. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/system.txt +0 -0
  89. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/user.txt +0 -0
  90. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/config.json +0 -0
  91. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/input_schema.json +0 -0
  92. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/output_schema.json +0 -0
  93. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/system.txt +0 -0
  94. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/user.txt +0 -0
  95. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/config.json +0 -0
  96. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/input_schema.json +0 -0
  97. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/output_schema.json +0 -0
  98. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/system.txt +0 -0
  99. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/user.txt +0 -0
  100. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/config.json +0 -0
  101. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/input_schema.json +0 -0
  102. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/output_schema.json +0 -0
  103. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/system.txt +0 -0
  104. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/user.txt +0 -0
  105. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/config.json +0 -0
  106. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/input_schema.json +0 -0
  107. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/output_schema.json +0 -0
  108. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/system.txt +0 -0
  109. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/user.txt +0 -0
  110. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/config.json +0 -0
  111. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/input_schema.json +0 -0
  112. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/output_schema.json +0 -0
  113. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/system.txt +0 -0
  114. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/user.txt +0 -0
  115. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/config.json +0 -0
  116. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/input_schema.json +0 -0
  117. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/output_schema.json +0 -0
  118. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/system.txt +0 -0
  119. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/user.txt +0 -0
  120. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/config.json +0 -0
  121. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/input_schema.json +0 -0
  122. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/output_schema.json +0 -0
  123. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/system.txt +0 -0
  124. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/user.txt +0 -0
  125. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/config.json +0 -0
  126. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/input_schema.json +0 -0
  127. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/output_schema.json +0 -0
  128. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/system.txt +0 -0
  129. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/user.txt +0 -0
  130. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/config.json +0 -0
  131. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/input_schema.json +0 -0
  132. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/output_schema.json +0 -0
  133. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/system.txt +0 -0
  134. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/user.txt +0 -0
  135. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/config.json +0 -0
  136. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/input_schema.json +0 -0
  137. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/output_schema.json +0 -0
  138. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/system.txt +0 -0
  139. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/user.txt +0 -0
  140. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/config.json +0 -0
  141. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/input_schema.json +0 -0
  142. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/output_schema.json +0 -0
  143. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/system.txt +0 -0
  144. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/user.txt +0 -0
  145. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/analysis-system.txt +0 -0
  146. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/analysis-user.txt +0 -0
  147. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/complexity-system.txt +0 -0
  148. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/complexity-user.txt +0 -0
  149. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/config.json +0 -0
  150. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/input_schema.json +0 -0
  151. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/output_schema.json +0 -0
  152. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grade-3.txt +0 -0
  153. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grade-4.txt +0 -0
  154. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grades-5-12.txt +0 -0
  155. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/background-knowledge.txt +0 -0
  156. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/config.json +0 -0
  157. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/grades-3-4-system.txt +0 -0
  158. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/grades-3-4-user.txt +0 -0
  159. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/input_schema.json +0 -0
  160. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/other-grades-system.txt +0 -0
  161. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/other-grades-user.txt +0 -0
  162. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/output_schema.json +0 -0
  163. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/__init__.py +0 -0
  164. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/__init__.py +0 -0
  165. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/__init__.py +0 -0
  166. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/__init__.py +0 -0
  167. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/__init__.py +0 -0
  168. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/get_academic_standard_by_case_identifier_uuid.py +0 -0
  169. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/search_academic_standards.py +0 -0
  170. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/learning_components/__init__.py +0 -0
  171. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/learning_components/list_learning_components_by_academic_standard.py +0 -0
  172. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/client.py +0 -0
  173. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/errors.py +0 -0
  174. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/__init__.py +0 -0
  175. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/academic_standard_search_result.py +0 -0
  176. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/academic_subject_enum.py +0 -0
  177. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/error.py +0 -0
  178. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/error_details.py +0 -0
  179. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/grade_level_enum.py +0 -0
  180. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/jurisdiction_enum.py +0 -0
  181. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/language_enum.py +0 -0
  182. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/learning_component_summary.py +0 -0
  183. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/list_learning_components_by_academic_standard_response_200.py +0 -0
  184. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/normalized_statement_type_enum.py +0 -0
  185. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/paginated_response.py +0 -0
  186. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/paginated_response_data_item.py +0 -0
  187. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/pagination.py +0 -0
  188. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/standards_framework_item.py +0 -0
  189. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/standards_framework_item_summary.py +0 -0
  190. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/types.py +0 -0
  191. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/__init__.py +0 -0
  192. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/mathematics/__init__.py +0 -0
  193. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/__init__.py +0 -0
  194. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/__init__.py +0 -0
  195. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_accuracy.py +0 -0
  196. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_actionability.py +0 -0
  197. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_manageability.py +0 -0
  198. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/strength_acknowledgment.py +0 -0
  199. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/student_response_specificity.py +0 -0
  200. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/tone_appropriateness.py +0 -0
  201. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/withholding_answers.py +0 -0
  202. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/__init__.py +0 -0
  203. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/__init__.py +0 -0
  204. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/background_knowledge_demands.py +0 -0
  205. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/grade_level_appropriateness.py +0 -0
  206. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/meaning_directness.py +0 -0
  207. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/organizational_structure.py +0 -0
  208. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/purpose_clarity.py +0 -0
  209. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/reference_knowledge_demands.py +0 -0
  210. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/sentence_structure.py +0 -0
  211. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/vocabulary_complexity.py +0 -0
  212. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/readability.py +0 -0
  213. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/sentence_features.py +0 -0
  214. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/logger.py +0 -0
  215. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/prompts/__init__.py +0 -0
  216. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/prompts/render.py +0 -0
  217. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/factory.py +0 -0
  218. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/py.typed +0 -0
  219. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/__init__.py +0 -0
  220. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/__init__.py +0 -0
  221. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/mathematics/__init__.py +0 -0
  222. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/__init__.py +0 -0
  223. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/ela_writing/__init__.py +0 -0
  224. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/evaluator.py +0 -0
  225. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/__init__.py +0 -0
  226. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/__init__.py +0 -0
  227. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_accuracy.py +0 -0
  228. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_actionability.py +0 -0
  229. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_manageability.py +0 -0
  230. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/strength_acknowledgment.py +0 -0
  231. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/student_response_specificity.py +0 -0
  232. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/tone_appropriateness.py +0 -0
  233. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/withholding_answers.py +0 -0
  234. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/kg_taxonomy.py +0 -0
  235. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/metadata.py +0 -0
  236. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/__init__.py +0 -0
  237. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/__init__.py +0 -0
  238. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/background_knowledge_demands.py +0 -0
  239. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/grade_level_appropriateness.py +0 -0
  240. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/meaning_directness.py +0 -0
  241. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/organizational_structure.py +0 -0
  242. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/purpose_clarity.py +0 -0
  243. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/reference_knowledge_demands.py +0 -0
  244. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/sentence_structure.py +0 -0
  245. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/vocabulary_complexity.py +0 -0
  246. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/__init__.py +0 -0
  247. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/client.py +0 -0
  248. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/run.py +0 -0
  249. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/types.py +0 -0
  250. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/utils.py +0 -0
  251. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/dependency_links.txt +0 -0
  252. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/top_level.txt +0 -0
  253. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/tests/test_logger.py +0 -0
  254. {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/tests/test_package_imports.py +0 -0
@@ -0,0 +1,320 @@
1
+ Metadata-Version: 2.4
2
+ Name: learning-commons-evaluators
3
+ Version: 1.2.0
4
+ Summary: Python SDK for Learning Commons educational evaluators
5
+ Author: Learning Commons
6
+ License: MIT
7
+ Project-URL: Homepage, https://github.com/learning-commons-org/evaluators
8
+ Project-URL: Repository, https://github.com/learning-commons-org/evaluators/tree/main/sdks/python
9
+ Project-URL: Documentation, https://docs.learningcommons.org/evaluators
10
+ Project-URL: Bug Tracker, https://github.com/learning-commons-org/evaluators/issues
11
+ Keywords: education,evaluators,literacy,text-complexity
12
+ Classifier: Development Status :: 3 - Alpha
13
+ Classifier: Intended Audience :: Developers
14
+ Classifier: License :: OSI Approved :: MIT License
15
+ Classifier: Programming Language :: Python :: 3
16
+ Classifier: Programming Language :: Python :: 3.11
17
+ Classifier: Programming Language :: Python :: 3.12
18
+ Classifier: Programming Language :: Python :: 3.13
19
+ Classifier: Programming Language :: Python :: 3.14
20
+ Classifier: Topic :: Education
21
+ Requires-Python: >=3.11
22
+ Description-Content-Type: text/markdown
23
+ License-File: LICENSE
24
+ Requires-Dist: pydantic<3,>=2.0.0
25
+ Requires-Dist: textstat<1,>=0.7.0
26
+ Requires-Dist: openai<4,>=2.47.0
27
+ Requires-Dist: anthropic<2,>=1.0.0
28
+ Requires-Dist: google-genai<3,>=1.39.0
29
+ Requires-Dist: httpx<1,>=0.27.0
30
+ Requires-Dist: pillow<14,>=10.1.0
31
+ Requires-Dist: attrs>=23.2.0
32
+ Provides-Extra: dev
33
+ Requires-Dist: pytest>=7.0.0; extra == "dev"
34
+ Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
35
+ Requires-Dist: pytest-cov>=5.0.0; extra == "dev"
36
+ Requires-Dist: ruff>=0.9.0; extra == "dev"
37
+ Requires-Dist: mypy>=1.14.0; extra == "dev"
38
+ Requires-Dist: openapi-python-client==0.29.1; extra == "dev"
39
+ Requires-Dist: ruamel.yaml<1,>=0.18; extra == "dev"
40
+ Dynamic: license-file
41
+
42
+ # learning-commons-evaluators
43
+
44
+ [![PyPI version](https://img.shields.io/pypi/v/learning-commons-evaluators)](https://pypi.org/project/learning-commons-evaluators/)
45
+
46
+ Python SDK for [Learning Commons evaluators](https://docs.learningcommons.org/evaluators/understanding-evaluators/introduction).
47
+
48
+ ## Supported evaluators
49
+
50
+ | Evaluator family | Evaluator |
51
+ | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
52
+ | [**Text Complexity evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/text-complexity/) - [Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/introduction) | Grade Level Appropriateness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/grade-level-appropriateness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/grade-level-appropriateness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/grade-level-appropriateness)</li></ul> |
53
+ | | Background Knowledge Demands<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/background-knowledge-demands/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/background-knowledge-demands/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/background-knowledge-demands)</li></ul> |
54
+ | | Vocabulary Complexity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/vocabulary-complexity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/vocabulary-complexity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/vocabulary-complexity)</li></ul> |
55
+ | | Sentence Structure<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/sentence-structure/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/sentence-structure/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/sentence-structure)</li></ul> |
56
+ | | Meaning Directness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/meaning-directness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/meaning-directness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/meaning-directness)</li></ul> |
57
+ | | Purpose Clarity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/purpose-clarity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/purpose-clarity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/purpose-clarity)</li></ul> |
58
+ | | Organizational Structure<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/organizational-structure/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/organizational-structure/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/organizational-structure)</li></ul> |
59
+ | | Reference Knowledge Demands<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/reference-knowledge-demands/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/reference-knowledge-demands/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/reference-knowledge-demands)</li></ul> |
60
+ | [**Graphics evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/graphics/) - [Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/introduction) | Graphics Complexity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/ela/graphics-complexity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/ela/graphics-complexity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/graphics-complexity)</li></ul> |
61
+ | | Graphics Accuracy<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/math/graphics-accuracy/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/math/graphics-accuracy/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/graphics-accuracy)</li></ul> |
62
+ | [**Feedback evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/feedback/) - [Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/introduction) | Strength Acknowledgment<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/strength-acknowledgment/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/strength-acknowledgment/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/strength-acknowledgment)</li></ul> |
63
+ | | Revision Actionability<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-actionability/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-actionability/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-actionability)</li></ul> |
64
+ | | Student Response Specificity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/student-response-specificity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/student-response-specificity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/student-response-specificity)</li></ul> |
65
+ | | Revision Accuracy<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-accuracy/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-accuracy/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-accuracy)</li></ul> |
66
+ | | Revision Manageability<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-manageability/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-manageability/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-manageability)</li></ul> |
67
+ | | Withholding Answers<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/withholding-answers/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/withholding-answers/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/withholding-answers)</li></ul> |
68
+ | | Tone Appropriateness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/tone-appropriateness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/tone-appropriateness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/tone-appropriateness)</li></ul> |
69
+ | [**Academic Standards evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/academic-standards-alignment/) - [Docs](https://docs.learningcommons.org/evaluators/academic-standards-evaluators/introduction) | Math Standards Alignment<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/academic-standards-alignment/mathematics/math-standards-alignment/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/academic-standards-alignment/mathematics/math-standards-alignment/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/academic-standards-evaluators/math-standards-alignment)</li></ul> |
70
+ | [**Durable Skills evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/durable-skills/) - [Docs](https://docs.learningcommons.org/evaluators/durable-skills-evaluators/introduction) | Critical Thinking<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/durable-skills/ela-writing/critical-thinking/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/durable-skills/ela-writing/critical-thinking/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/durable-skills-evaluators/critical-thinking)</li></ul> |
71
+
72
+ ## Dependencies
73
+
74
+ - Python 3.11+
75
+ - The provider clients ship with the package (`openai`, `anthropic`, `google-genai`), along with `pydantic`, `httpx`, `pillow`, and `textstat`.
76
+ - Credentials are constructor arguments. The SDK reads no provider keys from the environment, so a shell `GOOGLE_API_KEY` leaves `google_api_key` unset. A missing key raises `ConfigurationError` at construction, before any I/O.
77
+
78
+ ## Installation
79
+
80
+ Install the SDK:
81
+
82
+ ```bash
83
+ pip install learning-commons-evaluators
84
+ ```
85
+
86
+ Pass the key each evaluator's default provider requires ([which keys](https://docs.learningcommons.org/evaluators/getting-started/quickstart#required-api-keys)):
87
+
88
+ ```python
89
+ GradeLevelAppropriatenessEvaluator(google_api_key="...") # Google
90
+ SentenceStructureEvaluator(openai_api_key="...") # OpenAI
91
+ CriticalThinkingEvaluator(anthropic_api_key="...") # Anthropic
92
+ VocabularyComplexityEvaluator(openai_api_key="...", google_api_key="...")
93
+ MathStandardsAlignmentEvaluator(
94
+ anthropic_api_key="...",
95
+ learning_commons_api_key="...", # Knowledge Graph
96
+ )
97
+ ```
98
+
99
+ ## Quickstart
100
+
101
+ ```python
102
+ from learning_commons_evaluators import GradeLevelAppropriatenessEvaluator
103
+
104
+ # Configure evaluator
105
+ evaluator = GradeLevelAppropriatenessEvaluator(google_api_key="...")
106
+
107
+ # Run an evaluation
108
+ evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
109
+
110
+ # Print evaluation results
111
+ print(evaluation.result.grade_band) # a CCSS band, e.g. "2-3"
112
+ print(evaluation.result.alternative_grade_band) # the band reachable with scaffolding
113
+ print(evaluation.result.scaffolding_needed) # what that band would need
114
+ print(evaluation.metadata.model) # "google:gemini-3.6-flash"
115
+ ```
116
+
117
+ `await evaluator.evaluate(...)` is the same call from async code. `evaluate_sync` runs it to completion with `asyncio.run`, so call it from synchronous code. Inside a running event loop, await `evaluate`.
118
+
119
+ ## Methods
120
+
121
+ The package provides the following:
122
+
123
+ - [Discovery](#discovery)
124
+ - [Evaluation](#evaluation)
125
+ - [Outcomes](#outcomes)
126
+ - [Standards](#standards)
127
+ - [Text features](#text-features)
128
+
129
+ Import them from `learning_commons_evaluators`. The text-feature helpers live in `learning_commons_evaluators.features`.
130
+
131
+ ### Discovery
132
+
133
+ ```python
134
+ from learning_commons_evaluators import get_evaluators, get_evaluator
135
+
136
+ get_evaluators()
137
+ # tuple[EvaluatorMetadata, ...] — every evaluator, in taxonomy order
138
+
139
+ get_evaluator("text_complexity.ela_reading.vocabulary_complexity")
140
+ # EvaluatorMetadata | None — current and historical ids both resolve
141
+
142
+ get_evaluator("grade-level-appropriateness").id
143
+ # "text_complexity.ela_reading.grade_level_appropriateness"
144
+ ```
145
+
146
+ `EvaluatorMetadata` carries `id`, `stable_id`, `id_history`, `name`, `description`, `supported_grades`, `default_providers`, `required_credentials`, and an `outcome` block naming which result fields hold the verdict and its rationale (`None` when the evaluator declares no single verdict). `required_credentials` lists only non-LLM services: `("learning_commons_api_key",)` for math standards alignment and `()` for the other eighteen. Provider keys follow `default_providers`, so `(Provider.GOOGLE,)` means supply `google_api_key`.
147
+
148
+ ### Evaluation
149
+
150
+ Every evaluator class exposes `.evaluate(...)` and `.evaluate_sync(...)` (see [Supported evaluators](#supported-evaluators) for each evaluator's input and output).
151
+
152
+ Pass the contract's fields as keywords, or pass the evaluator's input model. Passing both raises `TypeError`.
153
+
154
+ ```python
155
+ import asyncio
156
+ from learning_commons_evaluators import GradeLevelAppropriatenessEvaluator
157
+
158
+ evaluator = GradeLevelAppropriatenessEvaluator(google_api_key="...")
159
+
160
+ # Sync
161
+ evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
162
+ print(evaluation.result.grade_band)
163
+
164
+ # Async
165
+ async def main() -> None:
166
+ evaluation = await evaluator.evaluate(text="The cat's out of the bag now.")
167
+ print(evaluation.result.grade_band)
168
+
169
+ if __name__ == "__main__":
170
+ asyncio.run(main())
171
+ ```
172
+
173
+ | Evaluator family | Evaluator | Typical input |
174
+ | ------------------ | ------------------------------------- | ---------------------------------------------------- |
175
+ | Text Complexity | `GradeLevelAppropriatenessEvaluator` | `{ text }` |
176
+ | | `BackgroundKnowledgeDemandsEvaluator` | `{ text, grade_level }` |
177
+ | | `VocabularyComplexityEvaluator` | `{ text, grade_level }` |
178
+ | | `SentenceStructureEvaluator` | `{ text, grade_level }` |
179
+ | | `MeaningDirectnessEvaluator` | `{ text, grade_level }` |
180
+ | | `PurposeClarityEvaluator` | `{ text, grade_level }` |
181
+ | | `OrganizationalStructureEvaluator` | `{ text, grade_level }` |
182
+ | | `ReferenceKnowledgeDemandsEvaluator` | `{ text, grade_level }` |
183
+ | Graphics | `GraphicsComplexityEvaluator` | `{ text, grade_level, image_paths, figure_labels? }` |
184
+ | | `GraphicsAccuracyEvaluator` | `{ image_paths, claim }` |
185
+ | Feedback | `StrengthAcknowledgmentEvaluator` | `{ student_text, feedback_text }` |
186
+ | | `RevisionActionabilityEvaluator` | `{ student_text, feedback_text }` |
187
+ | | `StudentResponseSpecificityEvaluator` | `{ student_text, feedback_text }` |
188
+ | | `RevisionAccuracyEvaluator` | `{ student_text, feedback_text }` |
189
+ | | `RevisionManageabilityEvaluator` | `{ student_text, feedback_text }` |
190
+ | | `WithholdingAnswersEvaluator` | `{ student_text, feedback_text }` |
191
+ | | `ToneAppropriatenessEvaluator` | `{ student_text, feedback_text }` |
192
+ | Academic Standards | `MathStandardsAlignmentEvaluator` | `{ question, case_identifier_uuid }` |
193
+ | Durable Skills | `CriticalThinkingEvaluator` | `{ assignment_text, source_passages, essay_text }` |
194
+
195
+ Every call returns an `EvaluationResult`: `evaluator` (the registry id), `result` (that evaluator's output model, keys unchanged), and `metadata` (`model`, `processing_time_ms`, `token_usage`). `metadata.model` is `"provider:model"`, joined with `+` when several models ran. An evaluator whose contract declares several steps sums token usage across them.
196
+
197
+ `grade_level` on the text-complexity and graphics-complexity evaluators is an `int` (`3`–`12`). Vocabulary Complexity takes a different model branch for grades 3–4 than for 5–12, and construction validates the union of keys those branches need, so it requires both `openai_api_key` and `google_api_key` at every grade.
198
+
199
+ Each graphics path is a local file, read in your process. The SDK checks format, size, and edge limits before any model call. A file outside those limits raises `InputValidationError`. For a question with its expected answer, build the claim with `compose_graphics_accuracy_claim(question, answer)`, which produces the text the evaluator was measured with:
200
+
201
+ ```python
202
+ from learning_commons_evaluators import (
203
+ GraphicsAccuracyEvaluator,
204
+ compose_graphics_accuracy_claim,
205
+ )
206
+
207
+ evaluation = GraphicsAccuracyEvaluator(google_api_key="...").evaluate_sync(
208
+ image_paths=["figures/apples-in-baskets.png"],
209
+ claim=compose_graphics_accuracy_claim("How many apples are there altogether?", "12"),
210
+ )
211
+ print(evaluation.result.is_correct, evaluation.result.basis)
212
+ ```
213
+
214
+ `source_passages` is a list of `{title?, author?, text}` in the order the student received them. The first item is Source 1. A passage may omit `title` and `author`.
215
+
216
+ The Math Standards Alignment evaluator also exposes `.evaluate_by_code()`. `evaluate` / `evaluate_sync` take the CASE Network UUID. `evaluate_by_code` is async: it resolves a statement code, then runs the same evaluation.
217
+
218
+ ```python
219
+ import asyncio
220
+
221
+ from learning_commons_evaluators import Jurisdiction, MathStandardsAlignmentEvaluator
222
+
223
+ math = MathStandardsAlignmentEvaluator(
224
+ anthropic_api_key="...",
225
+ learning_commons_api_key="...",
226
+ )
227
+
228
+ # UUID: evaluate_sync wraps evaluate()
229
+ math.evaluate_sync(
230
+ question="…",
231
+ case_identifier_uuid="6ba25656-d7cc-11e8-824f-0242ac160002",
232
+ )
233
+
234
+ # Statement code, as that jurisdiction spells it
235
+ asyncio.run(
236
+ math.evaluate_by_code(
237
+ question="…",
238
+ statement_code="3.MD.C.7.d",
239
+ jurisdiction=Jurisdiction.MULTI_STATE, # optional; Multi-State is Common Core
240
+ grade_level="3", # optional; see below
241
+ )
242
+ )
243
+ ```
244
+
245
+ Spell the code the way its jurisdiction spells it. A code is a lookup key: Ohio writes `3.MD.7` where Common Core writes `3.MD.C.7`. A Common Core code with `jurisdiction=Jurisdiction.OHIO` raises `StandardNotFoundError`. `grade_level` (`"K"` through `"12"`) is consulted only when one code matches several standards. With no grade, the first copy that has learning components is evaluated. A grade that matches no copy raises `InputValidationError`. `result.statement_code` is the Knowledge Graph's own spelling of the copy that was judged, and `result.case_identifier_uuid` names it. The contract declares no single score, so `read_outcome(...).score` is `None`.
246
+
247
+ ### Outcomes
248
+
249
+ ```python
250
+ from learning_commons_evaluators import get_evaluator, read_outcome
251
+
252
+ evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
253
+ declared = get_evaluator(evaluation.evaluator)
254
+ outcome = read_outcome(evaluation, declared.outcome if declared else None)
255
+ print(outcome.score) # the verdict, as one comparable string
256
+ print(outcome.reasoning)
257
+ ```
258
+
259
+ `read_outcome` picks the verdict and rationale named by the evaluator's declared `outcome` block.
260
+
261
+ `score` is a string when the field is present. A boolean verdict is `"true"` or `"false"` (Graphics Accuracy). A feedback `quality_score` of `0` or `1` is `"0"` or `"1"`. `"0"` is truthy, so compare explicitly (`score == "1"`), or read the numeric field from `evaluation.result` directly. `score` is `None` when the evaluator has no declared outcome or the payload is missing that field — a reporting gap. Math Standards Alignment is that case.
262
+
263
+ ### Standards
264
+
265
+ ```python
266
+ from learning_commons_evaluators import (
267
+ Jurisdiction,
268
+ KnowledgeGraphClient,
269
+ normalize_statement_code,
270
+ )
271
+
272
+ normalize_statement_code(" 5.nbt.a.1 ") # "5.NBT.A.1"
273
+
274
+ async with KnowledgeGraphClient(api_key) as kg:
275
+ matches = await kg.search_standards("5.NBT.A.1", jurisdiction=Jurisdiction.MULTI_STATE)
276
+ standard = await kg.get_academic_standard(matches[0].case_identifier_uuid)
277
+ components = await kg.get_learning_components(matches[0].case_identifier_uuid)
278
+ component_set = await kg.get_learning_component_set(matches[0].case_identifier_uuid)
279
+ ```
280
+
281
+ | Method | Returns | Raises |
282
+ | -------------------------------------------------- | ---------------------------------------------------------------------------- | ----------------------------------------------------------------------- |
283
+ | `search_standards(statement_code, ...)` | every match, best first (`StandardMatch`) | `InputValidationError`, `StandardNotFoundError`, Knowledge Graph errors |
284
+ | `get_academic_standard(case_identifier_uuid)` | one `AcademicStandard` | `InputValidationError`, Knowledge Graph errors |
285
+ | `get_learning_components(case_identifier_uuid)` | evaluable `LearningComponent`s (descriptions present) | `InputValidationError`, `KnowledgeGraphError` |
286
+ | `get_learning_component_set(case_identifier_uuid)` | those components plus `undescribed_count` for components with no description | `InputValidationError`, `KnowledgeGraphError` |
287
+
288
+ `search_standards` defaults to `Jurisdiction.MULTI_STATE` (Common Core). Pass `jurisdiction` or `academic_subject` to override that. More than one match means the code is reused across courses or frameworks.
289
+
290
+ The client owns an HTTP connection pool, so close it (`async with`, or `await kg.aclose()`). It is bound to the event loop that first uses it. Keep one client inside one `asyncio.run`. Evaluators open and close the clients they need for each evaluation, so one evaluator can be reused across `evaluate_sync` calls.
291
+
292
+ ### Text features
293
+
294
+ These power sentence-structure preprocessing. They are deterministic and do not call a model. Counts come from `textstat`, which is the library the sentence-structure contract binds for Python.
295
+
296
+ ```python
297
+ from learning_commons_evaluators.features import (
298
+ add_engineered_features,
299
+ features_to_json,
300
+ readability_counts,
301
+ )
302
+
303
+ readability_counts(text) # ReadabilityCounts: counts and flesch_kincaid_grade
304
+ add_engineered_features(analysis) # sentence analysis → features
305
+ features_to_json(features) # JSON string for a prompt
306
+ ```
307
+
308
+ ## More resources
309
+
310
+ [Check out the docs](https://docs.learningcommons.org/evaluators/sdk-api-reference/overview) for more implementation details:
311
+
312
+ - [Configuration](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/configuration), including model overrides, logging, and telemetry
313
+ - [Inputs and output schemas](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/evaluation) for all [Supported evaluators](#supported-evaluators)
314
+ - Read a feedback evaluator's criterion keys with `list(ToneAppropriatenessOutput.model_fields["key_features"].annotation.model_fields)`
315
+ - [Error handling](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/error-handling) — the same hierarchy is written up in [docs/error-handling.md](https://github.com/learning-commons-org/evaluators/blob/main/sdks/python/docs/error-handling.md)
316
+ - [Local development](https://github.com/learning-commons-org/evaluators/blob/main/sdks/python/docs/local-development.md)
317
+
318
+ ## License
319
+
320
+ MIT