learning-commons-evaluators 1.0.0__tar.gz → 1.2.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- learning_commons_evaluators-1.2.0/PKG-INFO +320 -0
- learning_commons_evaluators-1.2.0/README.md +279 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/pyproject.toml +8 -3
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/__init__.py +36 -1
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/output_schema.json +9 -1
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/config.json +25 -6
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/input_schema.json +59 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/system.txt +3 -3
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/config.json +118 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/input_schema.json +49 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/output_schema.json +233 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/system.txt +84 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/ela/graphics_complexity/user.txt +4 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/config.json +66 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/input_schema.json +35 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/output_schema.json +42 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/system.txt +35 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/contracts/_generated/graphics/math/graphics_accuracy/user.txt +3 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/loader.py +26 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/knowledge_graph.py +5 -5
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/errors.py +10 -5
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/__init__.py +14 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/mathematics/math_standards_alignment.py +199 -81
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/base.py +7 -7
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/__init__.py +1 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/ela_writing/__init__.py +1 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/durable_skills/ela_writing/critical_thinking.py +31 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/__init__.py +1 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/ela/__init__.py +1 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/ela/graphics_complexity.py +65 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/math/__init__.py +1 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/graphics/math/graphics_accuracy.py +61 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/inputs.py +243 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/multi_step.py +21 -2
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/registry.py +12 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/single_step.py +511 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/evaluators/source_passages.py +45 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/__init__.py +12 -1
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/features/image_source.py +188 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/preprocessing.py +23 -6
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/__init__.py +6 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/providers/_common.py +118 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/providers/anthropic_sdk.py +201 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/base.py +44 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/google_genai.py +68 -15
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/openai_sdk.py +64 -10
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/retry.py +12 -5
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/mathematics/math_standards_alignment.py +2 -1
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/ela_writing/critical_thinking.py +55 -4
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/__init__.py +2 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/ela/__init__.py +2 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/ela/graphics_complexity.py +141 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/math/__init__.py +2 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/graphics/math/graphics_accuracy.py +42 -0
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators/schemas/outcome.py +115 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/version.py +1 -1
- learning_commons_evaluators-1.2.0/src/learning_commons_evaluators.egg-info/PKG-INFO +320 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/SOURCES.txt +25 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/requires.txt +2 -1
- learning_commons_evaluators-1.0.0/PKG-INFO +0 -353
- learning_commons_evaluators-1.0.0/README.md +0 -313
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/input_schema.json +0 -35
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/evaluators/inputs.py +0 -118
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/evaluators/single_step.py +0 -262
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/providers/_common.py +0 -61
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/providers/anthropic_sdk.py +0 -130
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators/schemas/outcome.py +0 -59
- learning_commons_evaluators-1.0.0/src/learning_commons_evaluators.egg-info/PKG-INFO +0 -353
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/LICENSE +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/setup.cfg +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/config.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/coarse-filter-user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/academic_standards_alignment/mathematics/math_standards_alignment/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/durable_skills/ela_writing/critical_thinking/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_accuracy/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_actionability/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/revision_manageability/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/strength_acknowledgment/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/student_response_specificity/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/tone_appropriateness/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/feedback/ela_writing/withholding_answers/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/background_knowledge_demands/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/grade_level_appropriateness/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/meaning_directness/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/organizational_structure/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/purpose_clarity/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/reference_knowledge_demands/user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/analysis-system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/analysis-user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/complexity-system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/complexity-user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grade-3.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grade-4.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/sentence_structure/rubric-grades-5-12.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/background-knowledge.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/config.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/grades-3-4-system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/grades-3-4-user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/input_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/other-grades-system.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/other-grades-user.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/contracts/_generated/text_complexity/ela_reading/vocabulary_complexity/output_schema.json +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/get_academic_standard_by_case_identifier_uuid.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/academic_standards/search_academic_standards.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/learning_components/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/api/learning_components/list_learning_components_by_academic_standard.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/client.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/errors.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/academic_standard_search_result.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/academic_subject_enum.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/error.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/error_details.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/grade_level_enum.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/jurisdiction_enum.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/language_enum.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/learning_component_summary.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/list_learning_components_by_academic_standard_response_200.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/normalized_statement_type_enum.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/paginated_response.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/paginated_response_data_item.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/pagination.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/standards_framework_item.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/models/standards_framework_item_summary.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/dependencies/_generated/knowledge_graph/types.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/academic_standards_alignment/mathematics/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_accuracy.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_actionability.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/revision_manageability.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/strength_acknowledgment.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/student_response_specificity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/tone_appropriateness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/feedback/ela_writing/withholding_answers.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/background_knowledge_demands.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/grade_level_appropriateness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/meaning_directness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/organizational_structure.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/purpose_clarity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/reference_knowledge_demands.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/sentence_structure.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/evaluators/text_complexity/ela_reading/vocabulary_complexity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/readability.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/features/sentence_features.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/logger.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/prompts/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/prompts/render.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/providers/factory.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/py.typed +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/academic_standards_alignment/mathematics/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/durable_skills/ela_writing/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/evaluator.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_accuracy.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_actionability.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/revision_manageability.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/strength_acknowledgment.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/student_response_specificity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/tone_appropriateness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/feedback/ela_writing/withholding_answers.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/kg_taxonomy.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/metadata.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/background_knowledge_demands.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/grade_level_appropriateness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/meaning_directness.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/organizational_structure.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/purpose_clarity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/reference_knowledge_demands.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/sentence_structure.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/schemas/text_complexity/ela_reading/vocabulary_complexity.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/__init__.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/client.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/run.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/types.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators/telemetry/utils.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/dependency_links.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/src/learning_commons_evaluators.egg-info/top_level.txt +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/tests/test_logger.py +0 -0
- {learning_commons_evaluators-1.0.0 → learning_commons_evaluators-1.2.0}/tests/test_package_imports.py +0 -0
|
@@ -0,0 +1,320 @@
|
|
|
1
|
+
Metadata-Version: 2.4
|
|
2
|
+
Name: learning-commons-evaluators
|
|
3
|
+
Version: 1.2.0
|
|
4
|
+
Summary: Python SDK for Learning Commons educational evaluators
|
|
5
|
+
Author: Learning Commons
|
|
6
|
+
License: MIT
|
|
7
|
+
Project-URL: Homepage, https://github.com/learning-commons-org/evaluators
|
|
8
|
+
Project-URL: Repository, https://github.com/learning-commons-org/evaluators/tree/main/sdks/python
|
|
9
|
+
Project-URL: Documentation, https://docs.learningcommons.org/evaluators
|
|
10
|
+
Project-URL: Bug Tracker, https://github.com/learning-commons-org/evaluators/issues
|
|
11
|
+
Keywords: education,evaluators,literacy,text-complexity
|
|
12
|
+
Classifier: Development Status :: 3 - Alpha
|
|
13
|
+
Classifier: Intended Audience :: Developers
|
|
14
|
+
Classifier: License :: OSI Approved :: MIT License
|
|
15
|
+
Classifier: Programming Language :: Python :: 3
|
|
16
|
+
Classifier: Programming Language :: Python :: 3.11
|
|
17
|
+
Classifier: Programming Language :: Python :: 3.12
|
|
18
|
+
Classifier: Programming Language :: Python :: 3.13
|
|
19
|
+
Classifier: Programming Language :: Python :: 3.14
|
|
20
|
+
Classifier: Topic :: Education
|
|
21
|
+
Requires-Python: >=3.11
|
|
22
|
+
Description-Content-Type: text/markdown
|
|
23
|
+
License-File: LICENSE
|
|
24
|
+
Requires-Dist: pydantic<3,>=2.0.0
|
|
25
|
+
Requires-Dist: textstat<1,>=0.7.0
|
|
26
|
+
Requires-Dist: openai<4,>=2.47.0
|
|
27
|
+
Requires-Dist: anthropic<2,>=1.0.0
|
|
28
|
+
Requires-Dist: google-genai<3,>=1.39.0
|
|
29
|
+
Requires-Dist: httpx<1,>=0.27.0
|
|
30
|
+
Requires-Dist: pillow<14,>=10.1.0
|
|
31
|
+
Requires-Dist: attrs>=23.2.0
|
|
32
|
+
Provides-Extra: dev
|
|
33
|
+
Requires-Dist: pytest>=7.0.0; extra == "dev"
|
|
34
|
+
Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
|
|
35
|
+
Requires-Dist: pytest-cov>=5.0.0; extra == "dev"
|
|
36
|
+
Requires-Dist: ruff>=0.9.0; extra == "dev"
|
|
37
|
+
Requires-Dist: mypy>=1.14.0; extra == "dev"
|
|
38
|
+
Requires-Dist: openapi-python-client==0.29.1; extra == "dev"
|
|
39
|
+
Requires-Dist: ruamel.yaml<1,>=0.18; extra == "dev"
|
|
40
|
+
Dynamic: license-file
|
|
41
|
+
|
|
42
|
+
# learning-commons-evaluators
|
|
43
|
+
|
|
44
|
+
[](https://pypi.org/project/learning-commons-evaluators/)
|
|
45
|
+
|
|
46
|
+
Python SDK for [Learning Commons evaluators](https://docs.learningcommons.org/evaluators/understanding-evaluators/introduction).
|
|
47
|
+
|
|
48
|
+
## Supported evaluators
|
|
49
|
+
|
|
50
|
+
| Evaluator family | Evaluator |
|
|
51
|
+
| :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
52
|
+
| [**Text Complexity evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/text-complexity/) - [Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/introduction) | Grade Level Appropriateness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/grade-level-appropriateness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/grade-level-appropriateness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/grade-level-appropriateness)</li></ul> |
|
|
53
|
+
| | Background Knowledge Demands<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/background-knowledge-demands/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/background-knowledge-demands/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/background-knowledge-demands)</li></ul> |
|
|
54
|
+
| | Vocabulary Complexity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/vocabulary-complexity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/vocabulary-complexity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/vocabulary-complexity)</li></ul> |
|
|
55
|
+
| | Sentence Structure<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/sentence-structure/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/sentence-structure/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/sentence-structure)</li></ul> |
|
|
56
|
+
| | Meaning Directness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/meaning-directness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/meaning-directness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/meaning-directness)</li></ul> |
|
|
57
|
+
| | Purpose Clarity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/purpose-clarity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/purpose-clarity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/purpose-clarity)</li></ul> |
|
|
58
|
+
| | Organizational Structure<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/organizational-structure/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/organizational-structure/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/organizational-structure)</li></ul> |
|
|
59
|
+
| | Reference Knowledge Demands<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/reference-knowledge-demands/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/text-complexity/ela-reading/reference-knowledge-demands/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/text-complexity-evaluators/reference-knowledge-demands)</li></ul> |
|
|
60
|
+
| [**Graphics evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/graphics/) - [Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/introduction) | Graphics Complexity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/ela/graphics-complexity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/ela/graphics-complexity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/graphics-complexity)</li></ul> |
|
|
61
|
+
| | Graphics Accuracy<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/math/graphics-accuracy/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/graphics/math/graphics-accuracy/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/graphics-evaluators/graphics-accuracy)</li></ul> |
|
|
62
|
+
| [**Feedback evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/feedback/) - [Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/introduction) | Strength Acknowledgment<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/strength-acknowledgment/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/strength-acknowledgment/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/strength-acknowledgment)</li></ul> |
|
|
63
|
+
| | Revision Actionability<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-actionability/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-actionability/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-actionability)</li></ul> |
|
|
64
|
+
| | Student Response Specificity<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/student-response-specificity/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/student-response-specificity/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/student-response-specificity)</li></ul> |
|
|
65
|
+
| | Revision Accuracy<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-accuracy/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-accuracy/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-accuracy)</li></ul> |
|
|
66
|
+
| | Revision Manageability<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-manageability/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/revision-manageability/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/revision-manageability)</li></ul> |
|
|
67
|
+
| | Withholding Answers<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/withholding-answers/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/withholding-answers/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/withholding-answers)</li></ul> |
|
|
68
|
+
| | Tone Appropriateness<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/tone-appropriateness/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/feedback/ela-writing/tone-appropriateness/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/feedback-evaluators/tone-appropriateness)</li></ul> |
|
|
69
|
+
| [**Academic Standards evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/academic-standards-alignment/) - [Docs](https://docs.learningcommons.org/evaluators/academic-standards-evaluators/introduction) | Math Standards Alignment<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/academic-standards-alignment/mathematics/math-standards-alignment/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/academic-standards-alignment/mathematics/math-standards-alignment/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/academic-standards-evaluators/math-standards-alignment)</li></ul> |
|
|
70
|
+
| [**Durable Skills evaluators**](https://github.com/learning-commons-org/evaluators/tree/main/evals/durable-skills/) - [Docs](https://docs.learningcommons.org/evaluators/durable-skills-evaluators/introduction) | Critical Thinking<ul><li>[Input schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/durable-skills/ela-writing/critical-thinking/input_schema.json)</li><li>[Output schema](https://github.com/learning-commons-org/evaluators/blob/main/evals/durable-skills/ela-writing/critical-thinking/output_schema.json)</li><li>[Docs](https://docs.learningcommons.org/evaluators/durable-skills-evaluators/critical-thinking)</li></ul> |
|
|
71
|
+
|
|
72
|
+
## Dependencies
|
|
73
|
+
|
|
74
|
+
- Python 3.11+
|
|
75
|
+
- The provider clients ship with the package (`openai`, `anthropic`, `google-genai`), along with `pydantic`, `httpx`, `pillow`, and `textstat`.
|
|
76
|
+
- Credentials are constructor arguments. The SDK reads no provider keys from the environment, so a shell `GOOGLE_API_KEY` leaves `google_api_key` unset. A missing key raises `ConfigurationError` at construction, before any I/O.
|
|
77
|
+
|
|
78
|
+
## Installation
|
|
79
|
+
|
|
80
|
+
Install the SDK:
|
|
81
|
+
|
|
82
|
+
```bash
|
|
83
|
+
pip install learning-commons-evaluators
|
|
84
|
+
```
|
|
85
|
+
|
|
86
|
+
Pass the key each evaluator's default provider requires ([which keys](https://docs.learningcommons.org/evaluators/getting-started/quickstart#required-api-keys)):
|
|
87
|
+
|
|
88
|
+
```python
|
|
89
|
+
GradeLevelAppropriatenessEvaluator(google_api_key="...") # Google
|
|
90
|
+
SentenceStructureEvaluator(openai_api_key="...") # OpenAI
|
|
91
|
+
CriticalThinkingEvaluator(anthropic_api_key="...") # Anthropic
|
|
92
|
+
VocabularyComplexityEvaluator(openai_api_key="...", google_api_key="...")
|
|
93
|
+
MathStandardsAlignmentEvaluator(
|
|
94
|
+
anthropic_api_key="...",
|
|
95
|
+
learning_commons_api_key="...", # Knowledge Graph
|
|
96
|
+
)
|
|
97
|
+
```
|
|
98
|
+
|
|
99
|
+
## Quickstart
|
|
100
|
+
|
|
101
|
+
```python
|
|
102
|
+
from learning_commons_evaluators import GradeLevelAppropriatenessEvaluator
|
|
103
|
+
|
|
104
|
+
# Configure evaluator
|
|
105
|
+
evaluator = GradeLevelAppropriatenessEvaluator(google_api_key="...")
|
|
106
|
+
|
|
107
|
+
# Run an evaluation
|
|
108
|
+
evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
|
|
109
|
+
|
|
110
|
+
# Print evaluation results
|
|
111
|
+
print(evaluation.result.grade_band) # a CCSS band, e.g. "2-3"
|
|
112
|
+
print(evaluation.result.alternative_grade_band) # the band reachable with scaffolding
|
|
113
|
+
print(evaluation.result.scaffolding_needed) # what that band would need
|
|
114
|
+
print(evaluation.metadata.model) # "google:gemini-3.6-flash"
|
|
115
|
+
```
|
|
116
|
+
|
|
117
|
+
`await evaluator.evaluate(...)` is the same call from async code. `evaluate_sync` runs it to completion with `asyncio.run`, so call it from synchronous code. Inside a running event loop, await `evaluate`.
|
|
118
|
+
|
|
119
|
+
## Methods
|
|
120
|
+
|
|
121
|
+
The package provides the following:
|
|
122
|
+
|
|
123
|
+
- [Discovery](#discovery)
|
|
124
|
+
- [Evaluation](#evaluation)
|
|
125
|
+
- [Outcomes](#outcomes)
|
|
126
|
+
- [Standards](#standards)
|
|
127
|
+
- [Text features](#text-features)
|
|
128
|
+
|
|
129
|
+
Import them from `learning_commons_evaluators`. The text-feature helpers live in `learning_commons_evaluators.features`.
|
|
130
|
+
|
|
131
|
+
### Discovery
|
|
132
|
+
|
|
133
|
+
```python
|
|
134
|
+
from learning_commons_evaluators import get_evaluators, get_evaluator
|
|
135
|
+
|
|
136
|
+
get_evaluators()
|
|
137
|
+
# tuple[EvaluatorMetadata, ...] — every evaluator, in taxonomy order
|
|
138
|
+
|
|
139
|
+
get_evaluator("text_complexity.ela_reading.vocabulary_complexity")
|
|
140
|
+
# EvaluatorMetadata | None — current and historical ids both resolve
|
|
141
|
+
|
|
142
|
+
get_evaluator("grade-level-appropriateness").id
|
|
143
|
+
# "text_complexity.ela_reading.grade_level_appropriateness"
|
|
144
|
+
```
|
|
145
|
+
|
|
146
|
+
`EvaluatorMetadata` carries `id`, `stable_id`, `id_history`, `name`, `description`, `supported_grades`, `default_providers`, `required_credentials`, and an `outcome` block naming which result fields hold the verdict and its rationale (`None` when the evaluator declares no single verdict). `required_credentials` lists only non-LLM services: `("learning_commons_api_key",)` for math standards alignment and `()` for the other eighteen. Provider keys follow `default_providers`, so `(Provider.GOOGLE,)` means supply `google_api_key`.
|
|
147
|
+
|
|
148
|
+
### Evaluation
|
|
149
|
+
|
|
150
|
+
Every evaluator class exposes `.evaluate(...)` and `.evaluate_sync(...)` (see [Supported evaluators](#supported-evaluators) for each evaluator's input and output).
|
|
151
|
+
|
|
152
|
+
Pass the contract's fields as keywords, or pass the evaluator's input model. Passing both raises `TypeError`.
|
|
153
|
+
|
|
154
|
+
```python
|
|
155
|
+
import asyncio
|
|
156
|
+
from learning_commons_evaluators import GradeLevelAppropriatenessEvaluator
|
|
157
|
+
|
|
158
|
+
evaluator = GradeLevelAppropriatenessEvaluator(google_api_key="...")
|
|
159
|
+
|
|
160
|
+
# Sync
|
|
161
|
+
evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
|
|
162
|
+
print(evaluation.result.grade_band)
|
|
163
|
+
|
|
164
|
+
# Async
|
|
165
|
+
async def main() -> None:
|
|
166
|
+
evaluation = await evaluator.evaluate(text="The cat's out of the bag now.")
|
|
167
|
+
print(evaluation.result.grade_band)
|
|
168
|
+
|
|
169
|
+
if __name__ == "__main__":
|
|
170
|
+
asyncio.run(main())
|
|
171
|
+
```
|
|
172
|
+
|
|
173
|
+
| Evaluator family | Evaluator | Typical input |
|
|
174
|
+
| ------------------ | ------------------------------------- | ---------------------------------------------------- |
|
|
175
|
+
| Text Complexity | `GradeLevelAppropriatenessEvaluator` | `{ text }` |
|
|
176
|
+
| | `BackgroundKnowledgeDemandsEvaluator` | `{ text, grade_level }` |
|
|
177
|
+
| | `VocabularyComplexityEvaluator` | `{ text, grade_level }` |
|
|
178
|
+
| | `SentenceStructureEvaluator` | `{ text, grade_level }` |
|
|
179
|
+
| | `MeaningDirectnessEvaluator` | `{ text, grade_level }` |
|
|
180
|
+
| | `PurposeClarityEvaluator` | `{ text, grade_level }` |
|
|
181
|
+
| | `OrganizationalStructureEvaluator` | `{ text, grade_level }` |
|
|
182
|
+
| | `ReferenceKnowledgeDemandsEvaluator` | `{ text, grade_level }` |
|
|
183
|
+
| Graphics | `GraphicsComplexityEvaluator` | `{ text, grade_level, image_paths, figure_labels? }` |
|
|
184
|
+
| | `GraphicsAccuracyEvaluator` | `{ image_paths, claim }` |
|
|
185
|
+
| Feedback | `StrengthAcknowledgmentEvaluator` | `{ student_text, feedback_text }` |
|
|
186
|
+
| | `RevisionActionabilityEvaluator` | `{ student_text, feedback_text }` |
|
|
187
|
+
| | `StudentResponseSpecificityEvaluator` | `{ student_text, feedback_text }` |
|
|
188
|
+
| | `RevisionAccuracyEvaluator` | `{ student_text, feedback_text }` |
|
|
189
|
+
| | `RevisionManageabilityEvaluator` | `{ student_text, feedback_text }` |
|
|
190
|
+
| | `WithholdingAnswersEvaluator` | `{ student_text, feedback_text }` |
|
|
191
|
+
| | `ToneAppropriatenessEvaluator` | `{ student_text, feedback_text }` |
|
|
192
|
+
| Academic Standards | `MathStandardsAlignmentEvaluator` | `{ question, case_identifier_uuid }` |
|
|
193
|
+
| Durable Skills | `CriticalThinkingEvaluator` | `{ assignment_text, source_passages, essay_text }` |
|
|
194
|
+
|
|
195
|
+
Every call returns an `EvaluationResult`: `evaluator` (the registry id), `result` (that evaluator's output model, keys unchanged), and `metadata` (`model`, `processing_time_ms`, `token_usage`). `metadata.model` is `"provider:model"`, joined with `+` when several models ran. An evaluator whose contract declares several steps sums token usage across them.
|
|
196
|
+
|
|
197
|
+
`grade_level` on the text-complexity and graphics-complexity evaluators is an `int` (`3`–`12`). Vocabulary Complexity takes a different model branch for grades 3–4 than for 5–12, and construction validates the union of keys those branches need, so it requires both `openai_api_key` and `google_api_key` at every grade.
|
|
198
|
+
|
|
199
|
+
Each graphics path is a local file, read in your process. The SDK checks format, size, and edge limits before any model call. A file outside those limits raises `InputValidationError`. For a question with its expected answer, build the claim with `compose_graphics_accuracy_claim(question, answer)`, which produces the text the evaluator was measured with:
|
|
200
|
+
|
|
201
|
+
```python
|
|
202
|
+
from learning_commons_evaluators import (
|
|
203
|
+
GraphicsAccuracyEvaluator,
|
|
204
|
+
compose_graphics_accuracy_claim,
|
|
205
|
+
)
|
|
206
|
+
|
|
207
|
+
evaluation = GraphicsAccuracyEvaluator(google_api_key="...").evaluate_sync(
|
|
208
|
+
image_paths=["figures/apples-in-baskets.png"],
|
|
209
|
+
claim=compose_graphics_accuracy_claim("How many apples are there altogether?", "12"),
|
|
210
|
+
)
|
|
211
|
+
print(evaluation.result.is_correct, evaluation.result.basis)
|
|
212
|
+
```
|
|
213
|
+
|
|
214
|
+
`source_passages` is a list of `{title?, author?, text}` in the order the student received them. The first item is Source 1. A passage may omit `title` and `author`.
|
|
215
|
+
|
|
216
|
+
The Math Standards Alignment evaluator also exposes `.evaluate_by_code()`. `evaluate` / `evaluate_sync` take the CASE Network UUID. `evaluate_by_code` is async: it resolves a statement code, then runs the same evaluation.
|
|
217
|
+
|
|
218
|
+
```python
|
|
219
|
+
import asyncio
|
|
220
|
+
|
|
221
|
+
from learning_commons_evaluators import Jurisdiction, MathStandardsAlignmentEvaluator
|
|
222
|
+
|
|
223
|
+
math = MathStandardsAlignmentEvaluator(
|
|
224
|
+
anthropic_api_key="...",
|
|
225
|
+
learning_commons_api_key="...",
|
|
226
|
+
)
|
|
227
|
+
|
|
228
|
+
# UUID: evaluate_sync wraps evaluate()
|
|
229
|
+
math.evaluate_sync(
|
|
230
|
+
question="…",
|
|
231
|
+
case_identifier_uuid="6ba25656-d7cc-11e8-824f-0242ac160002",
|
|
232
|
+
)
|
|
233
|
+
|
|
234
|
+
# Statement code, as that jurisdiction spells it
|
|
235
|
+
asyncio.run(
|
|
236
|
+
math.evaluate_by_code(
|
|
237
|
+
question="…",
|
|
238
|
+
statement_code="3.MD.C.7.d",
|
|
239
|
+
jurisdiction=Jurisdiction.MULTI_STATE, # optional; Multi-State is Common Core
|
|
240
|
+
grade_level="3", # optional; see below
|
|
241
|
+
)
|
|
242
|
+
)
|
|
243
|
+
```
|
|
244
|
+
|
|
245
|
+
Spell the code the way its jurisdiction spells it. A code is a lookup key: Ohio writes `3.MD.7` where Common Core writes `3.MD.C.7`. A Common Core code with `jurisdiction=Jurisdiction.OHIO` raises `StandardNotFoundError`. `grade_level` (`"K"` through `"12"`) is consulted only when one code matches several standards. With no grade, the first copy that has learning components is evaluated. A grade that matches no copy raises `InputValidationError`. `result.statement_code` is the Knowledge Graph's own spelling of the copy that was judged, and `result.case_identifier_uuid` names it. The contract declares no single score, so `read_outcome(...).score` is `None`.
|
|
246
|
+
|
|
247
|
+
### Outcomes
|
|
248
|
+
|
|
249
|
+
```python
|
|
250
|
+
from learning_commons_evaluators import get_evaluator, read_outcome
|
|
251
|
+
|
|
252
|
+
evaluation = evaluator.evaluate_sync(text="The cat's out of the bag now.")
|
|
253
|
+
declared = get_evaluator(evaluation.evaluator)
|
|
254
|
+
outcome = read_outcome(evaluation, declared.outcome if declared else None)
|
|
255
|
+
print(outcome.score) # the verdict, as one comparable string
|
|
256
|
+
print(outcome.reasoning)
|
|
257
|
+
```
|
|
258
|
+
|
|
259
|
+
`read_outcome` picks the verdict and rationale named by the evaluator's declared `outcome` block.
|
|
260
|
+
|
|
261
|
+
`score` is a string when the field is present. A boolean verdict is `"true"` or `"false"` (Graphics Accuracy). A feedback `quality_score` of `0` or `1` is `"0"` or `"1"`. `"0"` is truthy, so compare explicitly (`score == "1"`), or read the numeric field from `evaluation.result` directly. `score` is `None` when the evaluator has no declared outcome or the payload is missing that field — a reporting gap. Math Standards Alignment is that case.
|
|
262
|
+
|
|
263
|
+
### Standards
|
|
264
|
+
|
|
265
|
+
```python
|
|
266
|
+
from learning_commons_evaluators import (
|
|
267
|
+
Jurisdiction,
|
|
268
|
+
KnowledgeGraphClient,
|
|
269
|
+
normalize_statement_code,
|
|
270
|
+
)
|
|
271
|
+
|
|
272
|
+
normalize_statement_code(" 5.nbt.a.1 ") # "5.NBT.A.1"
|
|
273
|
+
|
|
274
|
+
async with KnowledgeGraphClient(api_key) as kg:
|
|
275
|
+
matches = await kg.search_standards("5.NBT.A.1", jurisdiction=Jurisdiction.MULTI_STATE)
|
|
276
|
+
standard = await kg.get_academic_standard(matches[0].case_identifier_uuid)
|
|
277
|
+
components = await kg.get_learning_components(matches[0].case_identifier_uuid)
|
|
278
|
+
component_set = await kg.get_learning_component_set(matches[0].case_identifier_uuid)
|
|
279
|
+
```
|
|
280
|
+
|
|
281
|
+
| Method | Returns | Raises |
|
|
282
|
+
| -------------------------------------------------- | ---------------------------------------------------------------------------- | ----------------------------------------------------------------------- |
|
|
283
|
+
| `search_standards(statement_code, ...)` | every match, best first (`StandardMatch`) | `InputValidationError`, `StandardNotFoundError`, Knowledge Graph errors |
|
|
284
|
+
| `get_academic_standard(case_identifier_uuid)` | one `AcademicStandard` | `InputValidationError`, Knowledge Graph errors |
|
|
285
|
+
| `get_learning_components(case_identifier_uuid)` | evaluable `LearningComponent`s (descriptions present) | `InputValidationError`, `KnowledgeGraphError` |
|
|
286
|
+
| `get_learning_component_set(case_identifier_uuid)` | those components plus `undescribed_count` for components with no description | `InputValidationError`, `KnowledgeGraphError` |
|
|
287
|
+
|
|
288
|
+
`search_standards` defaults to `Jurisdiction.MULTI_STATE` (Common Core). Pass `jurisdiction` or `academic_subject` to override that. More than one match means the code is reused across courses or frameworks.
|
|
289
|
+
|
|
290
|
+
The client owns an HTTP connection pool, so close it (`async with`, or `await kg.aclose()`). It is bound to the event loop that first uses it. Keep one client inside one `asyncio.run`. Evaluators open and close the clients they need for each evaluation, so one evaluator can be reused across `evaluate_sync` calls.
|
|
291
|
+
|
|
292
|
+
### Text features
|
|
293
|
+
|
|
294
|
+
These power sentence-structure preprocessing. They are deterministic and do not call a model. Counts come from `textstat`, which is the library the sentence-structure contract binds for Python.
|
|
295
|
+
|
|
296
|
+
```python
|
|
297
|
+
from learning_commons_evaluators.features import (
|
|
298
|
+
add_engineered_features,
|
|
299
|
+
features_to_json,
|
|
300
|
+
readability_counts,
|
|
301
|
+
)
|
|
302
|
+
|
|
303
|
+
readability_counts(text) # ReadabilityCounts: counts and flesch_kincaid_grade
|
|
304
|
+
add_engineered_features(analysis) # sentence analysis → features
|
|
305
|
+
features_to_json(features) # JSON string for a prompt
|
|
306
|
+
```
|
|
307
|
+
|
|
308
|
+
## More resources
|
|
309
|
+
|
|
310
|
+
[Check out the docs](https://docs.learningcommons.org/evaluators/sdk-api-reference/overview) for more implementation details:
|
|
311
|
+
|
|
312
|
+
- [Configuration](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/configuration), including model overrides, logging, and telemetry
|
|
313
|
+
- [Inputs and output schemas](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/evaluation) for all [Supported evaluators](#supported-evaluators)
|
|
314
|
+
- Read a feedback evaluator's criterion keys with `list(ToneAppropriatenessOutput.model_fields["key_features"].annotation.model_fields)`
|
|
315
|
+
- [Error handling](https://docs.learningcommons.org/evaluators/sdk-api-reference/python/error-handling) — the same hierarchy is written up in [docs/error-handling.md](https://github.com/learning-commons-org/evaluators/blob/main/sdks/python/docs/error-handling.md)
|
|
316
|
+
- [Local development](https://github.com/learning-commons-org/evaluators/blob/main/sdks/python/docs/local-development.md)
|
|
317
|
+
|
|
318
|
+
## License
|
|
319
|
+
|
|
320
|
+
MIT
|