schemathesis 3.39.11__tar.gz → 3.39.13__tar.gz

{schemathesis-3.39.11 → schemathesis-3.39.13}/.readthedocs.yml

@@ -4,6 +4,9 @@ build:
   tools:
     python: "3.11"
 
+sphinx:
+  configuration: docs/conf.py
+
 python:
   install:
     - method: pip

{schemathesis-3.39.11 → schemathesis-3.39.13}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: schemathesis
-Version: 3.39.11
+Version: 3.39.13
 Summary: Property-based testing framework for Open API and GraphQL based apps
 Project-URL: Documentation, https://schemathesis.readthedocs.io/en/stable/
 Project-URL: Changelog, https://schemathesis.readthedocs.io/en/stable/changelog.html
@@ -213,7 +213,7 @@ api-tests:
         schema: "https://example.schemathesis.io/openapi.json"
 ```
 
-For more details, check out our [GitHub Action](https://github.com/schemathesis/action) repository or see our [GitHub Tutorial](https://docs.schemathesis.io/tutorials/github).
+For more details, check out our [GitHub Action](https://github.com/schemathesis/action) repository.
 
 ## Who's Using Schemathesis?
 

{schemathesis-3.39.11 → schemathesis-3.39.13}/README.md

@@ -113,7 +113,7 @@ api-tests:
         schema: "https://example.schemathesis.io/openapi.json"
 ```
 
-For more details, check out our [GitHub Action](https://github.com/schemathesis/action) repository or see our [GitHub Tutorial](https://docs.schemathesis.io/tutorials/github).
+For more details, check out our [GitHub Action](https://github.com/schemathesis/action) repository.
 
 ## Who's Using Schemathesis?
 

{schemathesis-3.39.11 → schemathesis-3.39.13}/docs/api.rst

@@ -87,16 +87,6 @@ Targeted testing
    :members:
 .. autofunction:: schemathesis.target
 
-Custom strategies for Open API "format" keyword
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-.. autofunction:: schemathesis.openapi.format
-
-Custom strategies for Open API media types
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-.. autofunction:: schemathesis.openapi.media_type
-
 Custom scalars for GraphQL
 ~~~~~~~~~~~~~~~~~~~~~~~~~~
 

{schemathesis-3.39.11 → schemathesis-3.39.13}/docs/changelog.rst

@@ -1,9 +1,31 @@
 Changelog
 =========
 
-:version:`Unreleased <v3.39.11...HEAD>` - TBD
+:version:`Unreleased <v3.39.13...HEAD>` - TBD
 ---------------------------------------------
 
+.. _v3.39.13:
+
+:version:`3.39.13 <v3.39.12...v3.39.13>` - 2025-03-09
+-----------------------------------------------------
+
+**Documentation**
+
+- Fix documentation build.
+
+.. _v3.39.12:
+
+:version:`3.39.12 <v3.39.11...v3.39.12>` - 2025-03-05
+-----------------------------------------------------
+
+**Added**
+
+- `--experimental-coverage-unspecified-methods` CLI option that accept a comma separated list of HTTP methods to use when generating test cases with methods not specified in the API during the **coverage** phase.
+
+**Fixed**
+
+- Incorrect quantifiers merging for patterns involving single-element set of characters like ``[+]``.
+
 .. _v3.39.11:
 
 :version:`3.39.11 <v3.39.10...v3.39.11>` - 2025-02-23

{schemathesis-3.39.11 → schemathesis-3.39.13}/docs/continuous_integration.rst

@@ -6,10 +6,6 @@ This guide outlines how to set up Schemathesis for automated API testing in your
 GitHub Actions
 --------------
 
-.. note::
-
-    💡 See our `GitHub Tutorial <https://docs.schemathesis.io/tutorials/github>`_ for a step-by-step guidance.
-
 For initial setup in a GitHub Actions workflow:
 
 .. code-block:: yaml
@@ -20,13 +16,6 @@ For initial setup in a GitHub Actions workflow:
       - uses: schemathesis/action@v1
         with:
           schema: 'http://127.0.0.1:5000/api/openapi.json'
-          # Optional, for PR comments
-          token: ${{ secrets.SCHEMATHESIS_TOKEN }}
-
-To get test results as comments in your GitHub pull requests, both the ``token`` and the `GitHub app`_ are required.
-Obtain the token by signing up on `Schemathesis.io <https://app.schemathesis.io/auth/sign-up/?utm_source=oss_docs&utm_content=ci>`_.
-
-.. image:: https://raw.githubusercontent.com/schemathesis/schemathesis/master/img/service_github_report.png
 
 To add headers like ``Authorization``:
 
@@ -81,8 +70,6 @@ In most cases, you'll want to set up your app in the CI environment. Here's a Gi
       - uses: schemathesis/action@v1
         with:
           schema: 'http://127.0.0.1:5000/api/openapi.json'
-          # Optional, for PR comments
-          token: ${{ secrets.SCHEMATHESIS_TOKEN }}
 
 API Schema in a File
 --------------------
@@ -120,4 +107,3 @@ You can configure Schemathesis behavior using the following environment variable
 - **SCHEMATHESIS_REPORT**: Enable or disable reporting. Valid values: ``true``, ``false``
 
 .. _Python app: https://github.com/schemathesis/schemathesis/tree/master/example
-.. _GitHub app: https://github.com/apps/schemathesis

{schemathesis-3.39.11 → schemathesis-3.39.13}/docs/getting-started.rst

@@ -58,10 +58,6 @@ GitHub Integration
 GitHub Actions
 ^^^^^^^^^^^^^^
 
-.. note::
-
-    💡 See our `GitHub Tutorial <https://docs.schemathesis.io/tutorials/github>`_ for a step-by-step guidance.
-
 Run Schemathesis tests as a part of your CI/CD pipeline. Add this YAML configuration to your GitHub Actions:
 
 .. code-block:: yaml
@@ -72,22 +68,6 @@ Run Schemathesis tests as a part of your CI/CD pipeline. Add this YAML configura
        - uses: schemathesis/action@v1
          with:
            schema: "https://example.schemathesis.io/openapi.json"
-           # OPTIONAL. Add Schemathesis.io token for pull request reports
-           token: ${{ secrets.SCHEMATHESIS_TOKEN }}
 
 For more details, check out our `GitHub Action <https://github.com/schemathesis/action>`_ repository.
 
-GitHub App
-^^^^^^^^^^
-
-Receive automatic comments in your pull requests and updates on GitHub checks status. Requires usage of our `SaaS platform <https://app.schemathesis.io/auth/sign-up/?utm_source=oss_docs&utm_content=index_note>`_.
-
-1. Install the `GitHub app <https://github.com/apps/schemathesis>`_.
-2. Enable in your repository settings.
-
-.. image:: https://raw.githubusercontent.com/schemathesis/schemathesis/master/img/service_github_report.png
-
-Service
--------
-
-If you prefer an all-in-one solution with quick setup, we have a `free tier <https://schemathesis.io/#pricing>`_ available.

{schemathesis-3.39.11 → schemathesis-3.39.13}/docs/index.rst

@@ -85,7 +85,6 @@ It generally follows the operational workflow of Schemathesis, detailing steps f
    python
    continuous_integration
    experimental
-   service
    auth
    contrib
    stateful

{schemathesis-3.39.11 → schemathesis-3.39.13}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "schemathesis"
-version = "3.39.11"
+version = "3.39.13"
 description = "Property-based testing framework for Open API and GraphQL based apps"
 keywords = ["pytest", "hypothesis", "openapi", "graphql", "testing"]
 authors = [{ name = "Dmitry Dygalo", email = "dmitry@dygalo.dev" }]

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/_hypothesis.py

@@ -114,8 +114,14 @@ def create_test(
                 wrapped_test, operation, hook_dispatcher=hook_dispatcher, as_strategy_kwargs=as_strategy_kwargs
             )
             if COVERAGE_PHASE.is_enabled:
+                unexpected_methods = generation_config.unexpected_methods if generation_config else None
                 wrapped_test = add_coverage(
-                    wrapped_test, operation, data_generation_methods, auth_storage, as_strategy_kwargs
+                    wrapped_test,
+                    operation,
+                    data_generation_methods,
+                    auth_storage,
+                    as_strategy_kwargs,
+                    unexpected_methods,
                 )
     return wrapped_test
 
@@ -225,6 +231,7 @@ def add_coverage(
     data_generation_methods: list[DataGenerationMethod],
     auth_storage: AuthStorage | None,
     as_strategy_kwargs: dict[str, Any],
+    unexpected_methods: set[str] | None = None,
 ) -> Callable:
     from schemathesis.specs.openapi.constants import LOCATION_TO_CONTAINER
 
@@ -237,7 +244,7 @@ def add_coverage(
         for container in LOCATION_TO_CONTAINER.values()
         if container in as_strategy_kwargs
     }
-    for case in _iter_coverage_cases(operation, data_generation_methods):
+    for case in _iter_coverage_cases(operation, data_generation_methods, unexpected_methods):
         if case.media_type and get_first_matching_media_type(case.media_type) is None:
             continue
         adjust_urlencoded_payload(case)
@@ -363,7 +370,9 @@ def _stringify_value(val: Any, container_name: str) -> Any:
 
 
 def _iter_coverage_cases(
-    operation: APIOperation, data_generation_methods: list[DataGenerationMethod]
+    operation: APIOperation,
+    data_generation_methods: list[DataGenerationMethod],
+    unexpected_methods: set[str] | None = None,
 ) -> Generator[Case, None, None]:
     from .specs.openapi.constants import LOCATION_TO_CONTAINER
     from .specs.openapi.examples import find_in_responses, find_matching_in_responses
@@ -373,6 +382,8 @@ def _iter_coverage_cases(
     serializers = get_serializers_for_operation(operation)
     template = Template(serializers)
     responses = find_in_responses(operation)
+    # NOTE: The HEAD method is excluded
+    unexpected_methods = unexpected_methods or {"get", "put", "post", "delete", "options", "patch", "trace"}
     for parameter in operation.iter_parameters():
         location = parameter.location
         name = parameter.name
@@ -448,8 +459,7 @@ def _iter_coverage_cases(
             yield case
     if DataGenerationMethod.negative in data_generation_methods:
         # Generate HTTP methods that are not specified in the spec
-        # NOTE: The HEAD method is excluded
-        methods = {"get", "put", "post", "delete", "options", "patch", "trace"} - set(operation.schema[operation.path])
+        methods = unexpected_methods - set(operation.schema[operation.path])
         for method in sorted(methods):
             data = template.unmodified()
             case = operation.make_case(**data.kwargs)

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/cli/__init__.py

@@ -9,7 +9,7 @@ from collections import defaultdict
 from dataclasses import dataclass
 from enum import Enum
 from queue import Queue
-from typing import TYPE_CHECKING, Any, Callable, Generator, Iterable, Literal, NoReturn, Sequence, Type, cast
+from typing import TYPE_CHECKING, Any, Callable, Generator, Iterable, Literal, NoReturn, Sequence, cast
 from urllib.parse import urlparse
 
 import click
@@ -27,6 +27,7 @@ from ..constants import (
     DEFAULT_STATEFUL_RECURSION_LIMIT,
     EXTENSIONS_DOCUMENTATION_URL,
     HOOKS_MODULE_ENV_VAR,
+    HTTP_METHODS,
     HYPOTHESIS_IN_MEMORY_DATABASE_IDENTIFIER,
     ISSUE_TRACKER_URL,
     WAIT_FOR_SCHEMA_ENV_VAR,
@@ -323,6 +324,16 @@ REPORT_TO_SERVICE = ReportToService()
     multiple=True,
     metavar="",
 )
+@grouped_option(
+    "--experimental-coverage-unexpected-methods",
+    "coverage_unexpected_methods",
+    help="HTTP methods to use when generating test cases with methods not specified in the API during the coverage phase.",
+    type=CsvChoice(sorted(HTTP_METHODS), case_sensitive=False),
+    callback=callbacks.convert_http_methods,
+    metavar="",
+    default=None,
+    envvar="SCHEMATHESIS_EXPERIMENTAL_COVERAGE_UNEXPECTED_METHODS",
+)
 @grouped_option(
     "--experimental-no-failfast",
     "no_failfast",
@@ -874,6 +885,7 @@ def run(
     set_path: dict[str, str],
     experiments: list,
     no_failfast: bool,
+    coverage_unexpected_methods: set[str] | None,
     missing_required_header_allowed_statuses: list[str],
     positive_data_acceptance_allowed_statuses: list[str],
     negative_data_rejection_allowed_statuses: list[str],
@@ -1000,6 +1012,7 @@ def run(
         graphql_allow_null=generation_graphql_allow_null,
         codec=generation_codec,
         with_security_parameters=generation_with_security_parameters,
+        unexpected_methods=coverage_unexpected_methods,
     )
 
     report: ReportToService | click.utils.LazyFile | None

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/cli/callbacks.py

@@ -344,6 +344,14 @@ def convert_checks(ctx: click.core.Context, param: click.core.Parameter, value:
     return reduce(operator.iadd, value, [])
 
 
+def convert_http_methods(
+    ctx: click.core.Context, param: click.core.Parameter, value: list[str] | None
+) -> set[str] | None:
+    if value is None:
+        return value
+    return {item.lower() for item in value}
+
+
 def convert_status_codes(
     ctx: click.core.Context, param: click.core.Parameter, value: list[str] | None
 ) -> list[str] | None:

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/cli/options.py

@@ -26,7 +26,12 @@ class CustomHelpMessageChoice(click.Choice):
 class BaseCsvChoice(click.Choice):
     def parse_value(self, value: str) -> tuple[list[str], set[str]]:
         selected = [item for item in value.split(",") if item]
-        invalid_options = set(selected) - set(self.choices)
+        if not self.case_sensitive:
+            invalid_options = {
+                item for item in selected if item.upper() not in {choice.upper() for choice in self.choices}
+            }
+        else:
+            invalid_options = set(selected) - set(self.choices)
         return selected, invalid_options
 
     def fail_on_invalid_options(self, invalid_options: set[str], selected: list[str]) -> NoReturn:

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/generation/__init__.py

@@ -50,3 +50,4 @@ class GenerationConfig:
     with_security_parameters: bool = True
     # Header generation configuration
     headers: HeaderConfig = field(default_factory=HeaderConfig)
+    unexpected_methods: set[str] | None = None

{schemathesis-3.39.11 → schemathesis-3.39.13}/src/schemathesis/specs/openapi/patterns.py

@@ -124,6 +124,21 @@ def _handle_anchored_pattern(parsed: list, pattern: str, min_length: int | None,
 
     for op, value in pattern_parts:
         if op == LITERAL:
+            # Check if the literal comes from a bracketed expression,
+            # e.g. Python regex parses "[+]" as a single LITERAL token.
+            if pattern[current_position] == "[":
+                # Find the matching closing bracket.
+                end_idx = current_position + 1
+                while end_idx < len(pattern):
+                    # Check for an unescaped closing bracket.
+                    if pattern[end_idx] == "]" and (end_idx == current_position + 1 or pattern[end_idx - 1] != "\\"):
+                        end_idx += 1
+                        break
+                    end_idx += 1
+                # Append the entire character set.
+                result += pattern[current_position:end_idx]
+                current_position = end_idx
+                continue
             if pattern[current_position] == "\\":
                 # Escaped value
                 current_position += 2

{schemathesis-3.39.11 → schemathesis-3.39.13}/test/cli/__snapshots__/test_commands/test_run_output[args24].raw

@@ -24,6 +24,13 @@ Experimental options:
                                             schema-analysis, stateful-test-
                                             runner, stateful-only, coverage-
                                             phase, positive_data_acceptance]
+  --experimental-coverage-unexpected-methods 
+                                            HTTP methods to use when generating
+                                            test cases with methods not
+                                            specified in the API during the
+                                            coverage phase. [possible values:
+                                            delete, get, head, options, patch,
+                                            post, put, trace]
   --experimental-no-failfast                Continue testing an API operation
                                             after a failure is found
   --experimental-missing-required-header-allowed-statuses 

{schemathesis-3.39.11 → schemathesis-3.39.13}/test/coverage/test_phase.py

@@ -9,6 +9,7 @@ from schemathesis import experimental
 from schemathesis._hypothesis import create_test
 from schemathesis.constants import NOT_SET
 from schemathesis.experimental import COVERAGE_PHASE
+from schemathesis.generation import GenerationConfig
 from schemathesis.generation._methods import DataGenerationMethod
 from schemathesis.models import TestPhase
 from schemathesis.specs.openapi.constants import LOCATION_TO_CONTAINER
@@ -1367,6 +1368,20 @@ def test_unspecified_http_methods(ctx, cli, openapi3_base_url, snapshot_cli):
 
     assert methods == {"PATCH", "TRACE", "DELETE", "OPTIONS", "PUT"}
 
+    methods = set()
+
+    test_func = create_test(
+        operation=operation,
+        test=test,
+        generation_config=GenerationConfig(unexpected_methods={"DELETE", "PUT"}),
+        data_generation_methods=[DataGenerationMethod.negative],
+        settings=settings(phases=[Phase.explicit]),
+    )
+
+    test_func()
+
+    assert methods == {"DELETE", "PUT"}
+
     module = ctx.write_pymodule(
         """
 import schemathesis

{schemathesis-3.39.11 → schemathesis-3.39.13}/test/specs/openapi/test_patterns.py

@@ -103,6 +103,8 @@ SKIP_BEFORE_PY11 = pytest.mark.skipif(
         (r"^abcd$", 50, 50, r"^abcd$"),
         # Edge cases
         ("^[a-z]*-[0-9]*$", 3, 3, "^([a-z]){0}-([0-9]){2}$"),
+        (r"^[+][\s0-9()-]+$", 1, 20, r"^[+]([\s0-9()-]){1,19}$"),
+        (r"^[\+][\s0-9()-]+$", 1, 20, r"^[\+]([\s0-9()-]){1,19}$"),
         # Multiple fixed parts
         ("^abc[0-9]{1,3}def[a-z]{2,5}ghi$", 12, 12, "^abc([0-9]){1}def([a-z]){2}ghi$"),
         ("^(((?:DB|BR)[-a-zA-Z0-9_]+),?){1,}$", None, 6000, "^(((?:DB|BR)[-a-zA-Z0-9_]+),?){1,6000}$"),

schemathesis-3.39.11/docs/service.rst

@@ -1,75 +0,0 @@
-Schemathesis as a Service
-=========================
-
-Schemathesis as a Service on `Schemathesis.io <https://app.schemathesis.io/auth/sign-up/?utm_source=oss_docs&utm_content=saas_docs_top>`_ provides a hosted environment, extending your testing capabilities with additional features accessible in both free and premium plans.
-
-.. note::
-
-    For a step-by-step guide on getting started with Schemathesis.io, visit our `Quick Start Guide <https://docs.schemathesis.io/quick-start/>`_.
-
-Schema Analysis (Experimental)
-------------------------------
-
-Schemathesis CLI now includes an experimental feature that integrates with Schemathesis.io to improve the efficiency and realism of generated test cases for better bug detection. This feature optimizes test case generation by:
-
-- Inferring "format" keywords for appropriate string data generation
-- Providing data generation strategies for uncommon media types (e.g., application/pdf)
-- Inferring data generation strategies for GraphQL scalars
-- Adjusting schemas for faster data generation in Schemathesis
-- Detecting the web server to generate more targeted test data and avoid rejected inputs
-
-By enabling this feature, you can potentially benefit from faster achievement of higher edge case coverage and tests that reach deeper into your API implementation.
-
-To enable schema analysis, use the ``--experimental=schema-analysis`` CLI option. It is also automatically enabled when the ``--report`` CLI option is used.
-
-.. note::
- 
-    During the experimental phase, schema analysis is available free of charge and does not require signup. By using this feature, you automatically agree to Schemathesis.io's `Terms of Service <https://schemathesis.io/legal/terms>`_ and `Privacy Policy`_.
-
-Please note that this feature is still experimental, and its effectiveness may vary depending on the API being tested. We are actively refining the algorithms and techniques used. If you encounter any issues or have suggestions, please open an issue on our GitHub repository or reach out via our support channels.
-
-Uploading Reports to Schemathesis.io
-------------------------------------
-
-When you use the Schemathesis CLI to run tests, you have the option to upload test reports to Schemathesis.io for a more detailed analysis and continuous tracking over time.
-This can be done by using the ``--report`` flag with your CLI commands.
-
-To store a report for later upload, you can first save it using the ``--report=report.tar.gz`` CLI option. Afterward, you can upload it with the ``st upload report.tar.gz`` command.
-
-.. note::
-
-    If the ``--report`` flag is not passed, or if its argument points to a local file, no data is sent to external services. Reports generated locally are fully self-contained and remain on your machine unless you explicitly upload them to Schemathesis.io using the upload command.
-
-    The content of the report includes all HTTP calls made during the test execution, providing transparency into the exact interactions Schemathesis performed.
-
-    This data helps improve the product's quality and usability by identifying edge cases, such as incompatible server behavior, but is only accessible to Schemathesis.io when the report is uploaded.
-
-What Data is Sent?
-------------------
-
-When you choose to upload your test reports, the following data is included in the reports sent to Schemathesis.io by the CLI:
-
-- **Metadata**:
-
-  - Information about your host machine to help us understand our users better.
-  - Collected data includes your Python interpreter version, implementation, system/OS name, the used Docker image name (if any) and release.
-
-- **Test Runs**:
-
-  - Most of the Schemathesis runner's events are included, encompassing all generated data and explicitly passed headers.
-  - Sensitive data within the generated test cases and received responses is automatically sanitized by default, replaced with the string ``[Filtered]`` to prevent accidental exposure.
-  - Further information on what is considered sensitive and how it is sanitized can be found at :ref:`Sanitizing Output <sanitizing-output>`.
-
-- **Environment Variables**:
-
-  - Some environment variables specific to CI providers are included.
-  - These are used to comment on pull requests.
-
-- **Command-Line Options**:
-
-  - Command-line options without free-form values are sent to help us understand how you use the CLI.
-  - Rest assured, any sensitive data passed through command-line options is sanitized by default.
-
-For more details on our data handling practices, please refer to our `Privacy Policy <https://schemathesis.io/legal/privacy>`_. If you have further questions or concerns about data handling, feel free to contact us at `support@schemathesis.io <mailto:support@schemathesis.io>`_.
-
-For information on data access, retention, and deletion, please refer to the `FAQ section <https://docs.schemathesis.io/faq>`_ in our SaaS documentation.