genlayer-test 0.9.0__py3-none-any.whl → 0.10.0__py3-none-any.whl

{genlayer_test-0.9.0.dist-info → genlayer_test-0.10.0.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: genlayer-test
-Version: 0.9.0
+Version: 0.10.0
 Summary: GenLayer Testing Suite
 Author: GenLayer
 License-Expression: MIT
@@ -270,31 +270,7 @@ $ gltest --default-wait-interval <default_wait_interval>
 $ gltest --default-wait-retries <default_wait_retries>
 ```
 
-10. Run tests with mocked LLM responses (localnet only)
-```bash
-$ gltest --test-with-mocks
-```
-The `--test-with-mocks` flag enables mocking of LLM responses when creating validators. This is particularly useful for:
-- Testing without actual LLM API calls
-- Ensuring deterministic test results
-- Faster test execution
-- Testing specific edge cases with controlled responses
-
-When using this flag with the `setup_validators` fixture, you can provide custom mock responses:
-```python
-def test_with_mocked_llm(setup_validators):
-    # Setup validators with a specific mock response
-    mock_response = {"result": "This is a mocked LLM response"}
-    setup_validators(mock_response=mock_response)
-    
-    # Your LLM-based contract will receive the mocked response
-    contract = factory.deploy()
-    result = contract.llm_method()  # Will use the mocked response
-```
-
-Note: This feature is only available when running tests on localnet.
-
-11. Run tests with leader-only mode enabled
+10. Run tests with leader-only mode enabled
 ```bash
 $ gltest --leader-only
 ```
@@ -475,7 +451,7 @@ def test_write_methods():
     ).transact(
         value=0,  # Optional: amount of native currency to send
         consensus_max_rotations=3,  # Optional: max consensus rotations
-        wait_interval=1,  # Optional: seconds between status checks
+        wait_interval=1000,  # Optional: milliseconds between status checks
         wait_retries=10,  # Optional: max number of retries
         transaction_context=None,  # Optional: custom transaction context
     )
@@ -538,7 +514,6 @@ The following fixtures are available in `gltest.fixtures`:
 - **`gl_client`** (session scope) - GenLayer client instance for network operations
 - **`default_account`** (session scope) - Default account for testing and deployments
 - **`accounts`** (session scope) - List of test accounts for multi-account scenarios
-- **`setup_validators`** (function scope) - Function to create test validators for LLM operations
 
 ##### 1. `gl_client` (session scope)
 Provides a GenLayer PY client instance that's created once per test session. This is useful for operations that interact directly with the GenLayer network.
@@ -573,26 +548,6 @@ def test_multiple_accounts(accounts):
     contract.transfer(args=[receiver.address, 100], account=sender)
 ```
 
-##### 4. `setup_validators` (function scope)
-Creates test validators for localnet environment. This fixture is particularly useful for testing LLM-based contract methods and consensus behavior. It yields a function that allows you to configure validators with custom settings.
-
-```python
-def test_with_validators(setup_validators):
-    # Setup validators with default configuration
-    setup_validators()
-    
-    # Or setup with custom mock responses for testing
-    mock_response = {"result": "mocked LLM response"}
-    setup_validators(mock_response=mock_response, n_validators=3)
-    
-    # Now test your LLM-based contract methods
-    contract = factory.deploy()
-    result = contract.llm_based_method()
-```
-
-Parameters for `setup_validators`:
-- `mock_response` (dict, optional): Mock validator response when using `--test-with-mocks` flag
-- `n_validators` (int, optional): Number of validators to create (default: 5)
 
 #### Using Fixtures in Your Tests
 
@@ -602,9 +557,7 @@ To use these fixtures, simply import them and include them as parameters in your
 from gltest import get_contract_factory
 from gltest.assertions import tx_execution_succeeded
 
-def test_complete_workflow(gl_client, default_account, accounts, setup_validators):
-    # Setup validators for LLM operations
-    setup_validators()
+def test_complete_workflow(gl_client, default_account, accounts):
     
     # Deploy contract with default account
     factory = get_contract_factory("MyContract")
@@ -650,7 +603,7 @@ def test_analyze_method():
     print(f"Reliability score: {analysis.reliability_score:.2f}%")
     print(f"Unique states: {analysis.unique_states}")
     print(f"Execution time: {analysis.execution_time:.1f}s")
-    
+
     # The analysis returns a MethodStatsSummary object with:
     # - method: The contract method name
     # - args: Arguments passed to the method
@@ -668,127 +621,6 @@ The `.analyze()` method helps you:
 - Identify edge cases and failure patterns
 - Benchmark performance across multiple runs
 
-### Mock LLM Responses
-
-The Mock LLM system allows you to simulate Large Language Model responses in GenLayer tests. This is essential for creating deterministic tests by providing predefined responses instead of relying on actual LLM calls.
-
-#### Basic Structure
-
-The mock system consists of a response dictionary that maps GenLayer methods to their mocked responses:
-
-```python
-mock_response = {
-    "response": {},                               # Optional: mocks gl.nondet.exec_prompt
-    "eq_principle_prompt_comparative": {},        # Optional: mocks gl.eq_principle.prompt_comparative
-    "eq_principle_prompt_non_comparative": {}     # Optional: mocks gl.eq_principle.prompt_non_comparative
-}
-
-setup_validators(mock_response)
-```
-
-#### Method Mappings
-
-| Mock Key | GenLayer Method |
-|----------|----------------|
-| `"response"` | `gl.nondet.exec_prompt` |
-| `"eq_principle_prompt_comparative"` | `gl.eq_principle.prompt_comparative` |
-| `"eq_principle_prompt_non_comparative"` | `gl.eq_principle.prompt_non_comparative` |
-
-#### How It Works
-
-The mock system works by pattern matching against the user message that gets built internally. When a GenLayer method is called:
-
-1. A user message is constructed internally (`<user_message>`)
-2. The mock system searches for strings within that message
-3. If a matching string is found in the mock dictionary, the associated response is returned
-
-##### String Matching Rules
-
-The system performs **substring matching** on the user message. The key in your mock dictionary must be contained within the actual user message.
-
-#### Examples
-
-##### Basic Example
-
-```python
-# Mock setup
-mock_response = {
-    "eq_principle_prompt_comparative": {
-        "The value of give_coin has to match": True
-    }
-}
-setup_validators(mock_response)
-
-# In your contract
-result = gl.eq_principle.prompt_comparative(
-    get_wizard_answer, 
-    "The value of give_coin has to match"  # This string will be matched
-)
-# result will be True
-```
-
-##### Substring Matching Examples
-
-✅ **Will work** - Partial match:
-```python
-"eq_principle_prompt_comparative": {
-    "The value of give_coin": True  # Substring of the full message
-}
-```
-
-❌ **Won't work** - Extra words break the match:
-```python
-"eq_principle_prompt_comparative": {
-    "The good value of give_coin": True  # "good" is not in the actual message
-}
-```
-
-##### Complete Example
-
-```python
-from gltest import get_contract_factory
-from gltest.fixtures import setup_validators
-
-def test_with_mocked_llm(setup_validators):
-    # Define mock responses
-    mock_response = {
-        "response": {
-            "What is the weather?": "It's sunny today",
-            "Calculate 2+2": "4"
-        },
-        "eq_principle_prompt_comparative": {
-            "values must be equal": True,
-            "amounts should match": False
-        },
-        "eq_principle_prompt_non_comparative": {
-            "Is this valid?": True
-        }
-    }
-    
-    # Initialize the mock system
-    setup_validators(mock_response)
-    
-    # Deploy and test your contract
-    factory = get_contract_factory("MyLLMContract")
-    contract = factory.deploy()
-    
-    # Your LLM methods will use the mocked responses
-    result = contract.check_weather()  # Uses mocked response
-```
-
-#### Best Practices
-
-1. **Be specific with match strings**: Use unique substrings that won't accidentally match other prompts
-2. **Test your matches**: Verify that your mock strings actually appear in the generated user messages
-3. **Keep mocks simple**: Mock responses should be minimal and focused on the test case
-4. **Document your mocks**: Comment why specific responses are mocked for future reference
-5. **Use with `--test-with-mocks` flag**: Enable mocking when running tests: `gltest --test-with-mocks`
-
-#### Notes
-
-- Mock responses are only available when running tests on localnet
-- The `setup_validators` fixture handles the mock setup when provided with a mock_response
-- Mocking is particularly useful for CI/CD pipelines where deterministic results are required
 
 ### Custom Transaction Context
 
@@ -839,17 +671,58 @@ def test_with_custom_transaction_context():
     )
 ```
 
+### Mock LLM Responses
+
+The Mock LLM system allows you to simulate Large Language Model responses in GenLayer tests. This is essential for creating deterministic tests by providing predefined responses instead of relying on actual LLM calls.
+
+#### Basic Structure
+
+The mock system consists of a response dictionary that maps GenLayer methods to their mocked responses:
+
+```python
+from gltest.types import MockedLLMResponse
+
+mock_response: MockedLLMResponse = {
+    "nondet_exec_prompt": {},                               # Optional: mocks gl.nondet.exec_prompt
+    "eq_principle_prompt_comparative": {},        # Optional: mocks gl.eq_principle.prompt_comparative
+    "eq_principle_prompt_non_comparative": {}     # Optional: mocks gl.eq_principle.prompt_non_comparative
+}
+```
+
+#### Method Mappings
+
+| Mock Key | GenLayer Method |
+|----------|----------------|
+| `"nondet_exec_prompt"` | `gl.nondet.exec_prompt` |
+| `"eq_principle_prompt_comparative"` | `gl.eq_principle.prompt_comparative` |
+| `"eq_principle_prompt_non_comparative"` | `gl.eq_principle.prompt_non_comparative` |
+
+#### How It Works
+
+The mock system works by pattern matching against the user message that gets built internally. When a GenLayer method is called:
+
+1. A user message is constructed internally (`<user_message>`)
+2. The mock system searches for strings within that message
+3. If a matching string is found in the mock dictionary, the associated response is returned
+
+##### String Matching Rules
+
+The system performs **substring matching** on the user message. The key in your mock dictionary must be contained within the actual user message.
+
+
 #### Mock Validators with Transaction Context
 
 Combine mock validators with custom datetime for fully deterministic tests:
 
 ```python
+from gltest.types import MockedLLMResponse
+
 def test_with_mocked_context():
     factory = get_contract_factory("LLMContract")
     validator_factory = get_validator_factory()
     
     # Define mock LLM responses
-    mock_response = {
+    mock_response: MockedLLMResponse = {
         "nondet_exec_prompt": {
             "analyze this": "positive sentiment"
         },
@@ -1041,7 +914,7 @@ def test_validator_cloning():
    tx_receipt = contract.set_value(
        args=["new_value"],
    ).transact(
-       wait_interval=2,  # Increase wait interval between status checks
+       wait_interval=2000,  # Increase wait interval between status checks
        wait_retries=20,  # Increase number of retry attempts
    )
    ```
@@ -1058,7 +931,7 @@ def test_validator_cloning():
    # For critical operations, use more conservative settings
    contract = factory.deploy(
        consensus_max_rotations=10,  # More rotations for better reliability
-       wait_interval=3,  # Longer wait between checks
+       wait_interval=3000,  # Longer wait between checks
        wait_retries=30  # More retries for consensus
    )
    ```

{genlayer_test-0.9.0.dist-info → genlayer_test-0.10.0.dist-info}/RECORD

@@ -1,10 +1,10 @@
-genlayer_test-0.9.0.dist-info/licenses/LICENSE,sha256=che_H4vE0QUx3HvWrAa1_jDEVInift0U6VO15-QqEls,1064
+genlayer_test-0.10.0.dist-info/licenses/LICENSE,sha256=che_H4vE0QUx3HvWrAa1_jDEVInift0U6VO15-QqEls,1064
 gltest/__init__.py,sha256=49112x2CLdYwvCbBZ1laJmMk0NQ7S3u5YUbxPefqhrk,454
 gltest/accounts.py,sha256=HUmWguJMolggQaZNRPw-LGlRlQCjLLdUanKRowMv6pI,812
 gltest/assertions.py,sha256=0dEk0VxcHK4I7GZPHxJmz-2jaA60V499gOSR74rZbfM,1748
 gltest/clients.py,sha256=1dX6wmG3QCevQRLbSaFlHymZSb-sJ5aYwet1IoX2nbA,1554
 gltest/exceptions.py,sha256=deJPmrTe5gF33qkkKF2IVJY7lc_knI7Ql3N7jZ8aLZs,510
-gltest/fixtures.py,sha256=EJXmqcC3LD03v07mepacFl58lAdhbLj6bP5rtALYISk,2507
+gltest/fixtures.py,sha256=omVjLh1kXXUyL7Oo8zzdooJBbSX-Qk-Aa-prp5MqvFc,833
 gltest/logging.py,sha256=jAkHsuMm-AEx1Xu1srU6W-0YzTwXJB48mCK-OVzAiN4,342
 gltest/types.py,sha256=H32fHrU5aFMaPHXgEWcHAmLWOZ9pBFVp8PK_ncpVOgM,940
 gltest/utils.py,sha256=-gHhjrS7i_GhDG3sKOq2qsTtYBt4HHgXHEXh-3RB_rI,573
@@ -25,14 +25,14 @@ gltest/validators/validator_factory.py,sha256=fpb-YyAKuWo4-pXBjrZ_TApYLsm6HHa6kG
 gltest_cli/logging.py,sha256=WXVhfq9vT6FtV_jxDqGEGia1ZWSIUKAfmWRnZd_gWQk,1266
 gltest_cli/main.py,sha256=Ti2-0Ev1x5_cM0D1UKqdgaDt80CDHEQGtdRne2qLm4M,53
 gltest_cli/config/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-gltest_cli/config/constants.py,sha256=llQD_yiJDwpohMBWufBKcmY8BXLkBeLe5eTj0QUOxSU,603
+gltest_cli/config/constants.py,sha256=z7njbU8WXYhTnp1NYrW4YI2jN-p114BP2UDSYF0qAJE,571
 gltest_cli/config/general.py,sha256=ezpoGsT8grO9zQH6RugV14b1GzeFt-htYToHQBJhNvY,186
-gltest_cli/config/plugin.py,sha256=o-tfm0KmbMe4iVLWGWUws5Wg2pwOEnfnASQv4ovXEXQ,7109
+gltest_cli/config/plugin.py,sha256=rySUyo7OSG1SOiUx2Xrxiv-SfjaxJSWpT5KKKNRk4Mk,6719
 gltest_cli/config/pytest_context.py,sha256=Ze8JSkrwMTCE8jIhpzU_71CEXg92SiEPvSgNTp-gbS4,243
-gltest_cli/config/types.py,sha256=oKRRFvCQESt3oca6T79RATHl9BtLNrVCqGc9tB5hovY,10083
-gltest_cli/config/user.py,sha256=jtqhEkp2pEh67Pk4xcshXNcApeCBRjLesZgpqJQuCYg,13625
-genlayer_test-0.9.0.dist-info/METADATA,sha256=09bCBWnQ0MR5FYhKFqZWgx7-nThb5RgR8xfFhl0nxMs,40707
-genlayer_test-0.9.0.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
-genlayer_test-0.9.0.dist-info/entry_points.txt,sha256=RWPcSArBpz_G4BYioh5L8Q8hyClRbSgzLimjcWMp-BQ,94
-genlayer_test-0.9.0.dist-info/top_level.txt,sha256=GSdrnQbiLcZssmtCpbDgBTygsc8Bt_TPeYjwm0FmpdA,18
-genlayer_test-0.9.0.dist-info/RECORD,,
+gltest_cli/config/types.py,sha256=c_4Ya8M9pxQmceSGgcgBIN-5hmrJxAnPFXkTzD7qrtI,9492
+gltest_cli/config/user.py,sha256=JeclpIVv4BT5COMW2xrEbTspI6e1RAYIOvd8ruPc3gM,12887
+genlayer_test-0.10.0.dist-info/METADATA,sha256=CR7BasEbdFf2WiG8ue3KkMNNAVlRmeF8xBn6-liq4E8,36341
+genlayer_test-0.10.0.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
+genlayer_test-0.10.0.dist-info/entry_points.txt,sha256=RWPcSArBpz_G4BYioh5L8Q8hyClRbSgzLimjcWMp-BQ,94
+genlayer_test-0.10.0.dist-info/top_level.txt,sha256=GSdrnQbiLcZssmtCpbDgBTygsc8Bt_TPeYjwm0FmpdA,18
+genlayer_test-0.10.0.dist-info/RECORD,,

gltest/fixtures.py

@@ -4,9 +4,8 @@ These fixtures can be imported and used in test files.
 """
 
 import pytest
-from gltest.clients import get_gl_client, get_gl_provider
+from gltest.clients import get_gl_client
 from gltest.accounts import get_accounts, get_default_account
-from gltest_cli.config.general import get_general_config
 
 
 @pytest.fixture(scope="session")
@@ -37,51 +36,3 @@ def accounts():
     Scope: session - created once per test session
     """
     return get_accounts()
-
-
-@pytest.fixture(scope="function")
-def setup_validators():
-    """
-    Creates test validators for localnet environment.
-
-    Args:
-        mock_response (dict, optional): Mock validator response when using --test-with-mocks flag
-        n_validators (int, optional): Number of validators to create (default: 5)
-
-    Scope: function - created fresh for each test
-    """
-    general_config = get_general_config()
-    provider = get_gl_provider()
-
-    def _setup(mock_response=None, n_validators=5):
-        if not general_config.check_local_rpc():
-            return
-        if general_config.get_test_with_mocks():
-            for _ in range(n_validators):
-                provider.make_request(
-                    method="sim_createValidator",
-                    params=[
-                        8,
-                        "openai",
-                        "gpt-4o",
-                        {"temperature": 0.75, "max_tokens": 500},
-                        "openai-compatible",
-                        {
-                            "api_key_env_var": "OPENAIKEY",
-                            "api_url": "https://api.openai.com",
-                            "mock_response": mock_response if mock_response else {},
-                        },
-                    ],
-                )
-        else:
-            provider.make_request(
-                method="sim_createRandomValidators",
-                params=[n_validators, 8, 12],
-            )
-
-    yield _setup
-
-    if not general_config.check_local_rpc():
-        return
-
-    provider.make_request(method="sim_deleteAllValidators", params=[])

gltest_cli/config/constants.py

@@ -15,5 +15,4 @@ DEFAULT_NETWORK_ID = 61999
 # Defaults per network
 DEFAULT_WAIT_INTERVAL = 3000
 DEFAULT_WAIT_RETRIES = 50
-DEFAULT_TEST_WITH_MOCKS = False
 DEFAULT_LEADER_ONLY = False

gltest_cli/config/plugin.py

@@ -15,7 +15,6 @@ from gltest_cli.config.pytest_context import _pytest_context
 from gltest_cli.config.constants import (
     DEFAULT_WAIT_INTERVAL,
     DEFAULT_WAIT_RETRIES,
-    DEFAULT_TEST_WITH_MOCKS,
     DEFAULT_LEADER_ONLY,
     CHAINS,
 )
@@ -65,13 +64,6 @@ def pytest_addoption(parser):
         help="Target network (defaults to 'localnet' if no config file)",
     )
 
-    group.addoption(
-        "--test-with-mocks",
-        action="store_true",
-        default=DEFAULT_TEST_WITH_MOCKS,
-        help="Test with mocks",
-    )
-
     group.addoption(
         "--leader-only",
         action="store_true",
@@ -120,7 +112,6 @@ def pytest_configure(config):
         default_wait_retries = config.getoption("--default-wait-retries")
         rpc_url = config.getoption("--rpc-url")
         network = config.getoption("--network")
-        test_with_mocks = config.getoption("--test-with-mocks")
         leader_only = config.getoption("--leader-only")
         chain_type = config.getoption("--chain-type")
 
@@ -135,7 +126,6 @@ def pytest_configure(config):
         plugin_config.default_wait_retries = int(default_wait_retries)
         plugin_config.rpc_url = rpc_url
         plugin_config.network_name = network
-        plugin_config.test_with_mocks = test_with_mocks
         plugin_config.leader_only = leader_only
         plugin_config.chain_type = chain_type
 
@@ -175,7 +165,6 @@ def pytest_sessionstart(session):
         logger.info(
             f"  Default wait retries: {general_config.get_default_wait_retries()}"
         )
-        logger.info(f"  Test with mocks: {general_config.get_test_with_mocks()}")
 
         if (
             general_config.get_leader_only()

gltest_cli/config/types.py

@@ -7,7 +7,6 @@ from gltest_cli.config.constants import PRECONFIGURED_NETWORKS
 from gltest_cli.config.constants import (
     DEFAULT_WAIT_INTERVAL,
     DEFAULT_WAIT_RETRIES,
-    DEFAULT_TEST_WITH_MOCKS,
     DEFAULT_LEADER_ONLY,
     CHAINS,
 )
@@ -21,7 +20,6 @@ class PluginConfig:
     default_wait_interval: Optional[int] = None
     default_wait_retries: Optional[int] = None
     network_name: Optional[str] = None
-    test_with_mocks: bool = False
     leader_only: bool = False
     chain_type: Optional[str] = None
 
@@ -35,7 +33,6 @@ class NetworkConfigData:
     leader_only: bool = False
     default_wait_interval: Optional[int] = None
     default_wait_retries: Optional[int] = None
-    test_with_mocks: bool = False
     chain_type: Optional[str] = None
 
     def __post_init__(self):
@@ -60,8 +57,6 @@ class NetworkConfigData:
             self.default_wait_retries, int
         ):
             raise ValueError("default_wait_retries must be an integer")
-        if not isinstance(self.test_with_mocks, bool):
-            raise TypeError("test_with_mocks must be a boolean")
         if self.chain_type is not None and not isinstance(self.chain_type, str):
             raise ValueError("chain_type must be a string")
 
@@ -223,15 +218,6 @@ class GeneralConfig:
             return self.plugin_config.network_name
         return self.user_config.default_network
 
-    def get_test_with_mocks(self) -> bool:
-        if self.plugin_config.test_with_mocks:
-            return True
-        network_name = self.get_network_name()
-        if network_name in self.user_config.networks:
-            network_config = self.user_config.networks[network_name]
-            return network_config.test_with_mocks
-        return DEFAULT_TEST_WITH_MOCKS
-
     def get_leader_only(self) -> bool:
         if self.plugin_config.leader_only:
             return True

gltest_cli/config/user.py

@@ -15,7 +15,6 @@ from gltest_cli.config.constants import (
     PRECONFIGURED_NETWORKS,
     DEFAULT_WAIT_INTERVAL,
     DEFAULT_WAIT_RETRIES,
-    DEFAULT_TEST_WITH_MOCKS,
     DEFAULT_LEADER_ONLY,
     CHAINS,
 )
@@ -31,7 +30,6 @@ VALID_NETWORK_KEYS = [
     "leader_only",
     "default_wait_interval",
     "default_wait_retries",
-    "test_with_mocks",
     "chain_type",
 ]
 VALID_PATHS_KEYS = ["contracts", "artifacts"]
@@ -51,7 +49,6 @@ def get_default_user_config() -> UserConfig:
             leader_only=DEFAULT_LEADER_ONLY,
             default_wait_interval=DEFAULT_WAIT_INTERVAL,
             default_wait_retries=DEFAULT_WAIT_RETRIES,
-            test_with_mocks=DEFAULT_TEST_WITH_MOCKS,
             chain_type="localnet",
         ),
         "studionet": NetworkConfigData(
@@ -62,7 +59,6 @@ def get_default_user_config() -> UserConfig:
             leader_only=DEFAULT_LEADER_ONLY,
             default_wait_interval=DEFAULT_WAIT_INTERVAL,
             default_wait_retries=DEFAULT_WAIT_RETRIES,
-            test_with_mocks=DEFAULT_TEST_WITH_MOCKS,
             chain_type="studionet",
         ),
         "testnet_asimov": NetworkConfigData(
@@ -73,7 +69,6 @@ def get_default_user_config() -> UserConfig:
             leader_only=DEFAULT_LEADER_ONLY,
             default_wait_interval=DEFAULT_WAIT_INTERVAL,
             default_wait_retries=DEFAULT_WAIT_RETRIES,
-            test_with_mocks=DEFAULT_TEST_WITH_MOCKS,
             chain_type="testnet_asimov",
         ),
     }
@@ -163,11 +158,6 @@ def validate_network_config(network_name: str, network_config: dict):
             f"network {network_name} default_wait_retries must be an integer"
         )
 
-    if "test_with_mocks" in network_config and not isinstance(
-        network_config["test_with_mocks"], bool
-    ):
-        raise ValueError(f"network {network_name} test_with_mocks must be a boolean")
-
     if "chain_type" in network_config:
         if not isinstance(network_config["chain_type"], str):
             raise ValueError(f"network {network_name} chain_type must be a string")
@@ -294,10 +284,6 @@ def _get_overridden_networks(raw_config: dict) -> tuple[dict, str]:
                 networks_config[network_name].default_wait_retries = network_config[
                     "default_wait_retries"
                 ]
-            if "test_with_mocks" in network_config:
-                networks_config[network_name].test_with_mocks = network_config[
-                    "test_with_mocks"
-                ]
             if "chain_type" in network_config:
                 networks_config[network_name].chain_type = network_config["chain_type"]
             continue
@@ -313,7 +299,6 @@ def _get_overridden_networks(raw_config: dict) -> tuple[dict, str]:
         default_wait_retries = network_config.get(
             "default_wait_retries", DEFAULT_WAIT_RETRIES
         )
-        test_with_mocks = network_config.get("test_with_mocks", DEFAULT_TEST_WITH_MOCKS)
         chain_type = network_config["chain_type"]  # Required for custom networks
         networks_config[network_name] = NetworkConfigData(
             id=network_id,
@@ -323,7 +308,6 @@ def _get_overridden_networks(raw_config: dict) -> tuple[dict, str]:
             leader_only=leader_only,
             default_wait_interval=default_wait_interval,
             default_wait_retries=default_wait_retries,
-            test_with_mocks=test_with_mocks,
             chain_type=chain_type,
         )
     return networks_config, user_default_network