bmad-method 6.0.0-alpha.16 → 6.0.0-alpha.18

package/src/modules/bmgd/gametest/knowledge/certification-testing.md

@@ -0,0 +1,319 @@
+# Platform Certification Testing Guide
+
+## Overview
+
+Certification testing ensures games meet platform holder requirements (Sony TRC, Microsoft XR, Nintendo Guidelines). Failing certification delays launch and costs money—test thoroughly before submission.
+
+## Platform Requirements Overview
+
+### Major Platforms
+
+| Platform        | Requirements Doc                       | Submission Portal         |
+| --------------- | -------------------------------------- | ------------------------- |
+| PlayStation     | TRC (Technical Requirements Checklist) | PlayStation Partners      |
+| Xbox            | XR (Xbox Requirements)                 | Xbox Partner Center       |
+| Nintendo Switch | Guidelines                             | Nintendo Developer Portal |
+| Steam           | Guidelines (less strict)               | Steamworks                |
+| iOS             | App Store Guidelines                   | App Store Connect         |
+| Android         | Play Store Policies                    | Google Play Console       |
+
+## Common Certification Categories
+
+### Account and User Management
+
+```
+REQUIREMENT: User Switching
+  GIVEN user is playing game
+  WHEN system-level user switch occurs
+  THEN game handles transition gracefully
+  AND no data corruption
+  AND correct user data loads
+
+REQUIREMENT: Guest Accounts
+  GIVEN guest user plays game
+  WHEN guest makes progress
+  THEN progress is not saved to other accounts
+  AND appropriate warnings displayed
+
+REQUIREMENT: Parental Controls
+  GIVEN parental controls restrict content
+  WHEN restricted content is accessed
+  THEN content is blocked or modified
+  AND appropriate messaging shown
+```
+
+### System Events
+
+```
+REQUIREMENT: Suspend/Resume (PS4/PS5)
+  GIVEN game is running
+  WHEN console enters rest mode
+  AND console wakes from rest mode
+  THEN game resumes correctly
+  AND network reconnects if needed
+  AND no audio/visual glitches
+
+REQUIREMENT: Controller Disconnect
+  GIVEN player is in gameplay
+  WHEN controller battery dies
+  THEN game pauses immediately
+  AND reconnect prompt appears
+  AND gameplay resumes when connected
+
+REQUIREMENT: Storage Full
+  GIVEN storage is nearly full
+  WHEN game attempts save
+  THEN graceful error handling
+  AND user informed of issue
+  AND no data corruption
+```
+
+### Network Requirements
+
+```
+REQUIREMENT: PSN/Xbox Live Unavailable
+  GIVEN online features
+  WHEN platform network is unavailable
+  THEN offline features still work
+  AND appropriate error messages
+  AND no crashes
+
+REQUIREMENT: Network Transition
+  GIVEN active online session
+  WHEN network connection lost
+  THEN graceful handling
+  AND reconnection attempted
+  AND user informed of status
+
+REQUIREMENT: NAT Type Handling
+  GIVEN various NAT configurations
+  WHEN multiplayer is attempted
+  THEN appropriate feedback on connectivity
+  AND fallback options offered
+```
+
+### Save Data
+
+```
+REQUIREMENT: Save Data Integrity
+  GIVEN save data exists
+  WHEN save is loaded
+  THEN data is validated
+  AND corrupted data handled gracefully
+  AND no crashes on invalid data
+
+REQUIREMENT: Cloud Save Sync
+  GIVEN cloud saves enabled
+  WHEN save conflict occurs
+  THEN user chooses which to keep
+  AND no silent data loss
+
+REQUIREMENT: Save Data Portability (PS4→PS5)
+  GIVEN save from previous generation
+  WHEN loaded on current generation
+  THEN data migrates correctly
+  AND no features lost
+```
+
+## Platform-Specific Requirements
+
+### PlayStation (TRC)
+
+| Requirement | Description                 | Priority |
+| ----------- | --------------------------- | -------- |
+| TRC R4010   | Suspend/resume handling     | Critical |
+| TRC R4037   | User switching              | Critical |
+| TRC R4062   | Parental controls           | Critical |
+| TRC R4103   | PS VR comfort ratings       | VR only  |
+| TRC R4120   | DualSense haptics standards | PS5      |
+| TRC R5102   | PSN sign-in requirements    | Online   |
+
+### Xbox (XR)
+
+| Requirement | Description                   | Priority    |
+| ----------- | ----------------------------- | ----------- |
+| XR-015      | Title timeout handling        | Critical    |
+| XR-045      | User sign-out handling        | Critical    |
+| XR-067      | Active user requirement       | Critical    |
+| XR-074      | Quick Resume support          | Series X/S  |
+| XR-115      | Xbox Accessibility Guidelines | Recommended |
+
+### Nintendo Switch
+
+| Requirement        | Description         | Priority |
+| ------------------ | ------------------- | -------- |
+| Docked/Handheld    | Seamless transition | Critical |
+| Joy-Con detachment | Controller handling | Critical |
+| Home button        | Immediate response  | Critical |
+| Screenshots/Video  | Proper support      | Required |
+| Sleep mode         | Resume correctly    | Critical |
+
+## Automated Test Examples
+
+### System Event Testing
+
+```cpp
+// Unreal - Suspend/Resume Test
+IMPLEMENT_SIMPLE_AUTOMATION_TEST(
+    FSuspendResumeTest,
+    "Certification.System.SuspendResume",
+    EAutomationTestFlags::ApplicationContextMask | EAutomationTestFlags::ProductFilter
+)
+
+bool FSuspendResumeTest::RunTest(const FString& Parameters)
+{
+    // Get game state before suspend
+    FGameState StateBefore = GetCurrentGameState();
+
+    // Simulate suspend
+    FCoreDelegates::ApplicationWillEnterBackgroundDelegate.Broadcast();
+
+    // Simulate resume
+    FCoreDelegates::ApplicationHasEnteredForegroundDelegate.Broadcast();
+
+    // Verify state matches
+    FGameState StateAfter = GetCurrentGameState();
+
+    TestEqual("Player position preserved",
+        StateAfter.PlayerPosition, StateBefore.PlayerPosition);
+    TestEqual("Game progress preserved",
+        StateAfter.Progress, StateBefore.Progress);
+
+    return true;
+}
+```
+
+```csharp
+// Unity - Controller Disconnect Test
+[UnityTest]
+public IEnumerator ControllerDisconnect_ShowsPauseMenu()
+{
+    // Simulate gameplay
+    GameManager.Instance.StartGame();
+    yield return new WaitForSeconds(1f);
+
+    // Simulate controller disconnect
+    InputSystem.DisconnectDevice(Gamepad.current);
+    yield return null;
+
+    // Verify pause menu shown
+    Assert.IsTrue(PauseMenu.IsVisible, "Pause menu should appear");
+    Assert.IsTrue(Time.timeScale == 0, "Game should be paused");
+
+    // Simulate reconnect
+    InputSystem.ReconnectDevice(Gamepad.current);
+    yield return null;
+
+    // Verify prompt appears
+    Assert.IsTrue(ReconnectPrompt.IsVisible);
+}
+```
+
+```gdscript
+# Godot - Save Corruption Test
+func test_corrupted_save_handling():
+    # Create corrupted save file
+    var file = FileAccess.open("user://save_corrupt.dat", FileAccess.WRITE)
+    file.store_string("CORRUPTED_GARBAGE_DATA")
+    file.close()
+
+    # Attempt to load
+    var result = SaveManager.load("save_corrupt")
+
+    # Should handle gracefully
+    assert_null(result, "Should return null for corrupted save")
+    assert_false(OS.has_feature("crashed"), "Should not crash")
+
+    # Should show user message
+    var message_shown = ErrorDisplay.current_message != ""
+    assert_true(message_shown, "Should inform user of corruption")
+```
+
+## Pre-Submission Checklist
+
+### General Requirements
+
+- [ ] Game boots to interactive state within platform time limit
+- [ ] Controller disconnect pauses game
+- [ ] User sign-out handled correctly
+- [ ] Save data validates on load
+- [ ] No crashes in 8+ hours of automated testing
+- [ ] Memory usage within platform limits
+- [ ] Load times meet requirements
+
+### Platform Services
+
+- [ ] Achievements/Trophies work correctly
+- [ ] Friends list integration works
+- [ ] Invite system functions
+- [ ] Store/DLC integration validated
+- [ ] Cloud saves sync properly
+
+### Accessibility (Increasingly Required)
+
+- [ ] Text size options
+- [ ] Colorblind modes
+- [ ] Subtitle options
+- [ ] Controller remapping
+- [ ] Screen reader support (where applicable)
+
+### Content Compliance
+
+- [ ] Age rating displayed correctly
+- [ ] Parental controls respected
+- [ ] No prohibited content
+- [ ] Required legal text present
+
+## Common Certification Failures
+
+| Issue                 | Platform     | Fix                                 |
+| --------------------- | ------------ | ----------------------------------- |
+| Home button delay     | All consoles | Respond within required time        |
+| Controller timeout    | PlayStation  | Handle reactivation properly        |
+| Save on suspend       | PlayStation  | Don't save during suspend           |
+| User context loss     | Xbox         | Track active user correctly         |
+| Joy-Con drift         | Switch       | Proper deadzone handling            |
+| Background memory     | Mobile       | Release resources when backgrounded |
+| Crash on corrupt data | All          | Validate all loaded data            |
+
+## Testing Matrix
+
+### Build Configurations to Test
+
+| Configuration   | Scenarios               |
+| --------------- | ----------------------- |
+| First boot      | No save data exists     |
+| Return user     | Save data present       |
+| Upgrade path    | Previous version save   |
+| Fresh install   | After uninstall         |
+| Low storage     | Minimum space available |
+| Network offline | No connectivity         |
+
+### Hardware Variants
+
+| Platform    | Variants to Test                |
+| ----------- | ------------------------------- |
+| PlayStation | PS4, PS4 Pro, PS5               |
+| Xbox        | One, One X, Series S, Series X  |
+| Switch      | Docked, Handheld, Lite          |
+| PC          | Min spec, recommended, high-end |
+
+## Best Practices
+
+### DO
+
+- Read platform requirements document thoroughly
+- Test on actual hardware, not just dev kits
+- Automate certification test scenarios
+- Submit with extra time for re-submission
+- Document all edge case handling
+- Test with real user accounts
+
+### DON'T
+
+- Assume debug builds behave like retail
+- Skip testing on oldest supported hardware
+- Ignore platform-specific features
+- Wait until last minute to test certification items
+- Use placeholder content in submission build
+- Skip testing with real platform services

package/src/modules/bmgd/gametest/knowledge/compatibility-testing.md

@@ -0,0 +1,228 @@
+# Compatibility Testing for Games
+
+## Overview
+
+Compatibility testing ensures your game works correctly across different hardware, operating systems, and configurations that players use.
+
+## Types of Compatibility Testing
+
+### Hardware Compatibility
+
+- Graphics cards (NVIDIA, AMD, Intel)
+- CPUs (Intel, AMD, Apple Silicon)
+- Memory configurations
+- Storage types (HDD, SSD, NVMe)
+- Input devices (controllers, keyboards, mice)
+
+### Software Compatibility
+
+- Operating system versions
+- Driver versions
+- Background software conflicts
+- Antivirus interference
+
+### Platform Compatibility
+
+- Console SKUs (PS5, Xbox Series X|S)
+- PC storefronts (Steam, Epic, GOG)
+- Mobile devices (iOS, Android)
+- Cloud gaming services
+
+### Configuration Compatibility
+
+- Graphics settings combinations
+- Resolution and aspect ratios
+- Refresh rates (60Hz, 144Hz, etc.)
+- HDR and color profiles
+
+## Testing Matrix
+
+### Minimum Hardware Matrix
+
+| Component | Budget   | Mid-Range | High-End |
+| --------- | -------- | --------- | -------- |
+| GPU       | GTX 1050 | RTX 3060  | RTX 4080 |
+| CPU       | i5-6400  | i7-10700  | i9-13900 |
+| RAM       | 8GB      | 16GB      | 32GB     |
+| Storage   | HDD      | SATA SSD  | NVMe     |
+
+### OS Matrix
+
+- Windows 10 (21H2, 22H2)
+- Windows 11 (22H2, 23H2)
+- macOS (Ventura, Sonoma)
+- Linux (Ubuntu LTS, SteamOS)
+
+### Controller Matrix
+
+- Xbox Controller (wired, wireless, Elite)
+- PlayStation DualSense
+- Nintendo Pro Controller
+- Generic XInput controllers
+- Keyboard + Mouse
+
+## Testing Approach
+
+### 1. Define Supported Configurations
+
+- Minimum specifications
+- Recommended specifications
+- Officially supported platforms
+- Known unsupported configurations
+
+### 2. Create Test Matrix
+
+- Prioritize common configurations
+- Include edge cases
+- Balance coverage vs. effort
+
+### 3. Execute Systematic Testing
+
+- Full playthrough on key configs
+- Spot checks on edge cases
+- Automated smoke tests where possible
+
+### 4. Document Issues
+
+- Repro steps with exact configuration
+- Severity and frequency
+- Workarounds if available
+
+## Common Compatibility Issues
+
+### Graphics Issues
+
+| Issue                | Cause                  | Detection                        |
+| -------------------- | ---------------------- | -------------------------------- |
+| Crashes on launch    | Driver incompatibility | Test on multiple GPUs            |
+| Rendering artifacts  | Shader issues          | Visual inspection across configs |
+| Performance variance | Optimization gaps      | Profile on multiple GPUs         |
+| Resolution bugs      | Aspect ratio handling  | Test non-standard resolutions    |
+
+### Input Issues
+
+| Issue                   | Cause              | Detection                      |
+| ----------------------- | ------------------ | ------------------------------ |
+| Controller not detected | Missing driver/API | Test all supported controllers |
+| Wrong button prompts    | Platform detection | Swap controllers mid-game      |
+| Stick drift handling    | Deadzone issues    | Test worn controllers          |
+| Mouse acceleration      | Raw input issues   | Test at different DPIs         |
+
+### Audio Issues
+
+| Issue          | Cause            | Detection                   |
+| -------------- | ---------------- | --------------------------- |
+| No sound       | Device selection | Test multiple audio devices |
+| Crackling      | Buffer issues    | Test under CPU load         |
+| Wrong channels | Surround setup   | Test stereo vs 5.1 vs 7.1   |
+
+## Platform-Specific Considerations
+
+### PC
+
+- **Steam:** Verify Steam Input, Steamworks features
+- **Epic:** Test EOS features if used
+- **GOG:** Test offline/DRM-free functionality
+- **Game Pass:** Test Xbox services integration
+
+### Console
+
+- **Certification Requirements:** Study TRCs/XRs early
+- **SKU Differences:** Test on all variants (S vs X)
+- **External Storage:** Test on USB drives
+- **Quick Resume:** Test suspend/resume cycles
+
+### Mobile
+
+- **Device Fragmentation:** Test across screen sizes
+- **OS Versions:** Test min supported to latest
+- **Permissions:** Test permission flows
+- **App Lifecycle:** Test background/foreground
+
+## Automated Compatibility Testing
+
+### Smoke Tests
+
+```yaml
+# Run on matrix of configurations
+compatibility_test:
+  matrix:
+    os: [windows-10, windows-11, ubuntu-22]
+    gpu: [nvidia, amd, intel]
+  script:
+    - launch_game --headless
+    - verify_main_menu_reached
+    - check_no_errors
+```
+
+### Screenshot Comparison
+
+- Capture screenshots on different GPUs
+- Compare for rendering differences
+- Flag significant deviations
+
+### Cloud Testing Services
+
+- AWS Device Farm
+- BrowserStack (web games)
+- LambdaTest
+- Sauce Labs
+
+## Compatibility Checklist
+
+### Pre-Alpha
+
+- [ ] Minimum specs defined
+- [ ] Key platforms identified
+- [ ] Test matrix created
+- [ ] Test hardware acquired/rented
+
+### Alpha
+
+- [ ] Full playthrough on min spec
+- [ ] Controller support verified
+- [ ] Major graphics issues found
+- [ ] Platform SDK integrated
+
+### Beta
+
+- [ ] All matrix configurations tested
+- [ ] Edge cases explored
+- [ ] Certification pre-check done
+- [ ] Store page requirements met
+
+### Release
+
+- [ ] Final certification passed
+- [ ] Known issues documented
+- [ ] Workarounds communicated
+- [ ] Support matrix published
+
+## Documenting Compatibility
+
+### System Requirements
+
+```
+MINIMUM:
+- OS: Windows 10 64-bit
+- Processor: Intel Core i5-6400 or AMD equivalent
+- Memory: 8 GB RAM
+- Graphics: NVIDIA GTX 1050 or AMD RX 560
+- Storage: 50 GB available space
+
+RECOMMENDED:
+- OS: Windows 11 64-bit
+- Processor: Intel Core i7-10700 or AMD equivalent
+- Memory: 16 GB RAM
+- Graphics: NVIDIA RTX 3060 or AMD RX 6700 XT
+- Storage: 50 GB SSD
+```
+
+### Known Issues
+
+Maintain a public-facing list of known compatibility issues with:
+
+- Affected configurations
+- Symptoms
+- Workarounds
+- Fix status