agent-harness 0.9.0 → 0.10.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 8162991fcf80a1cfe21b522abe909f615e87e56942b8261f5ee3cbb9a86f18c2
-  data.tar.gz: 22f7b57522dc3f38dd73a5200cbf878ca72d0b22d889c29bfa58ca878725a705
+  metadata.gz: 3549cf974343fcdb961dea202dc22b84f820671a29f9139f1e36bb9c8a6363d4
+  data.tar.gz: a35417365aba964248a50cc44d543fd6e11e18a7c27946d7f7750cdfa6347cf0
 SHA512:
-  metadata.gz: 1a9f60dc02f229765786bfe38c5cc84f489f52efb8d146f1a0595f9bc03d930b6e71f2194cfb4c86d24e191e1c5d184e7030addda5f1ab09a4a9098ff3a90a7f
-  data.tar.gz: 7b4a8d87ceb151d28d867522afe69872f5a983df961b7c2a1dcccf07324c1ca8c6cc2e7ed1eb7b4dd129d7315917084a0e0da7d29c2ad4e032b6be29eda71fa2
+  metadata.gz: beb28e93b4f37ad2328f70fa4ec0e88677e0b2bf0bff2c2826fb3086aab4b9c0714692f8b17268ec3ecb58815f19021880237c6fff59821d73942cb18b008e5f
+  data.tar.gz: d12b1399447b77bf9b570b6791b7426d92e52d691b094f27329a118f1e1ba472daf794a27bc2150a0d8b9a47d825f668dc875f128ac2986e44236792c6d07d10

data/.release-please-manifest.json

@@ -1,3 +1,3 @@
 {
-  ".": "0.9.0"
+  ".": "0.10.0"
 }

data/CHANGELOG.md

@@ -1,5 +1,17 @@
 ## [Unreleased]
 
+## [0.10.0](https://github.com/viamin/agent-harness/compare/agent-harness/v0.9.0...agent-harness/v0.10.0) (2026-04-21)
+
+
+### Features
+
+* **codex:** expose JSONL transcript parser ([#148](https://github.com/viamin/agent-harness/issues/148)) ([05312ea](https://github.com/viamin/agent-harness/commit/05312eaf9c11fff50931e511ee6e534838eb8746))
+
+
+### Bug Fixes
+
+* **copilot:** github-copilot-cli does not support the -p flag used by build_command ([#141](https://github.com/viamin/agent-harness/issues/141)) ([d06fbc4](https://github.com/viamin/agent-harness/commit/d06fbc414489d6c3bc93a122d0eb2a5771ddbb26))
+
 ## [0.9.0](https://github.com/viamin/agent-harness/compare/agent-harness/v0.8.0...agent-harness/v0.9.0) (2026-04-19)
 
 

data/README.md

@@ -501,6 +501,29 @@ AgentHarness.auth_status(:claude)
 
 For providers without a built-in auth check (including `:api_key` providers), `auth_valid?` returns `false` and `auth_status` returns an error indicating the check is not implemented. Custom providers can implement an `auth_status` instance method to provide their own check.
 
+### Auth Flow Capabilities
+
+Before rendering provider-specific auth controls, check whether the flow is supported:
+
+```ruby
+AgentHarness.auth_url_supported?(:claude)
+# => true
+
+AgentHarness.auth_url_supported?(:codex)
+# => false
+
+AgentHarness.refresh_auth_supported?(:claude)
+# => true
+
+AgentHarness.refresh_auth_supported?(:codex)
+# => false
+
+AgentHarness.auth_capabilities(:codex)
+# => { auth_type: :api_key, auth_url: false, refresh: false }
+```
+
+Provider aliases are resolved the same way as other auth APIs, so `:anthropic` reports the same capabilities as `:claude`. Unknown providers raise `AgentHarness::ProviderNotFoundError`, matching `auth_url` and `refresh_auth` provider lookup behavior.
+
 ### Auth Error Detection
 
 When a CLI agent fails due to expired or invalid authentication, `send_message` raises `AuthenticationError` with the provider name. Authentication errors are always surfaced directly to the caller (never auto-switched to another provider) so your application can trigger the appropriate re-auth flow:
@@ -509,9 +532,15 @@ When a CLI agent fails due to expired or invalid authentication, `send_message`
 begin
   AgentHarness.send_message("Hello", provider: :claude)
 rescue AgentHarness::AuthenticationError => e
-  puts e.provider  # => :claude
-  puts e.message   # => "oauth token expired"
-  # Trigger re-authentication flow for the specific provider
+  provider = e.provider
+
+  if AgentHarness.auth_url_supported?(provider)
+    redirect_to AgentHarness.auth_url(provider)
+  elsif AgentHarness.refresh_auth_supported?(provider)
+    render :reauth_token_form, locals: { provider: provider }
+  else
+    render :auth_expired_without_refresh, locals: { provider: provider, message: e.message }
+  end
 end
 ```
 
@@ -524,7 +553,7 @@ AgentHarness.auth_url(:claude)
 # => "https://claude.ai/oauth/authorize"
 ```
 
-This raises `NotImplementedError` for `:api_key` providers.
+This raises `AgentHarness::UnsupportedAuthFlowError` for `:api_key` providers or providers whose OAuth URL flow is not implemented. The exception inherits from `AgentHarness::Error` and `StandardError`, so host applications can rescue it with their normal app-level error handling.
 
 ### Credential Refresh
 
@@ -537,7 +566,9 @@ AgentHarness.refresh_auth(:claude, token: "new-oauth-token")
 
 Any existing expiry metadata in the credentials file is cleared on refresh so that `auth_valid?` returns `true` immediately after a successful refresh.
 
-This raises `NotImplementedError` for `:api_key` providers. Credential file paths respect the `CLAUDE_CONFIG_DIR` environment variable.
+This raises `AgentHarness::UnsupportedAuthFlowError` for `:api_key` providers or providers whose credential refresh flow is not implemented. Credential file paths respect the `CLAUDE_CONFIG_DIR` environment variable.
+
+If you currently rescue `NotImplementedError` for unsupported auth URL generation or credential refresh, update that code to rescue `AgentHarness::UnsupportedAuthFlowError` or the broader `AgentHarness::Error` instead.
 
 ## Provider Health Checks
 

data/lib/agent_harness/authentication.rb

@@ -35,19 +35,46 @@ module AgentHarness
         end
       end
 
+      # Get authentication flow capabilities for a provider.
+      #
+      # @param provider_name [Symbol] the provider name
+      # @return [Hash] capabilities with :auth_type, :auth_url, :refresh keys
+      # @raise [ProviderNotFoundError] if provider is unknown
+      def auth_capabilities(provider_name)
+        provider_name = provider_name.to_sym
+        provider = resolve_provider(provider_name)
+        canonical_name = Providers::Registry.instance.canonical_name(provider_name)
+        flow_supported = claude_oauth_flow_provider?(provider_name, canonical_name)
+
+        {
+          auth_type: provider.auth_type,
+          auth_url: flow_supported,
+          refresh: flow_supported
+        }
+      end
+
+      # Check whether OAuth URL generation is supported for a provider.
+      #
+      # @param provider_name [Symbol] the provider name
+      # @return [Boolean] true if auth_url can be called for the provider
+      # @raise [ProviderNotFoundError] if provider is unknown
+      def auth_url_supported?(provider_name)
+        auth_capabilities(provider_name)[:auth_url]
+      end
+
       # Generate an OAuth URL for a provider
       #
       # Only supported for :oauth auth type providers.
       #
       # @param provider_name [Symbol] the provider name
       # @return [String] the OAuth authorization URL
-      # @raise [NotImplementedError] if provider doesn't support OAuth
+      # @raise [UnsupportedAuthFlowError] if provider doesn't support OAuth
       def auth_url(provider_name)
         provider_name = provider_name.to_sym
         provider = resolve_provider(provider_name)
 
         unless provider.auth_type == :oauth
-          raise NotImplementedError,
+          raise UnsupportedAuthFlowError,
             "Provider #{provider_name} uses #{provider.auth_type} auth and does not support OAuth URL generation"
         end
 
@@ -55,29 +82,38 @@ module AgentHarness
         when :claude, :anthropic
           claude_auth_url
         else
-          raise NotImplementedError,
+          raise UnsupportedAuthFlowError,
             "OAuth URL generation is not yet implemented for provider #{provider_name}"
         end
       end
 
+      # Check whether credential refresh is supported for a provider.
+      #
+      # @param provider_name [Symbol] the provider name
+      # @return [Boolean] true if refresh_auth can be called for the provider
+      # @raise [ProviderNotFoundError] if provider is unknown
+      def refresh_auth_supported?(provider_name)
+        auth_capabilities(provider_name)[:refresh]
+      end
+
       # Refresh authentication credentials for a provider
       #
       # For OAuth providers, stores a pre-exchanged token directly.
       # This method accepts a token (not an authorization code) because
       # the OAuth code-exchange flow is provider-specific and should be
       # handled by the caller or a CLI login command before calling this.
-      # For API key providers, raises NotImplementedError.
+      # For API key providers, raises UnsupportedAuthFlowError.
       #
       # @param provider_name [Symbol] the provider name
       # @param token [String] OAuth token to store (must be non-blank)
       # @return [Hash] result with :success key
-      # @raise [NotImplementedError] if provider doesn't support credential refresh
+      # @raise [UnsupportedAuthFlowError] if provider doesn't support credential refresh
       def refresh_auth(provider_name, token: nil)
         provider_name = provider_name.to_sym
         provider = resolve_provider(provider_name)
 
         unless provider.auth_type == :oauth
-          raise NotImplementedError,
+          raise UnsupportedAuthFlowError,
             "Provider #{provider_name} uses #{provider.auth_type} auth and does not support credential refresh"
         end
 
@@ -85,13 +121,17 @@ module AgentHarness
         when :claude, :anthropic
           refresh_claude_auth(token: token)
         else
-          raise NotImplementedError,
+          raise UnsupportedAuthFlowError,
             "Credential refresh is not yet implemented for provider #{provider_name}"
         end
       end
 
       private
 
+      def claude_oauth_flow_provider?(requested_name, canonical_name)
+        [:claude, :anthropic].include?(requested_name) || canonical_name == :claude
+      end
+
       def resolve_provider(provider_name)
         klass = Providers::Registry.instance.get(provider_name)
         canonical_name = Providers::Registry.instance.canonical_name(provider_name)

data/lib/agent_harness/errors.rb

@@ -66,6 +66,9 @@ module AgentHarness
   # subscription to API-metered usage.
   class AuthMismatchError < AuthenticationError; end
 
+  # Raised when a provider does not support the requested authentication flow.
+  class UnsupportedAuthFlowError < Error; end
+
   # Configuration errors
   class ConfigurationError < Error; end
 

data/lib/agent_harness/providers/codex.rb

@@ -139,6 +139,28 @@ module AgentHarness
         def smoke_test_contract
           Base::DEFAULT_SMOKE_TEST_CONTRACT
         end
+
+        def parse_cli_jsonl_transcript(raw_output, max_events: nil)
+          return new.send(:parse_jsonl_output, "") if max_events && max_events <= 0
+
+          output = max_events ? tail_nonempty_lines(raw_output, limit: max_events).join("\n") : raw_output
+
+          new.send(:parse_jsonl_output, output)
+        end
+
+        private
+
+        def tail_nonempty_lines(text, limit:)
+          return [] if limit <= 0
+
+          text.to_s.each_line.each_with_object([]) do |line, lines|
+            stripped = line.strip
+            next if stripped.empty?
+
+            lines.shift if lines.size >= limit
+            lines << stripped
+          end
+        end
       end
 
       def name
@@ -603,10 +625,11 @@ module AgentHarness
           when "turn.completed"
             turn_usage = build_token_usage(event["usage"])
             result = event["result"]
+            result_parts = result.is_a?(String) ? [result] : extract_task_complete_parts(event)
             wrapped_completion_without_new_output =
               pending_turn_usage_source == :wrapped &&
               pending_turn_usage &&
-              !result.is_a?(String) &&
+              result_parts.nil? &&
               (turn_usage.nil? || current_turn_parts.empty? || current_turn_parts.equal?(pending_wrapped_output_parts))
 
             if wrapped_completion_without_new_output
@@ -663,8 +686,8 @@ module AgentHarness
               pending_wrapped_same_turn_finalization = false
             end
 
-            if result.is_a?(String)
-              current_turn_parts = [result]
+            if result_parts
+              current_turn_parts = result_parts
               saw_assistant_output = true
               current_turn_finalized_output = true
             end

data/lib/agent_harness/providers/github_copilot.rb

@@ -8,12 +8,12 @@ module AgentHarness
     class GithubCopilot < Base
       include TokenUsageParsing
 
-      PACKAGE_NAME = "@githubnext/github-copilot-cli"
-      SUPPORTED_CLI_VERSION = "0.1.36"
-      SUPPORTED_CLI_REQUIREMENT = Gem::Requirement.new(">= #{SUPPORTED_CLI_VERSION}", "< 0.2.0").freeze
-
       MODEL_PATTERN = /^gpt-[\d.o-]+(?:-turbo)?(?:-mini)?$/i
       JSON_OUTPUT_MIN_VERSION = Gem::Version.new("0.0.422").freeze
+      SUBCOMMAND_CLI_MIN_VERSION = Gem::Version.new("0.1.0").freeze
+      UNSUPPORTED_SUBCOMMAND_CLI_MESSAGE =
+        "github-copilot-cli 0.1.x does not expose a non-interactive send interface; " \
+        "the what-the-shell subcommand is interactive and cannot be used by AgentHarness."
 
       SMOKE_TEST_CONTRACT = {
         prompt: "Reply with exactly OK.",
@@ -34,41 +34,22 @@ module AgentHarness
 
         def available?
           executor = AgentHarness.configuration.command_executor
-          !!executor.which(binary_name)
-        end
-
-        def installation_contract(version: SUPPORTED_CLI_VERSION)
-          version = version.strip if version.respond_to?(:strip)
-          validate_install_version!(version)
-          package_spec = "#{PACKAGE_NAME}@#{version}".freeze
-          install_command_prefix = ["npm", "install", "-g", "--ignore-scripts"].freeze
-          install_command = (install_command_prefix + [package_spec]).freeze
-          version_requirement = SUPPORTED_CLI_REQUIREMENT.requirements
-            .map { |op, ver| "#{op} #{ver}".freeze }
-            .freeze
-
-          contract = {
-            source: {
-              type: :npm,
-              package: PACKAGE_NAME
-            }.freeze,
-            install_command_prefix: install_command_prefix,
-            install_command: install_command,
-            binary_name: binary_name,
-            default_version: SUPPORTED_CLI_VERSION,
-            version: version,
-            version_requirement: version_requirement,
-            supported_version_requirement: SUPPORTED_CLI_REQUIREMENT.to_s
-          }
+          return false unless executor.which(binary_name)
 
-          contract.each_value do |value|
-            value.freeze if value.is_a?(String)
-          end
-          contract.freeze
+          !subcommand_cli_version?(copilot_cli_version(executor: executor))
+        rescue
+          false
         end
 
-        def install_command(version: SUPPORTED_CLI_VERSION)
-          installation_contract(version: version)[:install_command]
+        def installation_contract(version: nil)
+          # The published @githubnext/github-copilot-cli package only has
+          # 0.1.x releases, and those expose an interactive subcommand instead
+          # of the non-interactive -p prompt path AgentHarness uses.
+          nil
+        end
+
+        def install_command(version: nil)
+          installation_contract(version: version)&.fetch(:install_command)
         end
 
         def provider_metadata_overrides
@@ -134,26 +115,26 @@ module AgentHarness
 
         private
 
-        def validate_install_version!(version)
-          unless version.is_a?(String) && !version.strip.empty?
-            raise ArgumentError,
-              "Unsupported GitHub Copilot CLI version #{version.inspect}; " \
-              "supported versions must satisfy #{SUPPORTED_CLI_REQUIREMENT}"
-          end
+        def copilot_cli_version(executor:)
+          result = executor.execute([binary_name, "--version"], timeout: 5, env: {})
+          extract_version(result)
+        rescue
+          nil
+        end
 
-          parsed_version = begin
-            Gem::Version.new(version)
-          rescue ArgumentError
-            raise ArgumentError,
-              "Unsupported GitHub Copilot CLI version #{version.inspect}; " \
-              "supported versions must satisfy #{SUPPORTED_CLI_REQUIREMENT}"
-          end
+        def subcommand_cli_version?(version)
+          !version.nil? && version >= SUBCOMMAND_CLI_MIN_VERSION
+        end
 
-          return if SUPPORTED_CLI_REQUIREMENT.satisfied_by?(parsed_version)
+        def extract_version(result)
+          return nil unless result.success?
 
-          raise ArgumentError,
-            "Unsupported GitHub Copilot CLI version #{version.inspect}; " \
-            "supported versions must satisfy #{SUPPORTED_CLI_REQUIREMENT}"
+          version_string = [result.stdout, result.stderr].compact.join("\n")[/\d+\.\d+\.\d+(?:[-+][A-Za-z0-9.-]+)?/]
+          return nil if version_string.nil? || version_string.empty?
+
+          Gem::Version.new(version_string)
+        rescue ArgumentError
+          nil
         end
       end
 
@@ -194,18 +175,22 @@ module AgentHarness
         }
       end
 
-      def dangerous_mode_flags(probe_timeout: nil, env: {})
-        return [] unless supports_json_output_format?(probe_timeout: probe_timeout, env: env)
+      def dangerous_mode_flags(probe_timeout: nil, env: {}, version: nil)
+        version ||= copilot_cli_version(probe_timeout: probe_timeout, env: env)
+        return [] if subcommand_cli_version?(version)
+        return [] unless supports_json_output_format?(version: version)
 
         ["--allow-all"]
       end
 
-      def supports_sessions?
-        true
+      def supports_sessions?(probe_timeout: nil, env: {}, version: nil)
+        legacy_prompt_cli?(version: version, probe_timeout: probe_timeout, env: env)
       end
 
-      def session_flags(session_id)
+      def session_flags(session_id, version: nil, probe_timeout: nil, env: {})
         return [] unless session_id && !session_id.empty?
+        return [] unless legacy_prompt_cli?(version: version, probe_timeout: probe_timeout, env: env)
+
         ["--resume", session_id]
       end
 
@@ -221,7 +206,7 @@ module AgentHarness
           output_format: :text,
           sandbox_aware: false,
           uses_subcommand: false,
-          non_interactive_flag: "-p",
+          non_interactive_flag: nil,
           legitimate_exit_codes: [0],
           stderr_is_diagnostic: true,
           parses_rate_limit_reset: false
@@ -324,11 +309,15 @@ module AgentHarness
       protected
 
       def build_command(prompt, options)
-        cmd = [self.class.binary_name, "-p", prompt]
         env = options.fetch(:_command_env) { build_env(options) }
         runtime = options[:provider_runtime]
+        version = copilot_cli_version(probe_timeout: options[:_version_probe_timeout], env: env)
 
-        if supports_json_output_format?(probe_timeout: options[:_version_probe_timeout], env: env)
+        raise unsupported_subcommand_cli_error if subcommand_cli_version?(version)
+
+        cmd = [self.class.binary_name, "-p", prompt]
+
+        if supports_json_output_format?(version: version)
           cmd += ["--output-format", "json"]
         else
           # Silent mode suppresses the model/stats decoration older CLIs print in
@@ -340,11 +329,11 @@ module AgentHarness
         cmd += ["--model", model] if model
         if options[:dangerous_mode] && supports_dangerous_mode?
           cmd += programmatic_tool_approval_flags
-          cmd += dangerous_mode_flags(probe_timeout: options[:_version_probe_timeout], env: env)
+          cmd += dangerous_mode_flags(version: version)
         end
 
         if options[:session] && !options[:session].empty?
-          cmd += session_flags(options[:session])
+          cmd += session_flags(options[:session], version: version)
         end
 
         cmd
@@ -385,9 +374,22 @@ module AgentHarness
         ["--allow-all-tools"]
       end
 
-      def supports_json_output_format?(probe_timeout: nil, env: {})
-        version = copilot_cli_version(probe_timeout: probe_timeout, env: env)
-        !version.nil? && version >= JSON_OUTPUT_MIN_VERSION
+      def supports_json_output_format?(probe_timeout: nil, env: {}, version: nil)
+        version ||= copilot_cli_version(probe_timeout: probe_timeout, env: env)
+        !version.nil? && !subcommand_cli_version?(version) && version >= JSON_OUTPUT_MIN_VERSION
+      end
+
+      def legacy_prompt_cli?(probe_timeout: nil, env: {}, version: nil)
+        version ||= copilot_cli_version(probe_timeout: probe_timeout, env: env)
+        !version.nil? && !subcommand_cli_version?(version)
+      end
+
+      def subcommand_cli_version?(version)
+        self.class.send(:subcommand_cli_version?, version)
+      end
+
+      def unsupported_subcommand_cli_error
+        ProviderError.new(UNSUPPORTED_SUBCOMMAND_CLI_MESSAGE)
       end
 
       def copilot_cli_version(probe_timeout: nil, env: {})
@@ -443,14 +445,7 @@ module AgentHarness
       end
 
       def extract_version(result)
-        return nil unless result.success?
-
-        version_string = [result.stdout, result.stderr].compact.join("\n")[/\d+\.\d+\.\d+(?:[-+][A-Za-z0-9.-]+)?/]
-        return nil if version_string.nil? || version_string.empty?
-
-        Gem::Version.new(version_string)
-      rescue ArgumentError
-        nil
+        self.class.send(:extract_version, result)
       end
 
       def parse_jsonl_output(output)

data/lib/agent_harness/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module AgentHarness
-  VERSION = "0.9.0"
+  VERSION = "0.10.0"
 end

data/lib/agent_harness.rb

@@ -184,19 +184,43 @@ module AgentHarness
       Authentication.auth_status(provider_name)
     end
 
+    # Get authentication flow capabilities for a provider
+    # @param provider_name [Symbol] the provider name
+    # @return [Hash] capabilities with :auth_type, :auth_url, :refresh keys
+    # @raise [ProviderNotFoundError] if provider is unknown
+    def auth_capabilities(provider_name)
+      Authentication.auth_capabilities(provider_name)
+    end
+
+    # Check whether OAuth URL generation is supported for a provider
+    # @param provider_name [Symbol] the provider name
+    # @return [Boolean] true if auth_url can be called for the provider
+    # @raise [ProviderNotFoundError] if provider is unknown
+    def auth_url_supported?(provider_name)
+      Authentication.auth_url_supported?(provider_name)
+    end
+
     # Generate an OAuth URL for a provider
     # @param provider_name [Symbol] the provider name
     # @return [String] the OAuth authorization URL
-    # @raise [NotImplementedError] if provider doesn't support OAuth
+    # @raise [UnsupportedAuthFlowError] if provider doesn't support OAuth
     def auth_url(provider_name)
       Authentication.auth_url(provider_name)
     end
 
+    # Check whether credential refresh is supported for a provider
+    # @param provider_name [Symbol] the provider name
+    # @return [Boolean] true if refresh_auth can be called for the provider
+    # @raise [ProviderNotFoundError] if provider is unknown
+    def refresh_auth_supported?(provider_name)
+      Authentication.refresh_auth_supported?(provider_name)
+    end
+
     # Refresh authentication credentials for a provider
     # @param provider_name [Symbol] the provider name
     # @param token [String, nil] OAuth token to store
     # @return [Hash] result with :success key
-    # @raise [NotImplementedError] if provider doesn't support credential refresh
+    # @raise [UnsupportedAuthFlowError] if provider doesn't support credential refresh
     def refresh_auth(provider_name, token: nil)
       Authentication.refresh_auth(provider_name, token: token)
     end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: agent-harness
 version: !ruby/object:Gem::Version
-  version: 0.9.0
+  version: 0.10.0
 platform: ruby
 authors:
 - Bart Agapinan