whois-parser-next 0.3.0 → 0.3.2

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 5c90a3f9e48b3ede88480bcaec9eabccfe31a7f60cf867df226192f54e0dbe29
-  data.tar.gz: 683529a7de7ea08c12065878dbc59d364f43163264d2c8338f1b90011aec5821
+  metadata.gz: 4dd7f05a922301b74d2dccf983d9712ac9611198244bb84bf7da9d3106eb6985
+  data.tar.gz: 474233b88fad6dad201ca87d0d5c91e5a15a8abab76904192710d644a74420db
 SHA512:
-  metadata.gz: d9608362d4824d5c3a9044b3dd59e2c82935e915c88b938af75c9f8904852fab632b2e76132f25fd7a4faf7652ed63cdd54f86327c73e9efa1326df5d0225c14
-  data.tar.gz: 8c93323b08ea3c950f809bd201026a4a2a5086f9d5fddfcb31dad8a2888a5857ad4810f3932b3995b1abf4adee44fa4bf6354f96191527b5799952f4508a40e2
+  metadata.gz: 0f041533d14ae1f57dfe6ea92e1967bb1ef5fdfb40379f4eea079c2bf37c58adadf53e8ed0685e0e55076ba9df44341b5a91f9115e59478a67f1c178d66fae76
+  data.tar.gz: 762d431b3ec1aa9b967a68b74f346ed41fbb37adbbb4f5304fb8e615dec298308f5f276f54a06e57da5b8a1bc217f6dd4b5f57c0df5e62c6142f1202d1069c41

data/CHANGELOG.md

@@ -2,6 +2,41 @@
 
 This project uses [Semantic Versioning 2.0.0](http://semver.org/).
 
+#### Release 0.3.2 (2026-09-25)
+
+- ADDED: Added host-keyed parsers for the current IANA-listed WHOIS hosts for
+  `.mu` (`whois.tld.mu`), `.africa` (`whois.nic.africa`), and `.sr`
+  (`whois.sr`). These parsers recognize the documented current registered and
+  authoritative-absence response shapes, while empty, denied, throttled, and
+  ambiguous responses remain non-positive.
+- LIMITATION: The pinned `whois` 6.0.3 client routes `.mu` and `.africa` to
+  different hosts and has no `.sr` mapping. The new parsers are selected only
+  for response parts keyed to their IANA-listed hosts; this release does not
+  add default-client routing or claim effective application coverage for
+  these TLDs.
+- CORRECTION (2026-09-25): The corrected top-1,000 scorecard retracts the
+  previously published 175-pair total. Its bounded rowwise crosswalk
+  reproduces 130 directly traceable report-pair observations, with 31 package
+  rows remaining detail-insufficient. The later `.top`, `.uz`, and `.sa`
+  scorecard follow-ups, and the `.mu`, `.africa`, and `.sr` host-specific
+  reports in this release, remain outside that pinned baseline. These are
+  audit-evidence counts, not parser coverage or an effective-coverage rate.
+- EVIDENCE: [`.mu` and `.africa` current-host report](docs/audits/top-201-250-current-host-followup-2026-09-25.md),
+  [`.sr` current-host report](docs/audits/topdomains-251-275-sr-followup-2026-09-25.md),
+  and [corrected scorecard](docs/audits/top-1000-effective-coverage-scorecard-2026-09-25.md).
+
+#### Release 0.3.1 (2026-09-25)
+
+- ADDED: Added paired registered and exact authoritative-absence parsing for
+  `.ma` and `.hn`. Empty and denied replies remain unavailable, rate limits
+  remain throttled, and conflicting or incomplete replies remain unknown.
+- FIXED: Corrected `.pk` parsing for PKNIC's observed indented response
+  fields. Registration and availability still require explicit markers;
+  incomplete or conflicting replies remain unknown, and denied or throttled
+  replies remain non-positive.
+- EVIDENCE: [Current `.ma` and `.hn` responses](docs/audits/top-126-150-tlds-2026-09-19.md)
+  and [production-shaped `.pk` responses](docs/audits/top1000-es-pk-shop-dev-app-2026-09-25.md).
+
 
 #### Release 0.3.0 (2026-09-25)
 
@@ -23,12 +58,17 @@ This project uses [Semantic Versioning 2.0.0](http://semver.org/).
   added unavailable-only handling for explicit unsupported responses from
   `.digital`, `.email`, `.live`, `.media`, `.network`, and `.services`.
 - DOCS: Added a scorecard for 1,000 observed TLD strings from the ICANN DNS
-  Magnitude snapshot dated 2026-09-12. Its strict count of 175 paired rows is
-  pinned to parser baseline `f2c822c` and excludes the Top 100, whose summary
-  labels do not expose row-level evidence pairs. The scorecard does not claim
-  1,000 effective WHOIS integrations or a single effective-coverage rate.
-  Later `.uz`/`.sa` evidence and `.pk`/`.ge` parsers are follow-ups, not
-  additions to that pinned count.
+  Magnitude snapshot dated 2026-09-12. The original scorecard stated 175
+  paired rows and excluded the Top 100, whose summary labels do not expose
+  row-level evidence pairs. See the dated correction below; the scorecard
+  does not claim 1,000 effective WHOIS integrations or a single
+  effective-coverage rate.
+- CORRECTION (2026-09-25): A rowwise crosswalk could not reproduce the
+  originally published 175-pair claim. The corrected scorecard and bounded
+  evidence ledger identify 130 directly traceable snapshot pair observations
+  and 31 package rows with insufficient row-level detail; later `.top`,
+  `.uz`, and `.sa` pairs are recorded separately. These are report evidence
+  counts, not effective parser coverage.
 - SOURCES: The audit notes link to the [ICANN DNS Magnitude
   snapshot](https://magnitude.research.icann.org/historic/20260912.full.html),
   [IANA `.top`](https://www.iana.org/domains/root/db/top.html),

data/README.md

@@ -38,7 +38,7 @@ of current WHOIS responses, explicit unknown states, registry-specific
 fixtures, and safe handling of malformed, rate-limited, retired, or changed
 server responses.
 
-The current source version is `0.3.0`. Check the [RubyGems project
+The current source version is `0.3.2`. Check the [RubyGems project
 page](https://rubygems.org/gems/whois-parser-next) for its publication status
 and the latest published version.
 
@@ -54,11 +54,10 @@ Whois::Parser
 ```
 
 Existing applications can retain `require "whois-parser"` and their
-`Whois::Parser` integrations. To install version 0.3.0 after it appears on
-RubyGems, pin it as follows:
+`Whois::Parser` integrations. To install version 0.3.2, pin it as follows:
 
 ```ruby
-gem "whois-parser-next", "= 0.3.0", require: "whois-parser"
+gem "whois-parser-next", "= 0.3.2", require: "whois-parser"
 ```
 
 ## Requirements
@@ -87,18 +86,23 @@ The [2026-09-25 scorecard](docs/audits/top-1000-effective-coverage-scorecard-202
 summarizes evidence for 1,000 observed TLD strings from the
 [ICANN DNS Magnitude snapshot dated 2026-09-12](https://magnitude.research.icann.org/historic/20260912.full.html).
 These strings are not 1,000 guaranteed working WHOIS registries or
-domain-availability results. Its strict paired count is pinned to baseline
-`f2c822c`, excludes the Top 100 whose summary labels do not expose row-level
-evidence pairs, and does not claim an effective-coverage percentage. The
-scorecard keeps verified parser evidence, explicit unavailable or unsupported
-responses, unknown or unresolved endpoints, and classification-only rows
-distinct. Later `.uz`/`.sa` paired evidence and `.pk`/`.ge` parsers are
-follow-ups, not changes to the pinned scorecard counts. The `.pk` parser does
-not make the default `whois` 6.0.3 Web adapter use port 43; `Whois::Client`
-host configuration does not override that adapter. The `.ge` parser targets
-IANA's `whois.nic.ge`, while the default `whois` route is
-`whois.registration.ge`. Both require explicit fixed-host routing before an
-application can count them as effective coverage.
+domain-availability results. A dated correction retracts the previously
+published 175 paired count: the hand-audited report crosswalk reproduces 130
+direct row-pair observations (61 at ranks 101–300 and 69 at 301–1000), with 31
+package rows remaining detail-insufficient. Three later pairs (`.top`, `.uz`,
+`.sa`) are tracked separately from that pinned baseline. See the [corrected
+scorecard](docs/audits/top-1000-effective-coverage-scorecard-2026-09-25.md),
+[methodology](docs/audits/top1000-evidence-ledger-methodology-2026-09-25.md),
+and [bounded machine-readable subset](docs/audits/data/whois-parser-top1000-evidence-ledger-subset-2026-09-25.csv).
+No effective-coverage percentage is asserted. Summary-only, unsupported,
+unknown, one-sided, and classification-only evidence is not promoted to a
+pair. The `.pk` parser does not make the default `whois` 6.0.3 Web adapter use
+port 43; `Whois::Client` host configuration does not override that adapter.
+The `.ge` parser targets IANA's `whois.nic.ge`, while the default `whois` route
+is `whois.registration.ge`. The `.mu` and `.africa` parsers also target IANA
+hosts that differ from the default `whois` 6.0.3 mappings, and `.sr` has no
+default mapping. These host-keyed parsers require separately verified routing
+before an application can count them as effective coverage.
 
 Start with the [source verification report](docs/audits/top-1000-source-verification-2026-09-19.md),
 the [Top 20 review](docs/audits/top-20-tlds-2026-09-19.md), and the [Top 100

data/RELEASING.md

@@ -21,8 +21,8 @@ RubyGems API key to the repository or its Actions secrets.
 Create and push the annotated release tag only after the checks above pass:
 
 ```shell
-git tag -a v0.3.0 -m "whois-parser-next 0.3.0"
-git push origin v0.3.0
+git tag -a v0.3.2 -m "whois-parser-next 0.3.2"
+git push origin v0.3.2
 ```
 
 The release workflow repeats the full suite and package smoke test before it

data/lib/whois/parser/version.rb

@@ -1,6 +1,6 @@
 module Whois
   class Parser
     # The current library version.
-    VERSION = "0.3.0".freeze
+    VERSION = "0.3.2".freeze
   end
 end

data/lib/whois/parsers/whois.nic.africa.rb

@@ -0,0 +1,23 @@
+require_relative 'base_icann_compliant'
+
+module Whois
+  class Parsers
+    # Parser for IANA's current .africa WHOIS endpoint, whois.nic.africa.
+    #
+    # The registry's exact `No information was found matching that query.`
+    # response is treated as absence. Other unrecognised responses remain
+    # unknown, and inherited response-safety checks preserve denials and
+    # throttling as errors.
+    class WhoisNicAfrica < BaseIcannCompliant
+      property_supported :available? do
+        content_for_scanner.match?(
+          /^[ \t]*No information was found matching that query\.[ \t]*$/i
+        )
+      end
+
+      property_supported :expires_on do
+        node("Registry Expiry Date") { |value| parse_time(value) }
+      end
+    end
+  end
+end

data/lib/whois/parsers/whois.nic.hn.rb

@@ -24,14 +24,14 @@ module Whois
 
       property_supported :status do
         if no_object_found?
-          :available
+          registration_fields_present? ? :unknown : :available
         else
           super()
         end
       end
 
       property_supported :available? do
-        no_object_found? || super()
+        status == :available
       end
 
       property_supported :registered? do
@@ -43,6 +43,12 @@ module Whois
       def no_object_found?
         content_for_scanner.match?(/^The queried object does not exist:\s*No Object Found\s*$/i)
       end
+
+      def registration_fields_present?
+        content_for_scanner.match?(
+          /^[ \t]*(?:Domain Status|Domain ID|Creation Date|Updated Date|Registry Expiry Date|Name Server|(?:Sponsoring )?Registrar|Registrant|Admin|Billing|Tech):/i
+        )
+      end
     end
 
   end

data/lib/whois/parsers/whois.pknic.net.pk.rb

@@ -52,17 +52,17 @@ module Whois
       private
 
       def echoed_domain
-        content_for_scanner[/^Domain:\s*((?:[a-z0-9](?:[a-z0-9-]{0,61}[a-z0-9])?\.)+pk)\s*$/i, 1]
+        content_for_scanner[/^ {0,8}Domain:[ \t]*((?:[a-z0-9](?:[a-z0-9-]{0,61}[a-z0-9])?\.)+pk)[ \t]*$/i, 1]
       end
 
       def registered_evidence?
-        !!(echoed_domain && content_for_scanner.match?(/^Status: Domain is Registered\s*$/))
+        !!(echoed_domain && content_for_scanner.match?(/^ {0,8}Status: Domain is Registered[ \t]*$/))
       end
 
       def available_evidence?
         !!(echoed_domain &&
-          content_for_scanner.match?(/^Status: Not Registered, and may be available if valid\s*$/) &&
-          content_for_scanner.match?(/^Available: Yes\.\s*$/))
+          content_for_scanner.match?(/^ {0,8}Status: Not Registered, and may be available if valid[ \t]*$/) &&
+          content_for_scanner.match?(/^ {0,8}Available: Yes\.[ \t]*$/))
       end
     end
 

data/lib/whois/parsers/whois.registre.ma.rb

@@ -27,21 +27,15 @@ module Whois
       include RegistryResponseSafety
 
       property_supported :status do
-        if available?
-          :available
-        elsif content_for_scanner.match?(/^domain:/i)
-          :registered
-        else
-          :unknown
-        end
+        classify_status
       end
 
       property_supported :available? do
-        !!(content_for_scanner =~ /^%error 230 No Objects Found/)
+        classify_status == :available
       end
 
       property_supported :registered? do
-        status == :registered
+        classify_status == :registered
       end
 
 
@@ -59,6 +53,92 @@ module Whois
 
       property_not_supported :expires_on
 
+      private
+
+      def classify_status
+        return :unknown if conflicting_evidence?
+
+        return :registered if registered_evidence?
+        return :available if available_evidence?
+
+        :unknown
+      end
+
+      def conflicting_evidence?
+        return false unless absence_markers.any?
+
+        record_details_present? || legacy_record_evidence?
+      end
+
+      def registered_evidence?
+        return false unless valid_domain_name_fields? && domain_names.one? && absence_markers.empty?
+
+        current_record_evidence? || legacy_record_evidence?
+      end
+
+      def current_record_evidence?
+        domain_status_values == ['clientTransferProhibited https://icann.org/epp#clientTransferProhibited']
+      end
+
+      def legacy_record_evidence?
+        legacy_domain_names.one? &&
+          content_for_scanner.match?(/^[ \t]*domain:Class-Name:domain[ \t]*$/i) &&
+          content_for_scanner.match?(/^[ \t]*%ok[ \t]*$/i)
+      end
+
+      def available_evidence?
+        absence_markers.one? && valid_domain_name_fields? && !record_details_present? &&
+          !legacy_record_evidence?
+      end
+
+      def valid_domain_name_fields?
+        fields = domain_name_field_values
+        return false if domain_name_field? && fields.empty?
+
+        fields.empty? || (fields.one? && domain_names.one?)
+      end
+
+      def domain_names
+        (current_domain_names + legacy_domain_names).uniq
+      end
+
+      def domain_name_field_values
+        content_for_scanner.scan(/^[ \t]*Domain Name:[ \t]*(\S+)[ \t]*$/i).flatten +
+          content_for_scanner.scan(/^[ \t]*domain:Domain-Name:[ \t]*(\S+)[ \t]*$/i).flatten
+      end
+
+      def current_domain_names
+        content_for_scanner.scan(
+          /^[ \t]*Domain Name:[ \t]*((?:[a-z0-9](?:[a-z0-9-]{0,61}[a-z0-9])?\.)+ma)[ \t]*$/i
+        ).flatten.map(&:downcase)
+      end
+
+      def legacy_domain_names
+        content_for_scanner.scan(
+          /^[ \t]*domain:Domain-Name:[ \t]*((?:[a-z0-9](?:[a-z0-9-]{0,61}[a-z0-9])?\.)+ma)[ \t]*$/i
+        ).flatten.map(&:downcase)
+      end
+
+      def domain_status_values
+        content_for_scanner.scan(/^[ \t]*Domain Status:[ \t]*(.+?)[ \t]*$/i).flatten
+      end
+
+      def absence_markers
+        content_for_scanner.scan(
+          /^[ \t]*(?:%error 230 No Objects Found|The queried object does not exist: No Object Found)[ \t]*$/i
+        )
+      end
+
+      def domain_name_field?
+        content_for_scanner.match?(/^[ \t]*(?:Domain Name:|domain:Domain-Name:)/i)
+      end
+
+      def record_details_present?
+        content_for_scanner.match?(
+          /^[ \t]*(?:Domain Status|Domain ID|Registrar|Creation Date|Updated Date|Registry Expiry Date|Name Server|domain:Class-Name|domain:ID|domain:Auth-Area):/i
+        )
+      end
+
     end
 
   end

data/lib/whois/parsers/whois.sr.rb

@@ -0,0 +1,44 @@
+require_relative 'base_top1000_icann'
+
+module Whois
+  class Parsers
+    # Parser for the IANA-listed WHOIS server for .SR.
+    #
+    # IANA's delegation record and current server responses were checked on
+    # 2026-09-25. The generated-name response uses an exact Message marker;
+    # other incomplete responses must remain unknown.
+    class WhoisSr < BaseTop1000Icann
+      property_supported :domain do
+        node("Domain", &:downcase)
+      end
+
+      property_supported :status do
+        if reserved?
+          :reserved
+        elsif available?
+          :available
+        elsif !node("Domain").to_s.strip.empty? &&
+              node("Status").to_s.casecmp("active").zero? &&
+              !node("Creation Date").to_s.strip.empty?
+          :registered
+        else
+          :unknown
+        end
+      end
+
+      property_supported :available? do
+        content_for_scanner.match?(/^Message: No Object Found\s*$/i)
+      end
+
+      property_supported :registered? do
+        status == :registered
+      end
+
+      property_supported :nameservers do
+        Array.wrap(node("Name server")).reject(&:empty?).map do |name|
+          Parser::Nameserver.new(name: name.downcase)
+        end
+      end
+    end
+  end
+end

data/lib/whois/parsers/whois.tld.mu.rb

@@ -0,0 +1,20 @@
+require_relative 'base_icann_compliant'
+
+module Whois
+  class Parsers
+    # Parser for the IANA-listed .mu WHOIS server, whois.tld.mu.
+    #
+    # Captures from 2026-09-25 expose ICANN-style records and the exact
+    # `Domain not found.` absence marker. This host is distinct from the
+    # legacy whois.nic.mu mapping in whois 6.0.3.
+    class WhoisTldMu < BaseIcannCompliant
+      self.scanner = Scanners::BaseIcannCompliant, {
+        pattern_available: /^[ \t]*Domain not found\.[ \t]*$/i,
+      }
+
+      property_supported :expires_on do
+        node("Registry Expiry Date") { |value| parse_time(value) }
+      end
+    end
+  end
+end

data/lib/whois/scanners/base_cocca2.rb

@@ -20,6 +20,7 @@ module Whois
       DISCLAIMER_MATCHES = [
         "TERMS OF USE:", # global
         "Terminos de Uso:", # whois.nic.hn
+        "Queda absolutamente prohibido su uso", # current whois.nic.hn footer
         "The data in the WHOIS database of Meridian", # whois.meridiantld.net
         "This information is provided", # whois.gg
       ]

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: whois-parser-next
 version: !ruby/object:Gem::Version
-  version: 0.3.0
+  version: 0.3.2
 platform: ruby
 authors:
 - Simone Carletti
@@ -299,6 +299,7 @@ files:
 - lib/whois/parsers/whois.nic.accountant.rb
 - lib/whois/parsers/whois.nic.actor.rb
 - lib/whois/parsers/whois.nic.af.rb
+- lib/whois/parsers/whois.nic.africa.rb
 - lib/whois/parsers/whois.nic.ag.rb
 - lib/whois/parsers/whois.nic.agency.rb
 - lib/whois/parsers/whois.nic.ai.rb
@@ -701,12 +702,14 @@ files:
 - lib/whois/parsers/whois.sgnic.sg.rb
 - lib/whois/parsers/whois.sk-nic.sk.rb
 - lib/whois/parsers/whois.smallregistry.net.rb
+- lib/whois/parsers/whois.sr.rb
 - lib/whois/parsers/whois.srs.net.nz.rb
 - lib/whois/parsers/whois.sx.rb
 - lib/whois/parsers/whois.tcinet.ru.rb
 - lib/whois/parsers/whois.teleinfo.cn.rb
 - lib/whois/parsers/whois.thnic.co.th.rb
 - lib/whois/parsers/whois.tld.ee.rb
+- lib/whois/parsers/whois.tld.mu.rb
 - lib/whois/parsers/whois.tld.sy.rb
 - lib/whois/parsers/whois.tonic.to.rb
 - lib/whois/parsers/whois.tonicregistry.to.rb