sisimai 5.1.0 → 5.2.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 5b60a0c3953cb8512fed6e5e71e63780f8b6b681576f3a2b25787e7a98b42c36
-  data.tar.gz: 722e000aa41aa57e4efced1cf9ce3fb1c9658a725a8a027b26b58a07b31b7408
+  metadata.gz: 1361ff9bfe8b3766d3ac2a38719c055d91a1ea6ec36574675bfbf46029687470
+  data.tar.gz: 37bb5f43705adcbdedc7ccc2db6a049f405d5769aa8529aa6bdb49f0262b9070
 SHA512:
-  metadata.gz: 7ff66c2010a0eb055c34a2827f9d5824641a463c574264594d422f54e484cbe002eef9500ae1cff2878906f15e694b77f0a74e70f2cd14cf89dfd16517b4d256
-  data.tar.gz: 87a333ddb94b2f0a37c8921858e6f9be775e8f7d85a4c220fcf4a827748d230de0992049ee8e58f81e449525274290a51e7b6b7aadc93dde988e12baf654e3d3
+  metadata.gz: 786482ef8faa20a09f14660bcd294d5ffe504abfe7b1ba1bb1ee1e5dccab023436058c4e1c91345bc5dd0ec721359b6e6278105841b8a049845b59694f4ea7f4
+  data.tar.gz: 78d813269ac427deb8af80dc75f9bf42476bed3ee54cbb1aeda6c132e53d41e6a2fabb98f066b9cb0ae5d77d0a2f42053b8cc1dce893244eb8b9dd9f474af9e7

data/.github/workflows/rake-test.yml

@@ -37,7 +37,7 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        jruby: ["jruby-9.2", "jruby-9.4"]
+        jruby: ["jruby-9.4"]
     steps:
       - name: Checkout the repository(JRuby)
         uses: actions/checkout@v4

data/ChangeLog.md

@@ -3,6 +3,108 @@ RELEASE NOTES for Ruby version of Sisimai
 - releases: "https://github.com/sisimai/rb-sisimai/releases"
 - download: "https://rubygems.org/gems/sisimai"
 
+v5.2.0
+---------------------------------------------------------------------------------------------------
+- release: "5.2.0"
+- version: "Tue, 25 Feb 2025 11:17:31 +0900 (JST)"
+- changes:
+  - **Keep compatibility with the Go language version of Sisimai** #311 #318 #327
+    - **BREAKING CHANGES AT EXTERNAL USER APIs**
+        - Changes in accessors of `Sisimai::Fact` and key names in JSON string
+          - `smtpagent` has been renamed to `decodedby` #323
+          - `smtpcommand` has been renamed to `command` #323
+          - Removed accessors/keys are still available until v5.5.0
+          - New accessor and key `feedbackid`, it is a field for the `Feedback-ID:` header of the
+            original message #328
+        - New bounce reason `Sisimai::Reason::Suppressed`
+        - New bounce reason `Sisimai::Reason::FailedSTARTTLS` #322
+    - **THERE ARE SOME BREAKING CHANGES AT INTERNAL APIs**
+    - `Sisimai::SMTP::Error` has been renamed to `Sisimai::SMTP::Failure` and the following methods
+      implemented: #309
+      - `is_temporary()`
+      - `is_hardbounce()`
+      - `is_softbounce()`
+      - `soft_or_hard()` has been removed
+    - Changes in `Sisimai::Rhost` 
+      - `get()` method has been renamed to `find()`
+      - Fix bug in code to check the domain part of an email address as a remote hostname
+      - Add a new error message pattern: `hosted tenant which has no mail-enabled subscriptions'`
+        in `Sisimai::Rhost::Microsoft`
+      - Implement `name()` method
+      - Bug fix in `Sisimai::Rhost::Facebook`
+    - Remove `hardbounce` accessor from `Sisimai::Lhost` #313
+    - Implement `Sisimai::RFC3464::ThirdParty`
+    - Remove the following MTA modules from `Sisimai::Lhost` #315
+      - `Sisimai::RFC3464` can decode a bounce mail returned from services/MTAs below #317
+        - Amavis
+        - AmazonWorkMail
+        - Aol
+        - Barracuda
+        - Bigfoot
+        - Facebook
+        - McAfee
+        - MessageLabs
+        - Outlook
+        - PowerMTA
+          - Some codes for checking heaaders have been moved to `Sisimai::RFC3464::ThirdParty`
+        - ReceivingSES
+        - SendGrid
+        - SurfControl
+        - X5
+        - Yandex
+      - `Sisimai::Lhost::Exim` can decode a bounce mail returned from services/MTAs below
+        - MailRu
+        - MXLogic
+      - `Sisimai::Lhost::qmail` can decode a bounce mail returned from services/MTAs below
+        - X4
+        - Yahoo
+      - `Sisimai::Lhost::Exchange2007` can decode a bounce mail returned from Office365
+    - `Sisimai::Lhost::GSuite` has been renamed to `Sisimai::Lhost::GoogleWorkspace`
+    - `Sisimai::Lhost::AmazonSES` decodes only JSON formatted bounce mail notified from Amazon SNS
+      - The bounce mail from Amazon SES which have no JSON string is decoded by `Sisimai::RFC3464`
+    - Each error code table of the following MTA modules (removed at issue #315) have been moved to 
+      `Sisimai::Rhost::*` #318
+      - Aol
+      - Facebook
+      - GSuite
+      - MessageLabs
+      - Outlook
+    - `Sisimai::MDA` has been renamed to `Sisimai::LDA`
+    - `Sisimai::RFC791` for the IPv4 address implemented #319
+      - `Sisimai::String.ipv4` has been moved/renamed to `Sisimai::RFC791.find`
+      - Implement `Sisimai::RFC791.is_ipv4address`
+    - `Sisimai::RFC1123.is_validhostname()` has been renamed to `is_internethost()`
+    - Implement `Sisimai::RFC1123.find()`
+    - #312 `Sisimai::RFC1894.field()` method detect a comment string (returns an array which have
+      5 elements: ["field-name", "value-type", "value", "field-group", "comment"])
+    - `Reporting-MTA` indicates `lhost` in `Sisimai::RFC1894` (bug fix)
+  - Code improvement and bug fix at `Sisimai::Lhost::Exim`
+    - Remove needless condition for getting error messages
+    - Rewrite code for getting an SMTP reply code and a delivery status code
+  - Warn if `Sisimai::Message.load` method was called #302 #303
+  - Remove unused method `Sisimai::Order.deault` #304
+  - Fix bug in `Sisimai::Message.tidy()` method #305
+  - Code improvement in `Sisimai::RFC5322` and `Sisimai::ARF`
+  - Fix the minimum and the maximum SMTP Reply code: 221 and 557 in `Sisimai::SMTP::Reply`
+  - Add a new error message pattern in the followings:
+    - `Sisimai::Reason::BadReputation`
+    - `Sisimai::Reason::Blocked`
+    - `Sisimai::Reason::Filtered`
+    - `Sisimai::Reason::MailboxFull`
+    - `Sisimai::Reason::MesgTooBig`
+    - `Sisimai::Reason::RequirePTR`
+    - `Sisimai::Reason::SpamDetected`
+    - `Sisimai::Reason::SystemError`
+  - Remove regular expressions from error message patterns at the following classes: #308
+    - `Sisimai::Reason::Blocked`
+    - `Sisimai::Reason::MailerError`
+    - `Sisimai::Reason::SpamDetected`
+  - Fix typo in `Sisimai::Rhost::YahooInc` #310
+  - Bug fix: Unstable matching for getting an `Sisimai::Rhost::*` module name when the bounce mail
+    sent from Microsoft to Aol (Random key sort order of the Hash)
+  - Add `sv-SE` in `Sisimai::Lhost::Exchange2007`
+  - Large scale code improvement in `Sisimai::Lhost::V5sendmail`
+
 v5.1.0
 ---------------------------------------------------------------------------------------------------
 - release: "Mon,  1 Jul 2024 12:02:22 +0900 (JST)"

data/Makefile

@@ -57,10 +57,12 @@ release:
 
 test: user-test author-test
 user-test:
-	rake publictest
+	# Suppress warning messages until v5.5.0
+	rake publictest 2> /dev/null
 
 author-test:
-	rake privatetest
+	# Suppress warning messages until v5.5.0
+	rake privatetest 2> /dev/null
 
 check:
 	find lib -type f -exec grep --color -E ' $$' {} /dev/null \;

data/README-JA.md

@@ -10,6 +10,11 @@
 > ブランチを見てください。また`main`や`master`ブランチはもうこのリポジトリでは使用していません。
 [^1]: 4系を`clone`する場合は`git clone -b 4-stable https://github.com/sisimai/rb-sisimai.git`
 
+> [!CAUTION]
+> **Sisimai 4.25.14p11およびそれ以前のバージョンには 正規表現に関する脆弱性
+> [ReDoS: CVE-2022-4891](https://jvndb.jvn.jp/ja/contents/2022/JVNDB-2022-005663.html)があります。
+> 該当するバージョンをお使いの場合はv4.25.14p12以降へアップグレードしてください。**
+
 > [!WARNING]
 > Sisimai 5はRuby 2.4以上が必要です。インストール/アップグレードを実行する前に`ruby -v`コマンドで
 > システムに入っているRubyのバージョンを確認してください。
@@ -110,10 +115,10 @@ Install
 ### From RubyGems.org
 ```shell
 $ sudo gem install sisimai
-Fetching: sisimai-5.1.0.gem (100%)
-Successfully installed sisimai-5.1.0
-Parsing documentation for sisimai-5.1.0
-Installing ri documentation for sisimai-5.1.0
+Fetching: sisimai-5.2.0.gem (100%)
+Successfully installed sisimai-5.2.0
+Parsing documentation for sisimai-5.2.0
+Installing ri documentation for sisimai-5.2.0
 Done installing documentation for sisimai after 6 seconds
 1 gem installed
 ```
@@ -141,13 +146,13 @@ if [ -d "/usr/local/jr" ]; then \
 ...
 3 gems installed
 /opt/local/bin/rake install
-sisimai 5.1.0 built to pkg/sisimai-5.1.0.gem.
-sisimai (5.1.0) installed.
+sisimai 5.2.0 built to pkg/sisimai-5.2.0.gem.
+sisimai (5.2.0) installed.
 if [ -d "/usr/local/jr" ]; then \
 		PATH="/usr/local/jr/bin:$PATH" /usr/local/jr/bin/rake install; \
 	fi
-sisimai 5.1.0 built to pkg/sisimai-5.1.0-java.gem.
-sisimai (5.1.0) installed.
+sisimai 5.2.0 built to pkg/sisimai-5.2.0-java.gem.
+sisimai (5.2.0) installed.
 ```
 
 Usage
@@ -348,16 +353,16 @@ Sisimai 5.0.0から**Ruby 2.4以上**が必要になります。
 
 | 機能                                                 | Sisimai 4          | Sisimai 5           |
 |------------------------------------------------------|--------------------|---------------------|
-| 動作環境(CRuby)                                      | 2.1 -              | **2.4** or later    |
+| 動作環境(CRuby)                                      | 2.1 - 3.3.0        | **2.4** or later    |
 | 動作環境(JRuby)                                      | 9.0.4.0 - 9.1.17.0 | **9.2** or later    |
 | 元メールファイルを操作可能なコールバック機能         | なし               | あり[^3]            |
-| 解析エンジン(MTA/ESPモジュール)の数                  | 68                 | 73                  |
-| 検出可能なバウンス理由の数                           | 29                 | 34                  |
+| 解析エンジン(MTA/ESPモジュール)の数                  | 68                 | 58                  |
+| 検出可能なバウンス理由の数                           | 29                 | 36                  |
 | 依存Gem数(Ruby Standard Gemsを除く)                  | 1 Gem              | 1 Gem               |
-| ソースコードの行数                                   | 10,800 行          | 11,660 行           |
+| ソースコードの行数                                   | 10,800 行          | 9,860 行            |
 | テストフレームワーク                                 | rspec              | minitest            |
-| テスト件数(spec/またはtest/ディレクトリ)             | 311,000 件         | 414,000 件          |
-| 1秒間に解析できるバウンスメール数[^4]                | 231 通             | 305 通              |
+| テスト件数(spec/またはtest/ディレクトリ)             | 311,000 件         | 410,000 件          |
+| 1秒間に解析できるバウンスメール数[^4]                | 290 通             | 305 通              |
 | ライセンス                                           | 2条項BSD           | 2条項BSD            |
 | 開発会社による商用サポート                           | 提供中             | 提供中              |
 
@@ -410,6 +415,8 @@ Sisimai 5では新たに5個のバウンス理由が増えました。検出可
 | PTRレコードが未設定または無効なPTRレコード           | `Blocked`          | `RequirePTR`        |
 | RFCに準拠していないメール[^7]                        | `SecurityError`    | `NotCompliantRFC`   |
 | 単位時間の流量制限・送信速度が速すぎる               | `SecurityError`    | `Speeding`          |
+| STARTTLS関連のエラー (added at v5.2.0)               | `SecurityError`    | `FailedSTARTTLS`    |
+| 宛先がサプレッションリストに一致 (added at v5.2.0)   | `OnHold`           | `Suppressed`        |
 
 [^7]: RFC5322など
 
@@ -431,11 +438,11 @@ Related sites
 ---------------------------------------------------------------------------------------------------
 * __@libsisimai__ | [Sisimai on Twitter (@libsisimai)](https://twitter.com/libsisimai)
 * __LIBSISIMAI.ORG__ | [SISIMAI | MAIL ANALYZING INTERFACE | DECODING BOUNCES, BETTER AND FASTER.](https://libsisimai.org/)
-* __Sisimai Blog__ | [blog.libsisimai.org](http://blog.libsisimai.org/)
 * __Facebook Page__ | [facebook.com/libsisimai](https://www.facebook.com/libsisimai/)
 * __GitHub__ | [github.com/sisimai/rb-sisimai](https://github.com/sisimai/rb-sisimai)
 * __RubyGems.org__ | [rubygems.org/gems/sisimai](https://rubygems.org/gems/sisimai)
 * __Perl verson__ | [Perl version of Sisimai](https://github.com/sisimai/p5-sisimai)
+* __Go verson__ | [Go version of Sisimai](https://github.com/sisimai/go-sisimai)
 * __Fixtures__ | [set-of-emails - Sample emails for "make test"](https://github.com/sisimai/set-of-emails)
 
 See also
@@ -453,7 +460,7 @@ Author
 
 Copyright
 ===================================================================================================
-Copyright (C) 2015-2024 azumakuniyuki, All Rights Reserved.
+Copyright (C) 2015-2025 azumakuniyuki, All Rights Reserved.
 
 License
 ===================================================================================================

data/README.md

@@ -11,6 +11,11 @@
 > branch instead. We have moved away from using both the `main` and `master` branches in our development process.
 [^1]: Specify `-b 4-stable` when you clone Sisimai 4 for example, `git clone -b 4-stable https://github.com/sisimai/rb-sisimai.git`
 
+> [!CAUTION]
+> **Sisimai versions 4.25.14p11 and earlier contain a regular expression vulnerability 
+> [ReDoS: CVE-2022-4891](https://nvd.nist.gov/vuln/detail/CVE-2022-4891).
+> If you are using one of these versions, please upgrade to v4.25.14p12 or later.**
+
 > [!WARNING]
 > Sisimai 5 requires Ruby 2.4 or later. Check the version of Ruby in your system before installing/upgrading
 > by `ruby -v` command.
@@ -109,10 +114,10 @@ Install
 ### From RubyGems
 ```shell
 $ sudo gem install sisimai
-Fetching: sisimai-5.1.0.gem (100%)
-Successfully installed sisimai-5.1.0
-Parsing documentation for sisimai-5.1.0
-Installing ri documentation for sisimai-5.1.0
+Fetching: sisimai-5.2.0.gem (100%)
+Successfully installed sisimai-5.2.0
+Parsing documentation for sisimai-5.2.0
+Installing ri documentation for sisimai-5.2.0
 Done installing documentation for sisimai after 6 seconds
 1 gem installed
 ```
@@ -140,13 +145,13 @@ if [ -d "/usr/local/jr" ]; then \
 ...
 3 gems installed
 /opt/local/bin/rake install
-sisimai 5.1.0 built to pkg/sisimai-5.1.0.gem.
-sisimai (5.1.0) installed.
+sisimai 5.2.0 built to pkg/sisimai-5.2.0.gem.
+sisimai (5.2.0) installed.
 if [ -d "/usr/local/jr" ]; then \
 		PATH="/usr/local/jr/bin:$PATH" /usr/local/jr/bin/rake install; \
 	fi
-sisimai 5.1.0 built to pkg/sisimai-5.1.0-java.gem.
-sisimai (5.1.0) installed.
+sisimai 5.2.0 built to pkg/sisimai-5.2.0-java.gem.
+sisimai (5.2.0) installed.
 ```
 
 Usage
@@ -350,13 +355,13 @@ Beginning with v5.0.0, Sisimai requires **Ruby 2.4.0 or later.**
 | System requirements (CRuby)                          | 2.1 - 3.3.0        | **2.4** or later    |
 | System requirements (JRuby)                          | 9.0.4.0 - 9.1.17.0 | **9.2** or later    |
 | Callback feature for the original email file         | N/A                | Available[^3]       |
-| The number of MTA/ESP modules                        | 68                 | 73                  |
-| The number of detectable bounce reasons              | 29                 | 34                  |
+| The number of MTA/ESP modules                        | 68                 | 58                  |
+| The number of detectable bounce reasons              | 29                 | 36                  |
 | Dependencies (Except Ruby Standard Gems)             | 1 gem              | 1 gem               |
-| Source lines of code                                 | 10,300 lines       | 11,660 lines        |
+| Source lines of code                                 | 10,300 lines       | 9,800 lines         |
 | Test frameworks                                      | rspec              | minitest            |
-| The number of tests in spec/ or test/ directory      | 311,000 tests      | 414,000 tests       | 
-| The number of bounce emails decoded/sec (CRuby)[^4]  | 231 emails         | 305 emails          |
+| The number of tests in spec/ or test/ directory      | 311,000 tests      | 410,000 tests       | 
+| The number of bounce emails decoded/sec (CRuby)[^4]  | 290 emails         | 305 emails          |
 | License                                              | 2 Clause BSD       | 2 Caluse BSD        |
 | Commercial support                                   | Available          | Available           |
 
@@ -411,6 +416,8 @@ detect is available at [LIBSISIMAI.ORG/EN/REASON](https://libsisimai.org/en/reas
 | missing PTR/having invalid PTR                       | `Blocked`          | `RequirePTR`        |
 | non-compliance with RFC[^7]                          | `SecurityError`    | `NotCompliantRFC`   |
 | exceeding a rate limit or sending too fast           | `SecurityError`    | `Speeding`          |
+| STARTTLS-related errors (added at v5.2.0)            | `SecurityError`    | `FailedSTARTTLS`    |
+| Recipient in the suppression list (added at v5.2.0)  | `OnHold`           | `Suppressed`        |
 
 [^7]: RFC5322 and related RFCs
 
@@ -434,11 +441,11 @@ Related Sites
 ---------------------------------------------------------------------------------------------------
 * __@libsisimai__ | [Sisimai on Twitter (@libsisimai)](https://twitter.com/libsisimai)
 * __LIBSISIMAI.ORG__ | [SISIMAI | MAIL ANALYZING INTERFACE | DECODING BOUNCES, BETTER AND FASTER.](https://libsisimai.org/)
-* __Sisimai Blog__ | [blog.libsisimai.org](http://blog.libsisimai.org/)
 * __Facebook Page__ | [facebook.com/libsisimai](https://www.facebook.com/libsisimai/)
 * __GitHub__ | [github.com/sisimai/rb-sisimai](https://github.com/sisimai/rb-sisimai)
 * __RubyGems.org__ | [rubygems.org/gems/sisimai](https://rubygems.org/gems/sisimai)
 * __Perl verson__ | [Perl version of Sisimai](https://github.com/sisimai/p5-sisimai)
+* __Go verson__ | [Go version of Sisimai](https://github.com/sisimai/go-sisimai)
 * __Fixtures__ | [set-of-emails - Sample emails for "make test"](https://github.com/sisimai/set-of-emails)
 
 See also
@@ -456,7 +463,7 @@ Author
 
 Copyright
 ===================================================================================================
-Copyright (C) 2015-2024 azumakuniyuki, All Rights Reserved.
+Copyright (C) 2015-2025 azumakuniyuki, All Rights Reserved.
 
 License
 ===================================================================================================