RubyGems - sisimai - Versions diffs - 4.25.4-java → 4.25.10-java - Mend

sisimai 4.25.4-java → 4.25.10-java

Potentially problematic release.

This version of sisimai might be problematic. Click here for more details.

Files changed (681) hide show

checksums.yaml CHANGED

@@ -1,7 +1,7 @@
 ---
-SHA256:
-  metadata.gz: 0447e075261174ff041771d1f5ad336285e307bb5d2c987a15f6118781910b8b
-  data.tar.gz: 6a01a9e3c78c2ef292595552416685bdd08d8cbccfbaf9ba7e5c5ff36b0da487
+SHA1:
+  metadata.gz: 5af9494514958d512d85522d025bca46f3f9cd28
+  data.tar.gz: ca11f255f84bf1820b4b6349e5d2d97ec2d4ddc0
 SHA512:
-  metadata.gz: 3535a69520e958950a1f450a6e2d1b04131012c8976ac3ae37efda0066edbd6e1943d6687f83be786787bafcd19b5eeab9cc46e4900b4fb3a93489dfe9d0cacb
-  data.tar.gz: a324969a25521aca7b227fc0c4846d9b7a9c2246aabf9f562c9871e6cdd2b63ef98c1374f0e2bdc77bcf967c542ad0bea0254daf4ed5e470b5d29f1224448d44
+  metadata.gz: 527fc96261dcb18441b1f6f923ac1554be76858482d529c7af16dd6bfc307534a03efa07864b275d698d286599d3cafc45528ed2d2354f75c44c0f3fca492520
+  data.tar.gz: 12ffb0872b356f266f1224b81421dce9043d7e5e9180befbe1302562e6cb8cc0eb2bd05926bc7ac7d1b10689a3ceaf9c0c938c7664df9aeb0b7ce0be17c0be2f

data/.travis.yml CHANGED

@@ -3,8 +3,8 @@ rvm:
   # See http://rubies.travis-ci.org for Precompiled Ruby Versions
   - 2.1.1
   - 2.2.4
-  - 2.3.0
-  - 2.4.0
+# - 2.3.0
+# - 2.4.0
 # - 2.5.0
   - 2.6.0
 # - jruby-9.0.5.0

data/ANALYTICAL-PRECISION CHANGED

@@ -1,60 +1,64 @@
  bounceHammer 2.7.13p3
  MTA MODULE NAME          CAN PARSE   RATIO   NOTES
 --------------------------------------------------------------------------------
-Email::Activehunter .....    0/0014  0.0000  TransWARE Active!hunter
-Email::Amavis ...........    4/0004  1.0000  amavisd-new: https://www.amavis.org/
-Email::AmazonSES ........   40/0049  0.8163  Amazon SES(Sending): http://aws.amazon.com/ses/
-Email::AmazonWorkMail ...    9/0013  0.6923  Amazon WorkMail: https://aws.amazon.com/workmail/
-Email::Aol ..............   20/0023  0.8696  Aol Mail: http://www.aol.com
-Email::ApacheJames ......    0/0006  0.0000  Java Apache Mail Enterprise Server
-Email::Bigfoot ..........    3/0003  1.0000  Bigfoot: http://www.bigfoot.com
-Email::Biglobe ..........    5/0007  0.7143  BIGLOBE: http://www.biglobe.ne.jp
-Email::Courier ..........   14/0016  0.8750  Courier MTA
-Email::Domino ...........   10/0019  0.5263  IBM Domino Server
-Email::EZweb ............  133/0128  1.0000  au EZweb: http://www.au.kddi.com/mobile/
-Email::EinsUndEins ......    0/0004  0.0000  1&1: http://www.1and1.de
-Email::Exchange2003 .....    1/0051  0.0196  Microsoft Exchange Server 2003
-Email::Exchange2007 .....   10/0012  0.8333  Microsoft Exchange Server 2007
-Email::Exim .............  234/0259  0.9035  Exim
-Email::FML ..............    0/0004  0.0000  fml mailing list server/manager
-Email::Facebook .........    5/0005  1.0000  Facebook: https://www.facebook.com
-Email::GMX ..............    0/0010  0.0000  GMX: http://www.gmx.net
-Email::GSuite ...........   19/0019  1.0000  G Suite: https://gsuite.google.com/
-Email::Google ...........   61/0063  0.9683  Google Gmail: https://mail.google.com
-Email::IMailServer ......    0/0045  0.0000  IPSWITCH IMail Server
-Email::InterScanMSS .....    0/0008  0.0000  Trend Micro InterScan Messaging Security Suite
-Email::KDDI .............    6/0006  1.0000  au by KDDI: http://www.au.kddi.com
-Email::MXLogic ..........    0/0014  0.0000  McAfee SaaS
-Email::MailFoundry ......    0/0007  0.0000  MailFoundry
-Email::MailMarshalSMTP ..    0/0004  0.0000  Trustwave Secure Email Gateway
-Email::MailRu ...........    4/0023  0.1739  @mail.ru: https://mail.ru
-Email::McAfee ...........    0/0014  0.0000  McAfee Email Appliance
-Email::MessageLabs ......    7/0007  1.0000  Symantec.cloud http://www.messagelabs.com
-Email::MessagingServer ..   30/0033  0.9091  Oracle Communications Messaging Server
-Email::Notes ............    0/0013  0.0000  Lotus Notes
-Email::Office365 ........   26/0029  0.8966  Microsoft Office 365: http://office.microsoft.com/
-Email::OpenSMTPD ........    6/0024  0.2500  OpenSMTPD
-Email::Outlook ..........   21/0023  0.9130  Microsoft Outlook.com: https://www.outlook.com/
-Email::Postfix ..........  260/0277  0.9386  Postfix
-Email::ReceivingSES .....    0/0007  0.0000  Amazon SES(Receiving): http://aws.amazon.com/ses/
-Email::SendGrid .........    7/0012  0.5833  SendGrid: http://sendgrid.com/
-Email::Sendmail .........  354/0278  1.0000  V8Sendmail: /usr/sbin/sendmail
-Email::SurfControl ......    6/0008  0.7500  WebSense SurfControl
-Email::V5sendmail .......    0/0386  0.0000  Sendmail version 5
-Email::Verizon ..........    4/0004  1.0000  Verizon Wireless: http://www.verizonwireless.com
-Email::X1 ...............    0/0008  0.0000  Unknown MTA #1
-Email::X2 ...............    0/0070  0.0000  Unknown MTA #2
-Email::X3 ...............    0/0012  0.0000  Unknown MTA #3
-Email::X4 ...............    0/0029  0.0000  Unknown MTA #4 qmail clones
-Email::X5 ...............    3/0003  1.0000  Unknown MTA #5
-Email::Yahoo ............    0/0025  0.0000  Yahoo! MAIL: https://www.yahoo.com
-Email::Yandex ...........    4/0007  0.5714  Yandex.Mail: http://www.yandex.ru
-Email::Zoho .............    0/0011  0.0000  Zoho Mail: https://www.zoho.com
-Email::mFILTER ..........    0/0012  0.0000  Digital Arts m-FILTER
-Email::qmail ............   58/0087  0.6667  qmail
-ARF .....................    8/0038  0.2105  Abuse Feedback Reporting Format
-RFC3464 .................  151/0322  0.4689  Fallback Module for MTAs
-RFC3834 .................    0/0014  0.0000  Detector for auto replied message
+Activehunter .....    0/0014  0.0000  TransWARE Active!hunter
+Amavis ...........    4/0004  1.0000  amavisd-new: https://www.amavis.org/
+AmazonSES ........   40/0049  0.8163  Amazon SES(Sending): http://aws.amazon.com/ses/
+AmazonWorkMail ...    9/0013  0.6923  Amazon WorkMail: https://aws.amazon.com/workmail/
+Aol ..............   20/0023  0.8696  Aol Mail: http://www.aol.com
+ApacheJames ......    0/0006  0.0000  Java Apache Mail Enterprise Server
+Barracuda ........    0/0004  0.0000  Barracuda: https://www.barracuda.com
+Bigfoot ..........    3/0003  1.0000  Bigfoot: http://www.bigfoot.com
+Biglobe ..........    5/0007  0.7143  BIGLOBE: http://www.biglobe.ne.jp
+Courier ..........   14/0016  0.8750  Courier MTA
+Domino ...........   10/0019  0.5263  IBM Domino Server
+EZweb ............  133/0128  1.0000  au EZweb: http://www.au.kddi.com/mobile/
+EinsUndEins ......    0/0004  0.0000  1&1: http://www.1and1.de
+Exchange2003 .....    1/0051  0.0196  Microsoft Exchange Server 2003
+Exchange2007 .....   10/0012  0.8333  Microsoft Exchange Server 2007
+Exim .............  234/0259  0.9035  Exim
+FML ..............    0/0004  0.0000  fml mailing list server/manager
+Facebook .........    5/0005  1.0000  Facebook: https://www.facebook.com
+GMX ..............    0/0010  0.0000  GMX: http://www.gmx.net
+GSuite ...........   19/0019  1.0000  G Suite: https://gsuite.google.com/
+Gmail ............   61/0063  0.9683  Gmail: https://mail.google.com
+GoogleGroups .....    0/0028  0.0000  Google Groups: https://groups.google.com
+IMailServer ......    0/0045  0.0000  IPSWITCH IMail Server
+InterScanMSS .....    0/0008  0.0000  Trend Micro InterScan Messaging Security Suite
+KDDI .............    6/0006  1.0000  au by KDDI: http://www.au.kddi.com
+MXLogic ..........    0/0014  0.0000  McAfee SaaS
+MailFoundry ......    0/0007  0.0000  MailFoundry
+MailMarshalSMTP ..    0/0004  0.0000  Trustwave Secure Email Gateway
+MailRu ...........    4/0023  0.1739  @mail.ru: https://mail.ru
+McAfee ...........    0/0014  0.0000  McAfee Email Appliance
+MessageLabs ......    7/0007  1.0000  Symantec.cloud http://www.messagelabs.com
+MessagingServer ..   30/0033  0.9091  Oracle Communications Messaging Server
+Notes ............    0/0013  0.0000  Lotus Notes
+Office365 ........   26/0029  0.8966  Microsoft Office 365: http://office.microsoft.com/
+OpenSMTPD ........    6/0024  0.2500  OpenSMTPD
+Outlook ..........   21/0023  0.9130  Microsoft Outlook.com: https://www.outlook.com/
+Postfix ..........  260/0277  0.9386  Postfix
+PowerMTA .........    0/0005  0.0000  PowerMTA: https://www.sparkpost.com/powermta/
+ReceivingSES .....    0/0007  0.0000  Amazon SES(Receiving): http://aws.amazon.com/ses/
+SendGrid .........    7/0012  0.5833  SendGrid: http://sendgrid.com/
+Sendmail .........  354/0278  1.0000  V8Sendmail: /usr/sbin/sendmail
+SurfControl ......    6/0008  0.7500  WebSense SurfControl
+V5sendmail .......    0/0386  0.0000  Sendmail version 5
+Verizon ..........    4/0004  1.0000  Verizon Wireless: http://www.verizonwireless.com
+X1 ...............    0/0008  0.0000  Unknown MTA #1
+X2 ...............    0/0070  0.0000  Unknown MTA #2
+X3 ...............    0/0012  0.0000  Unknown MTA #3
+X4 ...............    0/0029  0.0000  Unknown MTA #4 qmail clones
+X5 ...............    3/0003  1.0000  Unknown MTA #5
+X6 ...............    0/0029  0.0000  Unknown MTA #6
+Yahoo ............    0/0025  0.0000  Yahoo! MAIL: https://www.yahoo.com
+Yandex ...........    4/0007  0.5714  Yandex.Mail: http://www.yandex.ru
+Zoho .............    0/0011  0.0000  Zoho Mail: https://www.zoho.com
+mFILTER ..........    0/0012  0.0000  Digital Arts m-FILTER
+qmail ............   58/0087  0.6667  qmail
+ARF ..............    8/0038  0.2105  Abuse Feedback Reporting Format
+RFC3464 ..........  151/0322  0.4689  Fallback Module for MTAs
+RFC3834 ..........    0/0014  0.0000  Detector for auto replied message
 --------------------------------------------------------------------------------
- bounceHammer 2.7.13p3    1523/2569  0.5928
- Sisimai 4.25.3p2         2569/2569  1.0000
+ bounceHammer      1523/2635  0.5779
+ Sisimai 4.25.8    2635/2635  1.0000

data/Benchmarks.mk CHANGED

@@ -1,4 +1,4 @@
-# rb-Sisimai/Benchmarks.mk
+# rb-sisimai/Benchmarks.mk
 #  ____                  _                          _                    _
 # | __ )  ___ _ __   ___| |__  _ __ ___   __ _ _ __| | _____   _ __ ___ | | __
 # |  _ \ / _ \ '_ \ / __| '_ \| '_ ` _ \ / _` | '__| |/ / __| | '_ ` _ \| |/ /
@@ -22,6 +22,8 @@ SPEEDTESTDIR := tmp/emails-for-speed-test
 COMMANDARGVS := -I./lib -rsisimai
 TOBEEXECUTED := 'Sisimai.make($$*.shift, delivered: true)' $(PUBLICMAILS)
+PROFILEARGVS := -rrblineprof -rrblineprof-report
+PROFCOMMANDS := 'p = lineprof(%r|./lib/sisimai|) { Sisimai.make($$*.shift, delivered: true) }; LineProf.report(p, out: "pf")'
 HOWMANYMAILS := $(RUBY) $(COMMANDARGVS) -le 'puts Sisimai.make($$*.shift, delivered: true).size'
 # -----------------------------------------------------------------------------
@@ -46,8 +48,8 @@ speed-test: emails-for-speed-test
 profile:
 	@ uptime
-	$(RUBY) -rprofile $(COMMANDARGVS) -e $(TOBEEXECUTED) $(SPEEDTESTDIR) 2> pf > /dev/null
-	cat ./pf | sed -e 's/^ *//g' | tr -s ' ' | sed -e 's/self self/self  self/' | tr ' ' '\t' > profiling-`date '+%Y-%m-%d-%T'`.txt
+	$(RUBY) $(COMMANDARGVS) $(PROFILEARGVS) -e $(PROFCOMMANDS) $(SPEEDTESTDIR)
+	cat ./pf > profile-`date '+%Y-%m-%d-%T'`.txt
 	$(RM) ./pf
 loc:

data/ChangeLog.md CHANGED

@@ -1,8 +1,191 @@
 RELEASE NOTES for Ruby version of Sisimai
 ================================================================================
-- releases: "https://github.com/sisimai/rb-Sisimai/releases"
+- releases: "https://github.com/sisimai/rb-sisimai/releases"
 - download: "https://rubygems.org/gems/sisimai"
+v4.25.10
+--------------------------------------------------------------------------------
+- release: "Tue, 22 Dec 2020 13:22:22 +0900 (JST)"
+- version: "4.25.10"
+- changes:
+  - #187 Remove the following old methods (marked as obsolete from v4.25.6)
+    - `Sisimai::Mail.close` (automatically closes at the EOF)
+    - `Sisimai::Mail.type` (use `Sisimai::Mail.kind` instead)
+    - `Sisimai::Mail.mail.*` (use `Sisimai::Mail.data.*` instead)
+  - `Sisimai::Lhost::Exim` and `Sisimai::Lhost::X3` improvement
+  - #205 Code improvement for `Source-IP` field on `Sisimai::ARF`
+  - #207 Updates for DMARC and SPF related errors
+    - The value of `reason` rejected due to DMARC policy is `policyviolation`
+    - The value of `reason` rejected due to no SPF record is `rejected`
+    - Add some sample emails related to above into set-of-emails/
+v4.25.9
+--------------------------------------------------------------------------------
+- release: "Sat,  3 Oct 2020 22:00:00 +0900 (JST)"
+- version: ""
+- changes:
+  - Suppress warning messages on Ruby 2.7. Thanks to @koic
+    - Suppress keyword argument warnings in Ruby 2.7 #200
+    - Suppress a Ruby warning for `Object#=~` and bug fix to match patterns #201
+  - #203 Replace `.+` with `[^ ]` on some large regular expressions for serious
+    performance reason.
+  - #204 Suport Null MX (RFC7505) on Sendmail sisimai/set-of-emails#4
+v4.25.8
+--------------------------------------------------------------------------------
+- release: "Fri, 17 Jul 2020 11:59:49 +0900 (JST)"
+- version: "4.25.8"
+- changes:
+  - **Repository URL was changed to https://github.com/sisimai/rb-sisimai**
+  - `Sisimai::Message.make` method was merged into `Sisimai::Message.new`
+  - `Sisimai::Message.divideup` returns an array (faster than a hash)
+  - Remove unused code blocks for deciding the order of email header fields at
+    `Sisimai::Data.make` method
+  - Remove old parameters: `datasrc` and `bounces` at the callback feature #189
+  - Implement `Sisimai::Rhost::Spectrum` for parsing bounce mails returned from
+    https://www.spectrum.com/.
+  - Remove unsed method `Sisimai::Rhost->list`
+  - Fix bugs in `Sisimai::Lhost::FML` and `Sisimai::Lhost::X5`
+  - Fix code for finding the value of `Diagnostic-Code` field in multiple lines
+    at `Sisimai::RFC3464`
+  - Implement Sisimai::Rhost::Cox for parsing bounce mails returned from Cox:
+    https://cox.com/ #193
+v4.25.7
+--------------------------------------------------------------------------------
+- release: "Sat, 25 Apr 2020 22:22:22 +0900 (JST)"
+- version: "4.25.7"
+- changes:
+  - Bug fix in `rake spec` for removed module `Sisimai::Lhost::UserDefined`
+v4.25.6
+--------------------------------------------------------------------------------
+- release: "Wed, 22 Apr 2020 16:22:22 +0900 (JST)"
+- version: "4.25.6"
+- changes:
+  - Performance improvement: 10% faster, reduced 9% of method calls
+  - #176 Make `Sisimai::Message` 27% faster
+    - Use the negative look-ahead regular expression code to convert all of the
+      email header strings into key-value pairs as a HASH at newly implemented
+      method `Sisiai::Message.makemap` #175. Thanks to @xtetsuji
+    - Remove `Sisimai::Message.takeapart` (replaced with `makemap`)
+    - Remove `Sisimai::Message.headers` (replaced with `makemap`)
+    - Code improvement for `require` statement before method calls #177
+  - Make `Sisimai::Order` 44% faster
+    - Rewrite `Sisimai::Order.make`
+    - Remove `Sisimai::Order.by`
+    - Remove `Sisimai::Order.headers`
+    - Remove `Sisimai::Lhost.headerlist`
+    - And all `headerlist` method have been removed from `Sisimai::Lhost::*`,
+      `Sisimai::RFC3834` and `Sisimai::ARF`
+    - The MTA module to be loaded at first is decided by the first 2 words of
+      each bounce mail subject, is defined at `Subject` in `Sisimai::Order`
+    - Some variables are replaced with `state`
+  - Each `field` parameter has been removed from the following methods because
+    Sisimai detect all the email header fields by `Sisimai::Message.makemap()`
+    without having to specify field names at `field` parameter
+    - `Sisimai.make`
+    - `Sisimai::Message.new`
+    - `Sisimai::Message.make`
+  - Code improvement for `require` statement before calling `match()` method of
+    some modules defined in `$PreMatches` at `Sisimai::Reason::UserUnknown`
+  - Remove the following unused methods:
+    - `Sisimai::MIME.patterns`
+    - `Sisimai::SMTP.command`
+  - `Sisimai::Lhost::Google` has been renamed to `Sisimai::Lhost::Gmail`
+  - Implement 4 MTA modules: #178 #181
+    - `Sisimai::Lhost::Barracuda`
+    - `Sisimai::Lhost::PowerMTA`
+    - `Sisimai::Lhost::X6`
+    - `Sisimai::Lhost::GoogleGroups`
+  - "email-" prefix of each sample email in set-of-emails/maildir directory has
+    been replaced with "lhost-" sisimai/set-of-emails#14
+  - SMTP Agent improvement #158
+    - Remove `Email::` prefix from the value of `smtpagent` at parsed results
+    - Remove `Sisimai::Lhost->smtpagent` method
+  - Improved the following MTA modules:
+    - `Sisimai::Lhost::Amavis` #183
+    - `Sisimai::Lhost::InterScanMSS`
+    - `Sisimai::Lhost::Office365` improvement for reading MIME-encoded subject
+    - `Sisimai::Lhost::Exchange2007` supports error messages in `it-CH`
+  - Tiny bug fix for `Subject` header decoding
+  - Fix bug in code for getting an `"addresser"` address from `From:` field in
+    the original message part which are multiple lines at `Sisimai::ARF`. #185
+  - New accessor `origin` at `Sisimai::Data` and the parsed results for keeping
+    a path to the source email #186
+  - #187 `Sisimai::Mail` improvement for compatibilities with the Go language
+    version of Sisimai which will be released this summer
+    - Removed `Sisimai::Mail::STDIN.name` (not used)
+    - Removed `Sisimai::Mail::Maildir.inodes` (not needed to check the inode)
+    - Removed `Sisimai::Mail::Maildir.count` (use `offset` instead)
+    - Warning message is displayed when the following methods are called:
+      - `Sisimai::Mail.close` (automatically closes at the EOF)
+      - `Sisimai::Mail.type` (use `Sisimai::Mail.kind` instead)
+      - `Sisimai::Mail.mail.*` (use `Sisimai::Mail.data.*` instead)
+      - Methods above will be removed at v4.25.10
+    - `Sisimai::Mail::Memory.data` renamed to `Sisimai::Mail::Memory.payload`
+    - `Sisimai::Mail::Maildir.size` keeps the number of files in the Maildir/
+    - `Sisimai::Mail::Maildir.offset` keeps the number of email files in the
+      Maildir/ which have been read
+    - Call `Sisimai::Mail::*.read` directly instead of `Sisimai::Mail.read`
+    - Remove `Sisimai::Lhost::UserDefined` (not used)
+  - Add the following D.S.N. codes and error messages (not tested)
+    - `Mailbox does not exist!` at `Sisimai::Reason::UserUnknown` (Amazon SES)
+    - `Not a valid recipienet` at `Sisimai::Reason::UserUnknown` (Yahoo!)
+    - `Envelope blocked` at `Sisimai::Reason::Rejected` (Minecast.com)
+    - `5.2.122` is toomanyconn, `5.4.11` is contenterror, `5.7.51` is blocked
+      at `Sisimai::Rhost::ExchangeOnline`
+v4.25.5
+--------------------------------------------------------------------------------
+- release: "Wed, 22 Jan 2020 14:44:44 +0900 (JST)"
+- version: "4.25.5"
+- changes:
+  - **JSON READING AS A INPUT SOURCE AND JSON PARSING AS A BOUNCE OBJECT ARE NO
+    LONGER PROVIDED AS OF v4.25.5**
+  - The following obsoleted classes and modules have been removed #166 #168
+    - `Sisimai::Message::Email`
+    - `Sisimai::Message::JSON`
+    - `Sisimai::Order::Email`
+    - `Sisimai::Order::JSON`
+    - `Sisimai::Bite::Email`
+    - `Sisimai::Bite::JSON`
+  - Fix bug in code to detect whether a bounce mail was generated by Office365
+    or not at `Sisimai::Lhost::Office365`
+  - Import sisimai/p5-Sisimai#342
+    - Fix parser code to get an error message which is not beginning with `#`
+      character at Exchange2007.
+  - Import sisimai/p5-Sisimai#347
+    - Support case insensitive error code at `Sisimai::Rhost::FrancePTT`,
+  - Import sisimai/p5-Sisimai#348
+    - Code improvements at `Sisimai::Lhost::EinsUndEins` for detecting errors
+      and setting the value of `rhost`
+  - Many Pull-Requests and sample emails for French ESPs by @aderumier
+    - Add 4 error code values at `Sisimai::Rhost::FrancePTT`
+      - `102` = `blocked`
+      - `426` = `suspend`
+      - `505` = `systemerror`
+      - `999` = `blocked`
+    - Add 7 sample emails at set-of-emails/ directory: rhost-franceptt-04, 05,
+      06, 07, 08, 10, and 11 for `Sisimai::Rhost::FrancePTT` #353 #357
+    - Add many error codes and error messages from Orange and La Poste
+  - Import sisimai/p5-Sisimai#350
+    - Code improvement at `Sisimai::Lhost::Postfix` for setting `HELO` into the
+      value of `smtpcommand` in the parsed results.
+  - Import sisimai/p5-Sisimai#351
+    - Code improvements at `Sisimai::Lhost::Postfix` for parsing an email which
+      have neither delivery reports nor error messages.
+  - Import sisimai/p5-Sisimai#352
+    - Code improvements at `Sisimai::RFC3834` for parsing a vacation message
+      replied automatically from iCloud.
+  - Accessor improvements in the following classes:
+    - `Sisimai::Message`
+    - `Sisimai::Data`
+    - `Sisimai::Mail` and child classes in `sisimai/mail` directory
+  - Fix duplicated ranges in some regular expressions at `Sisimai::Address`
+  - Large scale code improvement at each modules in `Sisimai::Lhost`
+  - reduce the number of lines in code about 12%
 v4.25.4
 --------------------------------------------------------------------------------
 - release: "Tue,  3 Dec 2019 12:34:45 +0900 (JST)"

data/Developers.mk CHANGED

@@ -1,4 +1,4 @@
-# p5-Sisimai/Developers.mk
+# rb-sisimai/Developers.mk
 #  ____                 _                                       _
 # |  _ \  _____   _____| | ___  _ __   ___ _ __ ___   _ __ ___ | | __
 # | | | |/ _ \ \ / / _ \ |/ _ \| '_ \ / _ \ '__/ __| | '_ ` _ \| |/ /
@@ -15,7 +15,7 @@ LS    := ls -1
 CP    := cp
 RM    := rm -f
-PERL5SISIMAI := p5-Sisimai
+PERL5SISIMAI := p5-sisimai
 PRECISIONTAB := ANALYTICAL-PRECISION
 PARSERLOGDIR := tmp/parser-logs
 MAILCLASSDIR := lib/$(NAME)/Lhost

data/Makefile CHANGED

@@ -1,4 +1,4 @@
-# rb-Sisimai/Makefile
+# rb-sisimai/Makefile
 #  __  __       _         __ _ _
 # |  \/  | __ _| | _____ / _(_) | ___
 # | |\/| |/ _` | |/ / _ \ |_| | |/ _ \

data/README-JA.md CHANGED

@@ -1,9 +1,9 @@
 ![](https://libsisimai.org/static/images/logo/sisimai-x01.png)
-[![License](https://img.shields.io/badge/license-BSD%202--Clause-orange.svg)](https://github.com/sisimai/rb-Sisimai/blob/master/LICENSE)
-[![Coverage Status](https://img.shields.io/coveralls/sisimai/rb-Sisimai.svg)](https://coveralls.io/r/sisimai/rb-Sisimai)
-[![Build Status](https://travis-ci.org/sisimai/rb-Sisimai.svg?branch=master)](https://travis-ci.org/sisimai/rb-Sisimai)
-[![Codacy Badge](https://api.codacy.com/project/badge/grade/38340177e6284a65be69c0c7c3dc2b58)](https://www.codacy.com/app/azumakuniyuki/rb-Sisimai)
+[![License](https://img.shields.io/badge/license-BSD%202--Clause-orange.svg)](https://github.com/sisimai/rb-sisimai/blob/master/LICENSE)
+[![Coverage Status](https://img.shields.io/coveralls/sisimai/rb-sisimai.svg)](https://coveralls.io/r/sisimai/rb-sisimai)
+[![Build Status](https://travis-ci.org/sisimai/rb-sisimai.svg?branch=master)](https://travis-ci.org/sisimai/rb-sisimai)
+[![Codacy Badge](https://api.codacy.com/project/badge/grade/38340177e6284a65be69c0c7c3dc2b58)](https://www.codacy.com/app/azumakuniyuki/rb-sisimai)
 [![Ruby](https://img.shields.io/badge/ruby-v2.1.0--v2.6.0-red.svg)](https://www.ruby-lang.org/)
 [![Gem Version](https://badge.fury.io/rb/sisimai.svg)](https://badge.fury.io/rb/sisimai)
@@ -19,7 +19,6 @@
 - [使い方 | Usage](#usage)
     - [基本的な使い方 | Basic usage](#basic-usage)
     - [解析結果をJSONで得る | Convert to JSON](#convert-to-json)
-    - [バウンスオブジェクトを読む | Read bounce object](#read-bounce-object)
     - [コールバック機能 | Callback feature](#callback-feature)
     - [ワンライナー | One-Liner](#one-liner)
     - [出力例 | Output example](#output-example)
@@ -40,7 +39,7 @@ What is Sisimai
 ===============================================================================
 Sisimai(シシマイ)はRFC5322準拠のエラーメールを解析し、解析結果をデータ構造に
 変換するインターフェイスを提供するRubyライブラリです。
-[github.com/sisimai/p5-Sisimai](https://github.com/sisimai/p5-Sisimai/)
+[github.com/sisimai/p5-sisimai](https://github.com/sisimai/p5-sisimai/)
 で公開しているPerl版シシマイから移植しました。
 ![](https://libsisimai.org/static/images/figure/sisimai-overview-1.png)
@@ -54,10 +53,7 @@ Key features
   * git clone & make
 * __高い解析精度__
   * 解析精度はbounceHammerの2倍
-  * 29種類のMTAに対応
-  * 22種類の著名なMSPに対応
-  * 2種類の著名なメール配信クラウドに対応(JSON)
-    * **Sisimai 4.25.5で削除予定**
+  * 68種類のMTA/MDA/ESPに対応
   * Feedback Loopにも対応
   * 29種類のエラー理由を検出
@@ -81,10 +77,10 @@ Install
 ```shell
 $ sudo gem install sisimai
-Fetching: sisimai-4.25.2.gem (100%)
-Successfully installed sisimai-4.25.2
-Parsing documentation for sisimai-4.25.2
-Installing ri documentation for sisimai-4.25.2
+Fetching: sisimai-4.25.5.gem (100%)
+Successfully installed sisimai-4.25.5
+Parsing documentation for sisimai-4.25.5
+Installing ri documentation for sisimai-4.25.5
 Done installing documentation for sisimai after 6 seconds
 1 gem installed
 ```
@@ -93,15 +89,15 @@ Done installing documentation for sisimai after 6 seconds
 ```shell
 $ cd /usr/local/src
-$ git clone https://github.com/sisimai/rb-Sisimai.git
-$ cd ./rb-Sisimai
+$ git clone https://github.com/sisimai/rb-sisimai.git
+$ cd ./rb-sisimai
 $ sudo make depend install-from-local
 gem install bundle rake rspec coveralls
 ...
 4 gems installed
 bundle exec rake install
-sisimai 4.25.2 built to pkg/sisimai-4.25.2.gem.
-sisimai (4.25.2) installed.
+sisimai 4.25.5 built to pkg/sisimai-4.25.5.gem.
+sisimai (4.25.5) installed.
 ```
 Usage
@@ -110,7 +106,8 @@ Usage
 Basic usage
 -------------------------------------------------------------------------------
 下記のようにSisimaiの`make()`メソッドをmboxかMaildirのPATHを引数にして実行すると
-解析結果が配列で返ってきます。
+解析結果が配列で返ってきます。v4.25.6から元データとなった電子メールファイルへの
+PATHを保持する`origin`が利用できます。
 ```ruby
 #! /usr/bin/env ruby
@@ -138,6 +135,7 @@ if v.is_a? Array
     puts e.deliverystatus       # 5.1.1
     puts e.replycode            # 550
     puts e.reason               # userunknown
+    puts e.origin               # /var/spool/bounce/Maildir/new/1740074341.eml
     h = e.damn                  # Convert to HASH
     j = e.dump('json')          # Convert to JSON string
@@ -159,30 +157,6 @@ puts Sisimai.dump('/path/to/mbox')  # or path to Maildir/
 puts Sisimai.dump('/path/to/mbox', delivered: true)
 ```
-Read bounce object
--------------------------------------------------------------------------------
-**この機能はSisimai 4.25.5で削除されます**
-メール配信クラウドからAPIで取得したバウンスオブジェクト(JSON)を読んで解析する
-場合は、次のようなコードを書いてください。この機能はSisimai v4.20.0で実装され
-ました。
-```ruby
-#! /usr/bin/env ruby
-require 'json'
-require 'sisimai'
-j = JSON.load('{"notificationType"=>"Bounce", "bounce"=>{"...') # JSON String
-v = Sisimai.make(j, input: 'json')
-if v.is_a? Array
-  v.each do |e|
-    ...
-  end
-end
-```
-現時点ではAmazon SESとSendGridのみをサポートしています。
 Callback feature
 -------------------------------------------------------------------------------
 Sisimai 4.19.0から`Sisimai.make()`と`Sisimai.dump()`にLamda(Procオブジェクト)
@@ -203,9 +177,8 @@ callbackto = lambda do |v|
   return r
 end
-list = ['X-Mailer']
-data = Sisimai.make('/path/to/mbox', hook: callbackto, field: list)
-json = Sisimai.dump('/path/to/mbox', hook: callbackto, field: list)
+data = Sisimai.make('/path/to/mbox', hook: callbackto)
+json = Sisimai.dump('/path/to/mbox', hook: callbackto)
 puts data[0].catch['x-mailer']      # Apple Mail (2.1283)
 ```
@@ -227,7 +200,7 @@ Output example
 ![](https://libsisimai.org/static/images/demo/sisimai-dump-02.gif)
 ```json
-[{"recipient": "kijitora@example.jp", "addresser": "shironeko@1jo.example.org", "feedbacktype": "", "action": "failed", "subject": "Nyaaaaan", "smtpcommand": "DATA", "diagnosticcode": "550 Unknown user kijitora@example.jp", "listid": "", "destination": "example.jp", "smtpagent": "Email::Courier", "lhost": "1jo.example.org", "deliverystatus": "5.0.0", "timestamp": 1291954879, "messageid": "201012100421.oBA4LJFU042012@1jo.example.org", "diagnostictype": "SMTP", "timezoneoffset": "+0900", "reason": "filtered", "token": "ce999a4c869e3f5e4d8a77b2e310b23960fb32ab", "alias": "", "senderdomain": "1jo.example.org", "rhost": "mfsmax.example.jp"}, {"diagnostictype": "SMTP", "timezoneoffset": "+0900", "reason": "userunknown", "timestamp": 1381900535, "messageid": "E1C50F1B-1C83-4820-BC36-AC6FBFBE8568@example.org", "token": "9fe754876e9133aae5d20f0fd8dd7f05b4e9d9f0", "alias": "", "senderdomain": "example.org", "rhost": "mx.bouncehammer.jp", "action": "failed", "addresser": "kijitora@example.org", "recipient": "userunknown@bouncehammer.jp", "feedbacktype": "", "smtpcommand": "DATA", "subject": "バウンスメールのテスト(日本語)", "destination": "bouncehammer.jp", "listid": "", "diagnosticcode": "550 5.1.1 <userunknown@bouncehammer.jp>... User Unknown", "deliverystatus": "5.1.1", "lhost": "p0000-ipbfpfx00kyoto.kyoto.example.co.jp", "smtpagent": "Email::Sendmail"}]
+[{"catch":{"x-mailer":"","return-path":"neko@example.com"},"token":"7e81d3b9306fc7a7f3fb4c7b705189d6806d3d6b","lhost":"omls-1.kuins.neko.example.jp","rhost":"nekonyaan0022.apcprd01.prod.exchangelabs.com","alias":"","listid":"","reason":"userunknown","action":"failed","origin":"set-of-emails/maildir/bsd/lhost-office365-13.eml","subject":"にゃーん","messageid":"","replycode":"550","smtpagent":"Office365","softbounce":0,"smtpcommand":"","destination":"neko.kyoto.example.jp","senderdomain":"example.com","feedbacktype":"","diagnosticcode":"Error Details Reported error: 550 5.1.10 RESOLVER.ADR.RecipientNotFound; Recipient not found by SMTP address lookup DSN generated by: NEKONYAAN0022.apcprd01.prod.exchangelabs.com","diagnostictype":"","deliverystatus":"5.1.10","timezoneoffset":"+0000","addresser":"neko@example.com","recipient":"kijitora-nyaan@neko.kyoto.example.jp","timestamp":1493508885}]
 ```
 Sisimai Specification
@@ -235,7 +208,7 @@ Sisimai Specification
 Differences between Ruby version and Perl version
 -------------------------------------------------------------------------------
-公開中のPerl版Sisimai(p5-Sisimai)とRuby版Sisimai(rb-Sisimai)は下記のような違いが
+公開中のPerl版Sisimai(p5-sisimai)とRuby版Sisimai(rb-sisimai)は下記のような違いが
 あります。bounceHammer 2.7.13p3とSisimai(シシマイ)の違いについては
 [Sisimai | 違いの一覧](https://libsisimai.org/ja/diff/)をご覧ください。
@@ -244,15 +217,15 @@ Differences between Ruby version and Perl version
 | 動作環境                                    | Ruby 2.1 - 2.6 | Perl 5.10 -   |
 |                                             | JRuby 9.0.4.0- |               |
 | 解析精度の割合(2000通のメール)[1]           | 1.00           | 1.00          |
-| メール解析速度(1000通のメール)              | 2.22秒[2]      | 1.50秒        |
+| メール解析速度(1000通のメール)              | 2.22秒[2]      | 1.35秒        |
 | インストール方法                            | gem install    | cpanm, cpm    |
 | 依存モジュール数(コアモジュールを除く)      | 1モジュール    | 2モジュール   |
-| LOC:ソースコードの行数                      | 11700行        | 8300行        |
-| テスト件数(spec/,t/,xt/ディレクトリ)        | 227700件       | 250000件      |
+| LOC:ソースコードの行数                      | 10300行        | 10500行       |
+| テスト件数(spec/,t/,xt/ディレクトリ)        | 236000件       | 265000件      |
 | ライセンス                                  | 二条項BSD      | 二条項BSD     |
 | 開発会社によるサポート契約                  | 提供中         | 提供中        |
-1. [./ANALYTICAL-PRECISION](https://github.com/sisimai/rb-Sisimai/blob/master/ANALYTICAL-PRECISION)を参照
+1. [./ANALYTICAL-PRECISION](https://github.com/sisimai/rb-sisimai/blob/master/ANALYTICAL-PRECISION)を参照
 2. Xeon E5-2640 2.5GHz x 2 cores | 5000 bogomips | 1GB RAM | Ruby 2.3.4p301
 Other spec of Sisimai
@@ -266,7 +239,7 @@ Contributing
 Bug report
 -------------------------------------------------------------------------------
-もしもSisimaiにバグを発見した場合は[Issues](https://github.com/sisimai/rb-Sisimai/issues)
+もしもSisimaiにバグを発見した場合は[Issues](https://github.com/sisimai/rb-sisimai/issues)
 にて連絡をいただけると助かります。
 Emails could not be parsed
@@ -283,14 +256,14 @@ Related sites
 * __libSISIMAI.ORG__ | [Sisimai | The successor to bounceHammer, Library to parse bounce mails](https://libsisimai.org/)
 * __Sisimai Blog__ | [blog.libsisimai.org](http://blog.libsisimai.org/)
 * __Facebook Page__ | [facebook.com/libsisimai](https://www.facebook.com/libsisimai/)
-* __GitHub__ | [github.com/sisimai/rb-Sisimai](https://github.com/sisimai/rb-Sisimai)
+* __GitHub__ | [github.com/sisimai/rb-sisimai](https://github.com/sisimai/rb-sisimai)
 * __RubyGems.org__ | [rubygems.org/gems/sisimai](https://rubygems.org/gems/sisimai)
-* __Perl verson__ | [Perl version of Sisimai](https://github.com/sisimai/p5-Sisimai)
+* __Perl verson__ | [Perl version of Sisimai](https://github.com/sisimai/p5-sisimai)
 * __Fixtures__ | [set-of-emails - Sample emails for "make test"](https://github.com/sisimai/set-of-emails)
 See also
 -------------------------------------------------------------------------------
-* [README.md - README.md in English](https://github.com/sisimai/rb-Sisimai/blob/master/README.md)
+* [README.md - README.md in English](https://github.com/sisimai/rb-sisimai/blob/master/README.md)
 * [RFC3463 - Enhanced Mail System Status Codes](https://tools.ietf.org/html/rfc3463)
 * [RFC3464 - An Extensible Message Format for Delivery Status Notifications](https://tools.ietf.org/html/rfc3464)
 * [RFC3834 - Recommendations for Automatic Responses to Electronic Mail](https://tools.ietf.org/html/rfc3834)
@@ -303,7 +276,7 @@ Author
 Copyright
 ===============================================================================
-Copyright (C) 2015-2019 azumakuniyuki, All Rights Reserved.
+Copyright (C) 2015-2020 azumakuniyuki, All Rights Reserved.
 License
 ===============================================================================