RubyGems - sisimai - Versions diffs - 4.21.1-java → 4.22.0-java - Mend

sisimai 4.21.1-java → 4.22.0-java

Potentially problematic release.

This version of sisimai might be problematic. Click here for more details.

Files changed (571) hide show

data/lib/sisimai/reason/securityerror.rb CHANGED Viewed

@@ -4,14 +4,18 @@ module Sisimai
     # or not. This class is called only Sisimai::Reason class.
     #
     # This is the error that a security violation was detected on a destination
-    # mail server. Depends on the security policy on the server, there is any
-    # virus in the email, a sender's email address is camouflaged address.
-    # Sisimai will set "securityerror" to the reason of email bounce if the value
-    # of Status: field in a bounce email is "5.7.*".
+    # mail server. Depends on the security policy on the server, a sender's email
+    # address is camouflaged address.
+    #
+    # Sisimai will set "securityerror" to the reason
+    # of email bounce if the value of Status: field in a bounce email is "5.7.*".
+    #
+    #   Action: failed
     #   Status: 5.7.0
     #   Remote-MTA: DNS; gmail-smtp-in.l.google.com
-    #   Diagnostic-Code: SMTP; 552-5.7.0 Our system detected an illegal attachment
-    #                    on your message. Please
+    #   Diagnostic-Code: SMTP; 552-5.7.0 Our system detected an illegal attachment on your message. Please
+    #   Last-Attempt-Date: Tue, 28 Apr 2009 11:02:45 +0900 (JST)
+    #
     module SecurityError
       # Imported from p5-Sisimail/lib/Sisimai/Reason/SecurityError.pm
       class << self
@@ -36,27 +40,15 @@ module Sisimai
               |turned[ ]on[ ]in[ ]your[ ]email[ ]client
               )
             |\d+[ ]denied[ ]\[[a-z]+\][ ].+[(]Mode:[ ].+[)]
-            |because[ ](?>
-               the[ ]recipient[ ]is[ ]not[ ]accepting[ ]mail[ ]with[ ](?:
-                 attachments        # AOL Phoenix
-                |embedded[ ]images  # AOL Phoenix
-                )
-              )
             |domain[ ].+[ ]is[ ]a[ ]dead[ ]domain
-            |email[ ](?:
-               not[ ]accepted[ ]for[ ]policy[ ]reasons
-              # http://kb.mimecast.com/Mimecast_Knowledge_Base/Administration_Console/Monitoring/Mimecast_SMTP_Error_Codes#554
-              |rejected[ ]due[ ]to[ ]security[ ]policies
-              )
             |Executable[ ]files[ ]are[ ]not[ ]allowed[ ]in[ ]compressed[ ]files
             |insecure[ ]mail[ ]relay
             |Recipient[ ]address[ ]rejected:[ ]Access[ ]denied
-            |sorry,[ ]you[ ]don'?t[ ]authenticate[ ]or[ ]the[ ]domain[ ]isn'?t[ ]in[ ]my[ ]list[ ]of[ ]allowed[ ]rcpthosts
-            |the[ ]message[ ]was[ ]rejected[ ]because[ ]it[ ]contains[ ]prohibited[ ]virus[ ]or[ ]spam[ ]content
-            |TLS[ ]required[ ]but[ ]not[ ]supported # SendGrid
+            |sorry,[ ]you[ ]don'?t[ ]authenticate[ ]or[ ]the[ ]domain[ ]isn'?t[ ]in[ ]
+              my[ ]list[ ]of[ ]allowed[ ]rcpthosts
+            |TLS[ ]required[ ]but[ ]not[ ]supported # SendGrid:the recipient mailserver does not support TLS or have a valid certificate
             |User[ ].+[ ]is[ ]not[ ]authorized[ ]to[ ]perform[ ]ses:SendRawEmail[ ]on[ ]resource
             |you[ ]are[ ]not[ ]authorized[ ]to[ ]send[ ]mail,[ ]authentication[ ]is[ ]required
-            |You[ ]have[ ]exceeded[ ]the[ ]the[ ]allowable[ ]number[ ]of[ ]posts[ ]without[ ]solving[ ]a[ ]captcha
             |verification[ ]failure
             )
           }ix
@@ -79,5 +71,3 @@ module Sisimai
   end
 end

data/lib/sisimai/reason/spamdetected.rb CHANGED Viewed

@@ -81,6 +81,7 @@ module Sisimai
             |rejecting[ ]banned[ ]content
             |related[ ]to[ ]content[ ]with[ ]spam[-]like[ ]characteristics
             |rule[ ]imposed[ ]as[ ].+is[ ]blacklisted[ ]on              # Mailmarshal RBLs
+            |Sender[ ]domain[ ]listed[ ]at[ ].+
             |sending[ ]address[ ]not[ ]accepted[ ]due[ ]to[ ]spam[ ]filter
             |spam[ ](?:
                .+[ ]exceeded

data/lib/sisimai/reason/syntaxerror.rb CHANGED Viewed

@@ -25,6 +25,7 @@ module Sisimai
         # @return   [True,False]            true: Connection rejected due to
         #                                         syntax error
         #                                   false: is not syntax error
+        # @since 4.1.25
         # @see http://www.ietf.org/rfc/rfc2822.txt
         def true(argvs)
           return nil unless argvs

data/lib/sisimai/reason/virusdetected.rb ADDED Viewed

@@ -0,0 +1,56 @@
+module Sisimai
+  module Reason
+    # Sisimai::Reason::VirusDetected checks the bounce reason is "virusdetected"
+    # or not. This class is called only Sisimai::Reason class.
+    #
+    # This is an error that any virus or trojan horse detected in the message by
+    # a virus scanner program at a destination mail server. This reason has been
+    # divided from "securityerror" at Sisimai 4.22.0.
+    #
+    #   Your message was infected with a virus. You should download a virus
+    #   scanner and check your computer for viruses.
+    #
+    #     Sender:    <sironeko@libsisimai.org>
+    #     Recipient: <kijitora@example.jp>
+    #
+    module VirusDetected
+      # Imported from p5-Sisimail/lib/Sisimai/Reason/VirusDetected.pm
+      class << self
+        def text; return 'virusdetected'; end
+        def description
+          return 'Email rejected due to a virus scanner on a destination host'
+        end
+        # Try to match that the given text and regular expressions
+        # @param    [String] argv1  String to be matched with regular expressions
+        # @return   [True,False]    false: Did not match
+        #                           true: Matched
+        # @since 4.22.0
+        def match(argv1)
+          return nil unless argv1
+          regex = %r{(?>
+             the[ ]message[ ]was[ ]rejected[ ]because[ ]it[ ]contains[ ]prohibited[ ]virus[ ]or[ ]spam[ ]content
+            |Your[ ]message[ ]was[ ]infected[ ]with[ ]a[ ]virus
+            )
+          }ix
+          return true if argv1 =~ regex
+          return false
+        end
+        # The bounce reason is security error or not
+        # @param    [Sisimai::Data] argvs   Object to be detected the reason
+        # @return   [True,False]            true: virus detected
+        #                                   false: virus was not detected
+        # @since 4.22.0
+        # @see http://www.ietf.org/rfc/rfc2822.txt
+        def true(_argvs)
+          return nil
+        end
+      end
+    end
+  end
+end

data/lib/sisimai/rfc3464.rb CHANGED Viewed

@@ -3,8 +3,7 @@ module Sisimai
   module RFC3464
     # Imported from p5-Sisimail/lib/Sisimai/RFC3464.pm
     class << self
-      require 'sisimai/mta'
-      require 'sisimai/rfc5322'
+      require 'sisimai/bite/email'
       # http://tools.ietf.org/html/rfc3464
       Re0 = {
@@ -42,7 +41,7 @@ module Sisimai
         :error   => %r/\A(?:[45]\d\d[ \t]+|[<][^@]+[@][^@]+[>]:?[ \t]+)/i,
         :command => %r/[ ](RCPT|MAIL|DATA)[ ]+command\b/,
       }
-      Indicators = Sisimai::MTA.INDICATORS
+      Indicators = Sisimai::Bite::Email.INDICATORS
       def description; 'Fallback Module for MTAs'; end
       def smtpagent;   'RFC3464'; end
@@ -50,7 +49,7 @@ module Sisimai
       def headerlist;  return []; end
       # Detect an error for RFC3464
-      # @param         [Hash] mhead       Message header of a bounce email
+      # @param         [Hash] mhead       Message headers of a bounce email
       # @options mhead [String] from      From header
       # @options mhead [String] date      Date header
       # @options mhead [String] subject   Subject header
@@ -68,7 +67,7 @@ module Sisimai
         require 'sisimai/mda'
         require 'sisimai/address'
-        dscontents = [Sisimai::MTA.DELIVERYSTATUS]
+        dscontents = [Sisimai::Bite.DELIVERYSTATUS]
         hasdivided = mbody.split("\n")
         havepassed = ['']
         scannedset = Sisimai::MDA.scan(mhead, mbody)
@@ -144,7 +143,7 @@ module Sisimai
               if x.size > 0 && x != y
                 # There are multiple recipient addresses in the message body.
-                dscontents << Sisimai::MTA.DELIVERYSTATUS
+                dscontents << Sisimai::Bite.DELIVERYSTATUS
                 v = dscontents[-1]
               end
               v['recipient'] = y
@@ -339,7 +338,8 @@ module Sisimai
             )
           }xi
           re_stop = %r{(?:
-             \AContent-Type:[ ]message/delivery-status
+             \A[*][*][*][ ].+[ ].+[ ][*][*][*]
+            |\AContent-Type:[ ]message/delivery-status
             |\AHere[ ]is[ ]a[ ]copy[ ]of[ ]the[ ]first[ ]part[ ]of[ ]the[ ]message
             |\AThe[ ]non-delivered[ ]message[ ]is[ ]attached[ ]to[ ]this[ ]message.
             |\AReceived:[ \t]*
@@ -406,7 +406,7 @@ module Sisimai
               if x.size > 0 && x != y
                 # There are multiple recipient addresses in the message body.
-                dscontents << Sisimai::MTA.DELIVERYSTATUS
+                dscontents << Sisimai::Bite.DELIVERYSTATUS
                 b = dscontents[-1]
               end
               b['recipient'] = y

data/lib/sisimai/rfc3834.rb CHANGED Viewed

@@ -80,10 +80,10 @@ module Sisimai
         end
         return nil if match < 1
-        require 'sisimai/mta'
+        require 'sisimai/bite/email'
         require 'sisimai/address'
-        dscontents = [Sisimai::MTA.DELIVERYSTATUS]
+        dscontents = [Sisimai::Bite.DELIVERYSTATUS]
         hasdivided = mbody.split("\n")
         recipients = 0  # (Integer) The number of 'Final-Recipient' header
         maxmsgline = 5  # (Integer) Max message length(lines)

data/lib/sisimai/rfc5322.rb CHANGED Viewed

@@ -47,7 +47,7 @@ module Sisimai
       build_flatten_rfc822header_list = lambda do
         # Convert HEADER: structured hash table to flatten hash table for being
-        # called from Sisimai::MTA::*
+        # called from Sisimai::Bite::Email::*
         fv = {}
         HeaderTable.each_value do |e|
           e.each do |ee|

data/lib/sisimai/skeleton.rb CHANGED Viewed

@@ -4,7 +4,7 @@ module Sisimai
     class << self
       # Imported from p5-Sisimail/lib/Sisimai/Skeleton.pm
-      # Flags for position variable for
+      # Flags for position variables
       # @return   [Hash] Position flag data
       # @private
       def INDICATORS

data/lib/sisimai/smtp/error.rb CHANGED Viewed

@@ -11,9 +11,9 @@ module Sisimai
         SoftOrHard = {
           :soft => %w|
             blocked contenterror exceedlimit expired filtered mailboxfull
-            mailererror mesgtoobig networkerror norelaying rejected suspend
-            securityerror spamdetected syntaxerror systemerror systemfull
-            toomanyconn
+            mailererror mesgtoobig networkerror norelaying policyviolation
+            rejected securityerror spamdetected suspend syntaxerror systemerror
+            systemfull toomanyconn virusdetected
           |,
           :hard => %w|hasmoved hostunknown userunknown|
         }

data/lib/sisimai/smtp/status.rb CHANGED Viewed

@@ -673,30 +673,32 @@ module Sisimai
             :undefined     => '4.0.900',
           },
           :permanent => {
-            :blocked       => '5.0.971',
-            :contenterror  => '5.0.960',
-            :exceedlimit   => '5.0.923',
-            :expired       => '5.0.947',
-            :filtered      => '5.0.910',
-            :hasmoved      => '5.0.916',
-            :hostunknown   => '5.0.912',
-            :mailboxfull   => '5.0.922',
-            :mailererror   => '5.0.939',
-            :mesgtoobig    => '5.0.934',
-            :networkerror  => '5.0.944',
-            :norelaying    => '5.0.909',
-            :notaccept     => '5.0.932',
-            :onhold        => '5.0.901',
-            :rejected      => '5.0.918',
-            :securityerror => '5.0.970',
-            :spamdetected  => '5.0.980',
-            :suspend       => '5.0.921',
-            :systemerror   => '5.0.930',
-            :systemfull    => '5.0.931',
-            :syntaxerror   => '5.0.902',
-            :toomanyconn   => '5.0.945',
-            :userunknown   => '5.0.911',
-            :undefined     => '5.0.900',
+            :blocked         => '5.0.971',
+            :contenterror    => '5.0.960',
+            :exceedlimit     => '5.0.923',
+            :expired         => '5.0.947',
+            :filtered        => '5.0.910',
+            :hasmoved        => '5.0.916',
+            :hostunknown     => '5.0.912',
+            :mailboxfull     => '5.0.922',
+            :mailererror     => '5.0.939',
+            :mesgtoobig      => '5.0.934',
+            :networkerror    => '5.0.944',
+            :norelaying      => '5.0.909',
+            :notaccept       => '5.0.932',
+            :onhold          => '5.0.901',
+            :policyviolation => '5.0.972',
+            :rejected        => '5.0.918',
+            :securityerror   => '5.0.970',
+            :spamdetected    => '5.0.980',
+            :suspend         => '5.0.921',
+            :systemerror     => '5.0.930',
+            :systemfull      => '5.0.931',
+            :syntaxerror     => '5.0.902',
+            :toomanyconn     => '5.0.945',
+            :userunknown     => '5.0.911',
+            :undefined       => '5.0.900',
+            :virusdetected   => '5.0.971',
           },
         }

data/lib/sisimai/version.rb CHANGED Viewed

@@ -1,4 +1,4 @@
 # Define the version number of Sisimai
 module Sisimai
-  VERSION = '4.21.1'.freeze
+  VERSION = '4.22.0'.freeze
 end

data/set-of-emails/README.md CHANGED Viewed

@@ -12,6 +12,7 @@ in this repository are read from `make test` at p5-Sisimai and rb-Sisimai.
 | Directory                     | Description                                  |
 |-------------------------------|----------------------------------------------|
+| jsonobj/                      | JSON formatted bounce objects                |
 | mailbox/                      | Unix mbox files                              |
 | maildir/                      | Email files                                  |
 |  - bsd/                       | A newline is LF                              |

data/set-of-emails/{jsonapi/ced-us-amazonses-01.json → jsonobj/json-amazonses-01.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-amazonses-02.json → jsonobj/json-amazonses-02.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-amazonses-03.json → jsonobj/json-amazonses-03.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-amazonses-04.json → jsonobj/json-amazonses-04.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-amazonses-05.json → jsonobj/json-amazonses-05.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-01.json → jsonobj/json-sendgrid-01.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-02.json → jsonobj/json-sendgrid-02.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-03.json → jsonobj/json-sendgrid-03.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-04.json → jsonobj/json-sendgrid-04.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-05.json → jsonobj/json-sendgrid-05.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-06.json → jsonobj/json-sendgrid-06.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-07.json → jsonobj/json-sendgrid-07.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-08.json → jsonobj/json-sendgrid-08.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-09.json → jsonobj/json-sendgrid-09.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-10.json → jsonobj/json-sendgrid-10.json} RENAMED Viewed

File without changes

data/set-of-emails/{jsonapi/ced-us-sendgrid-11.json → jsonobj/json-sendgrid-11.json} RENAMED Viewed

File without changes

data/set-of-emails/maildir/bsd/README.md CHANGED Viewed

@@ -1,8 +1,8 @@
 About Sample Emails in set-of-emails/maildir/bsd Directory
-===========================================================
+================================================================================
 Sisimai::ARF
-------------
+--------------------------------------------------------------------------------
 * arf-14.eml
   * [FBL-auth.eml](https://github.com/sendgrid/go-gmime/blob/master/gmime/fixtures/FBL-auth.eml)
   * Copyright (c) 2014, 2015 SendGrid Inc. | The MIT License
@@ -12,13 +12,13 @@ Sisimai::ARF
   * Copyright (c) 2014 prasad83 | The MIT License
 Sisimai::MTA::Exchange2003
---------------------------
+--------------------------------------------------------------------------------
 * mta-exchange-06.eml
   * mailman-2.1.15/tests/bounces/groupwise_01.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
 Sisimai::MTA::Exchange2007
---------------------------
+--------------------------------------------------------------------------------
 * mta-exchange2007-02.eml
   * [message-too-large.msg](https://github.com/rjbs/Mail-DeliveryStatus-BounceParser/blob/master/t/corpus/message-too-large.msg)
   * Copyright (C) 2003-2006 IC Group, Inc. | GPLv2
@@ -28,7 +28,7 @@ Sisimai::MTA::Exchange2007
   * Copyright (c) 2015 Lone Star Internet, Inc. | MIT
 Sisimai::MTA::Exim
-------------------
+--------------------------------------------------------------------------------
 * mta-exim-09.eml
   * [13.eml](https://github.com/prasad83/node-bounce-handler/blob/master/eml/13.eml)
   * Copyright (c) 2014 prasad83 | The MIT License
@@ -110,25 +110,25 @@ Sisimai::MTA::Exim
   * Copyright (c) 1995 - 2012 University of Cambridge.
 Sisimai::MTA::IMailServer
--------------------------
+--------------------------------------------------------------------------------
 * mta-imailserver-05.eml
   * mailman-2.1.15/tests/bounces/smtp32_03.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
 Sisimai::MTA::InterScanMSS
---------------------------
+--------------------------------------------------------------------------------
 * mta-interscanmss-02.eml
   * mailman-2.1.15/tests/bounces/simple_15.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
 Sisimai::MTA::Notes
--------------------
+--------------------------------------------------------------------------------
 * mta-notes-04.eml
   * [msg00154.html](http://osdir.com/ml/org.telecom.india-gii/2003-02/msg00154.html)
   * Copyrighted (c) 2000-2015, but we're happy to let you use what you wish with attribution. OSDir.com
 Sisimai::MTA::Postfix
----------------------
+--------------------------------------------------------------------------------
 * mta-postfix-18.eml
   * [relay_failed.eml](https://github.com/choonkeat/deliveryboy/blob/master/spec/fixtures/bounce_cases/relay_failed.eml)
   * Copyright (c) 2011 Chew Choon Keat | The MIT License
@@ -166,7 +166,7 @@ Sisimai::MTA::Postfix
   * Copyright (c) 2015 Rui Lopes (ruilopes.com) | MIT
 Sisimai::MTA::qmail
--------------------
+--------------------------------------------------------------------------------
 * mta-qmail-09.eml
   * mailman-2.1.15/tests/bounces/qmail_01.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
@@ -184,7 +184,7 @@ Sisimai::MTA::qmail
   * Copyright (c) 2015 Rui Lopes (ruilopes.com) | MIT
 Sisimai::RFC3464
-----------------
+--------------------------------------------------------------------------------
 * rfc3464-10.eml
   * [DSN-bounce.eml](https://github.com/sendgrid/go-gmime/blob/master/gmime/fixtures/DSN-bounce.eml)
   * Copyright (c) 2014, 2015 SendGrid Inc. | The MIT License
@@ -241,8 +241,16 @@ Sisimai::RFC3464
   * https://github.com/LoneStarInternet/mail_manager/tree/master/spec/test_app/spec/support/files/bounce-over-quota.txt
   * Copyright (c) 2015 Lone Star Internet, Inc. | MIT
+* rfc3464-31.eml
+  * https://github.com/houseabsolute/Courriel/blob/master/t/data/stress-test/mbox_mime_virus-mcafee-virusscan.txt
+  * Copyright (c) 2016 by Dave Rolsky. | Artistic License 2.0
+* rfc3464-32.eml
+  * https://github.com/houseabsolute/Courriel/blob/master/t/data/stress-test/mbox_mime_auto-error-msg.txt
+  * Copyright (c) 2016 by Dave Rolsky. | Artistic License 2.0
 Sisimai::RFC3834
-----------------
+--------------------------------------------------------------------------------
 * rfc3834-01.eml
   * [out_of_office.eml](https://github.com/tangofoxtrot/tmail_bouncer/blob/master/test/fixtures/out_of_office.eml)
   * Copyright (c) 2009 tangofoxtrot | The MIT License
@@ -264,13 +272,13 @@ Sisimai::RFC3834
   * Copyright (c) 2015 Lone Star Internet, Inc. | MIT
 Sisimai::MTA::Sendmail
-----------------------
+--------------------------------------------------------------------------------
 * mta-sendmail-23.eml
   * [DSN-spam.eml](https://github.com/sendgrid/go-gmime/blob/master/gmime/fixtures/DSN-spam.eml)
   * Copyright (c) 2014, 2015 SendGrid Inc. | The MIT License
 Sisimai::MSP::US::Google
-------------------------
+--------------------------------------------------------------------------------
 * us-msp-google-12.eml
   * mailman-2.1.15/tests/bounces/simple_17.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
@@ -280,19 +288,19 @@ Sisimai::MSP::US::Google
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
 Sisimai::MSP::US::Outlook
--------------------------
+--------------------------------------------------------------------------------
 * us-msp-outlook-09.eml
   * [connection_timed_out.eml](https://github.com/choonkeat/deliveryboy/blob/master/spec/fixtures/bounce_cases/connection_timed_out.eml)
   * Copyright (c) 2011 Chew Choon Keat | The MIT License
 Sisimai::MTA::X2
-----------------
+--------------------------------------------------------------------------------
 * mta-x2-05.eml
   * mailman-2.1.15/tests/bounces/yahoo_03.txt
   * Copyright (C) 1989, 1991 Free Software Foundation, Inc. | GPLv2
 Sisimai::MTA::X4
-----------------
+--------------------------------------------------------------------------------
 * mta-x4-01.eml
   * [bounce-secureservers.net-mailfolder_is_full.eml](https://github.com/justingit/dada-mail/blob/master/dada/t/corpus/email_messages/bounce-secureservers.net-mailfolder_is_full.eml)
   * Copyright (c) 1999 - 2015 Justin Simoni | GPL