PyPI - ethyca-fides - Versions diffs - 2.71.1rc2__py2.py3-none-any.whl → 2.72.0__py2.py3-none-any.whl - Mend

ethyca-fides 2.71.1rc2py2.py3-none-any.whl → 2.72.0py2.py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Potentially problematic release.

This version of ethyca-fides might be problematic. Click here for more details.

Files changed (359) hide show

fides/api/email_templates/templates/manual_task_digest.html ADDED Viewed

@@ -0,0 +1,316 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+    <meta charset="UTF-8">
+    <meta name="viewport" content="width=device-width, initial-scale=1.0">
+    <title>Weekly DSR Summary</title>
+    <style>
+        /* Reset styles for email clients */
+        body, table, td, p, a, li, blockquote {
+            -webkit-text-size-adjust: 100%;
+            -ms-text-size-adjust: 100%;
+        }
+        table, td {
+            mso-table-lspace: 0pt;
+            mso-table-rspace: 0pt;
+        }
+        img {
+            -ms-interpolation-mode: bicubic;
+            border: 0;
+            height: auto;
+            line-height: 100%;
+            outline: none;
+            text-decoration: none;
+        }
+        /* Main styles */
+        body {
+            margin: 0;
+            padding: 0;
+            width: 100% !important;
+            min-width: 100%;
+            height: 100%;
+            background-color: #f8fafc;
+            font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, 'Helvetica Neue', Arial, sans-serif;
+            font-size: 16px;
+            line-height: 1.6;
+            color: #334155;
+        }
+        .email-container {
+            max-width: 600px;
+            margin: 0 auto;
+            background-color: #ffffff;
+            border-radius: 8px;
+            box-shadow: 0 4px 6px -1px rgba(0, 0, 0, 0.1);
+            overflow: hidden;
+        }
+        .logo-section {
+            background-color: #ffffff;
+            padding: 24px;
+            text-align: center;
+            border-bottom: 1px solid #e5e5e5;
+        }
+        .logo-container {
+            margin-bottom: 0;
+        }
+        .header {
+            background-color: #000000;
+            padding: 32px 24px;
+            text-align: center;
+        }
+        .logo {
+            max-width: 200px;
+            max-height: 60px;
+            width: auto;
+            height: auto;
+            display: block;
+            margin: 0 auto;
+        }
+        .logo-placeholder {
+            width: 200px;
+            height: 60px;
+            background-color: #333333;
+            border: 2px dashed #666666;
+            display: flex;
+            align-items: center;
+            justify-content: center;
+            margin: 0 auto;
+            color: #999999;
+            font-size: 14px;
+            font-weight: 500;
+            text-align: center;
+            border-radius: 4px;
+        }
+        .header h1 {
+            color: #ffffff;
+            font-size: 24px;
+            font-weight: 600;
+            margin: 0;
+            letter-spacing: -0.025em;
+        }
+        .content {
+            padding: 32px 24px;
+        }
+        .greeting {
+            font-size: 18px;
+            color: #000000;
+            margin-bottom: 24px;
+            font-weight: 500;
+        }
+        .intro-text {
+            margin-bottom: 32px;
+            color: #333333;
+            line-height: 1.7;
+        }
+        .section {
+            margin-bottom: 32px;
+        }
+        .section-title {
+            font-size: 20px;
+            font-weight: 600;
+            color: #000000;
+            margin-bottom: 16px;
+            padding-bottom: 8px;
+            border-bottom: 2px solid #e5e5e5;
+        }
+        .task-count {
+            background-color: #f5f5f5;
+            border-left: 4px solid #000000;
+            padding: 16px 20px;
+            margin-bottom: 20px;
+            border-radius: 0 6px 6px 0;
+        }
+        .task-count-text {
+            font-size: 18px;
+            font-weight: 600;
+            color: #000000;
+            margin: 0;
+        }
+        .cta-button {
+            display: inline-block;
+            background-color: #000000;
+            color: #ffffff !important;
+            text-decoration: none;
+            padding: 12px 24px;
+            border-radius: 6px;
+            font-weight: 600;
+            font-size: 16px;
+            text-align: center;
+            transition: all 0.2s ease;
+            box-shadow: 0 2px 4px rgba(0, 0, 0, 0.2);
+        }
+        .cta-button:hover {
+            background-color: #333333;
+            box-shadow: 0 4px 8px rgba(0, 0, 0, 0.3);
+            transform: translateY(-1px);
+        }
+        .footer {
+            background-color: #f5f5f5;
+            padding: 24px;
+            text-align: center;
+            border-top: 1px solid #e5e5e5;
+        }
+        .footer-text {
+            color: #666666;
+            font-size: 14px;
+            line-height: 1.6;
+            margin: 0;
+        }
+        .signature {
+            margin-top: 24px;
+            color: #333333;
+            font-weight: 500;
+        }
+        /* Responsive styles */
+        @media only screen and (max-width: 600px) {
+            .email-container {
+                margin: 0;
+                border-radius: 0;
+            }
+            .header, .content, .footer {
+                padding: 24px 16px;
+            }
+            .header h1 {
+                font-size: 20px;
+            }
+            .greeting {
+                font-size: 16px;
+            }
+            .section-title {
+                font-size: 18px;
+            }
+            .cta-button {
+                width: 100%;
+                box-sizing: border-box;
+            }
+        }
+        /* Dark mode support */
+        @media (prefers-color-scheme: dark) {
+            body {
+                background-color: #000000;
+            }
+            .email-container {
+                background-color: #1a1a1a;
+            }
+            .greeting, .section-title {
+                color: #ffffff;
+            }
+            .intro-text, .footer-text, .signature {
+                color: #cccccc;
+            }
+            .task-count {
+                background-color: #333333;
+                border-left-color: #ffffff;
+            }
+            .task-count-text {
+                color: #ffffff;
+            }
+            .footer {
+                background-color: #333333;
+                border-top-color: #666666;
+            }
+            .logo-section {
+                background-color: #1a1a1a;
+                border-bottom-color: #666666;
+            }
+            .logo-placeholder {
+                background-color: #555555;
+                border-color: #888888;
+                color: #cccccc;
+            }
+        }
+    </style>
+</head>
+<body>
+    <div style="padding: 20px 0;">
+        <div class="email-container">
+            <!-- Logo Section -->
+            <div class="logo-section">
+                <div class="logo-container">
+                    {% if company_logo_url %}
+                        <img src="{{ company_logo_url }}" alt="{{ organization_name }} Logo" class="logo">
+                    {% else %}
+                        <div class="logo-placeholder">{{ organization_name }}</div>
+                    {% endif %}
+                </div>
+            </div>
+            <!-- Main Content -->
+            <div class="content">
+                <div class="greeting">Hi {{ vendor_contact_name }},</div>
+                <div class="intro-text">
+                    {{ intro_text | default("This is your weekly summary of open data subject requests tasks from " + organization_name + " that require your attention. Please review the tasks listed below in our <a href='" + portal_url + "' style='color: #000000; text-decoration: underline; font-weight: 600;'>Privacy Center</a> to ensure timely completion.") | safe }}
+                </div>
+                <!-- Tasks Due Soon Section -->
+                <div class="section">
+                    <div class="section-title">Tasks Due Soon</div>
+                    <div class="task-count">
+                        <p class="task-count-text">You have {{ total_task_count }} request{{ 's' if total_task_count != 1 else '' }} coming due, including {{ imminent_task_count }} within the next 7 days and {{ upcoming_task_count }} due in the next period.</p>
+                    </div>
+                    <div style="text-align: center;">
+                        <a href="{{ portal_url }}" class="cta-button">View All Tasks</a>
+                    </div>
+                </div>
+                <!-- Closing -->
+                <div style="margin-top: 32px;">
+                    <p style="color: #333333; margin-bottom: 24px;">
+                        {{ closing_text | default("Thank you for your partnership in processing these requests efficiently. If you have any questions or issues, please reach out to your contacts at " + organization_name + ".") | safe }}
+                    </p>
+                    <div class="signature">
+                        {{ signature | default("Best regards,<br>The " + organization_name + " Privacy Team") | safe }}
+                    </div>
+                </div>
+            </div>
+            <!-- Footer -->
+            <div class="footer">
+                <p class="footer-text">
+                    This email was sent from your Privacy Center. Please do not reply to this email.
+                </p>
+            </div>
+        </div>
+    </div>
+</body>
+</html>

fides/api/models/detection_discovery/monitor_task.py CHANGED Viewed

@@ -25,6 +25,7 @@ class MonitorTaskType(Enum):
     DETECTION = "detection"
     CLASSIFICATION = "classification"
+    LLM_CLASSIFICATION = "llm_classification"
     PROMOTION = "promotion"
     REMOVAL_PROMOTION = "removal_promotion"

fides/api/models/digest/digest_execution.py CHANGED Viewed

@@ -4,6 +4,7 @@ from sqlalchemy import Column, DateTime, ForeignKey, Integer, String, Text
 from sqlalchemy.dialects.postgresql import JSONB
 from sqlalchemy.ext.declarative import declared_attr
 from sqlalchemy.orm import Session, relationship
+from sqlalchemy.orm.attributes import flag_modified
 from sqlalchemy.sql import func
 from fides.api.db.base_class import Base
@@ -92,8 +93,12 @@ class DigestTaskExecution(
         self.processed_user_ids = processed_user_ids
         self.last_checkpoint_at = func.now()
+        # Mark JSONB fields as modified so SQLAlchemy knows they changed
+        flag_modified(self, "processed_user_ids")
         if execution_state:
             self.execution_state = execution_state
+            flag_modified(self, "execution_state")
         self.save(db)
@@ -123,8 +128,13 @@ class DigestTaskExecution(
     def get_remaining_work(self) -> Dict[str, Any]:
         """Get information about remaining work for resumption."""
+        # Ensure processed_user_ids is always a list
+        raw_processed_user_ids = self.processed_user_ids or []
+        processed_user_ids = (
+            raw_processed_user_ids if isinstance(raw_processed_user_ids, list) else []
+        )
         return {
-            "processed_user_ids": self.processed_user_ids or [],
+            "processed_user_ids": processed_user_ids,
             "execution_state": self.execution_state or {},
             "processed_count": self.processed_recipients or 0,
             "successful_count": self.successful_communications,

fides/api/models/event_audit.py CHANGED Viewed

@@ -31,6 +31,15 @@ class EventAuditType(str, EnumType):
     taxonomy_element_updated = "taxonomy.element.updated"
     taxonomy_element_deleted = "taxonomy.element.deleted"
+    # Connection operations
+    connection_created = "connection.created"
+    connection_updated = "connection.updated"
+    connection_deleted = "connection.deleted"
+    # Connection secrets operations
+    connection_secrets_created = "connection.secrets.created"
+    connection_secrets_updated = "connection.secrets.updated"
     # Digest
     digest_execution_started = "digest.execution.started"
     digest_execution_completed = "digest.execution.completed"

fides/api/models/messaging_template.py CHANGED Viewed

@@ -58,6 +58,13 @@ DEFAULT_MESSAGING_TEMPLATES: Dict[str, Any] = {
             "body": "Your erasure request has been completed.",
         },
     },
+    MessagingActionType.MANUAL_TASK_DIGEST.value: {
+        "label": "Manual task digest",
+        "content": {
+            "subject": "Weekly DSR Summary from __ORGANIZATION_NAME__",
+            "body": "This is your weekly summary of open data subject requests tasks from __ORGANIZATION_NAME__ that require your attention. Please review the tasks in our Privacy Center to ensure timely completion.",
+        },
+    },
 }

fides/api/models/privacy_request/privacy_request.py CHANGED Viewed

@@ -369,7 +369,7 @@ class PrivacyRequest(
         return {
             "id": self.id,
             "external_id": self.external_id,
-            "status": self.status.value,
+            "status": self.status.value if self.status is not None else None,
             "requested_at": (
                 self.requested_at.isoformat() if self.requested_at else None
             ),

fides/api/schemas/connection_configuration/connection_config.py CHANGED Viewed

@@ -13,6 +13,7 @@ from fides.api.schemas.connection_configuration import connection_secrets_schema
 from fides.api.schemas.policy import ActionType
 from fides.api.schemas.saas.saas_config import SaaSConfigBase
 from fides.api.util.connection_type import get_connection_type_secret_schema
+from fides.api.util.masking_util import mask_sensitive_fields
 class CreateConnectionConfiguration(BaseModel):
@@ -41,36 +42,6 @@ class CreateConnectionConfigurationWithSecrets(CreateConnectionConfiguration):
     model_config = ConfigDict(from_attributes=True, extra="ignore")
-def mask_sensitive_fields(
-    connection_secrets: Dict[str, Any], secret_schema: Dict[str, Any]
-) -> Dict[str, Any]:
-    """
-    Mask sensitive fields in the given secrets based on the provided schema.
-    This function traverses the given secrets dictionary and uses the provided schema to
-    identify fields that have been marked as sensitive. The function replaces the sensitive
-    field values with a mask string ('********').
-    Args:
-        connection_secrets (Dict[str, Any]): The secrets to be masked.
-        secret_schema (Dict[str, Any]): The schema defining which fields are sensitive.
-    Returns:
-        Dict[str, Any]: The secrets dictionary with sensitive fields masked.
-    """
-    if connection_secrets is None:
-        return connection_secrets
-    secret_schema_properties = secret_schema["properties"]
-    new_connection_secrets = {}
-    for key, value in connection_secrets.items():
-        if key in secret_schema_properties:
-            if secret_schema_properties.get(key, {}).get("sensitive", False):
-                new_connection_secrets[key] = "**********"
-            else:
-                new_connection_secrets[key] = value
-    return new_connection_secrets
 class ConnectionConfigSecretsMixin(BaseModel):
     """
     A schema mixin to declare a connection config `secrets` attribute

fides/api/schemas/messaging/messaging.py CHANGED Viewed

@@ -89,6 +89,7 @@ class MessagingActionType(str, Enum):
     PRIVACY_REQUEST_REVIEW_APPROVE = "privacy_request_review_approve"
     USER_INVITE = "user_invite"
     EXTERNAL_USER_WELCOME = "external_user_welcome"
+    MANUAL_TASK_DIGEST = "manual_task_digest"
     TEST_MESSAGE = "test_message"
@@ -101,6 +102,7 @@ CONFIGURABLE_MESSAGING_ACTION_TYPES: Tuple[str, ...] = (
     MessagingActionType.PRIVACY_REQUEST_COMPLETE_DELETION.value,
     MessagingActionType.PRIVACY_REQUEST_REVIEW_DENY.value,
     MessagingActionType.PRIVACY_REQUEST_REVIEW_APPROVE.value,
+    MessagingActionType.MANUAL_TASK_DIGEST.value,
 )
@@ -219,6 +221,18 @@ class ExternalUserWelcomeBodyParams(BaseModel):
     org_name: str
+class ManualTaskDigestBodyParams(BaseModel):
+    """Body params required to send manual task digest emails"""
+    vendor_contact_name: str
+    organization_name: str
+    portal_url: str
+    imminent_task_count: int
+    upcoming_task_count: int
+    total_task_count: int
+    company_logo_url: Optional[str] = None
 class FidesopsMessage(
     BaseModel,
 ):
@@ -256,6 +270,7 @@ class FidesopsMessage(
             MessagingActionType.PRIVACY_REQUEST_ERROR_NOTIFICATION: ErrorNotificationBodyParams,
             MessagingActionType.USER_INVITE: UserInviteBodyParams,
             MessagingActionType.EXTERNAL_USER_WELCOME: ExternalUserWelcomeBodyParams,
+            MessagingActionType.MANUAL_TASK_DIGEST: ManualTaskDigestBodyParams,
         }
         valid_body_params = valid_body_params_for_action_type.get(

fides/api/service/connectors/query_configs/saas_query_config.py CHANGED Viewed

@@ -46,6 +46,7 @@ from fides.api.util.saas_util import (
     ISO_8601_DATETIME,
     MASKED_OBJECT_FIELDS,
     PRIVACY_REQUEST_ID,
+    PRIVACY_REQUEST_OBJECT,
     REPLY_TO,
     REPLY_TO_TOKEN,
     UUID,
@@ -211,6 +212,7 @@ class SaaSQueryConfig(QueryConfig[SaaSRequestParams]):
         input_data: Dict[str, List[Any]],
         policy: Optional[Policy],
         read_request: SaaSRequest,
+        privacy_request: Optional[PrivacyRequest] = None,
     ) -> List[Tuple[SaaSRequestParams, Dict[str, Any]]]:
         """
         Takes the identity and reference values from input_data and combines them
@@ -223,6 +225,10 @@ class SaaSQueryConfig(QueryConfig[SaaSRequestParams]):
         self.current_request = read_request
         request_params = []
+        if privacy_request:
+            input_data[PRIVACY_REQUEST_OBJECT] = [privacy_request.to_safe_dict()]
         param_value_maps = self.generate_param_value_maps(input_data, read_request)
         for param_value_map in param_value_maps:
@@ -342,6 +348,14 @@ class SaaSQueryConfig(QueryConfig[SaaSRequestParams]):
         if self.privacy_request:
             param_values[PRIVACY_REQUEST_ID] = self.privacy_request.id
+        privacy_request_object = input_data.get(PRIVACY_REQUEST_OBJECT)
+        if (
+            isinstance(privacy_request_object, list)
+            and len(privacy_request_object) > 0
+            and isinstance(privacy_request_object[0], dict)
+        ):
+            param_values[PRIVACY_REQUEST_OBJECT] = privacy_request_object[0]
         custom_privacy_request_fields = input_data.get(CUSTOM_PRIVACY_REQUEST_FIELDS)
         if (
             isinstance(custom_privacy_request_fields, list)
@@ -462,6 +476,8 @@ class SaaSQueryConfig(QueryConfig[SaaSRequestParams]):
         if self.privacy_request:
             param_values[PRIVACY_REQUEST_ID] = self.privacy_request.id
+        param_values[PRIVACY_REQUEST_OBJECT] = privacy_request.to_safe_dict()
         param_values[CUSTOM_PRIVACY_REQUEST_FIELDS] = custom_privacy_request_fields
         param_values[UUID] = str(uuid4())
         param_values[ISO_8601_DATETIME] = datetime.now().strftime("%Y-%m-%dT%H:%M:%SZ")

ethyca-fides 2.71.1rc2__py2.py3-none-any.whl → 2.72.0__py2.py3-none-any.whl

Potentially problematic release.

ethyca-fides 2.71.1rc2py2.py3-none-any.whl → 2.72.0py2.py3-none-any.whl