PyPI - acryl-datahub-cloud - Versions diffs - 0.3.13.2rc4__py3-none-any.whl → 0.3.14rc0__py3-none-any.whl - Mend

acryl-datahub-cloud 0.3.13.2rc4py3-none-any.whl → 0.3.14rc0py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Potentially problematic release.

This version of acryl-datahub-cloud might be problematic. Click here for more details.

Files changed (33) hide show

acryl_datahub_cloud/metadata/schemas/ActionRequestInfo.avsc CHANGED Viewed

@@ -435,6 +435,75 @@
                                 "name": "source",
                                 "default": null,
                                 "doc": "Source information for the ownership"
+                              },
+                              {
+                                "Searchable": {
+                                  "/actor": {
+                                    "fieldName": "ownerAttributionActors",
+                                    "fieldType": "URN",
+                                    "queryByDefault": false
+                                  },
+                                  "/source": {
+                                    "fieldName": "ownerAttributionSources",
+                                    "fieldType": "URN",
+                                    "queryByDefault": false
+                                  },
+                                  "/time": {
+                                    "fieldName": "ownerAttributionDates",
+                                    "fieldType": "DATETIME",
+                                    "queryByDefault": false
+                                  }
+                                },
+                                "type": [
+                                  "null",
+                                  {
+                                    "type": "record",
+                                    "name": "MetadataAttribution",
+                                    "namespace": "com.linkedin.pegasus2avro.common",
+                                    "fields": [
+                                      {
+                                        "type": "long",
+                                        "name": "time",
+                                        "doc": "When this metadata was updated."
+                                      },
+                                      {
+                                        "java": {
+                                          "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+                                        },
+                                        "type": "string",
+                                        "name": "actor",
+                                        "doc": "The entity (e.g. a member URN) responsible for applying the assocated metadata. This can\neither be a user (in case of UI edits) or the datahub system for automation.",
+                                        "Urn": "Urn"
+                                      },
+                                      {
+                                        "java": {
+                                          "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+                                        },
+                                        "type": [
+                                          "null",
+                                          "string"
+                                        ],
+                                        "name": "source",
+                                        "default": null,
+                                        "doc": "The DataHub source responsible for applying the associated metadata. This will only be filled out\nwhen a DataHub source is responsible. This includes the specific metadata test urn, the automation urn.",
+                                        "Urn": "Urn"
+                                      },
+                                      {
+                                        "type": {
+                                          "type": "map",
+                                          "values": "string"
+                                        },
+                                        "name": "sourceDetail",
+                                        "default": {},
+                                        "doc": "The details associated with why this metadata was applied. For example, this could include\nthe actual regex rule, sql statement, ingestion pipeline ID, etc.\nAlso can include flags like 'propagated'=true or 'inferred'=true."
+                                      }
+                                    ],
+                                    "doc": "Information about who, why, and how this metadata was applied"
+                                  }
+                                ],
+                                "name": "attribution",
+                                "default": null,
+                                "doc": "Information about who, why, and how this metadata was applied"
                               }
                             ],
                             "doc": "Ownership information"
@@ -556,6 +625,32 @@
                                 "name": "lastModified",
                                 "default": null,
                                 "doc": "Audit stamp containing who last modified this relationship edge and when"
+                              },
+                              {
+                                "Searchable": {
+                                  "/actor": {
+                                    "fieldName": "structuredPropertyAttributionActors",
+                                    "fieldType": "URN",
+                                    "queryByDefault": false
+                                  },
+                                  "/source": {
+                                    "fieldName": "structuredPropertyAttributionSources",
+                                    "fieldType": "URN",
+                                    "queryByDefault": false
+                                  },
+                                  "/time": {
+                                    "fieldName": "structuredPropertyAttributionDates",
+                                    "fieldType": "DATETIME",
+                                    "queryByDefault": false
+                                  }
+                                },
+                                "type": [
+                                  "null",
+                                  "com.linkedin.pegasus2avro.common.MetadataAttribution"
+                                ],
+                                "name": "attribution",
+                                "default": null,
+                                "doc": "Information about who, why, and how this metadata was applied"
                               }
                             ]
                           }

acryl_datahub_cloud/metadata/schemas/AssertionAnalyticsRunEvent.avsc CHANGED Viewed

@@ -167,27 +167,6 @@
       "doc": "Data Platform for parent",
       "Urn": "Urn"
     },
-    {
-      "Searchable": {
-        "/*": {
-          "addToFilters": true,
-          "fieldType": "URN",
-          "hasValuesFieldName": "hasAsserteeContainer"
-        }
-      },
-      "TimeseriesField": {},
-      "java": {
-        "class": "com.linkedin.pegasus2avro.common.urn.Urn"
-      },
-      "type": [
-        "null",
-        "string"
-      ],
-      "name": "asserteeContainer",
-      "default": null,
-      "doc": "The Container attached to the entity's parent Asset",
-      "Urn": "Urn"
-    },
     {
       "Searchable": {
         "addToFilters": true,

acryl_datahub_cloud/metadata/schemas/ChartInfo.avsc CHANGED Viewed

@@ -188,7 +188,8 @@
           "createdActor": "inputEdges/*/created/actor",
           "createdOn": "inputEdges/*/created/time",
           "entityTypes": [
-            "dataset"
+            "dataset",
+            "chart"
           ],
           "isLineage": true,
           "name": "Consumes",

acryl_datahub_cloud/metadata/schemas/CorpUserInvitationStatus.avsc ADDED Viewed

@@ -0,0 +1,106 @@
+{
+  "type": "record",
+  "Aspect": {
+    "name": "corpUserInvitationStatus"
+  },
+  "name": "CorpUserInvitationStatus",
+  "namespace": "com.linkedin.pegasus2avro.identity",
+  "fields": [
+    {
+      "Searchable": {
+        "fieldType": "URN",
+        "hasValuesFieldName": "hasRole",
+        "queryByDefault": false
+      },
+      "java": {
+        "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+      },
+      "type": [
+        "null",
+        "string"
+      ],
+      "name": "role",
+      "default": null,
+      "doc": "Role will only work in non-sso environments today.",
+      "Urn": "Urn"
+    },
+    {
+      "type": {
+        "type": "record",
+        "name": "AuditStamp",
+        "namespace": "com.linkedin.pegasus2avro.common",
+        "fields": [
+          {
+            "type": "long",
+            "name": "time",
+            "doc": "When did the resource/association/sub-resource move into the specific lifecycle stage represented by this AuditEvent."
+          },
+          {
+            "java": {
+              "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+            },
+            "type": "string",
+            "name": "actor",
+            "doc": "The entity (e.g. a member URN) which will be credited for moving the resource/association/sub-resource into the specific lifecycle stage. It is also the one used to authorize the change.",
+            "Urn": "Urn"
+          },
+          {
+            "java": {
+              "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+            },
+            "type": [
+              "null",
+              "string"
+            ],
+            "name": "impersonator",
+            "default": null,
+            "doc": "The entity (e.g. a service URN) which performs the change on behalf of the Actor and must be authorized to act as the Actor.",
+            "Urn": "Urn"
+          },
+          {
+            "type": [
+              "null",
+              "string"
+            ],
+            "name": "message",
+            "default": null,
+            "doc": "Additional context around how DataHub was informed of the particular change. For example: was the change created by an automated process, or manually."
+          }
+        ],
+        "doc": "Data captured on a resource/association/sub-resource level giving insight into when that resource/association/sub-resource moved into a particular lifecycle stage, and who acted to move it into that specific lifecycle stage."
+      },
+      "name": "created",
+      "doc": "Created Audit"
+    },
+    {
+      "Searchable": {
+        "fieldName": "invitationStatus",
+        "fieldType": "KEYWORD",
+        "queryByDefault": false
+      },
+      "type": {
+        "type": "enum",
+        "name": "InvitationStatus",
+        "namespace": "com.linkedin.pegasus2avro.identity",
+        "symbols": [
+          "SENT",
+          "ACCEPTED",
+          "REVOKED",
+          "SUGGESTION_DISMISSED"
+        ]
+      },
+      "name": "status",
+      "doc": "The status of the invitation"
+    },
+    {
+      "type": "com.linkedin.pegasus2avro.common.AuditStamp",
+      "name": "lastUpdated",
+      "doc": "Last Status Change Audit"
+    },
+    {
+      "type": "string",
+      "name": "invitationToken",
+      "doc": "Unique token for the invitation URL - hashed via SecretService "
+    }
+  ]
+}

acryl_datahub_cloud/metadata/schemas/CorpUserKey.avsc CHANGED Viewed

@@ -21,6 +21,8 @@
       "testResults",
       "subTypes",
       "slackUserInfo",
+      "corpUserUsageFeatures",
+      "corpUserInvitationStatus",
       "share",
       "formNotifications"
     ],

acryl_datahub_cloud/metadata/schemas/CorpUserUsageFeatures.avsc ADDED Viewed

@@ -0,0 +1,93 @@
+{
+  "type": "record",
+  "Aspect": {
+    "name": "corpUserUsageFeatures"
+  },
+  "name": "CorpUserUsageFeatures",
+  "namespace": "com.linkedin.pegasus2avro.metadata.search.features",
+  "fields": [
+    {
+      "Searchable": {
+        "fieldName": "userUsageTotalPast30DaysFeature",
+        "fieldType": "COUNT"
+      },
+      "type": [
+        "null",
+        "long"
+      ],
+      "name": "userUsageTotalPast30Days",
+      "default": null,
+      "doc": "Total number of usage in the last 30 days"
+    },
+    {
+      "Searchable": {
+        "/*": {
+          "fieldName": "platformUsageTotal",
+          "fieldType": "OBJECT",
+          "queryByDefault": false
+        }
+      },
+      "type": [
+        "null",
+        {
+          "type": "map",
+          "values": "double"
+        }
+      ],
+      "name": "userPlatformUsageTotalsPast30Days",
+      "default": null,
+      "doc": "usage broken down by platform so we can differentiate between top users of snowflake vs redshift\nkey is supposed to be platform urn"
+    },
+    {
+      "Searchable": {
+        "/*": {
+          "fieldName": "platformUsagePercentage",
+          "fieldType": "OBJECT",
+          "queryByDefault": false
+        }
+      },
+      "type": [
+        "null",
+        {
+          "type": "map",
+          "values": "double"
+        }
+      ],
+      "name": "userPlatformUsagePercentilePast30Days",
+      "default": null,
+      "doc": "usage broken down by platform so we can differentiate between top users of snowflake vs redshift"
+    },
+    {
+      "Searchable": {
+        "fieldName": "userUsagePercentilePast30DaysFeature",
+        "fieldType": "DOUBLE"
+      },
+      "type": [
+        "null",
+        "double"
+      ],
+      "name": "userUsagePercentilePast30Days",
+      "default": null,
+      "doc": "Platform usage total percentile for ranking users across all platforms"
+    },
+    {
+      "Searchable": {
+        "/*": {
+          "fieldName": "topDatasetsByUsage",
+          "fieldType": "OBJECT",
+          "queryByDefault": false
+        }
+      },
+      "type": [
+        "null",
+        {
+          "type": "map",
+          "values": "double"
+        }
+      ],
+      "name": "userTopDatasetsByUsage",
+      "default": null,
+      "doc": "Gather what are the top datasets per user so we can create a welcome module\nWith links to the users top datasets with lineage (top 25)\nMap keys are dataset URN strings"
+    }
+  ]
+}

acryl_datahub_cloud/metadata/schemas/DataHubPageModuleProperties.avsc CHANGED Viewed

@@ -24,7 +24,8 @@
           "LINK": "Link type module",
           "OWNED_ASSETS": "Module displaying assets owned by a user",
           "RICH_TEXT": "Module containing rich text to be rendered",
-          "SUBSCRIBED_ASSETS": "Module displaying assets subscribed to by a given user"
+          "SUBSCRIBED_ASSETS": "Module displaying assets subscribed to by a given user",
+          "WORKFLOWS": "Module displaying workflows that can be started"
         },
         "name": "DataHubPageModuleType",
         "namespace": "com.linkedin.pegasus2avro.module",
@@ -35,7 +36,8 @@
           "HIERARCHY",
           "OWNED_ASSETS",
           "DOMAINS",
-          "SUBSCRIBED_ASSETS"
+          "SUBSCRIBED_ASSETS",
+          "WORKFLOWS"
         ],
         "doc": "Enum containing the types of page modules that there are"
       },
@@ -150,6 +152,15 @@
                     "name": "assetUrns",
                     "Urn": "Urn",
                     "urn_is_array": true
+                  },
+                  {
+                    "type": [
+                      "null",
+                      "string"
+                    ],
+                    "name": "dynamicFilterJson",
+                    "default": null,
+                    "doc": "Optional dynamic filters\n\nThe stringified json representing the logical predicate built in the UI to select assets.\nThis predicate is turned into orFilters to send through graphql since graphql doesn't support\narbitrary nesting. This string is used to restore the UI for this logical predicate."
                   }
                 ],
                 "doc": "The params required if the module is type ASSET_COLLECTION"

acryl_datahub_cloud/metadata/schemas/DatasetUsageStatistics.avsc CHANGED Viewed

@@ -130,6 +130,10 @@
       "doc": "The optional messageId, if provided serves as a custom user-defined unique identifier for an aspect value."
     },
     {
+      "Searchable": {
+        "fieldType": "COUNT",
+        "hasValuesFieldName": "hasUniqueUserCount"
+      },
       "TimeseriesField": {},
       "type": [
         "null",
@@ -140,6 +144,10 @@
       "doc": "Unique user count"
     },
     {
+      "Searchable": {
+        "fieldType": "COUNT",
+        "hasValuesFieldName": "hasTotalSqlQueriesCount"
+      },
       "TimeseriesField": {},
       "type": [
         "null",

acryl_datahub_cloud/metadata/schemas/InferredMetadata.avsc CHANGED Viewed

@@ -371,6 +371,75 @@
                         "name": "source",
                         "default": null,
                         "doc": "Source information for the ownership"
+                      },
+                      {
+                        "Searchable": {
+                          "/actor": {
+                            "fieldName": "ownerAttributionActors",
+                            "fieldType": "URN",
+                            "queryByDefault": false
+                          },
+                          "/source": {
+                            "fieldName": "ownerAttributionSources",
+                            "fieldType": "URN",
+                            "queryByDefault": false
+                          },
+                          "/time": {
+                            "fieldName": "ownerAttributionDates",
+                            "fieldType": "DATETIME",
+                            "queryByDefault": false
+                          }
+                        },
+                        "type": [
+                          "null",
+                          {
+                            "type": "record",
+                            "name": "MetadataAttribution",
+                            "namespace": "com.linkedin.pegasus2avro.common",
+                            "fields": [
+                              {
+                                "type": "long",
+                                "name": "time",
+                                "doc": "When this metadata was updated."
+                              },
+                              {
+                                "java": {
+                                  "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+                                },
+                                "type": "string",
+                                "name": "actor",
+                                "doc": "The entity (e.g. a member URN) responsible for applying the assocated metadata. This can\neither be a user (in case of UI edits) or the datahub system for automation.",
+                                "Urn": "Urn"
+                              },
+                              {
+                                "java": {
+                                  "class": "com.linkedin.pegasus2avro.common.urn.Urn"
+                                },
+                                "type": [
+                                  "null",
+                                  "string"
+                                ],
+                                "name": "source",
+                                "default": null,
+                                "doc": "The DataHub source responsible for applying the associated metadata. This will only be filled out\nwhen a DataHub source is responsible. This includes the specific metadata test urn, the automation urn.",
+                                "Urn": "Urn"
+                              },
+                              {
+                                "type": {
+                                  "type": "map",
+                                  "values": "string"
+                                },
+                                "name": "sourceDetail",
+                                "default": {},
+                                "doc": "The details associated with why this metadata was applied. For example, this could include\nthe actual regex rule, sql statement, ingestion pipeline ID, etc.\nAlso can include flags like 'propagated'=true or 'inferred'=true."
+                              }
+                            ],
+                            "doc": "Information about who, why, and how this metadata was applied"
+                          }
+                        ],
+                        "name": "attribution",
+                        "default": null,
+                        "doc": "Information about who, why, and how this metadata was applied"
                       }
                     ],
                     "doc": "Ownership information"

acryl_datahub_cloud/metadata/schemas/InviteToken.avsc CHANGED Viewed

@@ -28,6 +28,32 @@
       "default": null,
       "doc": "The role that this invite token may be associated with",
       "Urn": "Urn"
+    },
+    {
+      "Searchable": {
+        "fieldName": "tokenType",
+        "fieldType": "KEYWORD"
+      },
+      "type": [
+        {
+          "type": "enum",
+          "symbolDocs": {
+            "INDIVIDUAL": "Individual token generated for bulk invitations. Single-use, consumed on signup.",
+            "SHARED": "Shared token that admin can copy and share manually. Reusable until admin regenerates."
+          },
+          "name": "TokenType",
+          "namespace": "com.linkedin.pegasus2avro.identity",
+          "symbols": [
+            "SHARED",
+            "INDIVIDUAL"
+          ],
+          "doc": "Token types for different invitation workflows"
+        },
+        "null"
+      ],
+      "name": "tokenType",
+      "default": "SHARED",
+      "doc": "The type of invite token - shared (admin managed) or individual (single-use)"
     }
   ],
   "doc": "Aspect used to store invite tokens."

acryl-datahub-cloud 0.3.13.2rc4__py3-none-any.whl → 0.3.14rc0__py3-none-any.whl

Potentially problematic release.

acryl-datahub-cloud 0.3.13.2rc4py3-none-any.whl → 0.3.14rc0py3-none-any.whl