agrs-sequelize-sdk 1.1.97 → 1.1.99

package/agrs-sequelize/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Agressive Scale LTD
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/agrs-sequelize/README.md

@@ -0,0 +1,179 @@
+# agrs-sequelize SDK
+
+The `agrs-sequelize` SDK provides a structured way to manage your database models using Sequelize ORM. It allows you to easily add, update, and manage models, with support for publishing updates to NPM and pushing changes to GitHub.
+
+## Table of Contents
+
+- [Prerequisites](#prerequisites)
+- [Installation](#installation)
+- [Usage](#usage)
+  - [Adding or Modifying Models](#adding-or-modifying-models)
+  - [Model Loading](#model-loading)
+- [Publishing Changes](#publishing-changes)
+  - [Using PowerShell (Windows)](#using-powershell-windows)
+  - [Using Bash (Linux/macOS)](#using-bash-linuxmacos)
+- [Script Details](#script-details)
+  - [run.ps1 (PowerShell Script for Windows)](#runps1-powershell-script-for-windows)
+  - [run.sh (Bash Script for Linux/macOS)](#runsh-bash-script-for-linuxmacos)
+- [Example Model File](#example-model-file)
+- [Versioning](#versioning)
+- [Troubleshooting](#troubleshooting)
+- [License](#license)
+
+## Prerequisites
+
+Ensure the following dependencies are installed on your system:
+
+- **Node.js**: [Download Node.js](https://nodejs.org/)
+- **Sequelize**: Used for database interaction.
+- **Git**: Required for version control and publishing changes to GitHub.
+- **npm**: For managing and publishing packages.
+- **PowerShell** (Windows) or **Bash** (Linux/macOS): For running automation scripts.
+
+## Installation
+
+1. **Clone the Repository:**
+
+   ```bash
+   git clone https://github.com/your-repo/agrs-sequelize.git
+   cd agrs-sequelize
+    ```
+
+2. **Install Dependencies:**
+
+   ```bash
+        npm install
+    ```
+
+
+# Usage
+
+## Adding or Modifying Models
+To add or modify models in the agrs-sequelize SDK:
+
+1. **Create or Edit a Model:**
+
+    - Add a new model file inside the models directory or edit an existing one.
+    - Each model file should export a function that initializes the model with Sequelize.
+
+```javascript
+// models/YourModel.js
+module.exports = (sequelize, DataTypes) => {
+  const YourModel = sequelize.define('YourModel', {
+    fieldName: {
+      type: DataTypes.STRING,
+      allowNull: false,
+    },
+  });
+
+  // Define associations (optional)
+  YourModel.associate = (models) => {
+    YourModel.hasMany(models.OtherModel);
+  };
+
+  return YourModel;
+}; 
+```
+
+2. **Define Associations (if required):**
+
+    Use the associate method to define relationships with other models.
+    Associations like hasMany, belongsTo, etc., are supported.
+### Model Loading
+    Models are automatically loaded when initializing Sequelize.
+    The index.js file ensures all models in the models directory are properly loaded and associated.
+
+## Publishing Changes
+ After modifying or adding models, publish the changes to NPM and GitHub.
+
+### Using PowerShell (Windows)
+Open PowerShell as Administrator.
+
+Run the Script:
+
+```powershell
+./run.ps1
+```
+The script will:
+
+- Check for jq installation.
+- Bump the version in package.json.
+- Publish to NPM.
+- Commit and push changes to GitHub.
+
+### Using Bash (Linux/macOS)
+Open a Bash Terminal.
+
+Run the Script:
+
+```bash
+./run.sh
+```
+The script performs the same tasks as the PowerShell script, tailored for Bash environments.
+
+## Script Details
+### run.ps1 (PowerShell Script for Windows)
+Automates the publishing process:
+
+- Ensures jq is installed.
+- Increments the version in package.json.
+- Publishes the package to NPM.
+- Commits and pushes changes to GitHub.
+
+### run.sh (Bash Script for Linux/macOS)
+Provides similar functionality:
+
+- Checks for jq installation.
+- Bumps the package version.
+= Publishes to NPM.
+= Commits and pushes to GitHub.
+
+## Example Model File
+```javascript
+Copy code
+// models/YourModel.js
+module.exports = (sequelize, DataTypes) => {
+  const YourModel = sequelize.define('YourModel', {
+    name: {
+      type: DataTypes.STRING,
+      allowNull: false,
+    },
+  });
+
+  // Define associations (optional)
+  YourModel.associate = (models) => {
+    YourModel.hasMany(models.OtherModel);
+  };
+
+  return YourModel;
+};
+```
+In this example:
+
+YourModel has a name field.
+It has a hasMany association with OtherModel.
+## Versioning
+Versioning is handled automatically:
+
+- The scripts increment the version in package.json.
+- Follows semantic versioning (major, minor, patch).
+- Updated versions are published to NPM and committed to the repository.
+
+## Troubleshooting
+- ### Permission Issues:
+
+   - Linux/macOS: Ensure scripts have execute permissions (chmod +x run.sh).
+- ### NPM Login Errors:
+
+   - The script will prompt for NPM login if not already logged in.
+   - Verify NPM account credentials.
+
+- ### Missing Dependencies:
+
+   - The script checks for jq and installs it if missing.
+## License
+This project is licensed under the MIT License. See the LICENSE file for details.
+
+
+
+

package/agrs-sequelize/index.js

@@ -0,0 +1,169 @@
+const Sequelize = require("sequelize");
+const path = require("path");
+const fs = require("fs");
+
+// const env = process.env.NODE_ENV || "development";
+class DBModels {
+  constructor(config) {
+    this.config = config;
+    this.db = {};
+
+    // Initialize Sequelize
+    const sequelize = new Sequelize(
+      this.config.database,
+      this.config.username,
+      this.config.password,
+      {
+        host: this.config.host,
+        dialect: this.config.dialect,
+        port: this.config.port,
+        logging: false, // Enable logging to console
+        dialectOptions: {
+          ssl: {
+            require: true, // Require SSL
+            rejectUnauthorized: false, // For self-signed or unverified certificates
+          },
+        },
+        pool: {
+          max: 200, // Increase from 50, but stay under max_connections (200)
+          min: 5, // Increase minimum connections
+          acquire: 60000, // Double acquire timeout
+          idle: 30000, // Align with idle_in_transaction_session_timeout
+        },
+
+        retry: {
+          max: 5,
+          timeout: 60000,
+          match: [
+            /Connection terminated/,
+            /Connection timed out/,
+            /Operation timeout/,
+            /password authentication failed/,
+            /canceling authentication/,
+          ],
+        },
+      }
+    );
+
+    // Load all models
+    fs.readdirSync(path.join(__dirname, "models"))
+      .filter((file) => {
+        return file.indexOf(".") !== 0 && file.slice(-3) === ".js";
+      })
+      .forEach((file) => {
+        const model = require(path.join(__dirname, "models", file))(
+          sequelize,
+          Sequelize.DataTypes
+        );
+        this.db[model.name] = model;
+      });
+
+    // Set up associations
+    Object.keys(this.db).forEach((modelName) => {
+      if (this.db[modelName].associate) {
+        this.db[modelName].associate(this.db);
+      }
+    });
+
+    // Export the db object with Sequelize and models
+    this.db.sequelize = sequelize;
+    this.db.Sequelize = Sequelize;
+  }
+}
+
+module.exports = DBModels;
+
+// const Sequelize = require("sequelize");
+// const path = require("path");
+// const fs = require("fs");
+
+// class DBModels {
+//   constructor(config) {
+//     this.config = config;
+//     this.db = {};
+
+//     const sequelize = new Sequelize(
+//       this.config.database,
+//       this.config.username,
+//       this.config.password,
+//       {
+//         host: this.config.host,
+//         dialect: this.config.dialect,
+//         port: this.config.port,
+//         logging: false,
+//         dialectOptions: {
+//           ssl: {
+//             require: true,
+//             rejectUnauthorized: false,
+//           },
+//           statement_timeout: 30000,
+//           idle_in_transaction_session_timeout: 30000,
+//           connectTimeout: 30000,
+//         },
+//         pool: {
+//           max: 50, // Quarter of max connections (200)
+//           min: 0, // Start from 0 and scale up as needed
+//           acquire: 30000, // Maximum time to wait for a connection
+//           idle: 10000, // How long a connection can remain idle
+//         },
+//         retry: {
+//           max: 3,
+//           timeout: 20000,
+//           match: [
+//             /Connection terminated/,
+//             /Connection timed out/,
+//             /Operation timeout/,
+//             /ECONNRESET/,
+//             /PROTOCOL_CONNECTION_LOST/,
+//           ],
+//         },
+//       }
+//     );
+
+//     // Add connection monitoring listeners
+//     sequelize.connectionManager.on("acquire", function (connection) {
+//       console.log("Connection %d acquired", connection.threadId);
+//     });
+
+//     sequelize.connectionManager.on("release", function (connection) {
+//       console.log("Connection %d released", connection.threadId);
+//     });
+
+//     // Load all models
+//     fs.readdirSync(path.join(__dirname, "models"))
+//       .filter((file) => {
+//         return file.indexOf(".") !== 0 && file.slice(-3) === ".js";
+//       })
+//       .forEach((file) => {
+//         const model = require(path.join(__dirname, "models", file))(
+//           sequelize,
+//           Sequelize.DataTypes
+//         );
+//         this.db[model.name] = model;
+//       });
+
+//     // Set up associations
+//     Object.keys(this.db).forEach((modelName) => {
+//       if (this.db[modelName].associate) {
+//         this.db[modelName].associate(this.db);
+//       }
+//     });
+
+//     // Export the db object with Sequelize and models
+//     this.db.sequelize = sequelize;
+//     this.db.Sequelize = Sequelize;
+//   }
+
+//   // Add method for pool monitoring
+//   async getConnectionPoolStats() {
+//     const pool = this.db.sequelize.connectionManager.pool;
+//     return {
+//       all: pool.size,
+//       available: pool.available,
+//       borrowed: pool.borrowed,
+//       pending: pool.pending,
+//     };
+//   }
+// }
+
+// module.exports = DBModels;

package/agrs-sequelize/models/ActivityHistory.js

@@ -0,0 +1,73 @@
+// models/ActivityHistory.js
+module.exports = (sequelize, DataTypes) => {
+  const ActivityHistory = sequelize.define(
+    "ActivityHistory",
+    {
+      ActivityHistoryID: {
+        type: DataTypes.INTEGER,
+        primaryKey: true,
+        autoIncrement: true,
+      },
+      AssociatedModelType: {
+        type: DataTypes.STRING,
+        allowNull: false, // Could be 'Ad', 'AdSet', 'Campaign', etc.
+      },
+      AssociatedModelID: {
+        type: DataTypes.STRING,
+        allowNull: false, // ID of the associated model
+      },
+      ActorID: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ActorName: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ApplicationName: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      DateTimeInTimeZone: {
+        type: DataTypes.DATE,
+        allowNull: true,
+      },
+      EventType: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ObjectName: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ObjectType: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      TranslatedEventType: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ObjectID: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      ExtraData: {
+        type: DataTypes.JSONB,
+        allowNull: true,
+      },
+    },
+    {
+      tableName: "ActivityHistory",
+      indexes: [
+        {
+          unique: true,
+          name: "unique_index_on_date_object_event", // Custom name
+          fields: ["DateTimeInTimeZone", "ObjectID", "EventType"],
+        },
+      ],
+    }
+  );
+
+  return ActivityHistory;
+};

package/agrs-sequelize/models/Ad.js

@@ -0,0 +1,209 @@
+module.exports = (sequelize, DataTypes) => {
+  const Ad = sequelize.define(
+    "Ad",
+    {
+      AdID: {
+        type: DataTypes.STRING,
+        primaryKey: true,
+      },
+      AdName: {
+        type: DataTypes.STRING,
+        allowNull: false,
+      },
+      AdSetID: {
+        type: DataTypes.STRING,
+        allowNull: false,
+        references: {
+          model: "AdSet",
+          key: "AdSetID",
+        },
+      },
+      creativeId: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      pixelId: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      startTime: {
+        type: DataTypes.DATE,
+        allowNull: true,
+      },
+      endTime: {
+        type: DataTypes.DATE,
+        allowNull: true,
+      },
+      format: {
+        type: DataTypes.STRING,
+        allowNull: false,
+        defaultValue: "SINGLE",
+      },
+      imageHashes: {
+        type: DataTypes.ARRAY(DataTypes.STRING),
+        allowNull: true,
+      },
+      videoIds: {
+        type: DataTypes.ARRAY(DataTypes.STRING),
+        allowNull: true,
+      },
+      messages: {
+        type: DataTypes.ARRAY(DataTypes.TEXT),
+        allowNull: true,
+      },
+      headlines: {
+        type: DataTypes.ARRAY(DataTypes.TEXT),
+        allowNull: true,
+      },
+      websiteUrl: {
+        type: DataTypes.TEXT,
+        allowNull: true,
+      },
+      pageId: {
+        type: DataTypes.STRING(256),
+        allowNull: true,
+      },
+      actionTypes: {
+        type: DataTypes.STRING,
+        allowNull: true,
+        defaultValue: "offsite_conversion",
+      },
+      Status: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      publish: {
+        type: DataTypes.BOOLEAN,
+        allowNull: true,
+        defaultValue: true,
+      },
+      createdTime: {
+        type: DataTypes.DATE,
+        allowNull: true,
+      },
+      AGRS_CID: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      Draft: {
+        type: DataTypes.BOOLEAN,
+        allowNull: true,
+        defaultValue: false,
+      },
+      UserCreated: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      effectiveStatus: {
+        type: DataTypes.STRING,
+        allowNull: true,
+      },
+      issuesInfo: {
+        type: DataTypes.JSONB,
+        allowNull: true,
+      },
+      adReviewFeedback: {
+        type: DataTypes.JSONB,
+        allowNull: true,
+      },
+      waiting: {
+        type: DataTypes.BOOLEAN,
+        defaultValue: false,
+      },
+    },
+    {
+      tableName: "Ad",
+      indexes: [
+        {
+          fields: ["AdSetID"],
+        },
+      ],
+    }
+  );
+
+  Ad.associate = (models) => {
+    Ad.belongsTo(models.AdSet, { foreignKey: "AdSetID" });
+
+    Ad.belongsTo(models.CodefuelCampaign, {
+      foreignKey: "AGRS_CID",
+      targetKey: "AGRSCID",
+      as: "CodefuelCampaign",
+      constraints: false,
+    });
+
+    Ad.belongsTo(models.RSOCFeedCampaign, {
+      foreignKey: "AGRS_CID",
+      targetKey: "AGRS_CID",
+      as: "RSOCFeedCampaign",
+      constraints: false,
+    });
+
+    Ad.hasMany(models.AdPerformance, {
+      foreignKey: "AdID",
+    });
+  };
+
+  Ad.prototype.getRelatedCampaign = async function () {
+    if (!this.AGRS_CID) return null;
+
+    // Try fetching related CodefuelCampaign
+    const codefuelCampaign = await sequelize.models.CodefuelCampaign.findOne({
+      where: { AGRSCID: this.AGRS_CID },
+    });
+
+    if (codefuelCampaign) {
+      return {
+        type: "CodefuelCampaign",
+        data: codefuelCampaign,
+      };
+    }
+
+    // Try fetching related RSOCFeedCampaign
+    const rsocFeedCampaign = await sequelize.models.RSOCFeedCampaign.findOne({
+      where: { AGRS_CID: this.AGRS_CID },
+    });
+
+    if (rsocFeedCampaign) {
+      return {
+        type: "RSOCFeedCampaign",
+        data: rsocFeedCampaign,
+      };
+    }
+
+    return null;
+  };
+
+  Ad.addHook("afterCreate", async (ad, options) => {
+    if (ad.publish === false) {
+      // If publish is false on creation, save a snapshot to AdHistory
+      await sequelize.models.AdHistory.create({
+        AdID: ad.AdID,
+        DataSnapshot: ad.toJSON(), // Save the full Ad data as JSON
+      });
+    }
+  });
+
+  Ad.addHook("beforeUpdate", async (ad, options) => {
+    if (ad.changed("publish")) {
+      if (ad.previous("publish") === true && ad.publish === false) {
+        // Save current state to AdHistory
+        await sequelize.models.AdHistory.create({
+          AdID: ad.AdID,
+          DataSnapshot: ad._previousDataValues, // Save the full Ad data as JSON
+        });
+      } else if (ad.previous("publish") === false && ad.publish === true) {
+        // Delete the latest history entry
+        const latestHistory = await sequelize.models.AdHistory.findOne({
+          where: { AdID: ad.AdID },
+          order: [["timestamp", "DESC"]], // Get the latest history entry
+        });
+
+        if (latestHistory) {
+          await latestHistory.destroy();
+        }
+      }
+    }
+  });
+
+  return Ad;
+};