@intuned/browser-dev 0.1.4-dev.0

package/.babelrc

@@ -0,0 +1,21 @@
+{
+  "presets": [
+    [
+      "@babel/preset-env",
+      {
+        "targets": {
+          "chrome": 115,
+          "node": "16"
+        },
+        "modules": "commonjs"
+      }
+    ],
+    "@babel/preset-typescript"
+  ],
+  "plugins": [
+    "babel-plugin-macros",
+    "@babel/plugin-transform-export-namespace-from"
+  ],
+  "sourceMaps": false,
+  "comments": false
+}

package/.eslintignore

@@ -0,0 +1,10 @@
+node_modules
+dist
+.eslintrc.js
+*.test.ts
+*.js
+types-package
+vite.config.ts
+reports
+intuned
+**/*.d.ts

package/.eslintrc.js

@@ -0,0 +1,39 @@
+module.exports = {
+  root: true,
+  parser: "@typescript-eslint/parser",
+  parserOptions: {
+    project: "./tsconfig.eslint.json",
+    tsconfigRootDir: __dirname,
+  },
+  plugins: ["@typescript-eslint", "deprecation", "prettier"],
+  ignorePatterns: ["src/common/browserScripts/rollup.config.mjs"],
+  extends: [
+    "eslint:recommended",
+    "plugin:@typescript-eslint/eslint-recommended",
+    "plugin:@typescript-eslint/recommended",
+  ],
+  rules: {
+    "@next/next/no-html-link-for-pages": 0,
+    "prettier/prettier": "error",
+
+    // recommended for safety
+    "@typescript-eslint/no-floating-promises": "error", // forgetting to await Activities and Workflow APIs is bad
+    "deprecation/deprecation": "warn",
+
+    // code style preference
+    "object-shorthand": ["warn", "always"],
+
+    // relaxed rules, for convenience
+    "@typescript-eslint/no-unused-vars": [
+      "warn",
+      {
+        argsIgnorePattern: "^_",
+        varsIgnorePattern: "^_",
+      },
+    ],
+    "@typescript-eslint/no-explicit-any": "off",
+    "@typescript-eslint/no-empty-interface": "off",
+    "@typescript-eslint/ban-ts-comment": "warn",
+    "no-empty": "warn",
+  },
+};

package/BROWSER_SCRIPTS_SETUP.md

@@ -0,0 +1,84 @@
+# Browser Scripts Setup
+
+This document explains how the TypeScript SDK handles the shared `browser_scripts.js` file from the monorepo root.
+
+## Overview
+
+The `common/browser_scripts.js` file at the root of the monorepo needs to be included in both the TypeScript and Python SDK builds. Instead of copying the file at runtime, we generate a TypeScript module that exports the script content as a constant.
+
+## How It Works
+
+1. **Source File**: `/common/browser_scripts.js` - The shared browser scripts file
+2. **Generated File**: `/typescript-sdk/src/common/script.ts` - Auto-generated TypeScript module
+3. **Generator Script**: `/typescript-sdk/scripts/generate-browser-script.js` - Node.js script that reads the source and generates the TS module
+
+## Build Process
+
+The generation happens automatically:
+
+### During Development (prepare hook)
+
+When you run `yarn install` or `npm publish` in the development repo, the `prepare` hook generates `script.ts`:
+
+```bash
+yarn install  # automatically runs prepare → generate-browser-script
+npm publish   # prepare hook runs before publishing
+```
+
+### During Build
+
+The build script regenerates `script.ts` before compiling:
+
+```bash
+yarn build  # runs generate-browser-script → tsc → babel
+```
+
+### Manual Generation
+
+You can manually regenerate the file:
+
+```bash
+yarn generate-browser-script
+```
+
+### For Package Consumers
+
+When users install your package via npm/yarn, they get the pre-generated `script.ts` that's committed to the repo. The `prepare` hook does NOT run when installing as a dependency (only during development/publishing).
+
+## Usage in Code
+
+In `ensureBrowserScripts.ts`:
+
+```typescript
+import { BROWSER_SCRIPT } from "./script";
+
+async function ensureBrowserScripts(page: Page): Promise<void> {
+  // Check if already loaded
+  const pageHasScript = await page.evaluate(
+    '() => typeof window.__INTUNED__ !== "undefined"'
+  );
+
+  if (pageHasScript) {
+    return;
+  }
+
+  // Inject the script
+  await page.evaluate(BROWSER_SCRIPT);
+}
+```
+
+## Important Notes
+
+- **DO NOT** edit `script.ts` manually - it's auto-generated
+- **DO** commit `script.ts` to git - it needs to be in the published package
+- The file is regenerated on every build and during `prepare` (development only)
+- If you update `common/browser_scripts.js`, run `yarn generate-browser-script` to update and commit the changes
+- Package consumers get the pre-generated file, so they don't need the `scripts/` folder
+
+## Benefits
+
+1. ✅ **No runtime file reading** - Script is bundled as a string constant
+2. ✅ **Type-safe** - TypeScript can check imports
+3. ✅ **Better performance** - No filesystem access at runtime
+4. ✅ **Cleaner builds** - No need to copy .js files during build
+5. ✅ **Single source of truth** - Always uses the latest from `common/`

package/LICENSE

@@ -0,0 +1,43 @@
+Acceptance
+By using the software, you agree to all of the terms and conditions below.
+
+Copyright License
+The licensor grants you a non-exclusive, royalty-free, worldwide, non-sublicensable, non-transferable license to use, copy, distribute, make available, and prepare derivative works of the software, in each case subject to the limitations and conditions below.
+
+Limitations
+You may not provide the software to third parties as a hosted or managed service, where the service provides users with access to any substantial set of the features or functionality of the software.
+
+You may not move, change, disable, or circumvent the license key functionality in the software, and you may not remove or obscure any functionality in the software that is protected by the license key.
+
+You may not alter, remove, or obscure any licensing, copyright, or other notices of the licensor in the software. Any use of the licensor’s trademarks is subject to applicable law.
+
+Patents
+The licensor grants you a license, under any patent claims the licensor can license, or becomes able to license, to make, have made, use, sell, offer for sale, import and have imported the software, in each case subject to the limitations and conditions in this license. This license does not cover any patent claims that you cause to be infringed by modifications or additions to the software. If you or your company make any written claim that the software infringes or contributes to infringement of any patent, your patent license for the software granted under these terms ends immediately. If your company makes such a claim, your patent license ends immediately for work on behalf of your company.
+
+Notices
+You must ensure that anyone who gets a copy of any part of the software from you also gets a copy of these terms.
+
+If you modify the software, you must include in any modified copies of the software prominent notices stating that you have modified the software.
+
+No Other Rights
+These terms do not imply any licenses other than those expressly granted in these terms.
+
+Termination
+If you use the software in violation of these terms, such use is not licensed, and your licenses will automatically terminate. If the licensor provides you with a notice of your violation, and you cease all violation of this license no later than 30 days after you receive that notice, your licenses will be reinstated retroactively. However, if you violate these terms after such reinstatement, any additional violation of these terms will cause your licenses to terminate automatically and permanently.
+
+No Liability
+As far as the law allows, the software comes as is, without any warranty or condition, and the licensor will not be liable to you for any damages arising out of these terms or the use or nature of the software, under any kind of legal claim.
+
+Definitions
+The licensor is the entity offering these terms, and the software is the software the licensor makes available under these terms, including any portion of it.
+
+you refers to the individual or entity agreeing to these terms.
+
+your company is any legal entity, sole proprietorship, or other kind of organization that you work for, plus all organizations that have control over, are under the control of, or are under common control with that organization. control means ownership of substantially all the assets of an entity, or the power to direct its management and policies by vote, contract, or otherwise. Control can be direct or indirect.
+
+your licenses are all the licenses granted to you for the software under these terms.
+
+use means anything you do with the software requiring one of your licenses.
+
+trademark means trademarks, service marks, and similar rights.
+

package/README.md

@@ -0,0 +1,160 @@
+# Intuned Browser SDK (TypeScript)
+
+Intuned's TypeScript/JavaScript SDK for browser automation and web data extraction, designed to work seamlessly with the Intuned platform.
+
+## Installation
+
+### Using Yarn (Recommended)
+
+```bash
+yarn add @intuned/browser
+```
+
+### Using npm
+
+```bash
+npm install @intuned/browser
+```
+
+## Features
+
+The Intuned Browser SDK provides a comprehensive set of tools for browser automation and data extraction:
+
+### 🤖 AI-Powered Extraction
+
+- **Structured Data Extraction** - Extract structured data from web pages using AI with `extractStructuredData()`
+- **Smart Page Loading Detection** - Determine when pages have fully loaded with `isPageLoaded()`
+- **Schema Validation** - Validate extracted data against JSON schemas
+
+### 🌐 Web Automation Helpers
+
+- **Navigation** - Advanced URL navigation with `goToUrl()`
+- **Content Loading** - Scroll to load dynamic content with `scrollToLoadContent()`
+- **Network Monitoring** - Wait for network activity with `withNetworkSettledWait()`
+- **DOM Monitoring** - Wait for DOM changes with `waitForDomSettled()`
+- **Click Automation** - Click elements until exhausted with `clickUntilExhausted()`
+
+### 📄 Content Processing
+
+- **HTML Sanitization** - Clean and sanitize HTML with `sanitizeHtml()`
+- **Markdown Extraction** - Convert HTML to markdown with `extractMarkdown()`
+- **URL Resolution** - Resolve relative URLs with `resolveUrl()`
+- **Date Processing** - Parse and process dates with `processDate()`
+
+### 📁 File Operations
+
+- **File Downloads** - Download files with `downloadFile()`
+- **S3 Integration** - Upload and save files to S3 with `uploadFileToS3()` and `saveFileToS3()`
+
+### ✅ Data Validation
+
+- **Schema Validation** - Validate data structures with `validateDataUsingSchema()`
+- **Empty Value Filtering** - Filter empty values with `filterEmptyValues()`
+- **Custom Type Registry** - Define custom validators with `CustomTypeRegistry`
+
+### ⚡ Optimized Extractors
+
+- **High-Performance Extractors** - Pre-built optimized extractors for common use cases
+- Available via `@intuned/browser/optimized-extractors`
+
+## Quick Start
+
+```typescript
+import {
+  extractMarkdown,
+  sanitizeHtml,
+  goToUrl,
+  withNetworkSettledWait,
+} from "@intuned/browser";
+
+// Example: Extract and process web content
+async function extractContent(page: Page) {
+  // Navigate to URL
+  await goToUrl(page, "https://example.com");
+
+  // Wait for network to settle
+  await withNetworkSettledWait(page, async () => {
+    // Your actions here
+  });
+
+  // Get and sanitize HTML
+  const html = await page.content();
+  const cleanHtml = sanitizeHtml(html);
+
+  // Extract markdown
+  const markdown = extractMarkdown(cleanHtml);
+
+  return markdown;
+}
+```
+
+## AI-Powered Data Extraction
+
+```typescript
+import { extractStructuredData } from "@intuned/browser/ai";
+import type { JsonSchema } from "@intuned/browser/ai";
+
+// Define your data schema
+const schema: JsonSchema = {
+  type: "object",
+  properties: {
+    title: { type: "string" },
+    price: { type: "number" },
+    description: { type: "string" },
+  },
+  required: ["title", "price"],
+};
+
+// Extract structured data using AI
+async function extractProductData(page: Page) {
+  const result = await extractStructuredData({
+    page,
+    schema,
+    prompt: "Extract product information from this page",
+  });
+  return result;
+}
+```
+
+## Module Exports
+
+The SDK provides multiple import paths for different features:
+
+```typescript
+// Main helpers
+import { goToUrl, sanitizeHtml /* ... */ } from "@intuned/browser";
+
+// AI functions
+import { extractStructuredData, isPageLoaded } from "@intuned/browser/ai";
+
+// Optimized extractors
+import /* extractors */ "@intuned/browser/optimized-extractors";
+```
+
+## Documentation
+
+For detailed documentation on all functions and types, see the [documentation](https://docs.intunedhq.com/docs-old/getting-started/introduction).
+
+## Building from Source
+
+```bash
+# Install dependencies
+yarn install
+
+# Build the project
+yarn build
+
+# Run tests
+yarn test
+
+# Run tests with UI
+yarn test:dev
+```
+
+## Support
+
+For support, questions, or contributions, please contact the Intuned team at engineering@intunedhq.com.
+
+## About Intuned
+
+Intuned provides powerful tools for browser automation, web scraping, and data extraction. Visit [intunedhq.com](https://intunedhq.com) to learn more.

package/RELEASE.md

@@ -0,0 +1,60 @@
+# Release Guide
+
+## Quick Start
+
+```bash
+# From typescript-sdk directory
+bash scripts/release.sh prod 1.2.3
+```
+
+## Usage
+
+```bash
+bash scripts/release.sh {prod|dev} version [webapp-repo-path]
+```
+
+**Arguments:**
+
+- `prod` or `dev` - Environment (prod requires X.Y.Z format)
+- `version` - Version number (e.g., `1.2.3`)
+- `webapp-repo-path` - _(Optional)_ Path to WebApp repo (default: `../../WebApp`)
+
+**Examples:**
+
+```bash
+# Publish to npm (prod)
+bash scripts/release.sh prod 1.2.3
+
+# Publish dev version to npm
+bash scripts/release.sh dev 1.2.3-beta
+
+# Custom WebApp path
+bash scripts/release.sh prod 1.2.3 /path/to/WebApp
+```
+
+## Repo Structure
+
+The script expects this folder structure:
+
+```
+intuned-master/
+├── WebApp/
+└── intuned-sdk/
+    ├── python-sdk/
+    └── typescript-sdk/     ← Run script from here
+```
+
+## What It Does
+
+1. ✅ Builds project (`yarn build`, type checks)
+2. ✅ Updates version in `package.json`
+3. ✅ Adjusts package name for dev (`intuned-browser-dev`)
+4. ✅ Publishes to npm
+5. ✅ Updates all TypeScript templates in WebApp (`playwright_v1/`)
+6. ✅ Regenerates template files in WebApp
+
+## Prerequisites
+
+- Node.js & Yarn installed
+- npm credentials configured (`npm login`)
+- WebApp repo cloned (if updating templates)

package/dist/ai/export.d.js

@@ -0,0 +1,5 @@
+"use strict";
+
+Object.defineProperty(exports, "__esModule", {
+  value: true
+});