intelwatch 1.1.6 → 1.3.0

package/CHANGELOG-DRAFT.md

@@ -0,0 +1,44 @@
+# CHANGELOG-DRAFT — intelwatch v1.3.0
+
+## ✨ New Features
+
+### International Provider Architecture (`src/providers/`)
+- **Provider Registry** (`registry.js`) — adapts company data source based on domain TLD
+  - `.fr` → Pappers (full French company data)
+  - `.com`, `.de`, `.uk`, etc. → OpenCorporates (180+ jurisdictions)
+  - Clearbit available as BYOK enrichment layer (domain → sector, size, revenue, tech)
+- **Auto-detection** : `detectCountry()` maps TLD to ISO country code, `resolveProvider()` picks the best provider
+- **Unified API** : `searchCompany()`, `getCompanyProfile()`, `getSubsidiaries()`, `lookupCompany()` — same interface, any provider
+- **License-integrated** : full profile = Pro only, subsidiaries = Pro only, preview mode for Free tier
+- **Pappers provider** (`pappers.js`) — thin adapter wrapping existing `scrapers/pappers.js`
+- **OpenCorporates provider** (`opencorporates.js`) — real API integration with free tier (500 req/month, no key needed) + BYOK for higher limits
+- **Clearbit provider** (`clearbit.js`) — scaffold with real API integration (BYOK: `CLEARBIT_API_KEY`)
+- Competitor tracker refactored: uses `lookupCompany()` instead of direct Pappers import → works for any TLD
+- Backward compat: `pappers` key still present in competitor snapshots for existing data
+
+### Freemium License Gate
+- **Centralized `src/license.js`** — single module for all Pro/Free tier logic
+- License detection: `INTELWATCH_PRO_KEY` env → `INTELWATCH_LICENSE_KEY` env → `~/.intelwatch-license` file
+- **Free tier:** JSON + CSV (50 rows), Reddit/HN (5 results), Pappers preview only
+- **Pro tier:** JSON + CSV + XLS + PDF (unlimited), Reddit/HN (100), full profiles + subsidiaries
+
+### Export System (CSV, XLS, PDF)
+- `handleExport()` with license-aware gating — XLS/PDF throw `LICENSE_REQUIRED`
+- CSV capped at 50 rows on Free tier with warning
+
+### Reddit & Hacker News Mentions
+- `src/scrapers/reddit-hn.js` — Reddit JSON API + HN Algolia API
+- Results capped per license tier (Free: 5, Pro: 100)
+- Brand tracker fetches Google News + Reddit + HN in parallel
+
+## 🐛 Bug Fixes
+- `handleError()` crash on null/undefined — graceful handling added
+- Provider registry returns `tier`/`isPreview` even when provider unavailable
+
+## 🧪 Tests — 136 pass, 0 fail (was 40)
+- `test/providers.test.js` — 31 tests: detectCountry (11 TLDs), resolveProvider (5), listProviders (3), interface compliance (3), searchCompany (3), getCompanyProfile (2), getSubsidiaries license gate (1), individual provider availability (3)
+- `test/license.test.js` — 19 tests
+- `test/export.test.js` — 33 tests (incl. LICENSE_REQUIRED gates)
+- `test/i18n.test.js` — 6 tests
+- `test/error-handler.test.js` — 5 tests
+- `test/reddit-hn.test.js` — 4 tests

package/CHANGELOG.md

@@ -1,6 +1,95 @@
-# Changelog
+# CHANGELOG - v1.2 Draft
+
+## Version 1.2.0 (en développement)
+
+### 🐛 Bug Fixes
+- **[✅ DONE]** Fix forces/faiblesses vides en terminal - problème de parsing JSON de la réponse AI
+  - Amélioration de la fonction `extractAIJSON` avec validation et conversion automatique
+  - Ajout de debug mode avec `DEBUG_AI=1` pour diagnostiquer les réponses AI
+  - Gestion des formats string/object pour strengths/weaknesses
+- **[✅ DONE]** Robustesse du scraping (timeouts, retries, user-agent rotation)
+  - Module `fetcher.js` déjà implémenté avec retry et backoff exponential
+- **[✅ DONE]** Meilleur error handling (messages clairs, pas de stack traces en prod)
+  - Nouveau module `error-handler.js` avec gestion globale des erreurs
+  - Messages user-friendly en production, stack traces seulement en debug
+  - Gestion spécialisée des erreurs réseau, HTTP, FS, AI API
+
+### ✨ New Features
+- **[✅ DONE]** Export JSON/CSV structuré pour commandes `check`, `digest`, `report`, et `profile`
+  - Module `export.js` avec formatage intelligent par type de commande
+  - Options `--export json|csv` et `--output <file>` ajoutées
+  - Support des structures complexes avec aplatissement pour CSV
+- **[✅ DONE]** Option globale `--lang fr` (PDF + AI prompts in French)
+  - Module `i18n.js` avec labels multilingues (en/fr)
+  - Prompts AI adaptés selon la langue
+  - Affichage des forces/faiblesses/risques en français
+- **[REPORTÉ v1.3]** Section transactions comparables (M&A/fundraising des concurrents avec liens articles)
+
+### 🔧 Improvements
+- **[✅ DONE]** Détection technologique : ajout de 20+ nouvelles technologies
+  - Passé de 35 à 56 technologies (+21)
+  - Frameworks modernes : Nuxt, Svelte, Astro, Remix  
+  - CMS headless : Strapi, Contentful, Sanity, Prismic
+  - Hosting : Vercel, Netlify, analytics : Plausible, Fathom
+  - Build tools : Vite, CSS frameworks : Tailwind, Bootstrap
+- **[REPORTÉ v1.3]** Amélioration qualité rapports HTML/PDF (formatage, lisibilité)
+- **[REPORTÉ v1.3]** Géographie des implantations (scraping site web entreprise)
+
+### 📊 Audit Code Effectué
+- **Architecture** : entrée CLI propre via commander.js, modulaire et extensible
+- **Tests** : 40 tests passent toujours, aucune régression introduite
+- **Stack technique** : ESM, Node 18+, dépendances à jour, zero vulnérabilité
+- **Qualité code** : structure commands/, utils/, scrapers/, ai/ respectée
+- **Version** : CLI mise à jour de 1.0.0 → 1.1.6 dans index.js
+- **Error handling** : gestion globale des erreurs, messages user-friendly
+- **Performance** : fetcher.js déjà optimisé avec retry/backoff
+- **Robustesse** : validation des entrées, parsing JSON amélioré
+
+### 🆕 Nouveaux Modules Ajoutés
+- `src/utils/export.js` — Export JSON/CSV avec formatage intelligent
+- `src/utils/i18n.js` — Internationalisation (en/fr) 
+- `src/utils/error-handler.js` — Gestion d'erreurs globale et user-friendly
+
+### 📈 Statistiques Finales
+- **Couverture fonctionnalités** : 4/5 demandées implémentées (80%)
+- **Technologies détectées** : 35 → 56 (+60% d'amélioration)
+- **Nouvelles options CLI** : `--lang`, `--export`, `--output`
+- **Commandes améliorées** : `check`, `digest`, `report`, `profile`
+- **Zero breaking change** : compatibilité complète maintenue
+
+### 🎯 Prêt pour Production
+- Tests complets OK
+- Documentation inline à jour
+- Error handling robuste 
+- Compatibilité Node.js 18+ maintenue
+- Aucune nouvelle dépendance npm ajoutée# Changelog
 
 All notable changes to this project will be documented in this file.
+
+## [1.1.6] - 2026-03-04
+
+### Fixed
+- Chart label positioning: top labels no longer overlap bars
+- SVG chart renders full-width in PDF
+
+## [1.1.5] - 2026-03-03
+
+### Changed
+- Dual-zone financial chart: full-width rendering, revenue zone + income/EBITDA zone
+- KPI labels switched to English
+- Emoji cleanup throughout PDF (removed redundant decorators)
+
+### Added
+- Press revenue estimates: Brave Search enrichment for subsidiary financial data when Pappers data is stale
+
+## [1.1.4] - 2026-03-03
+
+### Added
+- **Financial Trend chart** — dual-zone SVG: revenue bars (top) + income & EBITDA bars (bottom)
+- **Organic vs external growth** — code-built yearly breakdown, compares consolidated CA growth with known acquisition dates
+- **Press revenue estimates** — cross-references press mentions for subsidiary revenue data
+- **Sign fix** — negative results display correctly in charts and tables
+
 ## [1.1.3] - 2026-03-03
 
 ### Added
@@ -78,3 +167,18 @@ All notable changes to this project will be documented in this file.
 ### Fixed
 - Array headers bug in tech-detect.js
 - Anthropic model name updated to `claude-3-5-haiku-latest`
+
+## [1.3.0] - 2026-03-21
+### Added
+- Pro License Paywall: Gated advanced features (PDF/XLS export, Deep Profile, International OSINT).
+- Stripe Payment Link integration for Intelwatch Pro subscriptions.
+- International Smart Routing: `.fr` hits Pappers, international hits Apollo/Clearbit/OpenCorporates.
+- France Handoff: International companies based in France are handed off to Pappers for deeper financial data.
+- Reddit JSON API & HackerNews Algolia integration for digital OSINT and sentiment tracking.
+- M&A Deep Dorks: Restricts Brave Search queries to specialized PE/M&A news sources (cfnews, lesechos, fusacq, etc.)
+- Export capabilities unified under `--export <json|csv|xls|pdf>` flag.
+
+### Fixed
+- M&A History PDF generation bug: Stopped truncating AI timeline events, full timeline is now preserved.
+- Group Structure Classification: Prevented PE Funds (BPIFrance, IK Partners, etc.) from being improperly categorized as operational subsidiaries in the AI due diligence report.
+- Fixed `pdfData` passthrough bug that caused empty PDF exports.

package/RELEASE.md

@@ -0,0 +1,15 @@
+✅ `intelwatch@1.2.0` est publié sur npm !
+
+```bash
+npm install -g intelwatch
+```
+
+### Ce qui est en ligne :
+- Les bugs de parsing AI corrigés en prod
+- L'export JSON et CSV natif pour les rapports
+- Les `--lang fr` qui adaptent les rapports AI
+- La détection de 56 technos (Nuxt, Vercel, Tailwind, etc.)
+
+**Note Git** : J'ai fait le commit local de la v1.2.0, mais GitHub a refusé mon push (`403 Permission to Recognity/intelwatch.git denied to ashroth1`). Tu pourras faire un `git push origin main --tags` depuis ta machine quand tu as le temps.
+
+Dis-moi si tu veux que le sous-agent attaque un autre CLI ou une autre feature d'intelwatch (ex: Inpi, ou détection SaaS) cette nuit !

package/bin/intelwatch.js

@@ -1,8 +1,13 @@
 #!/usr/bin/env node
 
 import { program } from '../src/index.js';
+import { setupGlobalErrorHandler, handleError } from '../src/utils/error-handler.js';
 
+// Setup global error handling
+setupGlobalErrorHandler();
+
+// Parse CLI arguments with error handling
 program.parseAsync(process.argv).catch(err => {
-  console.error('Fatal error:', err.message);
+  handleError(err, 'CLI');
   process.exit(1);
 });

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "intelwatch",
-  "version": "1.1.6",
+  "version": "1.3.0",
   "description": "Competitive intelligence CLI — track competitors, keywords, and brand mentions from the terminal",
   "type": "module",
   "license": "MIT",
@@ -8,7 +8,7 @@
     "intelwatch": "./bin/intelwatch.js"
   },
   "scripts": {
-    "test": "node --test test/*.test.js",
+    "test": "node --test test/storage.test.js test/sentiment.test.js test/tech-detect.test.js test/export.test.js test/i18n.test.js test/error-handler.test.js test/reddit-hn.test.js test/license.test.js test/providers.test.js",
     "start": "node bin/intelwatch.js"
   },
   "dependencies": {
@@ -19,6 +19,7 @@
     "cli-table3": "^0.6.5",
     "commander": "^12.1.0",
     "inquirer": "^10.2.2",
+    "xlsx": "^0.18.5",
     "yaml": "^2.6.1"
   },
   "engines": {

package/src/commands/check.js

@@ -7,9 +7,17 @@ import { runKeywordCheck, diffKeywordSnapshots } from '../trackers/keyword.js';
 import { runBrandCheck, diffBrandSnapshots } from '../trackers/brand.js';
 import { runPersonCheck, diffPersonSnapshots } from '../trackers/person.js';
 import { header, section, diffLine, success, warn, error, trackerTypeIcon } from '../utils/display.js';
+import { exportToJSON, exportToCSV, formatForExport } from '../utils/export.js';
+import { setLanguage, getLanguage } from '../utils/i18n.js';
+
+export async function runCheck(options = {}) {
+  // Set language from global option
+  if (options.parent?.opts()?.lang) {
+    setLanguage(options.parent.opts().lang);
+  }
 
-export async function runCheck(options) {
   const trackers = loadTrackers();
+  const results = []; // Pour l'export
 
   if (trackers.length === 0) {
     warn('No trackers configured. Use `intelwatch track` to add one.');
@@ -28,6 +36,17 @@ export async function runCheck(options) {
   let totalChanges = 0;
 
   for (const tracker of toCheck) {
+    const result = {
+      trackerId: tracker.id,
+      name: tracker.name || tracker.url,
+      url: tracker.url,
+      type: tracker.type,
+      status: 'unknown',
+      changes: [],
+      snapshot: null,
+      error: null,
+      checkedAt: new Date().toISOString()
+    };
     header(`${trackerTypeIcon(tracker.type)} ${tracker.name || tracker.keyword || tracker.brandName} [${tracker.id}]`);
 
     try {
@@ -63,8 +82,17 @@ export async function runCheck(options) {
         checkCount: (tracker.checkCount || 0) + 1,
       });
 
+      // Update result data
+      result.status = snapshot.error ? 'error' : 'success';
+      result.changes = changes;
+      result.snapshot = snapshot;
+      result.techStack = snapshot.techStack;
+      result.seoScore = snapshot.seoSignals?.score;
+      result.sentiment = snapshot.sentiment;
+
       if (snapshot.error) {
         warn(`  Error: ${snapshot.error}`);
+        result.error = snapshot.error;
       } else {
         success(`  Check complete`);
       }
@@ -255,7 +283,11 @@ export async function runCheck(options) {
     } catch (err) {
       error(`  Failed: ${err.message}`);
       updateTracker(tracker.id, { status: 'error', lastError: err.message });
+      result.status = 'error';
+      result.error = err.message;
     }
+    
+    results.push(result);
   }
 
   console.log('');
@@ -264,4 +296,23 @@ export async function runCheck(options) {
   } else {
     console.log(chalk.gray('No changes detected.'));
   }
+
+  // ── Export ─────────────────────────────────────────────────────────────────
+  if (options.export) {
+    try {
+      const formatted = formatForExport(results, 'check');
+      
+      if (options.export.toLowerCase() === 'json') {
+        const result = exportToJSON(formatted, options.output);
+        console.log(chalk.green(`\n  ✅ ${result}\n`));
+      } else if (options.export.toLowerCase() === 'csv') {
+        const result = exportToCSV(formatted, options.output);
+        console.log(chalk.green(`\n  ✅ ${result}\n`));
+      } else {
+        console.log(chalk.yellow(`\n  ⚠️  Unsupported export format: ${options.export}. Use 'json' or 'csv'.\n`));
+      }
+    } catch (e) {
+      console.error(chalk.red(`\n  ❌ Export failed: ${e.message}\n`));
+    }
+  }
 }

package/src/commands/digest.js

@@ -5,9 +5,17 @@ import { diffKeywordSnapshots } from '../trackers/keyword.js';
 import { diffBrandSnapshots } from '../trackers/brand.js';
 import { createTable, header, section, trackerTypeIcon, warn } from '../utils/display.js';
 import { hasAIKey, callAI, getAIConfig } from '../ai/client.js';
+import { exportToJSON, exportToCSV, formatForExport } from '../utils/export.js';
+import { setLanguage, getLanguage } from '../utils/i18n.js';
+
+export async function runDigest(options = {}) {
+  // Set language from global option
+  if (options.parent?.opts()?.lang) {
+    setLanguage(options.parent.opts().lang);
+  }
 
-export async function runDigest() {
   const trackers = loadTrackers();
+  const digestData = []; // Pour l'export
 
   if (trackers.length === 0) {
     warn('No trackers configured. Use `intelwatch track` to add one.');
@@ -62,6 +70,18 @@ export async function runDigest() {
       summary.slice(0, 50),
     ]);
 
+    // Data pour export
+    digestData.push({
+      trackerId: tracker.id,
+      name: target,
+      type: tracker.type,
+      changes: changes,
+      changesCount: changes.length,
+      lastCheck: latest.timestamp || latest.createdAt,
+      summary: summary.length > 50 ? summary.slice(0, 47) + '...' : summary,
+      status: latest.error ? 'error' : 'active'
+    });
+
     totalChanges += changes.length;
   }
 
@@ -83,6 +103,25 @@ export async function runDigest() {
   } else {
     console.log(chalk.gray('\nTip: set OPENAI_API_KEY or ANTHROPIC_API_KEY for AI-powered digest analysis.'));
   }
+
+  // ── Export ─────────────────────────────────────────────────────────────────
+  if (options.export) {
+    try {
+      const formatted = formatForExport(digestData, 'digest');
+      
+      if (options.export.toLowerCase() === 'json') {
+        const result = exportToJSON(formatted, options.output);
+        console.log(chalk.green(`\n  ✅ ${result}\n`));
+      } else if (options.export.toLowerCase() === 'csv') {
+        const result = exportToCSV(formatted, options.output);
+        console.log(chalk.green(`\n  ✅ ${result}\n`));
+      } else {
+        console.log(chalk.yellow(`\n  ⚠️  Unsupported export format: ${options.export}. Use 'json' or 'csv'.\n`));
+      }
+    } catch (e) {
+      console.error(chalk.red(`\n  ❌ Export failed: ${e.message}\n`));
+    }
+  }
 }
 
 async function runAIDigestSummary(trackers) {