newo 3.6.0 → 3.6.2

package/CHANGELOG.md

@@ -7,6 +7,18 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [3.6.2] - 2026-04-23
+
+### Fixed
+
+- **`attributes.yaml` YAML escaping**: The attribute serializer previously ran `.replace(/\\"/g, '"')` as a "prettify" post-processing step, which stripped legitimate YAML escape characters from double-quoted scalars. Values containing double quotes (e.g. `["+37410333310"]`) were written as invalid YAML like `value: "["+37410333310"]"` — rejected by `yaml.load` with `bad indentation of a mapping entry`. This made `newo push --format newo_v2` unable to parse customer/project attribute files at all, and long compiled values (e.g. AMI) broke on the first embedded quote. The serializer now uses the existing `patchYamlToPyyaml` post-processor (already used on the V2 path) to convert JSON-like double-quoted values to single-quoted form (`value: '["+37410333310"]'`) and handle long-line wrapping in pyyaml style. Fix applied in both `src/sync/attributes.ts` and `src/domain/strategies/sync/AttributeSyncStrategy.ts`. Added 11 round-trip regression tests.
+
+## [3.6.1] - 2026-04-14
+
+### Documentation
+
+- Update README.md with V2 format, libraries, and `newo export` documentation for npm package page
+
 ## [3.6.0] - 2026-04-13
 
 ### Added
@@ -988,7 +1000,8 @@ Another Item: $Price [Modifiers: modifier3]
 - GitHub Actions CI/CD integration
 - Robust authentication with token refresh
 
-[Unreleased]: https://github.com/sabbah13/newo-cli/compare/v3.3.0...HEAD
+[Unreleased]: https://github.com/sabbah13/newo-cli/compare/v3.6.2...HEAD
+[3.6.2]: https://github.com/sabbah13/newo-cli/compare/v3.6.1...v3.6.2
 [3.3.0]: https://github.com/sabbah13/newo-cli/compare/v3.2.0...v3.3.0
 [3.2.0]: https://github.com/sabbah13/newo-cli/compare/v3.1.0...v3.2.0
 [3.1.0]: https://github.com/sabbah13/newo-cli/compare/v3.0.0...v3.1.0

package/README.md

@@ -8,22 +8,22 @@
 **NEWO CLI** - Professional command-line tool for NEWO AI Agent development. Features **modular architecture**, **IDN-based file management**, and **comprehensive multi-customer support**.
 
 Sync NEWO "Project → Agent → Flow → Skills" structure to local files with:
+- 🆕 **Dual format support** (v3.6.0) - `cli_v1` (native) and `newo_v2` (platform compatible), auto-detected per customer
+- 🆕 **Libraries** (v3.6.0) - Pull/push shared reusable skills across agents within a project
+- 🆕 **Bulk export** (v3.6.0) - `newo export` downloads complete V2 ZIP from platform
 - 🚀 **Account migration** - Fully automated account copying with 100% accuracy
 - 🏗️ **Complete entity management** - Create, edit, and delete agents, flows, skills, events, and states
 - 🔄 **Intelligent synchronization** - Pull projects, attributes, and conversations automatically
-- 🎯 **IDN-based naming** - Skills named as `{skillIdn}.jinja/.guidance` for better organization
+- 🎯 **IDN-based naming** - Skills named as `{skillIdn}.jinja/.guidance` or `{skillIdn}.nsl/.nslg`
 - 📊 **Real-time progress** - Live progress tracking during large operations (1,000+ skills)
 - 🏢 **Multi-customer workspaces** - Work with multiple NEWO accounts simultaneously
-- 📁 **Hierarchical structure** - Complete project metadata and organized file structure
 - 🔐 **Secure authentication** - API key-based auth with automatic token refresh
 - ⚡ **Smart change detection** - SHA256-based efficient sync with hash consistency
-- 🛡️ **File validation** - Multiple file detection with clear warnings and safe handling
-- 🧠 **AI skill formats** - Support for `.guidance` (AI prompts) and `.jinja` (NSL templates)
+- 🧠 **AI skill formats** - Support for `.guidance`/`.jinja` (V1) and `.nslg`/`.nsl` (V2)
 - 📡 **Webhook automation** - Automatic webhook creation from YAML configuration
 - 📊 **Knowledge base import** - Bulk import AKB articles from structured text files
 - 💬 **Conversation history** - Extract and sync user conversations and personas
 - 🧪 **Sandbox testing** - Interactive agent testing with conversation continuation
-- ✅ **Migration verification** - Automated validation of migration completeness
 - 🔧 **CI/CD ready** - GitHub Actions integration for automated deployments
 
 ---
@@ -143,15 +143,33 @@ NEWO_REFRESH_URL=custom_refresh_endpoint   # Custom refresh endpoint
 
 | Command | Description | Features |
 |---------|-------------|----------|
-| `newo pull` | Download projects + attributes + metadata | • Real-time progress tracking (966+ skills)<br>• IDN-based file naming<br>• Automatic attributes.yaml generation<br>• `--force` for silent overwrite |
-| `newo push` | Upload local changes to NEWO | • Smart file validation<br>• Multiple file detection<br>• Hash-based change detection<br>• Safe error handling |
-| `newo status` | Show modified files with details | • Multiple file warnings<br>• Detailed change analysis<br>• Clean state validation<br>• Per-customer status |
-| `newo sandbox` | Test agents in sandbox chat mode | • Single-command mode for automation<br>• Multi-turn conversation support<br>• Debug info for agent development<br>• Conversation continuation |
+| `newo pull [--format <fmt>]` | Download projects + attributes + libraries | • Dual format: `cli_v1` / `newo_v2`<br>• Auto-detects format per customer<br>• Real-time progress tracking (1,000+ skills)<br>• IDN-based file naming<br>• `--force` for silent overwrite |
+| `newo push [--format <fmt>]` | Upload local changes to NEWO | • Works with both formats<br>• Hash-based change detection<br>• Library skill updates<br>• Publishes flows automatically |
+| `newo status [--format <fmt>]` | Show modified files | • Format-aware status<br>• Multiple file warnings<br>• Per-customer status |
+| `newo export [--output <file>]` | Download V2 bulk ZIP from platform | • Complete organization export<br>• Projects, agents, flows, skills, attributes, AKB<br>• Compatible with platform UI import |
+| `newo sandbox` | Test agents in sandbox chat mode | • Single-command mode for automation<br>• Multi-turn conversation support<br>• Debug info for agent development |
 | `newo conversations` | Pull conversation history | • User personas and chat history<br>• YAML format output<br>• Pagination support |
 | `newo list-customers` | List configured customers | • Shows default customer<br>• Multi-customer discovery |
 | `newo import-akb` | Import knowledge base articles | • Structured text parsing<br>• Bulk article import<br>• Validation and error reporting |
 | `newo meta` | Get project metadata (debug) | • Project structure analysis<br>• Metadata validation |
 
+### V2 Format Support (NEW v3.6.0)
+
+The CLI supports two formats that coexist in the same workspace:
+
+- **`cli_v1`** (default) - Native CLI format with per-entity metadata files, `.guidance`/`.jinja` extensions
+- **`newo_v2`** - Platform import/export format, `.nslg`/`.nsl` extensions, compatible with SuperAgent repository and NEWO platform export ZIPs
+
+**Format is auto-detected per customer** from filesystem markers (`import_version.txt` = V2, `projects/` dir = V1). Override per-command with `--format newo_v2` or set persistent default with `NEWO_FORMAT=newo_v2` in `.env`.
+
+```bash
+newo pull --format newo_v2      # Pull in V2 format
+newo export --output backup.zip  # Bulk V2 ZIP download
+newo push --format newo_v2       # Push from V2 format project
+```
+
+Round-trip tested against real SuperAgent export: 1426/1426 files, 1331 scripts byte-identical, zero data loss on platform import.
+
 ### Account Migration Commands
 
 **Enterprise-grade account migration with 100% automation:**

package/dist/domain/strategies/sync/AttributeSyncStrategy.js

@@ -14,6 +14,7 @@ import yaml from 'js-yaml';
 import path from 'path';
 import { getCustomerAttributes, getProjectAttributes, updateCustomerAttribute, updateProjectAttribute, listProjects } from '../../../api.js';
 import { writeFileSafe, customerAttributesPath, customerAttributesMapPath } from '../../../fsutil.js';
+import { patchYamlToPyyaml } from '../../../format/yaml-patch.js';
 import { sha256, saveHashes, loadHashes } from '../../../hash.js';
 /**
  * AttributeSyncStrategy - Handles attribute synchronization
@@ -171,18 +172,20 @@ export class AttributeSyncStrategy {
             ...attr,
             value_type: `__ENUM_PLACEHOLDER_${attr.value_type}__`
         }));
+        // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+        // wrapping and converts JSON-like double-quoted values to single-quoted
+        // (so strings containing `"` stay valid YAML on reload).
         let yamlContent = yaml.dump({ attributes: attributesWithPlaceholders }, {
             indent: 2,
             quotingType: '"',
             forceQuotes: false,
-            lineWidth: 80,
+            lineWidth: -1,
             noRefs: true,
             sortKeys: false,
-            flowLevel: -1
+            flowLevel: -1,
         });
-        // Replace placeholders with enum syntax
         yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
-        yamlContent = yamlContent.replace(/\\"/g, '"');
+        yamlContent = patchYamlToPyyaml(yamlContent);
         return yamlContent;
     }
     /**

package/dist/sync/attributes.js

@@ -6,6 +6,7 @@ import { writeFileSafe, customerAttributesPath, customerAttributesMapPath, custo
 import path from 'path';
 import fs from 'fs-extra';
 import yaml from 'js-yaml';
+import { patchYamlToPyyaml } from '../format/yaml-patch.js';
 /**
  * Save customer attributes to YAML format and return content for hashing
  */
@@ -55,23 +56,22 @@ export async function saveCustomerAttributes(client, customer, verbose = false)
         const attributesYaml = {
             attributes: cleanAttributes
         };
-        // Configure YAML output to match reference format exactly
+        // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+        // wrapping and converts JSON-like double-quoted values to single-quoted
+        // (so strings containing `"` stay valid YAML on reload).
         let yamlContent = yaml.dump(attributesYaml, {
             indent: 2,
             quotingType: '"',
             forceQuotes: false,
-            lineWidth: 80, // Wrap long lines to match reference format
+            lineWidth: -1,
             noRefs: true,
             sortKeys: false,
-            flowLevel: -1, // Never use flow syntax
-            styles: {
-                '!!str': 'folded' // Use folded style for better line wrapping of long strings
-            }
+            flowLevel: -1,
         });
-        // Post-process to fix enum format and improve JSON string formatting
+        // Post-process to fix enum format
         yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
-        // Fix JSON string formatting to match reference (remove escape characters)
-        yamlContent = yamlContent.replace(/\\"/g, '"');
+        // Convert JSON-like double-quoted values to single-quoted and wrap long lines
+        yamlContent = patchYamlToPyyaml(yamlContent);
         // Save all files: attributes.yaml, ID mapping, and backup for diff tracking
         await writeFileSafe(customerAttributesPath(customer.idn), yamlContent);
         await writeFileSafe(customerAttributesMapPath(customer.idn), JSON.stringify(idMapping, null, 2));
@@ -139,19 +139,19 @@ export async function saveProjectAttributes(client, customer, projectId, project
         const attributesYaml = {
             attributes: cleanAttributes
         };
-        // Configure YAML output
+        // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+        // wrapping and converts JSON-like double-quoted values to single-quoted.
         let yamlContent = yaml.dump(attributesYaml, {
             indent: 2,
             quotingType: '"',
             forceQuotes: false,
-            lineWidth: 80,
+            lineWidth: -1,
             noRefs: true,
             sortKeys: false,
-            flowLevel: -1
+            flowLevel: -1,
         });
-        // Post-process to fix enum format
         yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
-        yamlContent = yamlContent.replace(/\\"/g, '"');
+        yamlContent = patchYamlToPyyaml(yamlContent);
         // Save to project directory
         const customerDir = path.join(process.cwd(), 'newo_customers', customer.idn);
         const projectDir = path.join(customerDir, 'projects', projectIdn);

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "newo",
-  "version": "3.6.0",
+  "version": "3.6.2",
   "description": "NEWO CLI: Professional command-line tool with modular architecture for NEWO AI Agent development. Features account migration, integration management, webhook automation, AKB knowledge base, project attributes, sandbox testing, IDN-based file management, real-time progress tracking, intelligent sync operations, and comprehensive multi-customer support.",
   "type": "module",
   "bin": {

package/src/domain/strategies/sync/AttributeSyncStrategy.ts

@@ -38,6 +38,7 @@ import {
   customerAttributesPath,
   customerAttributesMapPath
 } from '../../../fsutil.js';
+import { patchYamlToPyyaml } from '../../../format/yaml-patch.js';
 import { sha256, saveHashes, loadHashes } from '../../../hash.js';
 
 /**
@@ -251,19 +252,21 @@ export class AttributeSyncStrategy implements ISyncStrategy<CustomerAttributesRe
       value_type: `__ENUM_PLACEHOLDER_${attr.value_type}__`
     }));
 
+    // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+    // wrapping and converts JSON-like double-quoted values to single-quoted
+    // (so strings containing `"` stay valid YAML on reload).
     let yamlContent = yaml.dump({ attributes: attributesWithPlaceholders }, {
       indent: 2,
       quotingType: '"',
       forceQuotes: false,
-      lineWidth: 80,
+      lineWidth: -1,
       noRefs: true,
       sortKeys: false,
-      flowLevel: -1
+      flowLevel: -1,
     });
 
-    // Replace placeholders with enum syntax
     yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
-    yamlContent = yamlContent.replace(/\\"/g, '"');
+    yamlContent = patchYamlToPyyaml(yamlContent);
 
     return yamlContent;
   }

package/src/sync/attributes.ts

@@ -11,6 +11,7 @@ import {
 import path from 'path';
 import fs from 'fs-extra';
 import yaml from 'js-yaml';
+import { patchYamlToPyyaml } from '../format/yaml-patch.js';
 import type { AxiosInstance } from 'axios';
 import type { CustomerConfig } from '../types.js';
 
@@ -72,25 +73,24 @@ export async function saveCustomerAttributes(
       attributes: cleanAttributes
     };
 
-    // Configure YAML output to match reference format exactly
+    // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+    // wrapping and converts JSON-like double-quoted values to single-quoted
+    // (so strings containing `"` stay valid YAML on reload).
     let yamlContent = yaml.dump(attributesYaml, {
       indent: 2,
       quotingType: '"',
       forceQuotes: false,
-      lineWidth: 80, // Wrap long lines to match reference format
+      lineWidth: -1,
       noRefs: true,
       sortKeys: false,
-      flowLevel: -1, // Never use flow syntax
-      styles: {
-        '!!str': 'folded' // Use folded style for better line wrapping of long strings
-      }
+      flowLevel: -1,
     });
 
-    // Post-process to fix enum format and improve JSON string formatting
+    // Post-process to fix enum format
     yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
 
-    // Fix JSON string formatting to match reference (remove escape characters)
-    yamlContent = yamlContent.replace(/\\"/g, '"');
+    // Convert JSON-like double-quoted values to single-quoted and wrap long lines
+    yamlContent = patchYamlToPyyaml(yamlContent);
 
     // Save all files: attributes.yaml, ID mapping, and backup for diff tracking
     await writeFileSafe(customerAttributesPath(customer.idn), yamlContent);
@@ -172,20 +172,20 @@ export async function saveProjectAttributes(
       attributes: cleanAttributes
     };
 
-    // Configure YAML output
+    // Emit YAML without folding/wrapping; patchYamlToPyyaml handles long-line
+    // wrapping and converts JSON-like double-quoted values to single-quoted.
     let yamlContent = yaml.dump(attributesYaml, {
       indent: 2,
       quotingType: '"',
       forceQuotes: false,
-      lineWidth: 80,
+      lineWidth: -1,
       noRefs: true,
       sortKeys: false,
-      flowLevel: -1
+      flowLevel: -1,
     });
 
-    // Post-process to fix enum format
     yamlContent = yamlContent.replace(/__ENUM_PLACEHOLDER_(\w+)__/g, '!enum "AttributeValueTypes.$1"');
-    yamlContent = yamlContent.replace(/\\"/g, '"');
+    yamlContent = patchYamlToPyyaml(yamlContent);
 
     // Save to project directory
     const customerDir = path.join(process.cwd(), 'newo_customers', customer.idn);