@imgly/codesign-mcp 0.1.0

package/assets/docs/guide/starterkits/background-removal-editor.md

@@ -0,0 +1,480 @@
+> This is one page of the CE.SDK Vanilla JS/TS documentation. For a complete overview, see the [Vanilla JS/TS Documentation Index](https://img.ly/docs/cesdk/js.md). For all docs in one file, see [llms-full.txt](./llms-full.txt.md).
+
+**Navigation:** [Starter Kits](./starterkits.md) > [Plugins](./starterkits/plugins.md) > [Background Removal Editor](./starterkits/background-removal-editor.md)
+
+---
+
+Effortlessly remove background from images directly in the browser with no additional costs and privacy concerns.
+
+![Background Removal Editor starter kit showing AI-powered background removal interface](https://img.ly/docs/cesdk/./assets/browser.hero.webp)
+
+> **Reading time:** 10 minutes
+>
+> **Resources:**
+>
+> - [Download examples](https://github.com/imgly/starterkit-background-removal-editor-ts-web/archive/refs/tags/release-$UBQ_VERSION$.zip)
+> - [View source on GitHub](https://github.com/imgly/starterkit-background-removal-editor-ts-web/tree/release-$UBQ_VERSION$)
+> - [Open in StackBlitz](https://stackblitz.com/github/imgly/starterkit-background-removal-editor-ts-web/tree/release-$UBQ_VERSION$)
+> - [Live demo](https://img.ly/docs/cesdk/examples/starterkit-background-removal-editor/)
+
+---
+
+## Prerequisites
+
+Before you begin, make sure you have the following:
+
+- **Node.js v20+** and npm installed locally – [Download Node.js](https://nodejs.org/)
+- A **supported browser** – Chrome 114+, Edge 114+, Firefox 115+, Safari 15.6+<br />
+  See [Browser Support](./browser-support.md) for the full list.
+
+---
+
+<Tabs syncKey="project-type">
+  <TabItem label="New Project">
+    ## Get Started
+
+    Run the Background Removal Editor starter kit directly with Vite.
+
+    ## Step 1: Clone the Starter Kit
+
+    <TerminalTabs>
+      <TerminalTab label="git">
+        git clone https://github.com/imgly/starterkit-background-removal-editor-ts-web.git
+        cd starterkit-background-removal-editor-ts-web
+      </TerminalTab>
+
+      <TerminalTab label="degit">
+        npx degit imgly/starterkit-background-removal-editor-ts-web my-project
+        cd my-project
+      </TerminalTab>
+    </TerminalTabs>
+
+    ## Step 2: Install Dependencies
+
+    <TerminalTabs syncKey="package-manager">
+      <TerminalTab label="npm">npm install</TerminalTab>
+      <TerminalTab label="pnpm">pnpm install</TerminalTab>
+      <TerminalTab label="yarn">yarn install</TerminalTab>
+    </TerminalTabs>
+
+    ## Step 3: Download Assets
+
+    CE.SDK requires engine assets (fonts, icons, UI elements) to function. These must be served as static files from your project's `public/` directory.
+
+    <TerminalTabs>
+      <TerminalTab label="Download">
+        curl -O https://cdn.img.ly/packages/imgly/cesdk-js/$UBQ\_VERSION$/imgly-assets.zip
+        unzip imgly-assets.zip -d public/
+        rm imgly-assets.zip
+      </TerminalTab>
+    </TerminalTabs>
+
+    ## Step 4: Run the Development Server
+
+    <TerminalTabs syncKey="package-manager">
+      <TerminalTab label="npm">npm run dev</TerminalTab>
+      <TerminalTab label="pnpm">pnpm dev</TerminalTab>
+      <TerminalTab label="yarn">yarn dev</TerminalTab>
+    </TerminalTabs>
+
+    Open `http://localhost:5173` in your browser. Select an image and click "BG Removal" in the canvas menu to remove its background.
+
+  </TabItem>
+
+  <TabItem label="Existing Project">
+    ## Get Started
+
+    Integrate the Background Removal Editor into an existing vanilla JavaScript/TypeScript project. This adds the editor configuration to your current project structure.
+
+    ## Step 1: Clone
+
+    <TerminalTabs>
+      <TerminalTab label="Navigate">
+        cd your-project
+      </TerminalTab>
+    </TerminalTabs>
+
+    Clone the starter kit and copy the editor configuration to your project:
+
+    <TerminalTabs>
+      <TerminalTab label="git">
+        git clone https://github.com/imgly/starterkit-background-removal-editor-ts-web.git
+        cp -r starterkit-background-removal-editor-ts-web/src/imgly ./src/imgly
+        rm -rf starterkit-background-removal-editor-ts-web
+      </TerminalTab>
+
+      <TerminalTab label="degit">
+        npx degit imgly/starterkit-background-removal-editor-ts-web/src/imgly ./src/imgly
+      </TerminalTab>
+    </TerminalTabs>
+
+    > **Adjust Path:** The default destination is `./src/imgly`. Adjust the path to match your project structure.
+
+    The `imgly/` folder contains the editor configuration:
+
+    ```
+    imgly/
+    ├── config/
+    │   ├── actions.ts                # Export/import actions
+    │   ├── features.ts               # Feature toggles
+    │   ├── i18n.ts                   # Translations
+    │   ├── plugin.ts                 # Main configuration plugin
+    │   ├── settings.ts               # Engine settings
+    │   └── ui/
+    │       ├── canvas.ts                 # Canvas configuration
+    │       ├── components.ts             # Custom component registration
+    │       ├── dock.ts                   # Dock layout configuration
+    │       ├── index.ts                  # Combines UI customization exports
+    │       ├── inspectorBar.ts           # Inspector bar layout
+    │       ├── navigationBar.ts          # Navigation bar layout
+    │       └── panel.ts                  # Panel configuration
+    ├── index.ts                  # Editor initialization function
+    └── plugins/
+        └── background-removal.ts
+    ```
+
+    ## Step 2: Install Dependencies
+
+    Install the required packages for the editor:
+
+    ### Core Editor
+
+    Install the Creative Editor SDK:
+
+    <TerminalTabs syncKey="package-manager">
+      <TerminalTab label="npm">npm install @cesdk/cesdk-js@$UBQ\_VERSION$</TerminalTab>
+      <TerminalTab label="pnpm">pnpm add @cesdk/cesdk-js@$UBQ\_VERSION$</TerminalTab>
+      <TerminalTab label="yarn">yarn add @cesdk/cesdk-js@$UBQ\_VERSION$</TerminalTab>
+    </TerminalTabs>
+
+    ### Background Removal
+
+    Add AI-powered background removal:
+
+    <TerminalTabs syncKey="package-manager">
+      <TerminalTab label="npm">
+        npm install @imgly/plugin-background-removal-web@$UBQ\_VERSION$ @imgly/background-removal onnxruntime-web
+      </TerminalTab>
+
+      <TerminalTab label="pnpm">
+        pnpm add @imgly/plugin-background-removal-web@$UBQ\_VERSION$ @imgly/background-removal onnxruntime-web
+      </TerminalTab>
+
+      <TerminalTab label="yarn">
+        yarn add @imgly/plugin-background-removal-web@$UBQ\_VERSION$ @imgly/background-removal onnxruntime-web
+      </TerminalTab>
+    </TerminalTabs>
+
+    - `@imgly/plugin-background-removal-web` – CE.SDK plugin that integrates background removal into the editor UI (canvas menu and Apps panel)
+    - `@imgly/background-removal` – AI-powered image segmentation library (~30MB model download on first use, then cached)
+    - `onnxruntime-web` – Machine learning runtime that executes the AI model in the browser
+
+    ## Step 3: Download Assets
+
+    CE.SDK requires engine assets (fonts, icons, UI elements) to function. These must be served as static files from your project's `public/` directory.
+
+    <TerminalTabs>
+      <TerminalTab label="Download">
+        curl -O https://cdn.img.ly/packages/imgly/cesdk-js/$UBQ\_VERSION$/imgly-assets.zip
+        unzip imgly-assets.zip -d public/
+        rm imgly-assets.zip
+      </TerminalTab>
+    </TerminalTabs>
+
+    > **Asset Configuration:** The starter kit is pre-configured to load assets from `/assets`. If you place assets in a different location, update the `baseURL` in Step 4: Add a Container Element.
+
+    ## Step 4: Add a Container Element
+
+    Add a container element to your HTML where the editor will be mounted:
+
+    ```html
+    <div id="cesdk_container" style="width: 100%; height: 100vh;"></div>
+    ```
+
+    ## Step 5: Initialize the Editor
+
+    Import and call the initialization function from your entry point:
+
+    ```typescript title="src/index.ts"
+    import CreativeEditorSDK from '@cesdk/cesdk-js';
+    import { initBackgroundRemovalEditor } from './imgly';
+
+    const config = {
+      baseURL: '/assets'
+    };
+
+    CreativeEditorSDK.create('#cesdk_container', config)
+      .then(async (cesdk) => {
+        await initBackgroundRemovalEditor(cesdk);
+      })
+      .catch((error) => {
+        console.error('Failed to initialize CE.SDK:', error);
+      });
+    ```
+
+  </TabItem>
+</Tabs>
+
+## Using Background Removal
+
+The editor provides two ways to remove backgrounds:
+
+### Via Canvas Menu
+
+1. Select an image in the editor
+2. The canvas menu appears with a "BG Removal" button
+3. Click the button to AI-remove the background
+
+### Via Apps Panel
+
+1. Click the "Apps" button in the dock (left sidebar)
+2. The Apps panel opens showing "Remove Background"
+3. Select an image, then click "Remove Background" in the panel
+
+> **First Use:** The first time you use background removal, it downloads the AI models (~30MB). Subsequent uses are instant as the models are cached by the browser.
+
+## Set Up a Scene
+
+CE.SDK offers multiple ways to load content into the editor. Choose the method that matches your use case:
+
+```typescript title="src/index.ts"
+// Create a blank design canvas - starts with an empty design scene
+await cesdk.actions.run('scene.create');
+
+// Load from a template archive - restores a previously saved project
+await cesdk.loadFromArchiveURL('https://example.com/template.zip');
+
+// Load from an image URL - creates a new scene with the image
+await cesdk.createFromImage('https://example.com/image.jpg');
+
+// Load from a scene file - restores a scene from JSON
+await cesdk.loadFromURL('https://example.com/scene.json');
+```
+
+The `createDesignScene()` method is ideal for design workflows, as it creates a blank canvas ready for content.
+
+> **More Loading Options:** See [Open the Editor](./open-the-editor.md) for all available loading methods.
+
+## Customize Assets
+
+The Background Removal Editor uses asset source plugins to provide built-in libraries for templates, stickers, shapes, and fonts. The starter kit includes a curated selection—customize what's included based on your needs.
+
+Asset sources are added via plugins in `src/imgly/index.ts`. Enable or disable individual sources:
+
+```typescript title="src/imgly/index.ts"
+import {
+  FiltersAssetSource,
+  StickerAssetSource,
+  TextAssetSource,
+  VectorShapeAssetSource,
+  EffectsAssetSource
+  // ...
+} from '@cesdk/cesdk-js/plugins';
+
+// Add only the sources you need
+await cesdk.addPlugin(new FiltersAssetSource());
+await cesdk.addPlugin(new StickerAssetSource());
+await cesdk.addPlugin(new TextAssetSource());
+await cesdk.addPlugin(new VectorShapeAssetSource());
+await cesdk.addPlugin(new EffectsAssetSource());
+// ...
+```
+
+> **Available Asset Sources:** See [Asset Source Plugins](./plugins/asset-sources.md) for the complete list of available sources.
+
+For production deployments, self-hosting assets is required—the IMG.LY CDN is intended for development only. See [Serve Assets](./serve-assets.md) for downloading assets, configuring `baseURL`, and excluding unused sources to optimize load times.
+
+## Configure Actions
+
+Actions are functions that handle user interactions like exporting designs, saving scenes, and importing files. CE.SDK provides built-in actions that you can run directly or override with custom implementations.
+
+**Key built-in actions:**
+
+- `exportDesign` – Export the current design to PNG, JPEG, PDF, or other formats
+- `saveScene` – Save the scene as a JSON string for later editing
+- `importScene` – Import a previously saved scene (supports `.scene` and `.cesdk` formats)
+- `exportScene` – Export the scene as a JSON file or `.cesdk` archive with all assets
+- `uploadFile` – Handle file uploads with progress tracking
+
+Use `cesdk.actions.run()` to execute any action:
+
+```typescript
+// Run a built-in action
+await cesdk.actions.run('exportDesign', { mimeType: 'image/png' });
+```
+
+#### Export and Save
+
+```typescript title="src/imgly/config/actions.ts"
+// Register export action that downloads the edited design
+cesdk.actions.register('exportDesign', async (exportOptions) => {
+  const { blobs, options } = await cesdk.utils.export(exportOptions);
+  await cesdk.utils.downloadFile(blobs[0], options.mimeType);
+});
+```
+
+> **Learn More:** See [Actions](./actions.md) for the full list of built-in actions, how to run them, and how to register custom actions.
+
+---
+
+## Customize (Optional)
+
+### Theming
+
+CE.SDK supports light and dark themes out of the box, plus automatic system preference detection. Switch between themes programmatically:
+
+```typescript title="src/imgly/config/settings.ts"
+// 'light' | 'dark' | 'system' | (() => 'light' | 'dark')
+cesdk.ui.setTheme('dark');
+```
+
+See [Theming](./user-interface/appearance/theming.md) for custom color schemes, CSS variables, and advanced styling options.
+
+### Localization
+
+Customize UI labels and add support for multiple languages. The i18n system supports translation keys for all UI elements:
+
+```typescript title="src/imgly/config/i18n.ts"
+// Override specific labels
+cesdk.i18n.setTranslations({
+  en: {
+    'actions.export.image': 'Download Design',
+    'common.cancel': 'Cancel',
+    'common.apply': 'Apply'
+  }
+});
+
+// Add a new language
+cesdk.i18n.setTranslations({
+  de: {
+    'actions.export.image': 'Design herunterladen'
+  }
+});
+
+// Set the active locale
+cesdk.i18n.setLocale('de');
+```
+
+See [Localization](./user-interface/localization.md) for supported languages, translation key reference, and right-to-left language support.
+
+### UI Layout
+
+![CE.SDK Editor UI Areas](https://img.ly/docs/cesdk/../_shared/assets/CESDK-UI.png)
+
+Customize the editor interface by modifying the dock, inspector bar, navigation bar, and canvas menu. CE.SDK provides Order APIs to control which components appear and in what sequence.
+
+```typescript title="src/imgly/config/ui/navigationBar.ts"
+// Get current navigation bar components
+const navOrder = cesdk.ui.getNavigationBarOrder();
+
+// Add a custom button to the navigation bar
+cesdk.ui.insertNavigationBarOrderComponent(
+  'ly.img.spacer',
+  { id: 'my-custom-action' },
+  'after'
+);
+
+// Rearrange dock items
+cesdk.ui.setDockOrder([
+  'ly.img.assetLibrary.dock',
+  'ly.img.separator',
+  'my-custom-dock-item'
+]);
+```
+
+See [Dock](./user-interface/customization/dock.md), [Inspector Bar](./user-interface/customization/inspector-bar.md), [Navigation Bar](./user-interface/customization/navigation-bar.md), [Canvas Menu](./user-interface/customization/canvas-menu.md), and [Canvas](./user-interface/customization/canvas.md) for detailed layout customization options.
+
+---
+
+## Key Capabilities
+
+The Background Removal Editor includes AI-powered background removal plus full design editing capabilities.
+
+<CapabilityGrid
+features={[
+{
+title: 'AI Background Removal',
+description:
+'Remove backgrounds with one click. Uses ONNX Runtime for client-side AI processing—no server needed.',
+imageId: 'green-screen',
+},
+{
+title: 'Professional Filters',
+description:
+'Apply color grading with LUT filters, duotone effects, and customizable image adjustments.',
+imageId: 'filters',
+},
+{
+title: 'Text & Typography',
+description:
+'Add styled text with comprehensive typography controls, fonts, and visual effects.',
+imageId: 'text-editing',
+},
+{
+title: 'Asset Libraries',
+description:
+'Access built-in collections of templates, stickers, shapes, and graphics, plus import custom assets.',
+imageId: 'asset-libraries',
+},
+{
+title: 'Privacy-First',
+description:
+'All processing happens locally in the browser. No data is sent to external servers.',
+imageId: 'client-side',
+},
+{
+title: 'Export Options',
+description:
+'Export to multiple formats including PNG, JPEG, and PDF with quality and size controls.',
+imageId: 'transform',
+},
+]}
+/>
+
+<br />
+
+> **Free Trial:** [Sign up for a free trial](https://img.ly/forms/free-trial) to get a license key and remove the watermark.
+
+---
+
+## Troubleshooting
+
+### Editor doesn't load
+
+- **Check the container element exists**: Ensure your container element is in the DOM before calling `create()`
+- **Verify the baseURL**: Assets must be accessible from the CDN or your self-hosted location
+- **Check console errors**: Look for CORS or network errors in browser developer tools
+
+### Assets don't appear
+
+- **Check network requests**: Open DevTools Network tab and look for failed requests to `cdn.img.ly`
+- **Self-host assets for production**: See [Serve Assets](./serve-assets.md) to host assets on your infrastructure
+
+### Background removal is slow on first use
+
+- **This is expected**: The first use downloads AI models (~30MB). Subsequent uses are instant as models are cached by the browser.
+
+### Watermark appears in production
+
+- **Add your license key**: Set the `license` property in your configuration
+- **Sign up for a trial**: Get a free trial license at [img.ly/forms/free-trial](https://img.ly/forms/free-trial)
+
+---
+
+## Next Steps
+
+- [Background Removal Plugin](./edit-image/remove-bg.md) – Detailed plugin configuration options
+- [Configuration](./configuration.md) – Complete list of initialization options
+- [Serve Assets](./serve-assets.md) – Self-host engine assets for production
+- [Actions](./actions.md) – Build custom export and save workflows
+- [Theming](./user-interface/appearance/theming.md) – Customize colors and appearance
+- [Localization](./user-interface/localization.md) – Add translations and language support
+
+---
+
+## More Resources
+
+- **[Vanilla JS/TS Documentation Index](https://img.ly/docs/cesdk/js.md)** - Browse all Vanilla JS/TS documentation
+- **[Complete Documentation](./llms-full.txt.md)** - Full documentation in one file (for LLMs)
+- **[Web Documentation](./js.md)** - Interactive documentation with examples
+- **[Support](mailto:support@img.ly)** - Contact IMG.LY support