@tencent-rtc/mcp 1.3.4 → 1.3.5

package/resource/doc/rtcengine/web/plugin/36-advanced-virtual-background.md

@@ -0,0 +1,242 @@
+## Function Description
+
+This document will describe how to implement the virtual background feature during a call.
+
+| Original Camera | Background Blur | Background Image |
+| --- | --- | --- |
+| <img src="https://qcloudimg.tencent-cloud.cn/raw/28a9246a5e1071ea0200bfde6d2b110b.jpg" /> | <img src="https://qcloudimg.tencent-cloud.cn/raw/a605b69b39cea73a6ebfde6324e93fff.jpg" /> | <img src="https://qcloudimg.tencent-cloud.cn/raw/fec848fc9ff4a2b4dbfc49a5f4c2fb3d.jpg" /> |
+
+## Prerequisites
+
+- Pricing see [RTC-Engine Packages](https://trtc.io/document/56025).
+- [TRTC SDK](https://www.npmjs.com/package/trtc-sdk-v5) version must be >= 5.5.0
+- System and configuration requirements for various platforms are as follows:
+
+<table>
+<tr>
+<td rowspan="1" colspan="1">Platform</td>
+
+<td rowspan="1" colspan="1">Operating System</td>
+
+<td rowspan="1" colspan="1">Browser Version</td>
+
+<td rowspan="1" colspan="1">FPS</td>
+
+<td rowspan="1" colspan="1">Recommended Configuration</td>
+
+<td rowspan="1" colspan="1">Remarks</td>
+</tr>
+
+<tr>
+<td rowspan="8" colspan="1">Web</td>
+
+<td rowspan="2" colspan="1">Windows</td>
+
+<td rowspan="2" colspan="1">Chrome 90+<br>Firefox 90+<br>Edge 97+</td>
+
+<td rowspan="1" colspan="1">30</td>
+
+<td rowspan="1" colspan="1">Memory: 16GB<br>CPU: i5-10500<br>GPU: Dedicated 2GB</td>
+
+<td rowspan="3" colspan="1">It is recommended to use the latest version of Chrome browser<br> <b> (Enable hardware acceleration in the browser)</b></td>
+</tr>
+
+<tr>
+<td rowspan="1" colspan="1">15</td>
+
+<td rowspan="1" colspan="1">Memory: 8GB<br>CPU: i3-8300<br>GPU: Integrated Intel 1GB</td>
+</tr>
+
+<tr>
+<td rowspan="1" colspan="1">Mac</td>
+
+<td rowspan="1" colspan="1">Chrome 98+<br>Firefox 96+<br>Safari 15+</td>
+
+<td rowspan="1" colspan="1">30</td>
+
+<td rowspan="1" colspan="1">2019 MacBook<br>Memory: 16GB (2667MHz)<br>CPU: i7 (6-core 2.60GHz)<br>GPU: AMD Radeon 5300M</td>
+</tr>
+
+<tr>
+<td rowspan="3" colspan="1">Android</td>
+
+<td rowspan="3" colspan="1">Chrome<br>Firefox Browser
+
+<td rowspan="1" colspan="1">30</td>
+
+<td rowspan="1" colspan="1">High-end devices (e.g., Qualcomm Snapdragon 8 Gen1)</td>
+
+<td rowspan="3" colspan="1">It is recommended to use Chrome, or Firefox browsers and other mainstream browsers<br>
+</tr>
+
+<tr>
+<td rowspan="1" colspan="1">20</td>
+
+<td rowspan="1" colspan="1">Mid-range devices (e.g., MediaTek Dimensity 8000-MAX)</td>
+</tr>
+
+<tr>
+<td rowspan="1" colspan="1">10</td>
+
+<td rowspan="1" colspan="1">Low-end devices (e.g., Qualcomm Snapdragon 660)</td>
+</tr>
+
+<tr>
+<td rowspan="2" colspan="1">iOS</td>
+
+<td rowspan="2" colspan="1">Chrome<br>Safari<br>Firefox</td>
+
+<td rowspan="1" colspan="1">30</td>
+
+<td rowspan="1" colspan="1">iPhone 13</td>
+
+<td rowspan="2" colspan="1">- Requires iOS 14.4 or above<br>- It is recommended to use Chrome or Safari browsers<br></td>
+</tr>
+
+<tr>
+<td rowspan="1" colspan="1">20</td>
+
+<td rowspan="1" colspan="1">iPhone XR</td>
+</tr>
+
+</table>
+
+## Implementation Steps
+
+### Deploying Static Resources
+
+This plugin relies on certain static resource files. To ensure that the browser can load and run these files properly, follow these steps:
+1. Publish the `node_modules/trtc-sdk-v5/assets` directory to a CDN or a static resource server.
+2. Pass your CDN URL to the `assetsPath` parameter when creating the `trtc` instance, for example: `TRTC.create({ assetsPath: 'https://xxxx/assets' })`. The SDK will load the required resource files as needed.
+  > - If your version is below `v5.10.0`, you need to download and extract [assets.zip](https://web.sdk.qcloud.com/trtc/webrtc/v5/assets/assets.zip), then publish it to a CDN or a static resource server.
+  > - If the Host URL of the files in the directory is different from the Host URL of the web application, you need to enable the CORS policy for the file domain.
+  > - Do not place the directory files under an HTTP service, as loading HTTP resources from an HTTPS domain will be blocked by browser security policies.
+  > - If you are using the ​**Face Centering** feature after version `v5.11.0`, please redeploy the assets.
+
+### Checking Browser Support (v5.8.1+)
+```javascript
+import { VirtualBackground } from 'trtc-sdk-v5/plugins/video-effect/virtual-background';
+if (!VirtualBackground.isSupported()) {
+    // Virtual background is not supported
+}
+```
+### Registering the Plugin
+
+```javascript
+import { VirtualBackground } from 'trtc-sdk-v5/plugins/video-effect/virtual-background';
+
+const trtc = TRTC.create({ plugins: [VirtualBackground], assetsPath: 'https://xxxx/assets' });
+```
+
+### Starting the Local Camera
+
+```javascript
+await trtc.startLocalVideo();
+```
+
+### Enabling the Virtual Background Plugin
+
+```javascript
+await trtc.startPlugin('VirtualBackground', {
+  sdkAppId: 123123,
+  userId: 'userId_123',
+  userSig: 'your_userSig'
+});
+```
+
+> Note: The first time you enable this feature, it requires loading computing resources, which has been automatically processed for you. For a more ultimate startup experience, please refer to the end of the document: [FAQ > How to speed up startup?](##-FAQ)
+
+### Updating Parameters as Needed
+
+```javascript
+// Changing to an image background
+await trtc.updatePlugin('VirtualBackground', {
+  type: 'image',
+  src: 'https://picsum.photos/seed/picsum/200/300'
+});
+```
+
+### Disabling Virtual Background
+
+```javascript
+await trtc.stopPlugin('VirtualBackground');
+```
+
+## API Documentation
+
+### trtc.startPlugin('VirtualBackground', options)
+
+Used to enable the virtual background.
+
+#### options
+
+| Name       | Type      | Attributes | Description                             |
+|------------|-----------|------------|-----------------------------------------|
+| sdkAppId   | `number`  | Required   | Current application ID                   |
+| userId     | `string`  | Required   | Current user ID                          |
+| userSig    | `string`  | Required   | UserSig corresponding to the user ID     |
+| type       | `string`  | Optional   | - `image` for image background <br> - `blur` for background blur (default) |
+| enableFaceCentering    | `boolean`        | Optional | `false` (default), (Since v5.11.0), set to true to enable automatic face centering |
+| enableEffectOptimization    | `boolean`        | Optional | `false` (default), experimental feature, set to true to reduce black edges and jagged edges around characters. Currently only supported on PC and since v5.13.0. |
+| blurLevel | `number` | Optional | - Set the level of blur when `type` is set to `blur`. Default value is 3, with a range from 1 to 10. |
+| src        | `string`  | Required if type is `image`  | Image URL, such as `https://picsum.photos/seed/picsum/200/300` |
+| onAbort    | `(error) => {}`  | Optional   | Callback for errors that occur during runtime <br> Recommended solutions can be found in the Common Issues section at the end of the document.  |
+
+**Example:**
+
+```javascript
+await trtc.startPlugin('VirtualBackground', {
+  sdkAppId: 123123,
+  userId: 'userId_123',
+  userSig: 'your_userSig',
+  type: 'image',
+  src: 'https://picsum.photos/seed/picsum/200/300'
+});
+```
+
+### trtc.updatePlugin('VirtualBackground', options)
+
+Allows modification of virtual background parameters.
+
+#### options
+
+| Name       | Type     | Attributes | Description                             |
+|------------|----------|------------|-----------------------------------------|
+| type       | `string` | Required   | - `image` for image background <br> - `blur` for background blur |
+| enableFaceCentering (Since v5.11.0)     | `boolean`        | Optional                   |`false`（default） 
+| blurLevel | `number` | Optional | - Set the level of blur when `type` is set to `blur`. Default value is 3, with a range from 1 to 10. |
+| src        | `string` | Required if type is `image`  | Image URL, such as `https://picsum.photos/seed/picsum/200/300` |
+
+**Example:**
+
+```javascript
+await trtc.updatePlugin('VirtualBackground', {
+  type: 'blur',
+  blurLevel: 6
+});
+```
+
+### trtc.stopPlugin('VirtualBackground')
+
+Disables the virtual background.
+
+## FAQs
+
+**1. When running the demo in Chrome, the video appears upside down and laggy**
+
+This plugin uses GPU acceleration, and you need to enable hardware acceleration mode in your browser settings. You can copy and paste `chrome://settings/system` into your browser's address bar and enable hardware acceleration mode.
+
+**2. When device performance is insufficient, causing high latency and rendering issues**
+
+
+```javascript
+async function onAbort(error) {
+  await trtc.stopPlugin('VirtualBackground'); // Stop the plugin
+  // Or lower the resolution and restart the plugin
+}
+
+await trtc.startPlugin('VirtualBackground', {
+  ...// Other parameters
+  onAbort,
+});
+```

package/resource/doc/rtcengine/web/plugin/37-advanced-voice-changer.md

@@ -0,0 +1,99 @@
+## Feature Description
+
+This document describes how to use the Voice Changer Plugin.
+
+## Prerequisites
+
+- Pricing see [RTC-Engine Packages](https://trtc.io/document/56025#f10b65d1-6e8d-41e3-8686-84909b00a1a2).
+- TRTC Web SDK version >= 5.10
+- Supported browsers: Chrome 66+, Edge 79+, Safari 15+, Firefox 76+, Chrome for Android 126+
+
+## Implementation Process
+
+### 1. Import and register the plugin
+
+```javascript
+import { VoiceChanger } from 'trtc-sdk-v5/plugins/voice-changer';
+
+let trtc = TRTC.create({ plugins: [VoiceChanger] });
+```
+
+### 2. Enable microphone
+
+```javascript
+await trtc.startLocalAudio();
+```
+
+### 3. Use the voice changer plugin
+
+```javascript
+await trtc.startPlugin('VoiceChanger', {
+  voiceType: 1,
+  sdkAppId: 123456,
+  userId: 'user_123',
+  userSig: 'XXXXXXXX'
+});
+
+// Update parameters after activation
+await trtc.updatePlugin('VoiceChanger', {
+  voiceType: 2,
+});
+
+// Disable the plugin before stopping microphone
+await trtc.stopPlugin('VoiceChanger');
+await trtc.stopLocalAudio();
+```
+
+
+## API Reference
+
+### trtc.startPlugin('VoiceChanger', options)
+
+Enable voice changing effects
+
+#### options
+| Name       | Type     | Attributes                                                     | Description |
+|------------|----------|----------------------------------------------------------------|-------------|
+| sdkAppId   | `number` | Current application's sdkAppId                                 |
+| userId     | `string` | Current user's userId                                          |
+| userSig    | `string` | Current user's userSig                                         |
+| voiceType  | `number` | 1-Mischievous Kid 2-Loli 3-Uncle 4-Heavy Metal 5-Cold 6-Foreign Accent 7-Caged Beast 8-Otaku 9-Strong Current 10-Heavy Machinery 11-Ethereal |
+
+**Example:**
+
+```javascript
+await trtc.startLocalAudio();
+await trtc.startPlugin('VoiceChanger', {
+  voiceType: 1,
+  sdkAppId: 123456,
+  userId: 'user_123',
+  userSig: 'XXXXXXXX'
+});
+```
+
+### trtc.updatePlugin('VoiceChanger', options)
+
+Modify voice changing effects
+
+#### options
+
+| Name       | Type     | Attributes   | Description                         |
+|------------|----------|--------------|-------------------------------------|
+| voiceType  | `number` | 1-Mischievous Kid 2-Loli 3-Uncle 4-Heavy Metal 5-Cold 6-Foreign Accent 7-Caged Beast 8-Otaku 9-Strong Current 10-Heavy Machinery 11-Ethereal |
+
+**Example:**
+
+```javascript
+await trtc.updatePlugin('VoiceChanger', {
+  voiceType: 2,
+});
+```
+
+### trtc.stopPlugin('VoiceChanger')
+
+Disable voice changing effects
+```javascript
+// Disable the plugin before stopping microphone
+await trtc.stopPlugin('VoiceChanger');
+await trtc.stopLocalAudio();
+```

package/resource/doc/rtcengine/web/plugin/39-advanced-video-decoder.md

@@ -0,0 +1,33 @@
+## Feature Description
+
+This document introduces how to use the TRTCVideoDecoder plugin to enable video decoder fallback capability. The plugin supports fallback to software decoding when regular decoding fails.
+
+## Prerequisites
+
+- TRTC Web SDK version >= 5.9.0
+
+- [Contact us](https://trtc.io/contact) to enable decoder fallback capability
+
+## Implementation Steps
+
+### Deploy Static Resources
+
+The plugin relies on some static resource files. To ensure that the browser can load and run these files properly, you need to complete the following steps:
+  1. Publish the `node_modules/trtc-sdk-v5/assets` directory to a CDN or static resource server.
+  2. Pass your CDN address to the `assetsPath` parameter when creating the `trtc` instance, for example: `TRTC.create({ assetsPath: 'https://xxx/assets' })`. The SDK will load the required resource files as needed.
+  > - If your version is below `v5.10.0`, you need to publish the `videodec.wasm` and `videodec_simd.wasm` files from the `node_modules/trtc-sdk-v5/plugins/video-decoder` directory to the CDN, and ensure they are in the same public directory, such as `xxx/assets`.
+  > - If the host URL of the directory files is different from the host URL of the web application, you need to enable the CORS policy for the file domain.
+  > - Do not place the directory files under an HTTP service, as loading HTTP resources under an HTTPS domain will be blocked by browser security policies.
+
+
+### 2. Import and Register Plugin
+
+```javascript
+import TRTCVideoDecoder from 'trtc-sdk-v5/plugins/video-decoder';
+
+const trtc = TRTC.create({ plugins: [TRTCVideoDecoder], assetsPath: 'https://example.com/assets/' });
+```
+
+## Plugin Activation
+
+The plugin functionality will automatically activate the fallback logic when SDK regular decoding fails, using software decoding method to decode.