@tencent-rtc/trtc-agent-skills 0.1.7 → 0.1.8

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (125) hide show
  1. package/AGENTS.md +1 -1
  2. package/CLAUDE.md +1 -1
  3. package/CODEBUDDY.md +1 -1
  4. package/README.md +10 -7
  5. package/README.zh.md +10 -7
  6. package/bin/cli.js +196 -44
  7. package/knowledge-base/conference/web/index.yaml +6 -6
  8. package/knowledge-base/slices/conference/web/official-roomkit-api.md +119 -8
  9. package/package.json +1 -1
  10. package/skills/trtc/SKILL.md +45 -10
  11. package/skills/trtc-ai-oral-coach/README.ja.md +3 -3
  12. package/skills/trtc-ai-oral-coach/README.md +3 -3
  13. package/skills/trtc-ai-oral-coach/README.zh-CN.md +3 -3
  14. package/skills/trtc-ai-oral-coach/SKILL.md +7 -4
  15. package/skills/trtc-ai-realtime-interpreter/README.ja.md +197 -0
  16. package/skills/trtc-ai-realtime-interpreter/README.md +197 -0
  17. package/skills/trtc-ai-realtime-interpreter/README.zh-CN.md +197 -0
  18. package/skills/trtc-ai-realtime-interpreter/SKILL.md +748 -0
  19. package/skills/trtc-ai-realtime-interpreter/auto_adapters/integration_templates/generic-rest-api.md +85 -0
  20. package/skills/trtc-ai-realtime-interpreter/auto_adapters/integration_templates/room-owner-authz-note.md +53 -0
  21. package/skills/trtc-ai-realtime-interpreter/auto_adapters/manifest.yaml +49 -0
  22. package/skills/trtc-ai-realtime-interpreter/auto_adapters/python/README.md +11 -0
  23. package/skills/trtc-ai-realtime-interpreter/auto_adapters/python/fastapi_reverse_proxy.py.tpl +84 -0
  24. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/.env.example +17 -0
  25. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/frontend/silent-listener.ts +91 -0
  26. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/manifest.yaml +110 -0
  27. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/requirements.txt +5 -0
  28. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/__init__.py +0 -0
  29. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/_capability_loader.py +89 -0
  30. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/agent.py +153 -0
  31. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/credentials.py +112 -0
  32. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/health.py +218 -0
  33. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/log_filter.py +33 -0
  34. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/server.py +266 -0
  35. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/trtc_client.py +188 -0
  36. package/skills/trtc-ai-realtime-interpreter/capabilities/conversation-core/src/usersig.py +53 -0
  37. package/skills/trtc-ai-realtime-interpreter/capabilities/meeting-ops/README.md +46 -0
  38. package/skills/trtc-ai-realtime-interpreter/capabilities/meeting-ops/manifest.yaml +63 -0
  39. package/skills/trtc-ai-realtime-interpreter/capabilities/meeting-ops/src/__init__.py +0 -0
  40. package/skills/trtc-ai-realtime-interpreter/capabilities/meeting-ops/src/fanout.py +149 -0
  41. package/skills/trtc-ai-realtime-interpreter/capabilities/meeting-ops/src/router.py +83 -0
  42. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/frontend/subtitle-parser.ts +145 -0
  43. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/manifest.yaml +68 -0
  44. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/src/__init__.py +0 -0
  45. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/src/modes.py +73 -0
  46. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/src/router.py +83 -0
  47. package/skills/trtc-ai-realtime-interpreter/capabilities/realtime-translation/src/service.py +77 -0
  48. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/README.md +23 -0
  49. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/backend/app/__init__.py +0 -0
  50. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/backend/app/server.py +277 -0
  51. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/backend/requirements.txt +5 -0
  52. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/backend/start.sh +28 -0
  53. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/recipe.yaml +72 -0
  54. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/index.html +12 -0
  55. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/legacy/index.html +738 -0
  56. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/package-lock.json +4302 -0
  57. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/package.json +33 -0
  58. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/postcss.config.js +6 -0
  59. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/App.vue +18 -0
  60. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/api/backend.ts +82 -0
  61. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/SetupScreen.vue +362 -0
  62. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/SummaryScreen.vue +203 -0
  63. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/ChatPanel.vue +188 -0
  64. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/ConferenceRoom.vue +453 -0
  65. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/ParticipantViewUI.vue +170 -0
  66. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/PeoplePanel.vue +206 -0
  67. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/SidePanel.vue +77 -0
  68. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/Toolbar.vue +371 -0
  69. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/TopBar.vue +310 -0
  70. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/components/conference/TranscriptPanel.vue +225 -0
  71. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/composables/useAiInterpreter.ts +263 -0
  72. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/composables/useConference.ts +98 -0
  73. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/env.d.ts +7 -0
  74. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/main.ts +5 -0
  75. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/store.ts +103 -0
  76. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/src/style.css +19 -0
  77. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/tailwind.config.js +25 -0
  78. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/tsconfig.json +25 -0
  79. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/tsconfig.node.json +10 -0
  80. package/skills/trtc-ai-realtime-interpreter/scenarios/meeting-interpreter/ui/vite.config.ts +26 -0
  81. package/skills/trtc-ai-realtime-interpreter/scripts/add-capability.py +163 -0
  82. package/skills/trtc-ai-realtime-interpreter/scripts/deploy-demo.sh +64 -0
  83. package/skills/trtc-ai-realtime-interpreter/scripts/lib/__init__.py +0 -0
  84. package/skills/trtc-ai-realtime-interpreter/scripts/lib/credential_validators.py +143 -0
  85. package/skills/trtc-ai-realtime-interpreter/scripts/lib/manifest_resolver.py +60 -0
  86. package/skills/trtc-ai-realtime-interpreter/scripts/lib/stack_detector.py +50 -0
  87. package/skills/trtc-ai-realtime-interpreter/scripts/post-install-patch.py +79 -0
  88. package/skills/trtc-ai-realtime-interpreter/scripts/verify-credentials.py +76 -0
  89. package/skills/trtc-ai-realtime-interpreter/start.sh +85 -0
  90. package/skills/trtc-ai-realtime-interpreter/triggers.yaml +29 -0
  91. package/skills/trtc-ai-service/README.ja.md +3 -3
  92. package/skills/trtc-ai-service/README.md +3 -3
  93. package/skills/trtc-ai-service/README.zh-CN.md +3 -3
  94. package/skills/trtc-ai-service/SKILL.md +9 -7
  95. package/skills/trtc-ai-service/capabilities/conversation-core/src/credentials.py +1 -1
  96. package/skills/trtc-chat/SKILL.md +1 -1
  97. package/skills/trtc-chat/docs/SKILL.md +1 -1
  98. package/skills/trtc-conference/flows/onboarding.md +6 -0
  99. package/skills/trtc-conference/flows/topic.md +6 -2
  100. package/skills/trtc-conference/playbooks/official-roomkit.md +3 -1
  101. package/skills/trtc-conference/tests/test_conference_index_contract.py +16 -0
  102. package/skills/trtc-conference/tests/test_conference_onboarding_contract.py +9 -0
  103. package/skills/trtc-conference/tests/test_conference_topic_flow_contract.py +16 -0
  104. package/skills/trtc-push/SKILL.md +118 -0
  105. package/skills/trtc-push/issues/ROUTER.json +429 -0
  106. package/skills/trtc-push/issues/cards/android/fcm-gms-domestic.md +53 -0
  107. package/skills/trtc-push/issues/cards/android/vendor-huawei.md +72 -0
  108. package/skills/trtc-push/issues/cards/common/console-certificate-quota.md +46 -0
  109. package/skills/trtc-push/issues/cards/common/registration-binding.md +67 -0
  110. package/skills/trtc-push/issues/cards/ios/aps-environment-3000.md +55 -0
  111. package/skills/trtc-push/issues/cards/ios/certificate-businessid.md +56 -0
  112. package/skills/trtc-push/issues/cards/ios/xcodegen-cocoapods-module.md +54 -0
  113. package/skills/trtc-push/issues/flows/android/delivered-not-displayed.md +52 -0
  114. package/skills/trtc-push/issues/flows/android/vendor-not-received.md +57 -0
  115. package/skills/trtc-push/issues/flows/common/badge.md +49 -0
  116. package/skills/trtc-push/issues/flows/common/console-product-limits.md +48 -0
  117. package/skills/trtc-push/issues/flows/common/server-api.md +51 -0
  118. package/skills/trtc-push/issues/flows/cross-platform/harmonyos.md +51 -0
  119. package/skills/trtc-push/issues/flows/cross-platform/uniapp-integration.md +57 -0
  120. package/skills/trtc-push/issues/flows/ios/offline-not-received.md +57 -0
  121. package/skills/trtc-push/references/code-templates.md +386 -0
  122. package/skills/trtc-push/references/hard-rules.md +112 -0
  123. package/skills/trtc-push/references/timpush-sdk-api.md +72 -0
  124. package/skills/trtc-push/references/workflow-protocol.md +82 -0
  125. /package/.cursor/rules/{main.mdc → ui-mode.mdc} +0 -0
@@ -0,0 +1,197 @@
1
+ # TRTC AI Realtime Interpreter Skill
2
+
3
+ [English](README.md) | [中文](README.zh-CN.md) | [日本語](README.ja.md)
4
+
5
+ > Build an AI real-time meeting interpreter powered by TRTC Conversational AI — zero code, voice-first. Two paths, both agent-driven: you just talk, the agent does the rest.
6
+
7
+ ## About Tencent RTC
8
+
9
+ [Tencent RTC](https://trtc.io/?utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=HIzH2eVJ) (Real-Time Communication) powers real-time audio, video, and conversational AI experiences for thousands of businesses worldwide. With a global edge network spanning 200+ countries and regions, TRTC delivers sub-300ms ultra-low latency at scale.
10
+
11
+ The **Conversational AI** capability enables developers to build voice agents that can listen, understand, and respond naturally — perfect for real-time interpretation, multilingual meetings, and cross-language communication scenarios.
12
+
13
+ ## What is this?
14
+
15
+ A plug-and-play Skill that builds an AI real-time meeting interpreter — packaged into a single agent-driven workflow:
16
+
17
+ ```
18
+ You (in your IDE's AI chat window):
19
+ "Help me build a real-time AI interpreter with TRTC"
20
+
21
+ AI (does everything automatically):
22
+ 1. Checks your runtime environment
23
+ 2. Lets you choose Quick Experience or Integrate into My System
24
+ 3. Guides you through 3 keys setup (cloud service credentials)
25
+ 4. Installs dependencies and assembles interpreter capabilities
26
+ 5. Starts the service and gives you a browser URL
27
+
28
+ You never open a terminal or run a script manually.
29
+ ```
30
+
31
+ ## Two ways to start
32
+
33
+ > The core capability of this Skill is **TRTC Conversational AI (voice-first) real-time interpretation**.
34
+
35
+ | Mode | Who it's for | What you get | What you need |
36
+ |------|-------------|-------------|---------------|
37
+ | **Quick Experience** | First-timers who want to see it in action | A complete Vue3 meeting room + AI interpreter (anyone speaks → translated + bilingual subtitles + transcription panel) | 3 keys |
38
+ | **Integrate into My System** | Users who already have a meeting room, live room, or app and want backend interpretation | Backend API endpoints + integration samples (no UI generated) | 3 keys |
39
+
40
+ > **No matter which path you choose, the AI walks you through every step** — zero coding experience needed.
41
+
42
+ ## The only entry point
43
+
44
+ [`SKILL.md`](./SKILL.md) — Read and executed by your Coding Agent (CodeBuddy / Cursor / Claude Code).
45
+
46
+ > **Install anywhere**: This Skill can live in a project subdirectory, `.agents/skills/`, `.codebuddy/skills/`, or any location — it does **not** need to be at the workspace root. Scripts self-locate and the agent only needs absolute paths.
47
+
48
+ ## Installation
49
+
50
+ Install via `npx` — works with any IDE, no plugin marketplace required. Run inside your project directory:
51
+
52
+ ```bash
53
+ # Default — auto-detect installed IDEs and install for each one found
54
+ npx -y @tencent-rtc/trtc-agent-skills@latest add
55
+
56
+ # Force install for every supported IDE
57
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --ide all
58
+
59
+ # Install only for one specific IDE
60
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --ide cursor
61
+
62
+ # Wipe a previous install before re-installing
63
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --clean
64
+ ```
65
+
66
+ ## Trigger keywords
67
+
68
+ - "实时翻译" / "AI 翻译" / "同声传译" / "会议翻译" / "TRTC 翻译"
69
+ - "real-time interpreter" / "real-time translation" / "AI interpreter"
70
+ - "TRTC Conversational AI" / "会议实时翻译" / "跨语言会议"
71
+ - "帮我用 TRTC 做一个 AI 实时会议翻译"
72
+ - "Help me build a real-time AI interpreter with TRTC"
73
+ - "把 AI 实时翻译能力接入我现有的直播间"
74
+
75
+ ## What are the 3 keys?
76
+
77
+ To get the interpreter running, you need 3 cloud service credentials. Don't worry — they're just 3 strings you copy and paste from the respective websites:
78
+
79
+ > **How are TRTC and Tencent Cloud related?** TRTC's Conversational AI service runs on Tencent Cloud. Simply put: TRTC handles the voice calls between participants and the AI agent, while Tencent Cloud handles the backend (permissions, service activation, billing, etc.). Both share the same login — register once and use both.
80
+
81
+ | Key | Purpose | Where to find it |
82
+ |-----|---------|-----------------|
83
+ | 1: TRTC App Credentials | Voice channel for the interpreter | https://console.trtc.io/?quickclaim=engine_trial&utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=3WFHfiqw (Sign up and create an **RTC Engine** app — supports Conversational AI) |
84
+ | 2: Tencent Cloud API Key | Backend permissions (login syncs with TRTC) | https://console.tencentcloud.com/cam/capi?utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=v0K1Q0DSE |
85
+ | 3: LLM API Key | The interpreter's "brain" — understand and translate speech in real time | Your AI provider (OpenAI, DeepSeek, etc.) |
86
+
87
+ > The AI will guide you step-by-step on how to obtain each key. Your key information is only used during this setup session — the system does not record or leak it.
88
+
89
+ ## What capabilities does the interpreter have?
90
+
91
+ | Capability | Description | Quick Experience | Integration |
92
+ |------------|-------------|:---:|:---:|
93
+ | Conversation Core | Voice pipeline + UserSig signer + credential management (skeleton, required) | ✅ Auto-assembled | ✅ Default included |
94
+ | Realtime Translation | Language-pair-driven real-time translation (STT → LLM translate → TTS + subtitle) | ✅ Default | 🔘 Optional |
95
+ | Meeting Ops | Multi-participant fanout orchestration (translate for everyone in the room) | ✅ Default | 🔘 Optional |
96
+ | Bilingual Subtitles | Real-time bilingual subtitle display (original + translation side by side) | ✅ Built-in | ✅ Built-in |
97
+ | Transcription Panel | Session transcription history with bilingual view | ✅ Built-in | ✅ Built-in |
98
+ | Host-only Control | Only the room host can toggle AI interpretation (demo design) | ✅ Built-in | 🔘 Your own auth |
99
+
100
+ > 💡 `realtime-translation` and `meeting-ops` capabilities share the same `conversation-core` skeleton — swap the language pair configuration to support different translation directions.
101
+
102
+ ## Supported language pairs
103
+
104
+ | Mode ID | Source Language | Target Language | STT Language | TTS Voice | Direction |
105
+ |---------|----------------|-----------------|--------------|-----------|-----------|
106
+ | `zh-en` | Chinese | English | `zh` | `v-female-p9Xy7Q1L` | Bidirectional (zh ↔ en) |
107
+ | `zh-yue` | Chinese | Cantonese | `zh` | `v-female-k3P8sL0Q` | Bidirectional (Mandarin ↔ Cantonese) |
108
+ | `en-yue` | English | Cantonese | `en` | `v-female-k3P8sL0Q` | Bidirectional (en ↔ Cantonese) |
109
+
110
+ > Language pairs are extensible — add more entries in `modes.py` to support additional translation directions. All TTS voices are built-in TRTC Conversational AI voices (`flow_01_turbo`), fully contained within the TRTC ecosystem.
111
+ >
112
+ > **Need more languages?** TRTC Conversational AI supports a wide range of STT languages and TTS voices beyond the defaults above. You can:
113
+ > - Check the [STT supported languages](https://trtc.io/document/69592?product=conversationalai) and [TTS voice list](https://trtc.io/document/68340?product=conversationalai) to switch to built-in models that cover your target languages
114
+ > - Switch to third-party STT/TTS models within the TRTC ecosystem via the configuration docs
115
+ > - [Contact our technical team](https://trtc.io/contact) for custom language pair requirements — we'll help you find the right model combination
116
+
117
+ ## Advanced: Customize TRTC Conversational AI
118
+
119
+ If you want to fine-tune the AI interpreter's voice behavior or change the underlying models, refer to the official TRTC Conversational AI documentation:
120
+
121
+ ### Adjust voice parameters (speed / pitch / timbre)
122
+
123
+ Both STT (speech-to-text) and TTS (text-to-speech) are powered by Tencent's in-house engines. You can adjust voice parameters via the following documentation:
124
+
125
+ | Stage | Documentation |
126
+ |-------|--------------|
127
+ | STT (Speech-to-Text) | [STT configuration parameters](https://trtc.io/document/69592?product=conversationalai) |
128
+ | TTS (Text-to-Speech) | [TTS configuration parameters](https://trtc.io/document/68340?product=conversationalai) |
129
+
130
+ ### Switch STT / LLM / TTS models
131
+
132
+ To change the underlying STT, LLM, or TTS models, check the model overview for each pipeline stage and follow the integration guide:
133
+
134
+ | Stage | Documentation |
135
+ |-------|--------------|
136
+ | STT (Speech-to-Text) | [STT Model Overview](https://trtc.io/document/69592?product=conversationalai) |
137
+ | LLM (Language Model) | [LLM Model Overview](https://trtc.io/document/68338?product=conversationalai) |
138
+ | TTS (Text-to-Speech) | [TTS Model Overview](https://trtc.io/document/68340?product=conversationalai) |
139
+
140
+ ### STT supported languages
141
+
142
+ When `engine_model_type` is set to `bigmodel`, you can specify the audio language for STT. Supported languages include: `zh` (Chinese), `en` (English), `yue` (Cantonese), `ar` (Arabic), `de` (German), `fr` (French), `es` (Spanish), `pt` (Portuguese), `id` (Indonesian), `it` (Italian), `ko` (Korean), `ru` (Russian), `th` (Thai), `vi` (Vietnamese), `ja` (Japanese), `tr` (Turkish), `hi` (Hindi), `ms` (Malay), `nl` (Dutch), `sv` (Swedish), `da` (Danish), `fi` (Finnish), `pl` (Polish), `cs` (Czech), `fil` (Filipino), `fa` (Persian), `el` (Greek), `ro` (Romanian), `hu` (Hungarian), `mk` (Macedonian).
143
+
144
+ ### Complete documentation
145
+
146
+ For other configuration needs, start from the [Conversational AI Overview](https://trtc.io/document/71130?product=conversationalai) page.
147
+
148
+ ## Directory structure
149
+
150
+ ```
151
+ trtc-ai-realtime-interpreter/
152
+ ├── SKILL.md # Agent execution SOP (the only entry point)
153
+ ├── README.md # English (main)
154
+ ├── README.zh-CN.md # Chinese
155
+ ├── README.ja.md # Japanese
156
+ ├── start.sh # Bootstrap (venv + deps + FastAPI:8020)
157
+ ├── capabilities/ # Atomic capabilities (shipped with repo, auto-mounted)
158
+ │ ├── conversation-core/ # Skeleton: FastAPI + voice pipeline + credential signer
159
+ │ ├── realtime-translation/ # Language-pair translation logic (STT/LLM/TTS)
160
+ │ └── meeting-ops/ # Multi-target fanout orchestration (no auth built-in)
161
+ ├── scenarios/
162
+ │ └── meeting-interpreter/ # Path A default: Vue3 meeting room + AI interpreter overlay
163
+ │ ├── recipe.yaml # Assembly recipe
164
+ │ ├── backend/ # Scenario-specific backend (host auth, HTTP serve)
165
+ │ └── ui/ # Vue3 frontend (conference room, toolbar, transcript)
166
+ ├── auto_adapters/ # Path B: headless API integration templates
167
+ │ ├── manifest.yaml
168
+ │ ├── python/
169
+ │ │ └── fastapi_reverse_proxy.py.tpl
170
+ │ └── integration_templates/
171
+ │ ├── generic-rest-api.md
172
+ │ └── room-owner-authz-note.md
173
+ └── scripts/ # Verify credentials / add capability / post-install patch / deploy
174
+ ├── verify-credentials.py
175
+ ├── add-capability.py
176
+ ├── post-install-patch.py
177
+ ├── deploy-demo.sh
178
+ └── lib/
179
+ ```
180
+
181
+ ## FAQ
182
+
183
+ | Issue | Solution |
184
+ |-------|----------|
185
+ | Key verification failed | Go back and double-check each key value — make sure you're using the server-side SDKSecretKey (not STSecretKey) |
186
+ | TRTC_REGION mismatch | Check your TRTC app region: international site apps must use `intl` |
187
+ | Port 8020 is in use | Use a different port or free port 8020: `lsof -ti :8020 -sTCP:LISTEN \| xargs kill` |
188
+ | Python version too low | Install Python 3.9+ from [python.org](https://www.python.org/downloads/) |
189
+ | Node.js / npm missing | Install Node.js LTS from [nodejs.org](https://nodejs.org/) |
190
+ | Browser shows blank page | Hard refresh: `Cmd+Shift+R` (Mac) / `Ctrl+Shift+R` (Windows) |
191
+ | "No such file" errors | The agent may have used a relative path — re-run from the correct SKILL_ROOT |
192
+ | Multiple TTS voices overlapping | Known v1 limitation when multiple participants speak simultaneously |
193
+ | Want to connect your own meeting system | Re-run and choose Path B (Integrate into My System) |
194
+
195
+ ## Contact Us
196
+
197
+ Need technical support or enterprise pricing? Submit your contact information at [trtc.io/contact](https://trtc.io/contact) and our team will get back to you shortly.
@@ -0,0 +1,197 @@
1
+ # TRTC AI 实时翻译 Skill
2
+
3
+ [English](README.md) | [中文](README.zh-CN.md) | [日本語](README.ja.md)
4
+
5
+ > 基于 TRTC Conversational AI 构建的 AI 实时会议翻译——零代码、语音优先。两条路径,全程由 AI 引导:你只需开口说话,AI 帮你搞定一切。
6
+
7
+ ## 关于 Tencent RTC
8
+
9
+ [Tencent RTC](https://trtc.io/?utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=HIzH2eVJ)(实时音视频)为全球数千家企业提供实时音频、视频和对话式 AI 体验。依托覆盖 200+ 国家和地区的全球边缘网络,TRTC 提供低于 300ms 的超低延迟大规模实时通信能力。
10
+
11
+ **Conversational AI** 能力让开发者可以构建能够聆听、理解并自然回应的语音智能体——非常适合实时翻译、多语言会议和跨语言沟通场景。
12
+
13
+ ## 这是什么?
14
+
15
+ 将"基于 TRTC Conversational AI 的实时会议翻译"打包成一个即插即用的 Skill:
16
+
17
+ ```
18
+ 你(在 IDE 的 AI 聊天窗口中说):
19
+ "帮我用 TRTC 做一个 AI 实时会议翻译"
20
+
21
+ AI(自动完成所有操作):
22
+ 1. 检查你的运行环境
23
+ 2. 让你选择搭建模式(快速体验 / 集成到我的系统)
24
+ 3. 引导你完成 3 个密钥的配置(云服务凭证)
25
+ 4. 安装依赖并组装翻译能力
26
+ 5. 启动服务并给你一个浏览器地址,直接查看效果
27
+
28
+ 你完全不需要打开终端或手动执行任何脚本。
29
+ ```
30
+
31
+ ## 两种方式开始
32
+
33
+ > 本 Skill 的核心能力是 **TRTC Conversational AI(语音优先)实时翻译**。
34
+
35
+ | 模式 | 适合谁 | 能得到什么 | 需要做什么 |
36
+ |------|--------|-----------|-----------|
37
+ | **快速体验** | 想先看看效果的新用户 | 一个完整的 Vue3 会议室 + AI 实时翻译(谁说话都有翻译 + 双语字幕 + 转写面板) | 配置 3 个密钥 |
38
+ | **集成到我的系统** | 已有会议室、直播间或应用、只想接入翻译能力的用户 | 后端 API 接口 + 集成示例代码(不生成 UI) | 配置 3 个密钥 |
39
+
40
+ > **无论选择哪种方式,AI 都会引导你走完每一步**——零编程经验也没问题。
41
+
42
+ ## 唯一入口
43
+
44
+ [`SKILL.md`](./SKILL.md) — 由你的编程助手(CodeBuddy / Cursor / Claude Code)读取和执行。
45
+
46
+ > **任意位置安装**:本 Skill 可以放在项目子目录、`.agents/skills/`、`.codebuddy/skills/` 或任何位置——**不需要**放在工作区根目录。脚本会自动定位自身路径,Agent 只需使用绝对路径。
47
+
48
+ ## 安装方式
49
+
50
+ 通过 `npx` 安装 — 支持任意 IDE,无需插件市场。在项目根目录执行:
51
+
52
+ ```bash
53
+ # 默认 — 自动检测已安装的 IDE 并安装
54
+ npx -y @tencent-rtc/trtc-agent-skills@latest add
55
+
56
+ # 强制为所有支持的 IDE 都安装
57
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --ide all
58
+
59
+ # 只为某个指定的 IDE 安装
60
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --ide cursor
61
+
62
+ # 重装前先清理旧的安装
63
+ npx -y @tencent-rtc/trtc-agent-skills@latest add --clean
64
+ ```
65
+
66
+ ## 触发关键词
67
+
68
+ - "实时翻译" / "AI 翻译" / "同声传译" / "会议翻译" / "TRTC 翻译"
69
+ - "real-time interpreter" / "real-time translation" / "AI interpreter"
70
+ - "TRTC Conversational AI" / "会议实时翻译" / "跨语言会议"
71
+ - "帮我用 TRTC 做一个 AI 实时会议翻译"
72
+ - "Help me build a real-time AI interpreter with TRTC"
73
+ - "把 AI 实时翻译能力接入我现有的直播间"
74
+
75
+ ## 3 个密钥是什么?
76
+
77
+ 要让翻译智能体跑起来,你需要 3 个云服务凭证。别担心——它们只是从相应网站复制粘贴的 3 个字符串:
78
+
79
+ > **TRTC 和腾讯云是什么关系?** TRTC 的对话式 AI 服务运行在腾讯云上。简单理解:TRTC 负责参会者与 AI 智能体之间的语音通话,腾讯云负责后台(权限校验、服务开通、计费等)。两者使用同一套登录体系,注册一次就能两边通用。
80
+
81
+ | 密钥 | 用途 | 获取地址 |
82
+ |------|------|---------|
83
+ | 密钥 1:TRTC 应用凭证 | 让翻译智能体能够进行语音通话 | https://console.trtc.io/?quickclaim=engine_trial&utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=3WFHfiqw(注册并创建 **RTC Engine** 应用,支持 Conversational AI) |
84
+ | 密钥 2:腾讯云 API 密钥 | 证明你有权限使用 TRTC 语音和通话服务(登录态与 TRTC 账号自动同步) | https://console.tencentcloud.com/cam/capi?utm_source=github&utm_medium=skill&utm_campaign=Twitter%20AI%20%E4%B8%93%E9%A1%B9%20-%20AI%20Oral%20Coach&_channel_track_key=v0K1Q0DSE |
85
+ | 密钥 3:LLM API 密钥 | 翻译智能体的"大脑"——实时听懂并翻译语音 | 你注册的 AI 服务网站(如 OpenAI、DeepSeek 等) |
86
+
87
+ > AI 会一步步详细告诉你如何获取每个密钥。你的密钥信息仅用于本次配置会话——系统不会记录或泄露。
88
+
89
+ ## 翻译能力有哪些?
90
+
91
+ | 能力 | 描述 | 快速体验 | 集成模式 |
92
+ |------|------|:---:|:---:|
93
+ | 对话骨架 | 语音通道 + UserSig 签发 + 凭证管理(骨架,必装) | ✅ 自动组装 | ✅ 默认包含 |
94
+ | 实时翻译 | 语言对驱动的实时翻译(STT → LLM 翻译 → TTS 播报 + 字幕) | ✅ 默认 | 🔘 可选 |
95
+ | 会议扇出 | 按参会人批量扇出翻译(房间内谁说话都有翻译) | ✅ 默认 | 🔘 可选 |
96
+ | 双语字幕 | 实时双语字幕显示(原文 + 译文并列显示) | ✅ 内置 | ✅ 内置 |
97
+ | 转写面板 | 整场会议的双语转写记录 | ✅ 内置 | ✅ 内置 |
98
+ | 房主控制 | 仅会议室主持人可以开关 AI 翻译(Demo 设计) | ✅ 内置 | 🔘 自定义鉴权 |
99
+
100
+ > 💡 `realtime-translation` 和 `meeting-ops` 能力共用同一套 `conversation-core` 骨架——替换语言对配置即可支持不同翻译方向。
101
+
102
+ ## 支持的语言对
103
+
104
+ | 模式 ID | 源语言 | 目标语言 | STT 识别语种 | TTS 音色 | 翻译方向 |
105
+ |---------|--------|----------|-------------|----------|---------|
106
+ | `zh-en` | 中文 | 英语 | `zh` | `v-female-p9Xy7Q1L` | 中英双向(中文 ↔ 英文) |
107
+ | `zh-yue` | 中文 | 粤语 | `zh` | `v-female-k3P8sL0Q` | 普通话 ↔ 粤语双向 |
108
+ | `en-yue` | 英语 | 粤语 | `en` | `v-female-k3P8sL0Q` | 英文 ↔ 粤语双向 |
109
+
110
+ > 语言对可扩展——在 `modes.py` 中新增条目即可支持更多翻译方向。所有 TTS 音色均为 TRTC 对话式 AI 内置音色(`flow_01_turbo`),全程闭环在 TRTC 生态内。
111
+ >
112
+ > **需要更多语言?** TRTC Conversational AI 支持远超上述默认配置的 STT 语种和 TTS 音色。你可以:
113
+ > - 查看 [STT 支持语种](https://trtc.io/document/69592?product=conversationalai) 和 [TTS 音色列表](https://trtc.io/document/68340?product=conversationalai),切换到覆盖目标语言的内置模型
114
+ > - 通过配置文档在 TRTC 生态内切换到第三方 STT/TTS 模型
115
+ > - [联系我们的技术团队](https://trtc.io/contact) 获取定制语言对方案——我们会帮你找到最合适的模型组合
116
+
117
+ ## 进阶:自定义 TRTC Conversational AI
118
+
119
+ 如果你想微调 AI 翻译智能体的声音行为或更换底层模型,请参阅 TRTC Conversational AI 官方文档:
120
+
121
+ ### 调整声音参数(语速 / 音调 / 音色)
122
+
123
+ STT(语音识别)和 TTS(语音合成)均使用腾讯自研引擎。你可以通过以下文档调整声音参数:
124
+
125
+ | 阶段 | 文档 |
126
+ |------|------|
127
+ | STT(语音识别) | [STT 配置参数](https://trtc.io/document/69592?product=conversationalai) |
128
+ | TTS(语音合成) | [TTS 配置参数](https://trtc.io/document/68340?product=conversationalai) |
129
+
130
+ ### 切换 STT / LLM / TTS 模型
131
+
132
+ 如需更换底层 STT、LLM 或 TTS 模型,请查看各环节的模型总览并按照接入指引操作:
133
+
134
+ | 阶段 | 文档 |
135
+ |------|------|
136
+ | STT(语音识别) | [STT 模型总览](https://trtc.io/document/69592?product=conversationalai) |
137
+ | LLM(大语言模型) | [LLM 模型总览](https://trtc.io/document/68338?product=conversationalai) |
138
+ | TTS(语音合成) | [TTS 模型总览](https://trtc.io/document/68340?product=conversationalai) |
139
+
140
+ ### STT 支持语种
141
+
142
+ 当 `engine_model_type` 指定为 `bigmodel` 时,可指定音频语种。支持语种包括:`zh`(中文)、`en`(英语)、`yue`(粤语)、`ar`(阿拉伯语)、`de`(德语)、`fr`(法语)、`es`(西班牙语)、`pt`(葡萄牙语)、`id`(印尼语)、`it`(意大利语)、`ko`(韩语)、`ru`(俄语)、`th`(泰语)、`vi`(越南语)、`ja`(日语)、`tr`(土耳其语)、`hi`(印地语)、`ms`(马来语)、`nl`(荷兰语)、`sv`(瑞典语)、`da`(丹麦语)、`fi`(芬兰语)、`pl`(波兰语)、`cs`(捷克语)、`fil`(菲律宾语)、`fa`(波斯语)、`el`(希腊语)、`ro`(罗马尼亚语)、`hu`(匈牙利语)、`mk`(马其顿语)。
143
+
144
+ ### 完整文档
145
+
146
+ 如有其他配置需求,请从 [Conversational AI 总览](https://trtc.io/document/71130?product=conversationalai) 页面出发寻找相关文档。
147
+
148
+ ## 目录结构
149
+
150
+ ```
151
+ trtc-ai-realtime-interpreter/
152
+ ├── SKILL.md # Agent 执行 SOP(唯一入口)
153
+ ├── README.md # English(主文档)
154
+ ├── README.zh-CN.md # Chinese
155
+ ├── README.ja.md # Japanese
156
+ ├── start.sh # 骨架启动脚本(venv + deps + FastAPI:8020)
157
+ ├── capabilities/ # 原子能力包(随仓库发布,自动挂载)
158
+ │ ├── conversation-core/ # 骨架:FastAPI + 语音通道 + 凭证签发
159
+ │ ├── realtime-translation/ # 语言对翻译逻辑(STT/LLM/TTS)
160
+ │ └── meeting-ops/ # 多目标扇出编排(无内置权限)
161
+ ├── scenarios/
162
+ │ └── meeting-interpreter/ # Path A 默认场景:Vue3 会议室 + AI 翻译叠加层
163
+ │ ├── recipe.yaml # 组装配方
164
+ │ ├── backend/ # 场景专属后端(房主鉴权、HTTP 托管)
165
+ │ └── ui/ # Vue3 前端(会议室、工具栏、转写面板)
166
+ ├── auto_adapters/ # Path B:无 UI API 集成模板
167
+ │ ├── manifest.yaml
168
+ │ ├── python/
169
+ │ │ └── fastapi_reverse_proxy.py.tpl
170
+ │ └── integration_templates/
171
+ │ ├── generic-rest-api.md
172
+ │ └── room-owner-authz-note.md
173
+ └── scripts/ # 凭证校验 / 能力安装 / 安装后检查 / 部署
174
+ ├── verify-credentials.py
175
+ ├── add-capability.py
176
+ ├── post-install-patch.py
177
+ ├── deploy-demo.sh
178
+ └── lib/
179
+ ```
180
+
181
+ ## 常见问题
182
+
183
+ | 问题 | 解决方法 |
184
+ |------|---------|
185
+ | 密钥校验失败 | 回到配置步骤逐项核对——注意要用服务端的 SDKSecretKey(不是客户端的 STSecretKey) |
186
+ | TRTC_REGION 不匹配 | 检查 TRTC 应用所在站点:国际站应用必须用 `intl` |
187
+ | 8020 端口被占用 | 换端口或释放端口:`lsof -ti :8020 -sTCP:LISTEN \| xargs kill` |
188
+ | Python 版本太旧 | 去 [python.org](https://www.python.org/downloads/) 安装 Python 3.9+ |
189
+ | 缺少 Node.js / npm | 去 [nodejs.org](https://nodejs.org/) 安装 Node.js LTS 版本 |
190
+ | 浏览器打开是空白页 | 强制刷新:Mac `Cmd+Shift+R` / Windows `Ctrl+Shift+R` |
191
+ | 报"No such file"错误 | Agent 可能用了相对路径——从正确的 SKILL_ROOT 重新执行 |
192
+ | 多人同时说话,TTS 声音叠放 | v1 已知限制,多人同时说话时多路翻译的 TTS 播报会叠加 |
193
+ | 想接入自己已有的会议室系统 | 重新运行并选择 Path B(集成到我的系统) |
194
+
195
+ ## 联系我们
196
+
197
+ 需要技术支持或企业定价方案?请通过 [trtc.io/contact](https://trtc.io/contact) 提交你的联系方式,我们的团队会尽快回复。