@lobehub/chat 1.2.9 → 1.2.11

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,5 +1,5 @@
1
1
  ---
2
- title: Anthropic Claude 系列 Tool Calling 评测
2
+ title: Anthropic Claude 系列 Tools Calling 评测
3
3
  description: >-
4
4
  使用 LobeChat 测试 Anthropic Claude 系列模型(Claude 3.5 sonnet / Claude 3 Opus /
5
5
  Claude 3 haiku) 的工具调用(Function Calling)能力,并展现评测结果
@@ -11,7 +11,7 @@ tags:
11
11
  - 插件
12
12
  ---
13
13
 
14
- # Anthropic Claude 系列 Tool Calling
14
+ # Anthropic Claude 系列 Tools Calling
15
15
 
16
16
  ## Claude 3.5 Sonnet
17
17
 
@@ -22,127 +22,15 @@ tags:
22
22
  <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/42a6980c-ea2a-44fd-b61f-a7989827f5a5" />
23
23
 
24
24
  <Image
25
- alt="Claude 3.5 Sonnet 简单指令的 Tool Calling"
25
+ alt="Claude 3.5 Sonnet 简单指令的 Tools Calling"
26
26
  src="https://github.com/lobehub/lobe-chat/assets/28616219/71146b75-2c73-48c3-9688-1d8814d2a791"
27
27
  />
28
28
 
29
- <details>
30
- <summary>Tool Calling 原始输出:</summary>
29
+ <details>
30
+ <summary>Tools Calling 原始输出:</summary>
31
31
 
32
32
  ```yml
33
- [stream start] 2024-6-24 20:24:40.289
34
- [chunk 0] 2024-6-24 20:24:40.294
35
-
36
- {"type":"message_start","message":{"id":"msg_01Q8ytAh2wiJHwKt7qEdaUsP","type":"message","role":"assistant","model":"claude-3-5-sonnet-20240620","content":[],"stop_reason":null,"stop_sequence":null,"usage":{"input_tokens":485,"output_tokens":4}}}
37
- [chunk 1] 2024-6-24 20:24:40.294
38
-
39
- {"type":"content_block_start","index":0,"content_block":{"type":"text","text":""}}
40
- [chunk 2] 2024-6-24 20:24:40.311
41
-
42
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"好的,"}}
43
- [chunk 3] 2024-6-24 20:24:40.312
44
-
45
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"我会"}}
46
- [chunk 4] 2024-6-24 20:24:40.313
47
-
48
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"为"}}
49
- [chunk 5] 2024-6-24 20:24:40.356
50
-
51
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"您"}}
52
- [chunk 6] 2024-6-24 20:24:40.358
53
-
54
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"查"}}
55
- [chunk 7] 2024-6-24 20:24:40.364
56
-
57
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"询杭州"}}
58
- [chunk 8] 2024-6-24 20:24:40.368
59
-
60
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"和北京的"}}
61
- [chunk 9] 2024-6-24 20:24:40.480
62
-
63
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"天"}}
64
- [chunk 10] 2024-6-24 20:24:40.487
65
-
66
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"气情况。"}}
67
- [chunk 11] 2024-6-24 20:24:40.489
68
-
69
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"让"}}
70
- [chunk 12] 2024-6-24 20:24:40.493
71
-
72
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"我为"}}
73
- [chunk 13] 2024-6-24 20:24:40.606
74
-
75
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"您获"}}
76
- [chunk 14] 2024-6-24 20:24:40.610
77
-
78
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"取这"}}
79
- [chunk 15] 2024-6-24 20:24:40.620
80
-
81
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"两"}}
82
- [chunk 16] 2024-6-24 20:24:40.621
83
-
84
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"个城市的"}}
85
- [chunk 17] 2024-6-24 20:24:40.730
86
-
87
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"当前天气"}}
88
- [chunk 18] 2024-6-24 20:24:40.733
89
-
90
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"信"}}
91
- [chunk 19] 2024-6-24 20:24:40.981
92
-
93
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"息。"}}
94
- [chunk 20] 2024-6-24 20:24:40.983
95
-
96
- {"type":"content_block_stop","index":0}
97
- [chunk 21] 2024-6-24 20:24:40.983
98
-
99
- {"type":"content_block_start","index":1,"content_block":{"type":"tool_use","id":"toolu_01CYUiZB5L2iLYfKkFL5TWtm","name":"realtime-weather____fetchCurrentWeather","input":{}}}
100
- [chunk 22] 2024-6-24 20:24:41.266
101
-
102
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":""}}
103
- [chunk 23] 2024-6-24 20:24:41.267
104
-
105
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"{\"city\": "}}
106
- [chunk 24] 2024-6-24 20:24:41.268
107
-
108
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"\"\\u67"}}
109
- [chunk 25] 2024-6-24 20:24:41.268
110
-
111
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"6d\\"}}
112
- [chunk 26] 2024-6-24 20:24:41.269
113
-
114
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"u5dde\"}"}}
115
- [chunk 27] 2024-6-24 20:24:41.270
116
-
117
- {"type":"content_block_stop","index":1}
118
- [chunk 28] 2024-6-24 20:24:41.271
119
-
120
- {"type":"content_block_start","index":2,"content_block":{"type":"tool_use","id":"toolu_019Q1i316spMrh2ATHsDLHB8","name":"realtime-weather____fetchCurrentWeather","input":{}}}
121
- [chunk 29] 2024-6-24 20:24:41.626
122
-
123
- {"type":"content_block_delta","index":2,"delta":{"type":"input_json_delta","partial_json":""}}
124
- [chunk 30] 2024-6-24 20:24:41.626
125
-
126
- {"type":"content_block_delta","index":2,"delta":{"type":"input_json_delta","partial_json":"{\"city"}}
127
- [chunk 31] 2024-6-24 20:24:41.628
128
-
129
- {"type":"content_block_delta","index":2,"delta":{"type":"input_json_delta","partial_json":"\": \"\\u531"}}
130
- [chunk 32] 2024-6-24 20:24:41.631
131
-
132
- {"type":"content_block_delta","index":2,"delta":{"type":"input_json_delta","partial_json":"7\\u4eac"}}
133
- [chunk 33] 2024-6-24 20:24:41.634
134
-
135
- {"type":"content_block_delta","index":2,"delta":{"type":"input_json_delta","partial_json":"\"}"}}
136
- [chunk 34] 2024-6-24 20:24:41.641
137
33
 
138
- {"type":"content_block_stop","index":2}
139
- [chunk 35] 2024-6-24 20:24:41.644
140
-
141
- {"type":"message_delta","delta":{"stop_reason":"tool_use","stop_sequence":null},"usage":{"output_tokens":146}}
142
- [chunk 36] 2024-6-24 20:24:41.654
143
- {"type":"message_stop"}
144
-
145
- [stream finished] total chunks: 37
146
34
  ```
147
35
 
148
36
  </details>
@@ -153,804 +41,150 @@ tags:
153
41
 
154
42
  <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/a9a40899-d5f3-4ef2-aa08-922751b05ca6" />
155
43
 
156
- 从上述视频中可以看到, sonnet 虽然也支持流式 Tool Calling ,但是它表现出来的特征是在创建长句 tool calling 时会等待住(详见 Tool Calling 原始输出 `[chunk 40]` 和 `[chunk 41]` 中间的耗时)。所以相对来说会在 Tool Calling 的起始阶段有一个较长的等待时间。
44
+ 从上述视频中可以看到:
45
+ 1. Sonnet 3.5 支持流式 Tools Calling 和 Parallel Tools Calling;
46
+ 2. 在流式 Tools Calling 时,表现出来的特征是在创建长句会等待住(详见 Tools Calling 原始输出 `[chunk 40]` 和 `[chunk 41]` 中间的耗时达到 6s)。所以相对来说会在 Tools Calling 的起始阶段有一个较长的等待时间。
157
47
 
158
48
  <Image
159
- alt="Claude 3.5 Sonnet 复杂指令的 Tool Calling"
49
+ alt="Claude 3.5 Sonnet 复杂指令的 Tools Calling"
160
50
  src="https://github.com/lobehub/lobe-chat/assets/28616219/23e2d7e5-a6f3-4f4c-9c6a-5651f35a5910"
161
51
  />
162
52
 
163
- <details>
164
- <summary>Tool Calling 原始输出:</summary>
53
+ <details>
54
+ <summary>Tools Calling 原始输出:</summary>
165
55
 
166
56
  ```yml
167
- [stream start] 2024-6-24 20:39:9.670
168
-
169
- [chunk 0] 2024-6-24 20:39:9.695
170
- {"type":"message_start","message":{"id":"msg_01Kj3TFjatNCn9AzdGRfsGN9","type":"message","role":"assistant","model":"claude-3-5-sonnet-20240620","content":[],"stop_reason":null,"stop_sequence":null,"usage":{"input_tokens":1742,"output_tokens":2}}}
171
-
172
- [chunk 1] 2024-6-24 20:39:9.696
173
- {"type":"content_block_start","index":0,"content_block":{"type":"text","text":""}}
174
-
175
- [chunk 2] 2024-6-24 20:39:9.697
176
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"当"}}
177
-
178
- [chunk 3] 2024-6-24 20:39:9.698
179
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"然可以为"}}
180
-
181
- [chunk 4] 2024-6-24 20:39:9.699
182
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"您"}}
183
-
184
- [chunk 5] 2024-6-24 20:39:9.874
185
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"画一只小"}}
186
-
187
- [chunk 6] 2024-6-24 20:39:9.876
188
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"狗。"}}
189
-
190
- [chunk 7] 2024-6-24 20:39:9.877
191
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"我会"}}
192
-
193
- [chunk 8] 2024-6-24 20:39:9.878
194
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"使"}}
195
-
196
- [chunk 9] 2024-6-24 20:39:9.993
197
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"用l"}}
198
-
199
- [chunk 10] 2024-6-24 20:39:9.994
200
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"obe-image-"}}
201
-
202
- [chunk 11] 2024-6-24 20:39:9.995
203
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"designer工"}}
204
-
205
- [chunk 12] 2024-6-24 20:39:9.995
206
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"具来"}}
207
-
208
- [chunk 13] 2024-6-24 20:39:10.80
209
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"生"}}
210
-
211
- [chunk 14] 2024-6-24 20:39:10.81
212
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"成这些"}}
213
-
214
- [chunk 15] 2024-6-24 20:39:10.81
215
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"图片"}}
216
-
217
- [chunk 16] 2024-6-24 20:39:10.82
218
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"。"}}
219
-
220
- [chunk 17] 2024-6-24 20:39:10.196
221
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"我"}}
222
-
223
- [chunk 18] 2024-6-24 20:39:10.197
224
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"会"}}
225
-
226
- [chunk 19] 2024-6-24 20:39:10.198
227
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"创"}}
228
-
229
- [chunk 20] 2024-6-24 20:39:10.206
230
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"建"}}
231
-
232
- [chunk 21] 2024-6-24 20:39:10.314
233
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"四"}}
234
-
235
- [chunk 22] 2024-6-24 20:39:10.318
236
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"个不同的"}}
237
-
238
- [chunk 23] 2024-6-24 20:39:10.320
239
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"描"}}
240
-
241
- [chunk 24] 2024-6-24 20:39:10.326
242
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"述来"}}
243
-
244
- [chunk 25] 2024-6-24 20:39:10.439
245
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"生"}}
246
-
247
- [chunk 26] 2024-6-24 20:39:10.444
248
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"成多"}}
249
-
250
- [chunk 27] 2024-6-24 20:39:10.451
251
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"样"}}
252
-
253
- [chunk 28] 2024-6-24 20:39:10.452
254
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"化"}}
255
-
256
- [chunk 29] 2024-6-24 20:39:10.566
257
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"的小"}}
258
-
259
- [chunk 30] 2024-6-24 20:39:10.570
260
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"狗图像"}}
261
-
262
- [chunk 31] 2024-6-24 20:39:10.575
263
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"。请"}}
264
-
265
- [chunk 32] 2024-6-24 20:39:10.580
266
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"稍等片"}}
267
-
268
- [chunk 33] 2024-6-24 20:39:10.710
269
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"刻,"}}
270
-
271
- [chunk 34] 2024-6-24 20:39:10.718
272
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"我现"}}
273
-
274
- [chunk 35] 2024-6-24 20:39:10.721
275
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"在就"}}
276
-
277
- [chunk 36] 2024-6-24 20:39:10.724
278
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"开始生"}}
279
-
280
- [chunk 37] 2024-6-24 20:39:10.838
281
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"成图片"}}
282
-
283
- [chunk 38] 2024-6-24 20:39:11.102
284
- {"type":"content_block_delta","index":0,"delta":{"type":"text_delta","text":"。"}}
285
-
286
- [chunk 39] 2024-6-24 20:39:11.103
287
- {"type":"content_block_stop","index":0}
288
-
289
- [chunk 40] 2024-6-24 20:39:11.104
290
- {"type":"content_block_start","index":1,"content_block":{"type":"tool_use","id":"toolu_01PMfL65ktLVuwmUD4C29U6E","name":"lobe-image-designer____text2image____builtin","input":{}}}
291
-
292
- [chunk 41] 2024-6-24 20:39:16.676
293
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":""}}
294
-
295
- [chunk 42] 2024-6-24 20:39:16.687
296
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"{\"prompt"}}
297
-
298
- [chunk 43] 2024-6-24 20:39:16.695
299
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"s\": [\"Photo"}}
300
-
301
- [chunk 44] 2024-6-24 20:39:16.699
302
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" of an "}}
303
-
304
- [chunk 45] 2024-6-24 20:39:16.706
305
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"adorable"}}
306
-
307
- [chunk 46] 2024-6-24 20:39:16.714
308
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" sma"}}
309
-
310
- [chunk 47] 2024-6-24 20:39:16.715
311
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ll puppy w"}}
312
-
313
- [chunk 48] 2024-6-24 20:39:16.726
314
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ith fluf"}}
315
-
316
- [chunk 49] 2024-6-24 20:39:16.727
317
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"fy fur, si"}}
318
-
319
- [chunk 50] 2024-6-24 20:39:16.733
320
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"tting o"}}
321
-
322
- [chunk 51] 2024-6-24 20:39:16.735
323
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"n a"}}
324
-
325
- [chunk 52] 2024-6-24 20:39:16.743
326
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" sof"}}
327
-
328
- [chunk 53] 2024-6-24 20:39:16.744
329
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"t g"}}
330
-
331
- [chunk 54] 2024-6-24 20:39:16.751
332
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"reen "}}
333
-
334
- [chunk 55] 2024-6-24 20:39:16.752
335
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"grass"}}
336
-
337
- [chunk 56] 2024-6-24 20:39:16.758
338
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" lawn"}}
339
-
340
- [chunk 57] 2024-6-24 20:39:16.759
341
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":". The p"}}
342
-
343
- [chunk 58] 2024-6-24 20:39:16.759
344
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"uppy ha"}}
345
-
346
- [chunk 59] 2024-6-24 20:39:16.765
347
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"s big"}}
348
-
349
- [chunk 60] 2024-6-24 20:39:16.771
350
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", "}}
351
-
352
- [chunk 61] 2024-6-24 20:39:16.771
353
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"expressiv"}}
354
-
355
- [chunk 62] 2024-6-24 20:39:16.772
356
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e eyes an"}}
357
-
358
- [chunk 63] 2024-6-24 20:39:16.777
359
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d "}}
360
-
361
- [chunk 64] 2024-6-24 20:39:16.778
362
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"flop"}}
363
-
364
- [chunk 65] 2024-6-24 20:39:16.783
365
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"py e"}}
366
-
367
- [chunk 66] 2024-6-24 20:39:16.783
368
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ars"}}
369
-
370
- [chunk 67] 2024-6-24 20:39:16.790
371
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":". It's ti"}}
372
-
373
- [chunk 68] 2024-6-24 20:39:16.790
374
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"lting it"}}
375
-
376
- [chunk 69] 2024-6-24 20:39:16.796
377
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"s head "}}
378
-
379
- [chunk 70] 2024-6-24 20:39:16.797
380
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"curio"}}
381
-
382
- [chunk 71] 2024-6-24 20:39:16.797
383
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"usly, l"}}
384
-
385
- [chunk 72] 2024-6-24 20:39:16.798
386
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ooking dir"}}
387
-
388
- [chunk 73] 2024-6-24 20:39:16.809
389
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ectly "}}
390
-
391
- [chunk 74] 2024-6-24 20:39:16.811
392
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"at"}}
393
-
394
- [chunk 75] 2024-6-24 20:39:16.811
395
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" the cam"}}
396
-
397
- [chunk 76] 2024-6-24 20:39:16.812
398
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"era. The b"}}
399
-
400
- [chunk 77] 2024-6-24 20:39:16.812
401
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ackgr"}}
402
-
403
- [chunk 78] 2024-6-24 20:39:16.813
404
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ou"}}
405
-
406
- [chunk 79] 2024-6-24 20:39:16.813
407
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"nd"}}
408
-
409
- [chunk 80] 2024-6-24 20:39:16.818
410
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" is "}}
411
-
412
- [chunk 81] 2024-6-24 20:39:16.819
413
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"slightly "}}
414
-
415
- [chunk 82] 2024-6-24 20:39:16.820
416
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"blu"}}
417
-
418
- [chunk 83] 2024-6-24 20:39:16.820
419
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"rred, focusi"}}
420
-
421
- [chunk 84] 2024-6-24 20:39:16.829
422
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ng"}}
423
-
424
- [chunk 85] 2024-6-24 20:39:16.830
425
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" attenti"}}
426
-
427
- [chunk 86] 2024-6-24 20:39:16.830
428
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"on on the "}}
429
-
430
- [chunk 87] 2024-6-24 20:39:16.831
431
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"cute puppy i"}}
432
-
433
- [chunk 88] 2024-6-24 20:39:16.831
434
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"n "}}
435
-
436
- [chunk 89] 2024-6-24 20:39:16.837
437
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"the foreg"}}
438
-
439
- [chunk 90] 2024-6-24 20:39:16.838
440
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"round. W"}}
441
-
442
- [chunk 91] 2024-6-24 20:39:16.838
443
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"arm, n"}}
444
-
445
- [chunk 92] 2024-6-24 20:39:16.839
446
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"atur"}}
447
-
448
- [chunk 93] 2024-6-24 20:39:16.839
449
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"al lighting"}}
450
-
451
- [chunk 94] 2024-6-24 20:39:16.840
452
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" enhances "}}
453
-
454
- [chunk 95] 2024-6-24 20:39:16.851
455
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"the pup"}}
456
-
457
- [chunk 96] 2024-6-24 20:39:16.851
458
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"py's featu"}}
459
-
460
- [chunk 97] 2024-6-24 20:39:16.852
461
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"res.\""}}
462
-
463
- [chunk 98] 2024-6-24 20:39:16.856
464
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", \"Wa"}}
465
-
466
- [chunk 99] 2024-6-24 20:39:16.857
467
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ter"}}
468
-
469
- [chunk 100] 2024-6-24 20:39:16.859
470
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"color "}}
471
57
 
472
- [chunk 101] 2024-6-24 20:39:16.861
473
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"painti"}}
474
-
475
- [chunk 102] 2024-6-24 20:39:16.868
476
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ng o"}}
477
-
478
- [chunk 103] 2024-6-24 20:39:16.868
479
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"f a playfu"}}
480
-
481
- [chunk 104] 2024-6-24 20:39:16.869
482
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"l puppy ch"}}
483
-
484
- [chunk 105] 2024-6-24 20:39:16.876
485
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"asing a"}}
486
-
487
- [chunk 106] 2024-6-24 20:39:16.877
488
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" r"}}
489
-
490
- [chunk 107] 2024-6-24 20:39:16.877
491
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ed ball"}}
492
-
493
- [chunk 108] 2024-6-24 20:39:16.877
494
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" in a "}}
495
-
496
- [chunk 109] 2024-6-24 20:39:16.878
497
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"sun"}}
498
-
499
- [chunk 110] 2024-6-24 20:39:16.878
500
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ny park. T"}}
501
-
502
- [chunk 111] 2024-6-24 20:39:16.879
503
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"he"}}
504
-
505
- [chunk 112] 2024-6-24 20:39:16.879
506
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" pu"}}
507
-
508
- [chunk 113] 2024-6-24 20:39:16.879
509
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ppy is mi"}}
510
-
511
- [chunk 114] 2024-6-24 20:39:16.886
512
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d-le"}}
513
-
514
- [chunk 115] 2024-6-24 20:39:16.886
515
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ap, its paw"}}
516
-
517
- [chunk 116] 2024-6-24 20:39:16.887
518
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"s "}}
519
-
520
- [chunk 117] 2024-6-24 20:39:16.898
521
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"off th"}}
522
-
523
- [chunk 118] 2024-6-24 20:39:16.898
524
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e ground,"}}
525
-
526
- [chunk 119] 2024-6-24 20:39:16.899
527
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" with a j"}}
528
-
529
- [chunk 120] 2024-6-24 20:39:16.899
530
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"oyful"}}
531
-
532
- [chunk 121] 2024-6-24 20:39:16.906
533
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" e"}}
534
-
535
- [chunk 122] 2024-6-24 20:39:16.907
536
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"xp"}}
537
-
538
- [chunk 123] 2024-6-24 20:39:16.907
539
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ressi"}}
540
-
541
- [chunk 124] 2024-6-24 20:39:16.907
542
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"on. Its fur"}}
543
-
544
- [chunk 125] 2024-6-24 20:39:16.908
545
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" is paint"}}
546
-
547
- [chunk 126] 2024-6-24 20:39:16.908
548
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ed wi"}}
549
-
550
- [chunk 127] 2024-6-24 20:39:16.909
551
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"th soft, "}}
552
-
553
- [chunk 128] 2024-6-24 20:39:16.928
554
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ble"}}
555
-
556
- [chunk 129] 2024-6-24 20:39:16.929
557
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"nded brush"}}
558
-
559
- [chunk 130] 2024-6-24 20:39:16.929
560
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" str"}}
561
-
562
- [chunk 131] 2024-6-24 20:39:16.930
563
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"oke"}}
564
-
565
- [chunk 132] 2024-6-24 20:39:16.930
566
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"s, giving "}}
567
-
568
- [chunk 133] 2024-6-24 20:39:16.931
569
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"it a "}}
570
-
571
- [chunk 134] 2024-6-24 20:39:16.931
572
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"dre"}}
573
-
574
- [chunk 135] 2024-6-24 20:39:16.931
575
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"amy qua"}}
576
-
577
- [chunk 136] 2024-6-24 20:39:16.932
578
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"lity. Splas"}}
579
-
580
- [chunk 137] 2024-6-24 20:39:16.939
581
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"hes of bri"}}
582
-
583
- [chunk 138] 2024-6-24 20:39:16.940
584
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"gh"}}
585
-
586
- [chunk 139] 2024-6-24 20:39:16.951
587
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"t colors"}}
588
-
589
- [chunk 140] 2024-6-24 20:39:16.952
590
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" in "}}
591
-
592
- [chunk 141] 2024-6-24 20:39:16.952
593
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"the backgr"}}
594
-
595
- [chunk 142] 2024-6-24 20:39:16.953
596
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ound sugge"}}
597
-
598
- [chunk 143] 2024-6-24 20:39:16.953
599
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"st flowers a"}}
600
-
601
- [chunk 144] 2024-6-24 20:39:16.953
602
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"nd tre"}}
603
-
604
- [chunk 145] 2024-6-24 20:39:16.960
605
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"es.\", \""}}
606
-
607
- [chunk 146] 2024-6-24 20:39:16.961
608
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"Cartoon"}}
609
-
610
- [chunk 147] 2024-6-24 20:39:16.962
611
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" illust"}}
612
-
613
- [chunk 148] 2024-6-24 20:39:16.963
614
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ration"}}
615
-
616
- [chunk 149] 2024-6-24 20:39:16.963
617
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" of a misc"}}
618
-
619
- [chunk 150] 2024-6-24 20:39:16.964
620
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"hievous pupp"}}
621
-
622
- [chunk 151] 2024-6-24 20:39:17.43
623
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"y "}}
624
-
625
- [chunk 152] 2024-6-24 20:39:17.45
626
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"tangled in "}}
627
-
628
- [chunk 153] 2024-6-24 20:39:17.49
629
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"a ball of br"}}
630
-
631
- [chunk 154] 2024-6-24 20:39:17.50
632
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ight blue"}}
633
-
634
- [chunk 155] 2024-6-24 20:39:17.50
635
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" yarn. Th"}}
636
-
637
- [chunk 156] 2024-6-24 20:39:17.51
638
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e pu"}}
639
-
640
- [chunk 157] 2024-6-24 20:39:17.54
641
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ppy has"}}
642
-
643
- [chunk 158] 2024-6-24 20:39:17.69
644
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" exagger"}}
645
-
646
- [chunk 159] 2024-6-24 20:39:17.69
647
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ate"}}
648
-
649
- [chunk 160] 2024-6-24 20:39:17.101
650
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d features "}}
651
-
652
- [chunk 161] 2024-6-24 20:39:17.102
653
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"with big,"}}
654
-
655
- [chunk 162] 2024-6-24 20:39:17.114
656
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" r"}}
657
-
658
- [chunk 163] 2024-6-24 20:39:17.115
659
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"oun"}}
660
-
661
- [chunk 164] 2024-6-24 20:39:17.115
662
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d eyes "}}
663
-
664
- [chunk 165] 2024-6-24 20:39:17.116
665
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"and a small"}}
666
-
667
- [chunk 166] 2024-6-24 20:39:17.116
668
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" pink t"}}
669
-
670
- [chunk 167] 2024-6-24 20:39:17.116
671
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ongue st"}}
672
-
673
- [chunk 168] 2024-6-24 20:39:17.123
674
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ic"}}
675
-
676
- [chunk 169] 2024-6-24 20:39:17.124
677
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ki"}}
678
-
679
- [chunk 170] 2024-6-24 20:39:17.124
680
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ng"}}
681
-
682
- [chunk 171] 2024-6-24 20:39:17.125
683
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" out. Th"}}
684
-
685
- [chunk 172] 2024-6-24 20:39:17.125
686
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e yarn is s"}}
687
-
688
- [chunk 173] 2024-6-24 20:39:17.136
689
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"trew"}}
690
-
691
- [chunk 174] 2024-6-24 20:39:17.137
692
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"n ab"}}
693
-
694
- [chunk 175] 2024-6-24 20:39:17.137
695
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ou"}}
696
-
697
- [chunk 176] 2024-6-24 20:39:17.144
698
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"t in "}}
699
-
700
- [chunk 177] 2024-6-24 20:39:17.144
701
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"a co"}}
702
-
703
- [chunk 178] 2024-6-24 20:39:17.145
704
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"mical m"}}
705
-
706
- [chunk 179] 2024-6-24 20:39:17.145
707
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"anner, "}}
708
-
709
- [chunk 180] 2024-6-24 20:39:17.145
710
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"with the pu"}}
711
-
712
- [chunk 181] 2024-6-24 20:39:17.146
713
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"pp"}}
714
-
715
- [chunk 182] 2024-6-24 20:39:17.146
716
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"y s"}}
717
-
718
- [chunk 183] 2024-6-24 20:39:17.147
719
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"itting in "}}
720
-
721
- [chunk 184] 2024-6-24 20:39:17.157
722
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"the cent"}}
723
-
724
- [chunk 185] 2024-6-24 20:39:17.166
725
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"er lookin"}}
726
-
727
- [chunk 186] 2024-6-24 20:39:17.166
728
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"g both co"}}
729
-
730
- [chunk 187] 2024-6-24 20:39:17.166
731
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"nfused"}}
732
-
733
- [chunk 188] 2024-6-24 20:39:17.167
734
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" and p"}}
735
-
736
- [chunk 189] 2024-6-24 20:39:17.167
737
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"leased with "}}
738
-
739
- [chunk 190] 2024-6-24 20:39:17.168
740
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"itself. B"}}
741
-
742
- [chunk 191] 2024-6-24 20:39:17.169
743
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"old"}}
744
-
745
- [chunk 192] 2024-6-24 20:39:17.169
746
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", vibrant"}}
747
-
748
- [chunk 193] 2024-6-24 20:39:17.169
749
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" colors "}}
750
-
751
- [chunk 194] 2024-6-24 20:39:17.170
752
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"and clean"}}
753
-
754
- [chunk 195] 2024-6-24 20:39:17.182
755
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" lines defin"}}
756
-
757
- [chunk 196] 2024-6-24 20:39:17.183
758
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e the styl"}}
759
-
760
- [chunk 197] 2024-6-24 20:39:17.183
761
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e.\","}}
762
-
763
- [chunk 198] 2024-6-24 20:39:17.183
764
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" \"Oil painti"}}
58
+ ```
765
59
 
766
- [chunk 199] 2024-6-24 20:39:17.184
767
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ng of"}}
60
+ </details>
768
61
 
769
- [chunk 200] 2024-6-24 20:39:17.185
770
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" a sl"}}
62
+ ## Claude 3 Opus
771
63
 
772
- [chunk 201] 2024-6-24 20:39:17.185
773
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"eepy puppy "}}
64
+ ### 简单调用指令:天气查询
774
65
 
775
- [chunk 202] 2024-6-24 20:39:17.185
776
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"curle"}}
66
+ 测试指令:指令
777
67
 
778
- [chunk 203] 2024-6-24 20:39:17.186
779
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d u"}}
780
68
 
781
- [chunk 204] 2024-6-24 20:39:17.186
782
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"p in a "}}
69
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/0e120fa2-8410-4552-a947-5ab7a91d994d" />
783
70
 
784
- [chunk 205] 2024-6-24 20:39:17.187
785
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"cozy wic"}}
71
+ 从上述视频中看到:
72
+ 1. Claude 3 Opus 在调用 Tools 的起点会输出一段 <thinking> 标签的内容,这段内容对于用户来说几乎没有什么帮助,反而带来了较多的 Token 消耗;
73
+ 2. Opus 会触发两次 Tools Calling,说明它并不支持 Parallel Tools Calling;
74
+ 3. 从 Tools Calling 的原始输出来看, Opus 也是支持流式 Tools Calling 的
786
75
 
787
- [chunk 206] 2024-6-24 20:39:17.198
788
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ker ba"}}
76
+ <Image
77
+ alt="Claude 3 Opus 简单指令的 Tools Calling"
78
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/fa2f89bc-b9d5-43e3-a15e-1e79174d002c"
79
+ />
789
80
 
790
- [chunk 207] 2024-6-24 20:39:17.199
791
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"sket. The pu"}}
792
81
 
793
- [chunk 208] 2024-6-24 20:39:17.199
794
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ppy is"}}
795
82
 
796
- [chunk 209] 2024-6-24 20:39:17.200
797
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" a m"}}
83
+ <details>
84
+ <summary>Tools Calling 原始输出:</summary>
798
85
 
799
- [chunk 210] 2024-6-24 20:39:17.200
800
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ix o"}}
801
86
 
802
- [chunk 211] 2024-6-24 20:39:17.200
803
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"f brown "}}
87
+ </details>
804
88
 
805
- [chunk 212] 2024-6-24 20:39:17.201
806
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"and"}}
807
89
 
808
- [chunk 213] 2024-6-24 20:39:17.201
809
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" whit"}}
90
+ ### 复杂调用指令:文生图
810
91
 
811
- [chunk 214] 2024-6-24 20:39:17.202
812
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e fur, wi"}}
92
+ 测试指令:指令
813
93
 
814
- [chunk 215] 2024-6-24 20:39:17.202
815
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"th on"}}
94
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/b2dc8cd9-2582-43fe-9121-29c20a1cdc7b" />
816
95
 
817
- [chunk 216] 2024-6-24 20:39:17.202
818
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e eye sl"}}
96
+ 从上述视频中看到:
97
+ 1. 结合简单任务, Opus 的工具调用一定会输出 <thinking> 标签,这其实对体验影响非常大
98
+ 2. Opus 输出的 prompts 字段是字符串,而不是数组,导致报错,无法正常调用插件。
819
99
 
820
- [chunk 217] 2024-6-24 20:39:17.213
821
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ightly open "}}
100
+ <Image
101
+ alt="Claude 3 Opus 复杂指令的 Tools Calling"
102
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/1eee785d-932f-4320-845e-eed0bee4b1ae"
103
+ />
822
104
 
823
- [chunk 218] 2024-6-24 20:39:17.214
824
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"as if"}}
105
+ <details>
106
+ <summary>Tools Calling 原始输出:</summary>
825
107
 
826
- [chunk 219] 2024-6-24 20:39:17.214
827
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" just w"}}
828
108
 
829
- [chunk 220] 2024-6-24 20:39:17.215
830
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"aking up"}}
109
+ </details>
831
110
 
832
- [chunk 221] 2024-6-24 20:39:17.215
833
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":". Soft"}}
111
+ ## Claude 3 Sonnet
834
112
 
835
- [chunk 222] 2024-6-24 20:39:17.215
836
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", wa"}}
113
+ ### 简单调用指令:天气查询
837
114
 
838
- [chunk 223] 2024-6-24 20:39:17.216
839
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"rm light"}}
115
+ 测试指令:指令
840
116
 
841
- [chunk 224] 2024-6-24 20:39:17.216
842
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" fi"}}
117
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/600becd5-7f12-4a9a-86c7-e5cca0db6b1b" />
843
118
 
844
- [chunk 225] 2024-6-24 20:39:17.217
845
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"lters th"}}
119
+ 从上述视频中可以看出,Claude 3 Sonnet 会调用两次 Tools Calling,说明它并不支持 Parallel Tools Calling。
846
120
 
847
- [chunk 226] 2024-6-24 20:39:17.217
848
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"rough"}}
121
+ <Image
122
+ alt="Claude 3 Sonnet 简单指令的 Tools Calling"
123
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/e82f5c69-7607-488f-8c10-0482fb380c6c"
124
+ />
849
125
 
850
- [chunk 227] 2024-6-24 20:39:17.217
851
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" a "}}
852
126
 
853
- [chunk 228] 2024-6-24 20:39:17.227
854
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"nearby"}}
127
+ <details>
128
+ <summary>Tools Calling 原始输出:</summary>
855
129
 
856
- [chunk 229] 2024-6-24 20:39:17.228
857
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" windo"}}
858
130
 
859
- [chunk 230] 2024-6-24 20:39:17.228
860
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"w, casti"}}
131
+ </details>
861
132
 
862
- [chunk 231] 2024-6-24 20:39:17.229
863
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ng gen"}}
133
+ ### 复杂调用指令:文生图
864
134
 
865
- [chunk 232] 2024-6-24 20:39:17.229
866
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"tle shado"}}
135
+ 测试指令:指令
867
136
 
868
- [chunk 233] 2024-6-24 20:39:17.230
869
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ws. Th"}}
870
137
 
871
- [chunk 234] 2024-6-24 20:39:17.230
872
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"e texture o"}}
138
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/c150aa5f-36bc-40f2-a779-9c4fdcf2cd4c" />
873
139
 
874
- [chunk 235] 2024-6-24 20:39:17.230
875
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"f the fu"}}
140
+ 从上述视频中可以看到, Sonnet 3 在复杂指令调用下就失败了。报错原因是 prompts 原本预期为一个数组,但是生成的却是一个字符串。
876
141
 
877
- [chunk 236] 2024-6-24 20:39:17.231
878
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"r an"}}
142
+ <Image
143
+ alt="Claude 3.5 Sonnet 复杂指令的 Tools Calling"
144
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/b7d84e26-920d-4a82-8798-1b1060ebb341"
145
+ />
879
146
 
880
- [chunk 237] 2024-6-24 20:39:17.231
881
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"d b"}}
147
+ <details>
148
+ <summary>Tools Calling 原始输出:</summary>
882
149
 
883
- [chunk 238] 2024-6-24 20:39:17.239
884
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"asket "}}
885
150
 
886
- [chunk 239] 2024-6-24 20:39:17.242
887
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"are r"}}
888
151
 
889
- [chunk 240] 2024-6-24 20:39:17.243
890
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"end"}}
152
+ </details>
891
153
 
892
- [chunk 241] 2024-6-24 20:39:17.243
893
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ered "}}
154
+ ## Claude 3 Haiku
894
155
 
895
- [chunk 242] 2024-6-24 20:39:17.244
896
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"in fine det"}}
897
156
 
898
- [chunk 243] 2024-6-24 20:39:17.244
899
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"ail"}}
157
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/02b3e872-735a-4928-8245-a90786acea8b" />
900
158
 
901
- [chunk 244] 2024-6-24 20:39:17.245
902
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", c"}}
159
+ 从上述视频中可以看出:
903
160
 
904
- [chunk 245] 2024-6-24 20:39:17.245
905
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"re"}}
161
+ 1. Claude 3 Haiku 会调用两次 Tools Calling,说明它也不支持 Parallel Tools Calling;
162
+ 2. Haiku 并没有回答好的,也是直接调用的工具;
906
163
 
907
- [chunk 246] 2024-6-24 20:39:17.252
908
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"atin"}}
909
164
 
910
- [chunk 247] 2024-6-24 20:39:17.253
911
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"g a sense"}}
165
+ <Image
166
+ alt="Claude 3 Haiku 简单指令的 Tools Calling"
167
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/9081b586-cf43-440f-8ef8-1de5d8658694"
168
+ />
912
169
 
913
- [chunk 248] 2024-6-24 20:39:17.253
914
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":" of comfort "}}
915
170
 
916
- [chunk 249] 2024-6-24 20:39:17.253
917
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"and tranq"}}
171
+ ### 复杂调用指令:文生图
918
172
 
919
- [chunk 250] 2024-6-24 20:39:17.254
920
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"uility."}}
173
+ 测试指令:指令
921
174
 
922
- [chunk 251] 2024-6-24 20:39:17.265
923
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"\"]"}}
924
175
 
925
- [chunk 252] 2024-6-24 20:39:17.266
926
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":", \"size\": \"1"}}
176
+ <Video src="https://github.com/lobehub/lobe-chat/assets/28616219/d1e3f804-0b89-4b90-9d78-69aee0db1c4d" />
927
177
 
928
- [chunk 253] 2024-6-24 20:39:17.266
929
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"024x1024"}}
178
+ 从上述视频中可以看到, Haiku 3 在复杂指令调用下也是失败的。报错原因同样是 prompts 生成了字符串而不是数组。
930
179
 
931
- [chunk 254] 2024-6-24 20:39:17.266
932
- {"type":"content_block_delta","index":1,"delta":{"type":"input_json_delta","partial_json":"\"}"}}
180
+ <Image
181
+ alt="Claude 3 Haiku 复杂指令的 Tools Calling"
182
+ src="https://github.com/lobehub/lobe-chat/assets/28616219/cde80220-4615-43bb-934f-35fe0de88754"
183
+ />
933
184
 
934
- [chunk 255] 2024-6-24 20:39:17.267
935
- {"type":"content_block_stop","index":1}
185
+ <details>
186
+ <summary>Tools Calling 原始输出:</summary>
936
187
 
937
- [chunk 256] 2024-6-24 20:39:17.267
938
- {"type":"message_delta","delta":{"stop_reason":"tool_use","stop_sequence":null},"usage":{"output_tokens":492}}
939
188
 
940
- [chunk 257] 2024-6-24 20:39:17.271
941
- {"type":"message_stop"}
942
- ```
943
189
 
944
190
  </details>
945
-
946
- ## Claude 3 Opus
947
-
948
- TODO
949
-
950
- ## Claude 3 Sonnet
951
-
952
- TODO
953
-
954
- ## Claude 3 Haiku
955
-
956
- TODO