streamdown 0.18.0__tar.gz → 0.19.0__tar.gz

{streamdown-0.18.0 → streamdown-0.19.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: streamdown
-Version: 0.18.0
+Version: 0.19.0
 Summary: A streaming markdown renderer for modern terminals with syntax highlighting
 Project-URL: Homepage, https://github.com/kristopolous/Streamdown
 Project-URL: Bug Tracker, https://github.com/kristopolous/Streamdown/issues
@@ -44,12 +44,12 @@ $ pip install streamdown
 ![Streamdown is Amazing](https://github.com/user-attachments/assets/268cb340-78cc-4df0-a773-c5ac95eceeeb)
 
 ### Provides clean copyable code for long code lines
-Some *inferior* renderers inject line breaks when copying code that wraps around. We're better and now you are too!
+Other renderers inject line breaks when copying code that wraps around. We're better and now you are too!
 ![Handle That Mandle](https://github.com/user-attachments/assets/a27aa70c-f691-4796-84f0-c2eb18c7de23)
 **Tip**: You can make things prettier if you don't mind if this guarantee is broken. See the `PrettyBroken` flag below!
 
 ### Supports images
-Here's kitty and alacritty. Try to do that in glow...
+Here's kitty and alacritty. 
 ![doggie](https://github.com/user-attachments/assets/81c43983-68cd-40c1-b1d5-aa3a52004504)
 
 ### Supports hyperlinks (OSC 8) and clipboard (OSC 52)
@@ -58,11 +58,12 @@ Here's kitty and alacritty. Try to do that in glow...
 ### Supports tables
 ![table](https://github.com/user-attachments/assets/dbe3d13e-6bac-4f45-bf30-f1857ed98898)
 
-As well as everything else...
+#### As well as everything else...
 ![dunder](https://github.com/user-attachments/assets/d41d7fec-6dec-4387-b53d-f2098f269a5e)
 
-Very ... Carefully ... Supported ... 
-![cjk1](https://github.com/user-attachments/assets/75162ade-4734-440e-aaa3-5ffc17a0dd46)
+#### ...even CJK 
+Compare how streamdown wraps around and spaces this tabular Chinese description of programming languages to the same file using glow.
+![cjk](https://github.com/user-attachments/assets/b831a5f3-7ef0-48b8-8d17-bb7b605df16a)
 
 ### Colors are highly (and quickly) configurable for people who care a lot, or just a little.
 ![configurable](https://github.com/user-attachments/assets/19ca2ec9-8ea1-4a79-87ca-8352789269fe)

{streamdown-0.18.0 → streamdown-0.19.0}/README.md

@@ -15,12 +15,12 @@ $ pip install streamdown
 ![Streamdown is Amazing](https://github.com/user-attachments/assets/268cb340-78cc-4df0-a773-c5ac95eceeeb)
 
 ### Provides clean copyable code for long code lines
-Some *inferior* renderers inject line breaks when copying code that wraps around. We're better and now you are too!
+Other renderers inject line breaks when copying code that wraps around. We're better and now you are too!
 ![Handle That Mandle](https://github.com/user-attachments/assets/a27aa70c-f691-4796-84f0-c2eb18c7de23)
 **Tip**: You can make things prettier if you don't mind if this guarantee is broken. See the `PrettyBroken` flag below!
 
 ### Supports images
-Here's kitty and alacritty. Try to do that in glow...
+Here's kitty and alacritty. 
 ![doggie](https://github.com/user-attachments/assets/81c43983-68cd-40c1-b1d5-aa3a52004504)
 
 ### Supports hyperlinks (OSC 8) and clipboard (OSC 52)
@@ -29,11 +29,12 @@ Here's kitty and alacritty. Try to do that in glow...
 ### Supports tables
 ![table](https://github.com/user-attachments/assets/dbe3d13e-6bac-4f45-bf30-f1857ed98898)
 
-As well as everything else...
+#### As well as everything else...
 ![dunder](https://github.com/user-attachments/assets/d41d7fec-6dec-4387-b53d-f2098f269a5e)
 
-Very ... Carefully ... Supported ... 
-![cjk1](https://github.com/user-attachments/assets/75162ade-4734-440e-aaa3-5ffc17a0dd46)
+#### ...even CJK 
+Compare how streamdown wraps around and spaces this tabular Chinese description of programming languages to the same file using glow.
+![cjk](https://github.com/user-attachments/assets/b831a5f3-7ef0-48b8-8d17-bb7b605df16a)
 
 ### Colors are highly (and quickly) configurable for people who care a lot, or just a little.
 ![configurable](https://github.com/user-attachments/assets/19ca2ec9-8ea1-4a79-87ca-8352789269fe)

{streamdown-0.18.0 → streamdown-0.19.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "streamdown"
-version = "0.18.0"
+version = "0.19.0"
 description = "A streaming markdown renderer for modern terminals with syntax highlighting"
 readme = "README.md"
 requires-python = ">=3.8"

{streamdown-0.18.0 → streamdown-0.19.0}/streamdown/sd.py

@@ -337,10 +337,10 @@ def ansi_collapse(codelist, inp):
 
 
 def split_text(text):
-    return re.split(
-        r'(?<=[\u4E00-\u9FFF\u3400-\u4DBF\uF900-\uFAFF])|(?=[\u4E00-\u9FFF\u3400-\u4DBF\uF900-\uFAFF])|\s+',
+    return [x for x in re.split(
+        r'(?<=[\u3000-\u303F\u4E00-\u9FFF\u3400-\u4DBF\uF900-\uFAFF])|(?=[\u4E00-\u9FFF\u3400-\u4DBF\uF900-\uFAFF])|\s+',
         text
-    )
+    ) if x]
 
 def text_wrap(text, width = -1, indent = 0, first_line_prefix="", subsequent_line_prefix="", force_truncate=False):
     if width == -1:
@@ -352,6 +352,7 @@ def text_wrap(text, width = -1, indent = 0, first_line_prefix="", subsequent_lin
     current_line = ""
     current_style = []
     
+    oldword = ''
     for word in words:
         # we apply the style if we see it at the beginning of the word
         codes = extract_ansi_codes(word)
@@ -360,8 +361,12 @@ def text_wrap(text, width = -1, indent = 0, first_line_prefix="", subsequent_lin
             current_style.append(codes.pop(0))
 
         if len(word) and visible_length(current_line) + visible_length(word) + 1 <= width:  # +1 for space
-
-            current_line += (" " if len(visible(word)) > 0 and current_line and not cjk_count(word) else "") + word
+            space = ""
+            if len(visible(word)) > 0 and current_line:
+                space = " "
+            if (":" in visible(word) or cjk_count(word)) and cjk_count(oldword):
+                space = ""
+            current_line += space + word
         else:
             # Word doesn't fit, finalize the previous line
             prefix = first_line_prefix if not lines else subsequent_line_prefix
@@ -383,6 +388,8 @@ def text_wrap(text, width = -1, indent = 0, first_line_prefix="", subsequent_lin
         if codes:
             current_style = ansi_collapse(current_style, codes)
 
+        oldword = word
+
     if len(lines) < 1:
         return []
 
@@ -834,7 +841,7 @@ def parse(stream):
         # This is intentional ... we can get here in llama 4 using
         # a weird thing
         if state.in_list:
-            indent = (len(state.list_item_stack) - 1) * Style.ListIndent + (len(bullet) - 1)
+            indent = (len(state.list_item_stack) - 1) * Style.ListIndent #+ (len(bullet) - 1)
             wrap_width = state.current_width() - indent - (2 * Style.ListIndent) 
             
             wrapped_lineList = text_wrap(content, wrap_width, Style.ListIndent,

streamdown-0.19.0/tests/cjj.mv

@@ -0,0 +1,4 @@
+| 特性               | Ruby                            | Python                          | OCaml                          |
+|------------------|--------------------------------|--------------------------------|-------------------------------|
+| **适用场景**       | 快速开发、Web 应用、自动化脚本    | 数据科学、机器学习、Web 开发、自动化脚本 | 性能关键的应用、编译器开发、金融建模 |
+

streamdown-0.19.0/tests/cjk-table.md

@@ -0,0 +1,13 @@
+| 特性               | Ruby                            | Python                          | OCaml                          |
+|------------------|--------------------------------|--------------------------------|-------------------------------|
+| **设计哲学**       | 使编程更加自然和有趣              | 强调代码的可读性和简洁性          | 提供高效的函数式编程功能        |
+| **应用领域**       | Web 开发、自动化脚本、原型开发    | Web 开发、数据科学、机器学习、自动化脚本 | 编译器开发、系统编程、金融建模  |
+| **特点**           | 动态类型、面向对象、元编程能力强  | 动态类型、面向对象、大量第三方库支持  | 静态类型、函数式编程、模块化、高性能 |
+| **语法示例**       | ```ruby<br>class Greeter<br>  def initialize(name)<br>    @name = name<br>  end<br><br>  def greet<br>    puts "Hello, #{@name}!"<br>  end<br>end<br><br>greeter = Greeter.new("World")<br>greeter.greet``` | ```python<br>class Greeter:<br>  def __init__(self, name):<br>    self.name = name<br><br>  def greet(self):<br>    print(f"Hello, {self.name}!")<br><br>greeter = Greeter("World")<br>greeter.greet()``` | ```ocaml<br>type greeter = {<br>  name: string;<br>}<br><br>let greet {name} =<br>  print_endline ("Hello, " ^ name ^ "!")<br><br>let greeter = {name = "World"}<br>let () = greet greeter``` |
+| **性能**           | 相对较低，但通过 JRuby、TruffleRuby 可以提高性能 | 适中，通过 Cython、PyPy 可以显著提高性能 | 高，编译后的代码接近 C 语言的性能 |
+| **优点**           | 开发速度快，社区活跃             | 丰富的第三方库，应用广泛          | 适合性能关键的应用，编译器优化能力强 |
+| **生态系统**       | Ruby on Rails 是最著名的 Web 框架，其他库和工具也很丰富 | 丰富的第三方库，如 NumPy、Pandas、Django、Flask | 相对较少，但有高质量的库，如 Core 和 Async |
+| **学习曲线**       | 较平缓，语法灵活，适合初学者      | 平坦，语法清晰，适合初学者        | 较陡峭，需要理解函数式编程概念    |
+| **文档**           | 丰富，社区支持好                 | 丰富，有大量的教程和资源          | 适中，但社区提供的资源质量高      |
+| **适用场景**       | 快速开发、Web 应用、自动化脚本    | 数据科学、机器学习、Web 开发、自动化脚本 | 性能关键的应用、编译器开发、金融建模 |
+