llguidance 0.7.29__cp39-abi3-win_amd64.whl → 0.7.30__cp39-abi3-win_amd64.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
llguidance/_lib.pyd CHANGED
Binary file
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: llguidance
3
- Version: 0.7.29
3
+ Version: 0.7.30
4
4
  License-File: LICENSE
5
5
  Summary: Bindings for the Low-level Guidance (llguidance) Rust library for use within Guidance
6
6
  Author: Michal Moskal
@@ -20,6 +20,7 @@ Project-URL: issue_tracker, https://github.com/microsoft/llguidance/issues
20
20
 
21
21
  ---
22
22
 
23
+ * 2025-06-11 [Making Structured Outputs Go Brrr](https://guidance-ai.github.io/llguidance/llg-go-brrr) blog post released
23
24
  * 2025-05-20 LLGuidance [shipped](https://x.com/OpenAIDevs/status/1924915341052019166) in [OpenAI](https://x.com/OpenAIDevs/status/1924915343677653014) for JSON Schema
24
25
  * 2025-04-11 integration [merged](https://github.com/chromium/chromium/commit/07ca6337c2f714ba0477202414bd2b1692e70594) into Chromium
25
26
  * 2025-03-25 integration [merged](https://github.com/vllm-project/vllm/pull/14779) into vLLM (v0.8.2)
@@ -76,6 +77,9 @@ The library is currently integrated in:
76
77
 
77
78
  ## Technical details
78
79
 
80
+ See [Making Structured Outputs Go Brrr](https://guidance-ai.github.io/llguidance/llg-go-brrr) for an overview of the library,
81
+ including the design decisions, performance, and how it compares to other approaches.
82
+
79
83
  Given a context-free grammar, a tokenizer, and a prefix of tokens, llguidance computes a token mask - a set of tokens from the tokenizer - that, when added to the current token prefix, can lead to a valid string in the language defined by the grammar. Mask computation takes approximately 50μs of single-core CPU time for a tokenizer with 128k tokens. While this timing depends on the exact grammar, it holds, for example, for grammars derived from JSON schemas. There is no significant startup cost.
80
84
 
81
85
  The library implements a context-free grammar parser using Earley’s algorithm on top of a lexer based on [derivatives of regular expressions](https://github.com/microsoft/derivre). Mask computation is achieved by traversing the [prefix tree (trie)](./docs/toktrie.md) of all possible tokens, leveraging [highly optimized](./docs/optimizations.md) code.
@@ -1,9 +1,9 @@
1
- llguidance-0.7.29.dist-info/METADATA,sha256=6fPGLt6sA0VsJsA64GyAapJaEbNDgHJTKYeorY_e0zI,10041
2
- llguidance-0.7.29.dist-info/WHEEL,sha256=2OnzeD-Mt7eNjmrtchSJO1LUSaCwNHKze1SLnzTwXU8,94
3
- llguidance-0.7.29.dist-info/licenses/LICENSE,sha256=mQaUD2Gx8LUz-n2ZuvVReLKAj74RPqUd-_rYVyzNXys,1162
1
+ llguidance-0.7.30.dist-info/METADATA,sha256=1aCJY3QCdpPT6m_kj3hHxHN9Vk2EmDb3OGckYsVcnRE,10380
2
+ llguidance-0.7.30.dist-info/WHEEL,sha256=-_hf5zxqxhUDENhNY1dZiEgkpsnabgX3NIxvVkxGNrY,94
3
+ llguidance-0.7.30.dist-info/licenses/LICENSE,sha256=mQaUD2Gx8LUz-n2ZuvVReLKAj74RPqUd-_rYVyzNXys,1162
4
4
  llguidance/__init__.py,sha256=tlrM-GzMdClgSIEblgA4ixP10h51VDJY5ejIP5FFJJw,620
5
5
  llguidance/_grammar_from.py,sha256=kEgwhVYBq3NE_O9MGjIRpci7dgOneLC9CvVGWpKEO84,2452
6
- llguidance/_lib.pyd,sha256=Ixq9YbgBiV45DxSOGB9dy_A5bUtrFlQ6J9tHOtGq53k,7438336
6
+ llguidance/_lib.pyd,sha256=vcN3TDqs9y0xg3e_k3qtLsw7fax2T-_qvPODNMcZuig,7565312
7
7
  llguidance/_lib.pyi,sha256=sxxOUh24-RL6voiR0npIQHj8znMOcrFM43NU1cB8-_c,22870
8
8
  llguidance/_struct_tag.py,sha256=wEJd9KGZTpS-R1ZXyyRFmr-48aYOZw_tI4PhIRy9h4g,4548
9
9
  llguidance/_tokenizer.py,sha256=9jonF41IUypGtV6lVUl9l9FGAyn9HNnDb9HKNDywZuQ,1120
@@ -17,4 +17,4 @@ llguidance/numpy.py,sha256=gUQkqJMWWlz9T-Vohtk6pH2XXqP0-RCoaWIOBgRHBhY,2721
17
17
  llguidance/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
18
18
  llguidance/tiktoken.py,sha256=sE4QWj88dANfdM0Y50ZvFI7ku6zBFomUCE4bRTtewF4,1135
19
19
  llguidance/torch.py,sha256=SgSutKZzhdlwFPRwD8fxLiPJsD45YYriNbM4Cr21jK0,2863
20
- llguidance-0.7.29.dist-info/RECORD,,
20
+ llguidance-0.7.30.dist-info/RECORD,,
@@ -1,4 +1,4 @@
1
1
  Wheel-Version: 1.0
2
- Generator: maturin (1.8.6)
2
+ Generator: maturin (1.8.7)
3
3
  Root-Is-Purelib: false
4
4
  Tag: cp39-abi3-win_amd64