sqlrite 0.9.0__tar.gz → 0.10.0__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {sqlrite-0.9.0 → sqlrite-0.10.0}/CLAUDE.md +1 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/Cargo.lock +7 -7
- {sqlrite-0.9.0 → sqlrite-0.10.0}/Cargo.toml +11 -2
- {sqlrite-0.9.0 → sqlrite-0.10.0}/PKG-INFO +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/README.md +4 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/package.json +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/_index.md +5 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/architecture.md +1 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/benchmarks-plan.md +23 -4
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/benchmarks.md +45 -21
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/concurrent-writes-plan.md +20 -8
- sqlrite-0.10.0/docs/concurrent-writes.md +340 -0
- sqlrite-0.10.0/docs/design-decisions.md +537 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/embedding.md +71 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/file-format.md +89 -2
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/pager.md +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/phase-7-plan.md +3 -2
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/roadmap.md +228 -6
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/smoke-test.md +5 -3
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/supported-sql.md +97 -18
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/usage.md +31 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/README.md +8 -0
- sqlrite-0.10.0/examples/rust/concurrent_writers.rs +85 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/pyproject.toml +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/README.md +53 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/conn.go +57 -15
- sqlrite-0.10.0/sdk/go/sqlrite.go +444 -0
- sqlrite-0.10.0/sdk/go/sqlrite_test.go +558 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/python/Cargo.toml +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/python/src/lib.rs +109 -11
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/python/tests/test_sqlrite.py +135 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/Cargo.toml +1 -1
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/ask/mod.rs +4 -2
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/ask/schema.rs +2 -1
- sqlrite-0.10.0/src/connection.rs +3238 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/error.rs +31 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/lib.rs +6 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/main.rs +51 -41
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/meta_command/mod.rs +275 -45
- sqlrite-0.10.0/src/mvcc/clock.rs +182 -0
- sqlrite-0.10.0/src/mvcc/log.rs +624 -0
- sqlrite-0.10.0/src/mvcc/mod.rs +134 -0
- sqlrite-0.10.0/src/mvcc/registry.rs +322 -0
- sqlrite-0.10.0/src/mvcc/store.rs +984 -0
- sqlrite-0.10.0/src/mvcc/transaction.rs +262 -0
- sqlrite-0.10.0/src/repl/mod.rs +281 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/db/database.rs +80 -3
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/db/table.rs +16 -8
- sqlrite-0.10.0/src/sql/dialect.rs +100 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/executor.rs +138 -23
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/hnsw.rs +34 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/mod.rs +15 -4
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/mod.rs +361 -33
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/pager.rs +64 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/wal.rs +290 -12
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/params.rs +2 -2
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/parser/create.rs +1 -1
- sqlrite-0.10.0/src/sql/pragma.rs +562 -0
- sqlrite-0.10.0/web/.gitignore +40 -0
- sqlrite-0.10.0/web/README.md +235 -0
- sqlrite-0.10.0/web/components.json +21 -0
- sqlrite-0.10.0/web/content/blog/adding-vector-search-with-hnsw.mdx +235 -0
- sqlrite-0.10.0/web/content/blog/how-sqlrite-stores-rows-on-disk.mdx +275 -0
- sqlrite-0.10.0/web/content/blog/shipping-sqlrite-tauri-mcp-sdks.mdx +351 -0
- sqlrite-0.10.0/web/content/blog/sqlrite-vs-sqlite-benchmarks.mdx +248 -0
- sqlrite-0.10.0/web/content/blog/why-im-building-sqlrite.mdx +222 -0
- sqlrite-0.10.0/web/eslint.config.mjs +16 -0
- sqlrite-0.10.0/web/next.config.ts +7 -0
- sqlrite-0.10.0/web/package-lock.json +8370 -0
- sqlrite-0.10.0/web/package.json +36 -0
- sqlrite-0.10.0/web/postcss.config.mjs +7 -0
- sqlrite-0.10.0/web/src/app/blog/[slug]/opengraph-image.tsx +32 -0
- sqlrite-0.10.0/web/src/app/blog/[slug]/page.tsx +232 -0
- sqlrite-0.10.0/web/src/app/blog/[slug]/twitter-image.tsx +29 -0
- sqlrite-0.10.0/web/src/app/blog/page.tsx +143 -0
- sqlrite-0.10.0/web/src/app/blog/rss.xml/route.ts +63 -0
- sqlrite-0.10.0/web/src/app/blog/tags/[tag]/page.tsx +109 -0
- sqlrite-0.10.0/web/src/app/docs/opengraph-image.tsx +20 -0
- sqlrite-0.10.0/web/src/app/docs/page.tsx +843 -0
- sqlrite-0.10.0/web/src/app/docs/twitter-image.tsx +20 -0
- sqlrite-0.10.0/web/src/app/globals.css +2377 -0
- sqlrite-0.10.0/web/src/app/layout.tsx +106 -0
- sqlrite-0.10.0/web/src/app/opengraph-image.tsx +20 -0
- sqlrite-0.10.0/web/src/app/page.tsx +99 -0
- sqlrite-0.10.0/web/src/app/robots.ts +15 -0
- sqlrite-0.10.0/web/src/app/sitemap.ts +48 -0
- sqlrite-0.10.0/web/src/app/twitter-image.tsx +20 -0
- sqlrite-0.10.0/web/src/components/architecture.tsx +111 -0
- sqlrite-0.10.0/web/src/components/benchmarks.tsx +158 -0
- sqlrite-0.10.0/web/src/components/blog-mdx.tsx +64 -0
- sqlrite-0.10.0/web/src/components/blog.tsx +81 -0
- sqlrite-0.10.0/web/src/components/cta-strip.tsx +26 -0
- sqlrite-0.10.0/web/src/components/desktop.tsx +117 -0
- sqlrite-0.10.0/web/src/components/features.tsx +133 -0
- sqlrite-0.10.0/web/src/components/footer.tsx +97 -0
- sqlrite-0.10.0/web/src/components/hero.tsx +57 -0
- sqlrite-0.10.0/web/src/components/icons.tsx +47 -0
- sqlrite-0.10.0/web/src/components/install-bar.tsx +54 -0
- sqlrite-0.10.0/web/src/components/nav.tsx +164 -0
- sqlrite-0.10.0/web/src/components/roadmap.tsx +228 -0
- sqlrite-0.10.0/web/src/components/sdk-showcase-client.tsx +91 -0
- sqlrite-0.10.0/web/src/components/sdk-showcase.tsx +186 -0
- sqlrite-0.10.0/web/src/components/sql-ref.tsx +254 -0
- sqlrite-0.10.0/web/src/components/terminal.tsx +193 -0
- sqlrite-0.10.0/web/src/lib/benchmarks.ts +263 -0
- sqlrite-0.10.0/web/src/lib/blog.ts +129 -0
- sqlrite-0.10.0/web/src/lib/highlight.ts +34 -0
- sqlrite-0.10.0/web/src/lib/og.tsx +144 -0
- sqlrite-0.10.0/web/src/lib/site.ts +26 -0
- sqlrite-0.10.0/web/src/lib/utils.ts +6 -0
- sqlrite-0.10.0/web/tsconfig.json +21 -0
- sqlrite-0.9.0/docs/design-decisions.md +0 -289
- sqlrite-0.9.0/sdk/go/sqlrite.go +0 -226
- sqlrite-0.9.0/sdk/go/sqlrite_test.go +0 -297
- sqlrite-0.9.0/src/connection.rs +0 -1140
- sqlrite-0.9.0/src/repl/mod.rs +0 -144
- {sqlrite-0.9.0 → sqlrite-0.10.0}/.github/workflows/ci.yml +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/.github/workflows/release-pr.yml +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/.github/workflows/release.yml +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/.github/workflows/rust.yml +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/.gitignore +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/CODE_OF_CONDUCT.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/LICENSE +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/MAINTAINERS +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/Makefile +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/index.html +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/package-lock.json +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/src/App.svelte +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/src/app.css +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/src/main.ts +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/src/vite-env.d.ts +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/svelte.config.js +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/tsconfig.json +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/desktop/vite.config.ts +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/ask-backend-examples.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/ask.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/desktop.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/fts.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/getting-started.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/mcp.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/phase-8-plan.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/release-plan.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/release-secrets.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/sql-engine.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/docs/storage-model.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/c/Makefile +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/c/hello.c +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/go/go.mod +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/go/hello.go +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/hybrid-retrieval/README.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/hybrid-retrieval/hybrid_retrieval.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/nodejs/hello.mjs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/python/hello.py +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/rust/quickstart.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/wasm/Makefile +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/wasm/index.html +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/examples/wasm/server.mjs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite - Desktop.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite Data Structures.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite Simple SQL Execution High Level Diagram.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite Simple SQL INSERT Execution High Level Diagram (Insert Row).png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite Simple SQL INSERT Execution High Level Diagram.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/SQLRite_logo.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/images/architecture.png +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/rust-toolchain.toml +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/AST.delete.example +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/AST.insert.exemple +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/AST.select.example +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/AST.update.example +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/CREATE TABLE sqlrite_schema.sql +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/CREATE_TABLE with duplicate.sql +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/CREATE_TABLE.sql +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/samples/INSERT.sql +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/scripts/bump-version.sh +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/ask.go +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/ask_test.go +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/go.mod +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/rows.go +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/go/stmt.go +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/python/README.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sdk/python/tests/test_ask.py +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/README.md +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/src/lib.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/src/prompt.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/src/provider/anthropic.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/src/provider/mock.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/src/provider/mod.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/sqlrite-ask/tests/anthropic_http.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/agg.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/db/mod.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/db/secondary_index.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/fts/bm25.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/fts/mod.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/fts/posting_list.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/fts/tokenizer.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/allocator.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/cell.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/file.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/freelist.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/fts_cell.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/header.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/hnsw_cell.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/index_cell.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/interior_page.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/overflow.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/page.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/table_page.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/pager/varint.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/parser/insert.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/parser/mod.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/parser/select.rs +0 -0
- {sqlrite-0.9.0 → sqlrite-0.10.0}/src/sql/tokenizer.rs +0 -0
|
@@ -16,6 +16,7 @@ SQLRite is a from-scratch SQLite-style embedded database written in Rust. It's p
|
|
|
16
16
|
- `sqlrite-ffi/` — C ABI cdylib + generated `sqlrite.h` header. Backs the Go SDK and any C consumer.
|
|
17
17
|
- `desktop/` — Tauri 2 + Svelte 5 GUI. Embeds the engine directly (no FFI hop).
|
|
18
18
|
- `benchmarks/` — SQLR-4 / SQLR-16 bench harness. `Driver` trait + SQLRite + SQLite (rusqlite-bundled) drivers + criterion-driven workloads. Excluded from the default CI build/test/clippy/doc commands; run locally with `make bench` (or `make bench-duckdb`). See [docs/benchmarks-plan.md](docs/benchmarks-plan.md).
|
|
19
|
+
- `web/` — marketing + docs site (Next.js 15 + Tailwind v4). Independent of the Cargo workspace; lives in-repo for now but is structured to lift into its own repository later. See [web/README.md](web/README.md).
|
|
19
20
|
|
|
20
21
|
Architecture deep-dive: [docs/architecture.md](docs/architecture.md). The full doc index is [docs/_index.md](docs/_index.md).
|
|
21
22
|
|
|
@@ -4799,7 +4799,7 @@ dependencies = [
|
|
|
4799
4799
|
|
|
4800
4800
|
[[package]]
|
|
4801
4801
|
name = "sqlrite-ask"
|
|
4802
|
-
version = "0.
|
|
4802
|
+
version = "0.10.0"
|
|
4803
4803
|
dependencies = [
|
|
4804
4804
|
"serde",
|
|
4805
4805
|
"serde_json",
|
|
@@ -4827,7 +4827,7 @@ dependencies = [
|
|
|
4827
4827
|
|
|
4828
4828
|
[[package]]
|
|
4829
4829
|
name = "sqlrite-desktop"
|
|
4830
|
-
version = "0.
|
|
4830
|
+
version = "0.10.0"
|
|
4831
4831
|
dependencies = [
|
|
4832
4832
|
"serde",
|
|
4833
4833
|
"serde_json",
|
|
@@ -4839,7 +4839,7 @@ dependencies = [
|
|
|
4839
4839
|
|
|
4840
4840
|
[[package]]
|
|
4841
4841
|
name = "sqlrite-engine"
|
|
4842
|
-
version = "0.
|
|
4842
|
+
version = "0.10.0"
|
|
4843
4843
|
dependencies = [
|
|
4844
4844
|
"clap",
|
|
4845
4845
|
"env_logger",
|
|
@@ -4856,7 +4856,7 @@ dependencies = [
|
|
|
4856
4856
|
|
|
4857
4857
|
[[package]]
|
|
4858
4858
|
name = "sqlrite-ffi"
|
|
4859
|
-
version = "0.
|
|
4859
|
+
version = "0.10.0"
|
|
4860
4860
|
dependencies = [
|
|
4861
4861
|
"cbindgen",
|
|
4862
4862
|
"serde",
|
|
@@ -4866,7 +4866,7 @@ dependencies = [
|
|
|
4866
4866
|
|
|
4867
4867
|
[[package]]
|
|
4868
4868
|
name = "sqlrite-mcp"
|
|
4869
|
-
version = "0.
|
|
4869
|
+
version = "0.10.0"
|
|
4870
4870
|
dependencies = [
|
|
4871
4871
|
"clap",
|
|
4872
4872
|
"libc",
|
|
@@ -4877,7 +4877,7 @@ dependencies = [
|
|
|
4877
4877
|
|
|
4878
4878
|
[[package]]
|
|
4879
4879
|
name = "sqlrite-nodejs"
|
|
4880
|
-
version = "0.
|
|
4880
|
+
version = "0.10.0"
|
|
4881
4881
|
dependencies = [
|
|
4882
4882
|
"napi",
|
|
4883
4883
|
"napi-build",
|
|
@@ -4887,7 +4887,7 @@ dependencies = [
|
|
|
4887
4887
|
|
|
4888
4888
|
[[package]]
|
|
4889
4889
|
name = "sqlrite-python"
|
|
4890
|
-
version = "0.
|
|
4890
|
+
version = "0.10.0"
|
|
4891
4891
|
dependencies = [
|
|
4892
4892
|
"pyo3",
|
|
4893
4893
|
"sqlrite-engine",
|
|
@@ -27,7 +27,7 @@ resolver = "3"
|
|
|
27
27
|
# `package =` key so the import name stays `sqlrite` internally:
|
|
28
28
|
# sqlrite = { package = "sqlrite-engine", path = "…" }
|
|
29
29
|
name = "sqlrite-engine"
|
|
30
|
-
version = "0.
|
|
30
|
+
version = "0.10.0"
|
|
31
31
|
authors = ["Joao Henrique Machado Silva <joaoh82@gmail.com>"]
|
|
32
32
|
edition = "2024"
|
|
33
33
|
rust-version = "1.85"
|
|
@@ -73,6 +73,15 @@ path = "examples/rust/quickstart.rs"
|
|
|
73
73
|
name = "hybrid-retrieval"
|
|
74
74
|
path = "examples/hybrid-retrieval/hybrid_retrieval.rs"
|
|
75
75
|
|
|
76
|
+
# Phase 11.12 — BEGIN CONCURRENT retry-loop demo. Mints a sibling
|
|
77
|
+
# Connection via `Connection::connect`, runs two concurrent
|
|
78
|
+
# transactions (first disjoint, then same-row), and surfaces the
|
|
79
|
+
# Busy / retry path. Run with `cargo run --example concurrent_writers`.
|
|
80
|
+
# See `docs/concurrent-writes.md` for the conceptual walkthrough.
|
|
81
|
+
[[example]]
|
|
82
|
+
name = "concurrent_writers"
|
|
83
|
+
path = "examples/rust/concurrent_writers.rs"
|
|
84
|
+
|
|
76
85
|
[features]
|
|
77
86
|
# Default build includes everything: the REPL binary (cli) and
|
|
78
87
|
# POSIX/Windows advisory file locks on the Pager (file-locks).
|
|
@@ -141,4 +150,4 @@ fs2 = { version = "0.4", optional = true }
|
|
|
141
150
|
# crate publishes to crates.io, and a path-only dep without a
|
|
142
151
|
# version field fails the manifest verification step. See PR #58
|
|
143
152
|
# retrospective in docs/roadmap.md.
|
|
144
|
-
sqlrite-ask = { version = "0.
|
|
153
|
+
sqlrite-ask = { version = "0.10.0", path = "sqlrite-ask", optional = true }
|
|
@@ -11,6 +11,8 @@ Rust-SQLite (SQLRite)
|
|
|
11
11
|
> What I cannot create, I do not understand.
|
|
12
12
|
> — Richard Feynman
|
|
13
13
|
|
|
14
|
+
📖 **Project website + docs:** the marketing + getting-started site is in [`web/`](web/) (Next.js 15 + Tailwind v4). Run `cd web && npm install && npm run dev` to preview locally; deploys to Vercel out of the box.
|
|
15
|
+
|
|
14
16
|
|
|
15
17
|
<table style="width:100%">
|
|
16
18
|
<tr>
|
|
@@ -167,6 +169,7 @@ sqlrite> DELETE FROM users WHERE age < 30;
|
|
|
167
169
|
| `UPDATE` | Multi-column `SET`; `WHERE`; UNIQUE + type enforcement; arithmetic in assignments (`SET age = age + 1`) |
|
|
168
170
|
| `DELETE` | `WHERE` predicate or full-table delete |
|
|
169
171
|
| `BEGIN` / `COMMIT` / `ROLLBACK` | Real transactions, snapshot-based; WAL-backed commit; single-level (no savepoints); auto-rollback if `COMMIT`'s disk write fails |
|
|
172
|
+
| `PRAGMA auto_vacuum` | Read (`PRAGMA auto_vacuum;`) returns the trigger threshold as a single-row result set; set (`PRAGMA auto_vacuum = 0.5;` / `= OFF;` / `= NONE;`) tunes or disables auto-VACUUM at the SQL layer for SDK / FFI / MCP consumers |
|
|
170
173
|
|
|
171
174
|
Expressions in `WHERE` and `UPDATE`'s `SET` RHS:
|
|
172
175
|
|
|
@@ -305,7 +308,7 @@ Lockstep versioning — one dispatch bumps every product to the same `vX.Y.Z`. T
|
|
|
305
308
|
- [x] **7a — `VECTOR(N)` column type** *(v0.1.10)*: dense f32 vectors with bracket-array literal syntax (`[0.1, 0.2, ...]`); file format bumped to v4
|
|
306
309
|
- [x] **7b — Distance functions** *(v0.1.11)*: `vec_distance_l2/cosine/dot` + `ORDER BY <expr> LIMIT k` so KNN queries work end-to-end
|
|
307
310
|
- [x] **7c — Bounded-heap top-k optimization** *(v0.1.12)*
|
|
308
|
-
- [x] **7d — HNSW ANN index** *(v0.1.13–15)*: `CREATE INDEX … USING hnsw (col)`; recall@10 ≥ 0.95 at default `M=16, ef_construction=200, ef_search=50`; persisted as a `KIND_HNSW` cell tree
|
|
311
|
+
- [x] **7d — HNSW ANN index** *(v0.1.13–15, +SQLR-28)*: `CREATE INDEX … USING hnsw (col) [WITH (metric = '<l2|cosine|dot>')]`; recall@10 ≥ 0.95 at default `M=16, ef_construction=200, ef_search=50`; persisted as a `KIND_HNSW` cell tree, with the metric round-tripping through the synthesized `sqlrite_master` SQL
|
|
309
312
|
- [x] **7e — JSON column type + path queries** *(v0.1.16)*: `JSON` / `JSONB` columns stored as canonical text; `json_extract` / `json_type` / `json_array_length` / `json_object_keys`; `$.key`, `[N]`, chained JSONPath subset
|
|
310
313
|
- [x] **7g.1 — `sqlrite-ask` crate** *(v0.1.18)*: foundational natural-language → SQL via the [Anthropic API](https://docs.anthropic.com/) (Sonnet 4.6 by default), prompt-cached schema dump, sync `ureq` HTTP.
|
|
311
314
|
- [x] **7g.2 — REPL `.ask` + dep-direction flip** *(v0.1.19)*: `.ask <question>` meta-command with `Run? [Y/n]` confirmation. The wiring required dropping the engine dep from `sqlrite-ask` (cargo cycle) — `sqlrite-ask` is now pure over `&str` schemas; the `Connection`/`Database` integration moved to the engine's new `ask` feature. Public surface for callers: `use sqlrite::{Connection, ConnectionAskExt}`.
|
|
@@ -16,7 +16,8 @@ A small, hand-written guide to the SQLRite codebase — how it's structured, how
|
|
|
16
16
|
## Using SQLRite as a library
|
|
17
17
|
|
|
18
18
|
- [Embedding](embedding.md) — the public `Connection` / `Statement` / `Rows` API (Phase 5a) and where the non-Rust SDKs plug in (Phase 5b – 5g)
|
|
19
|
-
- [`
|
|
19
|
+
- [Concurrent writes — MVCC + `BEGIN CONCURRENT`](concurrent-writes.md) — Phase 11 canonical reference: SQL surface, embedding API, SDK error mapping, REPL meta-commands, durability story, limitations. Design rationale lives in the [historical plan-doc](concurrent-writes-plan.md).
|
|
20
|
+
- [`examples/`](../examples/) — runnable Rust quickstart (`cargo run --example quickstart`) + concurrent-writers retry-loop demo (`cargo run --example concurrent_writers`); language-specific subdirectories fill in as each 5x sub-phase lands
|
|
20
21
|
|
|
21
22
|
## Phase 7 — AI-era extensions
|
|
22
23
|
|
|
@@ -52,6 +53,9 @@ As of May 2026, SQLRite has:
|
|
|
52
53
|
- A Tauri 2.0 + Svelte desktop app (Phase 2.5 complete)
|
|
53
54
|
- AI-era extensions across the product surface (Phase 7 complete): VECTOR columns + HNSW indexes (7a-7d), JSON columns (7e), the `ask()` natural-language → SQL family across the REPL / desktop / Rust / Python / Node / Go / WASM (7g.1-7g.7), and the [`sqlrite-mcp`](mcp.md) Model Context Protocol server (7h + 7g.8)
|
|
54
55
|
- Full-text search + hybrid retrieval (Phase 8 complete): FTS5-style inverted index with BM25 ranking + `fts_match` / `bm25_score` scalar functions + `try_fts_probe` optimizer hook + on-disk persistence with on-demand v4 → v5 file-format bump (8a-8c), a worked hybrid-retrieval example combining BM25 with vector cosine via raw arithmetic (8d), and a `bm25_search` MCP tool symmetric with `vector_search` (8e). See [`docs/fts.md`](fts.md).
|
|
56
|
+
- SQL surface + DX follow-ups (Phase 9 complete, v0.2.0 → v0.9.1): DDL completeness — `DEFAULT`, `DROP TABLE` / `DROP INDEX`, `ALTER TABLE` (9a); free-list + manual `VACUUM` (9b) + auto-VACUUM (9c); `IS NULL` / `IS NOT NULL` (9d); `GROUP BY` + aggregates + `DISTINCT` + `LIKE` + `IN` (9e); four flavors of `JOIN` — INNER, LEFT, RIGHT, FULL OUTER (9f); prepared statements + `?` parameter binding with a per-connection LRU plan cache (9g); HNSW probe widened to cosine + dot via `WITH (metric = …)` (9h); `PRAGMA` dispatcher with the `auto_vacuum` knob (9i)
|
|
57
|
+
- Benchmarks against SQLite + DuckDB (Phase 10 complete, SQLR-4 / SQLR-16): twelve-workload bench harness with a pluggable `Driver` trait, criterion-driven, pinned-host runs published. See [`docs/benchmarks.md`](benchmarks.md).
|
|
58
|
+
- Phase 11 (concurrent writes via MVCC + `BEGIN CONCURRENT`, SQLR-22) is **shipped end-to-end** — `Connection` is `Send + Sync`; `Connection::connect()` mints sibling handles. `sqlrite::mvcc` exposes `MvccClock`, `ActiveTxRegistry`, `MvStore`, `ConcurrentTx`, and the `MvccCommitBatch` / `MvccLogRecord` WAL codec. WAL header v1 → v2 persisted the clock high-water mark; v2 → v3 added typed MVCC log-record frames. `PRAGMA journal_mode = mvcc;` opts a database into MVCC. `BEGIN CONCURRENT` writes commit-validate against `MvStore`, abort with `SQLRiteError::Busy`, and append a typed MVCC log-record frame to the WAL — covered by the same fsync as the legacy page commit. Reopen replays those frames into `MvStore` and seeds `MvccClock` past the highest committed `commit_ts`. Reads via `Statement::query` see the BEGIN-time snapshot. Per-commit GC + `vacuum_mvcc()` bound version-chain growth. C FFI / Python / Node / Go all propagate `Busy` / `BusySnapshot` as typed retryable errors *and* mint sibling handles that share backing state — Go's process-level path registry (Phase 11.11c) handles cross-`*sql.DB` sharing too. The `sqlrite` REPL ships `.spawn` / `.use` / `.conns` for interactive demos; the SQLR-16 benchmark suite adds `W13` (concurrent writers, mostly disjoint rows) as the Phase-11 differentiator workload. The only remaining items are deferred-by-design or foundation work: indexes under MVCC (11.10) and the checkpoint-drain follow-up (parked half of 11.9). **User-facing reference:** [`docs/concurrent-writes.md`](concurrent-writes.md); runnable example at [`examples/rust/concurrent_writers.rs`](../examples/rust/concurrent_writers.rs). Original design proposal: [`docs/concurrent-writes-plan.md`](concurrent-writes-plan.md).
|
|
55
59
|
- A fully-automated release pipeline that ships every product to its registry on every release with one human action — Rust engine + `sqlrite-ask` + `sqlrite-mcp` to crates.io, Python wheels to PyPI (`sqlrite`), Node.js + WASM to npm (`@joaoh82/sqlrite` + `@joaoh82/sqlrite-wasm`), Go module via `sdk/go/v*` git tag, plus C FFI tarballs, MCP binary tarballs, and unsigned desktop installers as GitHub Release assets (Phase 6 complete)
|
|
56
60
|
|
|
57
61
|
See the [Roadmap](roadmap.md) for the full phase plan.
|
|
@@ -104,6 +104,7 @@ The engine never depends on the SDK crates; the SDK crates each depend on the en
|
|
|
104
104
|
| [`src/sql/hnsw.rs`](../src/sql/hnsw.rs) | Standalone HNSW algorithm — insert / search / layer assignment / beam search. Phase 7d.1. |
|
|
105
105
|
| [`src/sql/fts/`](../src/sql/fts/) | Full-text search — standalone tokenizer, BM25 scorer, and in-memory `PostingList` inverted index. Wired into the executor via the `fts_match` / `bm25_score` scalar functions and the `try_fts_probe` optimizer hook. Phase 8a-8b; persistence in 8c. See [`docs/fts.md`](fts.md). |
|
|
106
106
|
| [`src/sql/json.rs`](../src/sql/json.rs) | JSON column type + path-extraction functions (`json_extract`, `json_type`, `json_array_length`, `json_object_keys`). Phase 7e. |
|
|
107
|
+
| [`src/sql/pragma.rs`](../src/sql/pragma.rs) | `PRAGMA` dispatcher (SQLR-13). `try_parse_pragma` peeks at the SQL token stream before sqlparser sees it and routes any `PRAGMA …` shape to `execute_pragma`. First pragma wired up: `auto_vacuum` (read + set, with `OFF` / `NONE` to disable). Add new pragmas as a single arm in `execute_pragma`. |
|
|
107
108
|
| [`src/sql/pager/`](../src/sql/pager/) | On-disk file format and I/O — see [file-format.md](file-format.md) and [pager.md](pager.md) for details. WAL + checkpointer + shared/exclusive lock modes (Phase 4a-4e) live here. |
|
|
108
109
|
|
|
109
110
|
## Flow of a SQL statement
|
|
@@ -111,6 +111,16 @@ For W10/W11, the goal isn't to beat the comparators — they're battle-hardened
|
|
|
111
111
|
|
|
112
112
|
For W12, no off-the-shelf comparator exists in a single embedded engine; the number stands on its own.
|
|
113
113
|
|
|
114
|
+
### Group D — Concurrent writes (Phase 11.11b, the Phase-11 MVCC differentiator)
|
|
115
|
+
|
|
116
|
+
| ID | Name | Shape | Comparator |
|
|
117
|
+
|----|------|-------|------------|
|
|
118
|
+
| W13 | Concurrent writers | 4 worker threads × 50 BEGIN/UPDATE/COMMIT cycles each, random rowid in `1..=1000` (≈ 0.4% collision per op), `UPDATE counters SET n = n + 1 WHERE id = ?` | SQLite (`BEGIN IMMEDIATE` + `busy_timeout = 5s` per-connection) |
|
|
119
|
+
|
|
120
|
+
The headline workload Phase 11's MVCC machinery was designed for. SQLRite drives `BEGIN CONCURRENT` across sibling [`Connection::connect`](../docs/concurrent-writes.md) handles minted from the same process; SQLite drives `BEGIN IMMEDIATE` across separate `rusqlite::Connection` handles serializing through the WAL write lock. Both engines run the same retry-on-busy outer loop ([`is_retryable_busy`](../benchmarks/src/lib.rs) is engine-dispatched); only SQLRite actually exercises the retry path under this workload's shape — the contrast *is* the measurement.
|
|
121
|
+
|
|
122
|
+
Workload parameters live in [`benchmarks/src/workloads/concurrent_writers.rs`](../benchmarks/src/workloads/concurrent_writers.rs) as named constants (`W13_PRELOAD_ROWS`, `W13_N_WORKERS`, `W13_TXS_PER_WORKER`). Bumping any of them is a workload-version bump under Q8.
|
|
123
|
+
|
|
114
124
|
---
|
|
115
125
|
|
|
116
126
|
## Metrics
|
|
@@ -127,9 +137,10 @@ Keep tight. The task brief lists many candidates; the suite measures these:
|
|
|
127
137
|
Explicitly **not** measured in v1:
|
|
128
138
|
|
|
129
139
|
- **CPU%.** Noisy on a shared machine, redundant with wall-clock for single-threaded workloads.
|
|
130
|
-
- **Concurrency curves.** Engine is single-writer by design (Phase 4e). No concurrent-writer workload is meaningful until that changes.
|
|
131
140
|
- **Network I/O.** All targets are in-process.
|
|
132
141
|
|
|
142
|
+
**Updated post-Phase 11.11b:** Group D's `W13` (concurrent writers) lifts the single-writer caveat — SQLRite now has a real multi-writer story via `BEGIN CONCURRENT`, and W13 measures it directly against SQLite's single-writer baseline. Full concurrency-curve sweeps (varying `N` workers and collision rate) are a clean follow-up; v1 reports a single representative point.
|
|
143
|
+
|
|
133
144
|
---
|
|
134
145
|
|
|
135
146
|
## Methodology
|
|
@@ -190,7 +201,8 @@ benchmarks/
|
|
|
190
201
|
│ ├── join.rs — W9
|
|
191
202
|
│ ├── vector.rs — W10
|
|
192
203
|
│ ├── fts.rs — W11
|
|
193
|
-
│
|
|
204
|
+
│ ├── hybrid.rs — W12
|
|
205
|
+
│ └── concurrent_writers.rs — W13 (Phase 11.11b)
|
|
194
206
|
├── benches/
|
|
195
207
|
│ └── suite.rs — single criterion entry point that fans out
|
|
196
208
|
├── scripts/
|
|
@@ -264,11 +276,18 @@ Add the `duckdb-rs` driver under a `--features duckdb` flag. Wire only into Grou
|
|
|
264
276
|
|
|
265
277
|
**Exit criterion:** `docs/benchmarks.md` exists, the README has a "Benchmarks" section pointing at it, the first dated results JSON is committed.
|
|
266
278
|
|
|
267
|
-
###
|
|
279
|
+
### 9.7 — Group D concurrent writers (Phase 11.11b, shipped)
|
|
280
|
+
|
|
281
|
+
Adds `W13` (concurrent writers, mostly-disjoint rows) under a new Group D. The `Driver` trait grows three optional methods (`connect_sibling`, `concurrent_begin_sql`, `is_retryable_busy`) with defaults that make sense for engines without an MVCC story; SQLRite overrides all three. SQLite gains a `busy_timeout = 5s` pragma at open so its `BEGIN IMMEDIATE` blocks rather than fails on contention. The workload lives in [`benchmarks/src/workloads/concurrent_writers.rs`](../benchmarks/src/workloads/concurrent_writers.rs).
|
|
282
|
+
|
|
283
|
+
**Exit criterion:** W13 runs under both drivers, correctness gate passes (`SUM(n) == n_workers * txs_per_worker` after a sample), and the JSON envelope picks up `W13.v1` rows for both drivers.
|
|
284
|
+
|
|
285
|
+
### Post-9.7 ideas (parked)
|
|
268
286
|
|
|
269
287
|
- **libSQL driver** if/when we want a non-extension vector competitor for W10.
|
|
270
288
|
- **Per-PR regression detector.** A GitHub Action that runs the bench on a self-hosted runner and posts a comment if any workload regresses >20% from the last `main` baseline.
|
|
271
|
-
- **Concurrency
|
|
289
|
+
- **Concurrency curves for W13.** Sweep `N` workers (1, 2, 4, 8, 16) and `K` rows (10, 100, 1k, 10k) to chart SQLRite-MVCC's scaling envelope vs SQLite's serial baseline. v1 reports a single representative point; the sweep is a clean follow-up.
|
|
290
|
+
- **W13b hot-row contention.** Same workload, `K = 10` rows instead of 1000 — collision probability climbs to ~40% per op, exercising the retry loop hard. Useful for stressing the GC + retry path under adversarial contention.
|
|
272
291
|
- **Larger datasets (10M, 100M).** v1 is sized for fast iteration on a laptop. A "release-blocker run" config could 100× the row counts.
|
|
273
292
|
|
|
274
293
|
### Total scope estimate
|
|
@@ -90,7 +90,7 @@ A few methodology notes that change how you read the table.
|
|
|
90
90
|
- `Statement::query_with_params(&[Value])` / `Statement::execute_with_params(&[Value])` — bind `?` placeholders at execute time without re-running sqlparser.
|
|
91
91
|
- `Value::Vector(Vec<f32>)` as a first-class bind type — the 4 KB query vector for W10 is now bound directly instead of being re-lexed every iteration. The HNSW probe optimizer still recognizes the bound shape, so the algorithmic shortcut keeps firing.
|
|
92
92
|
|
|
93
|
-
The bench harness `Driver::query_one` / `query_all` paths route through `prepare_cached` + the bound API. Every workload's `WorkloadId.version` was bumped `v1 → v2` in lockstep — old JSON envelopes keep the v1 tag and stay readable, but cross-version comparisons require an explicit acknowledgment in the comparison script. The
|
|
93
|
+
The bench harness `Driver::query_one` / `query_all` paths route through `prepare_cached` + the bound API. Every workload's `WorkloadId.version` was bumped `v1 → v2` in lockstep — old JSON envelopes keep the v1 tag and stay readable, but cross-version comparisons require an explicit acknowledgment in the comparison script. The headline table below carries the v2 numbers from the post-SQLR-23 republished run (SQLR-25); the retired v1 baseline lives in the historical section underneath.
|
|
94
94
|
|
|
95
95
|
**Where DuckDB is misleading.** Per-PK-probe single-row OLTP queries (W9) are SQLite's home turf, not DuckDB's. The plan flags this as "apples-to-oranges"; we still publish the number because the directional comparison is informative.
|
|
96
96
|
|
|
@@ -100,29 +100,53 @@ The bench harness `Driver::query_one` / `query_all` paths route through `prepare
|
|
|
100
100
|
|
|
101
101
|
## Headline numbers
|
|
102
102
|
|
|
103
|
-
Median latency from the
|
|
103
|
+
Median latency from the post-SQLR-23 pinned-host run — [`benchmarks/results/2026-05-08-apple-ac84d560.json`](../benchmarks/results/2026-05-08-apple-ac84d560.json), Apple M1 Pro / macOS 23.5.0, criterion defaults (3 s warm-up, 5 s measurement, 100 samples on light workloads / 10 samples on heavy ones — see the JSON envelope's per-sample `samples` field). Only medians here; the JSON carries 95 % CIs, mean, std-dev, ops/s.
|
|
104
104
|
|
|
105
105
|
| Workload | SQLRite | SQLite (WAL+NORMAL) | DuckDB | Notes |
|
|
106
106
|
|---|---|---|---|---|
|
|
107
|
-
| **W1** read-by-PK |
|
|
108
|
-
| **W2** range-100 |
|
|
109
|
-
| **W2** range-1k |
|
|
110
|
-
| **W2** range-10k | 30.
|
|
111
|
-
| **W3** bulk insert (100k/txn) |
|
|
112
|
-
| **W4** single-row insert | 6.
|
|
113
|
-
| **W5** mixed OLTP |
|
|
114
|
-
| **W6** index lookup |
|
|
115
|
-
| **W7** SUM (1M rows) |
|
|
116
|
-
| **W8** GROUP BY card-10 |
|
|
117
|
-
| **W8** GROUP BY card-1k | 1.
|
|
118
|
-
| **W8** GROUP BY card-100k | _skipped_ |
|
|
119
|
-
| **W9** INNER JOIN (10k×10k) |
|
|
120
|
-
| **W10** vector top-10 (brute-force, 10k×384) |
|
|
121
|
-
| **W10** vector top-10 (HNSW) |
|
|
122
|
-
| **W11** BM25 top-10 (1k docs) |
|
|
123
|
-
| **W12** hybrid (1k docs) |
|
|
124
|
-
|
|
125
|
-
> The **canonical run** is [`benchmarks/results/2026-05-
|
|
107
|
+
| **W1** read-by-PK | 3.92 µs | 2.09 µs | — | ~1.9× — gap closed by SQLR-23 (was ~4.8× in v1) |
|
|
108
|
+
| **W2** range-100 | 24.27 ms | 66.62 µs | — | ~364× — full-scan vs index range probe |
|
|
109
|
+
| **W2** range-1k | 26.64 ms | 649.30 µs | — | ~41× |
|
|
110
|
+
| **W2** range-10k | 30.73 ms | 7.01 ms | — | ~4.4× — converges as scan dominates |
|
|
111
|
+
| **W3** bulk insert (100k/txn) | 606.20 ms | 183.96 ms | — | ~3.3× — 100k INSERT plan parsed once, not per-row (was ~6.2× in v1) |
|
|
112
|
+
| **W4** single-row insert | 6.57 ms | 11.35 µs | — | **~579× ⚠️** SQLR-18 |
|
|
113
|
+
| **W5** mixed OLTP | 58.00 ms | 9.65 µs | — | **~6,010× ⚠️** SQLR-18 |
|
|
114
|
+
| **W6** index lookup | 4.04 µs | 2.56 µs | — | ~1.6× — gap closed by SQLR-23 (was ~4.2× in v1) |
|
|
115
|
+
| **W7** SUM (1M rows) | 103.62 ms | 31.57 ms | 478.78 µs | DuckDB ~66× faster than SQLite |
|
|
116
|
+
| **W8** GROUP BY card-10 | 197.32 ms | 366.52 ms | 949.75 µs | DuckDB ~386× faster than SQLite |
|
|
117
|
+
| **W8** GROUP BY card-1k | 1.380 s | 240.64 ms | 1.039 ms | DuckDB ~232× faster than SQLite |
|
|
118
|
+
| **W8** GROUP BY card-100k | _skipped_ | 239.72 ms | 22.93 ms | **SQLRite skipped ⚠️** SQLR-19; DuckDB ~10× faster than SQLite |
|
|
119
|
+
| **W9** INNER JOIN (10k×10k) | 30.30 s | 2.16 µs | 484.97 µs | **~14M× ⚠️** SQLR-20; DuckDB ~225× slower than SQLite (analytical-engine OLTP weakness) |
|
|
120
|
+
| **W10** vector top-10 (brute-force, 10k×384) | 120.88 ms | — | — | compute-bound; modest ~13% drop vs v1 |
|
|
121
|
+
| **W10** vector top-10 (HNSW) | **2.40 ms** | — | — | **~53× faster than v1** ⭐ — SQLR-23 + SQLR-28 unmasked the index; HNSW now ~50× faster than brute-force |
|
|
122
|
+
| **W11** BM25 top-10 (1k docs) | 501.63 µs | 23.65 µs | — | ~21× — `fts_match` / `bm25_score` no longer re-parsed (was ~43× in v1) |
|
|
123
|
+
| **W12** hybrid (1k docs) | 607.90 µs | — | — | RAG headline (~15% faster than v1) |
|
|
124
|
+
|
|
125
|
+
> The **canonical v2 run** is [`benchmarks/results/2026-05-08-apple-ac84d560.json`](../benchmarks/results/2026-05-08-apple-ac84d560.json). It supersedes the v1 baseline (table below) end-to-end: every workload was rerun on the same canonical Apple M1 Pro host after [SQLR-23](https://github.com/joaoh82/rust_sqlite/pulls?q=SQLR-23) bumped `WorkloadId.version` from `v1 → v2` in lockstep (W10 → `v3` after [SQLR-28](https://github.com/joaoh82/rust_sqlite/pulls?q=SQLR-28) widened the HNSW probe to cosine + dot). The `dirty=true` flag reflects the working-tree state at run time (this doc update + the new envelope itself uncommitted); the **measurements themselves only depend on the bench binary**, which was built from the clean `ac84d560` tip. Subsequent official runs land alongside this file with their own date / host / commit.
|
|
126
|
+
|
|
127
|
+
### Historical (v1, retired)
|
|
128
|
+
|
|
129
|
+
The pre-SQLR-23 baseline from [`benchmarks/results/2026-05-07-apple-9ffd55a5.json`](../benchmarks/results/2026-05-07-apple-9ffd55a5.json), retained so the methodology shift is visible. The v1→v2 jump is not an algorithmic improvement — it's the bench-driver methodology change (per-iter `inline_params` → `prepare_cached` + bound `?` parameters; `Value::Vector` for HNSW-eligible KNN). Cross-version comparisons (`W1.v1` vs `W1.v2`) are flagged in the comparison script per Q8; the [`compare.py`](../benchmarks/scripts/compare.py) v1↔v2 report walks each one.
|
|
130
|
+
|
|
131
|
+
| Workload | SQLRite (v1) | SQLite (v1) | DuckDB (v1) |
|
|
132
|
+
|---|---|---|---|
|
|
133
|
+
| **W1** read-by-PK | 9.87 µs | 2.05 µs | — |
|
|
134
|
+
| **W2** range-100 | 23.99 ms | 60.50 µs | — |
|
|
135
|
+
| **W2** range-1k | 24.92 ms | 585.21 µs | — |
|
|
136
|
+
| **W2** range-10k | 30.15 ms | 6.24 ms | — |
|
|
137
|
+
| **W3** bulk insert (100k/txn) | 1.029 s | 166.43 ms | — |
|
|
138
|
+
| **W4** single-row insert | 6.76 ms | 9.78 µs | — |
|
|
139
|
+
| **W5** mixed OLTP | 55.63 ms | 9.96 µs | — |
|
|
140
|
+
| **W6** index lookup | 10.45 µs | 2.50 µs | — |
|
|
141
|
+
| **W7** SUM (1M rows) | 109.47 ms | 31.14 ms | 468.74 µs |
|
|
142
|
+
| **W8** GROUP BY card-10 | 201.80 ms | 438.09 ms | 761.40 µs |
|
|
143
|
+
| **W8** GROUP BY card-1k | 1.372 s | 251.13 ms | 871.80 µs |
|
|
144
|
+
| **W8** GROUP BY card-100k | _skipped_ | 238.96 ms | 19.58 ms |
|
|
145
|
+
| **W9** INNER JOIN (10k×10k) | 34.25 s | 2.23 µs | 699.23 µs |
|
|
146
|
+
| **W10** brute-force | 138.66 ms | — | — |
|
|
147
|
+
| **W10** HNSW | 126.81 ms | — | — |
|
|
148
|
+
| **W11** BM25 top-10 (1k docs) | 1.079 ms | 25.03 µs | — |
|
|
149
|
+
| **W12** hybrid (1k docs) | 713.53 µs | — | — |
|
|
126
150
|
|
|
127
151
|
---
|
|
128
152
|
|
|
@@ -1,8 +1,16 @@
|
|
|
1
1
|
# Concurrent writes plan — MVCC + `BEGIN CONCURRENT`
|
|
2
2
|
|
|
3
|
-
**
|
|
3
|
+
> 📘 **Looking for the user-facing reference?** This is the original
|
|
4
|
+
> design proposal, kept as the historical record of the decisions
|
|
5
|
+
> that shaped Phase 11. For the shipped surface — SQL, embedding API,
|
|
6
|
+
> SDK error mapping, REPL meta-commands, durability story,
|
|
7
|
+
> limitations — read [**`concurrent-writes.md`**](concurrent-writes.md)
|
|
8
|
+
> first; come back here when you want the *why* and the
|
|
9
|
+
> sequencing discussion.
|
|
10
|
+
|
|
11
|
+
**Status:** shipped end-to-end through Phase 11.11a (May 2026); a small set of follow-ups remain explicitly parked — see the [roadmap](roadmap.md#phase-11--concurrent-writes-via-mvcc--begin-concurrent-sqlr-22-in-flight--see-concurrent-writes-planmd). Drafted 2026-05-07.
|
|
4
12
|
**Inspiration:** [Turso](https://turso.tech) — a SQLite-compatible engine, written in Rust, that implements multi-version concurrency control to lift SQLite's single-writer ceiling. See [`turso/core/mvcc/`](https://github.com/tursodatabase/turso/tree/main/core/mvcc) and the [Turso concurrent-writes docs](https://docs.turso.tech/tursodb/concurrent-writes).
|
|
5
|
-
**Tracks:** SQLR
|
|
13
|
+
**Tracks:** [SQLR-22](https://app.marvinapp.io/) (Marvin).
|
|
6
14
|
|
|
7
15
|
This document proposes adding **multi-version concurrency control (MVCC)** and a **`BEGIN CONCURRENT`** transaction mode to SQLRite, enabling multiple writers in the same process to make progress in parallel under snapshot isolation, with row-level write-write conflict detection at commit. It is intentionally a *plan* — there is no code yet.
|
|
8
16
|
|
|
@@ -270,9 +278,11 @@ Goal: more than one `Connection` can target the same `Database` within a process
|
|
|
270
278
|
|
|
271
279
|
### Phase 10.5 — Checkpoint + crash recovery
|
|
272
280
|
|
|
273
|
-
-
|
|
274
|
-
|
|
275
|
-
-
|
|
281
|
+
> **Status (roadmap 11.9 — May 2026):** The crash-recovery half landed in roadmap Phase 11.9. WAL format is bumped to v3; commits append a typed `MvccCommitBatch` frame before the legacy save's fsync; reopen replays those frames into `MvStore` and seeds `MvccClock` past the highest `commit_ts`. The checkpoint-drain half — folding MVCC log records into pager-level updates and re-enabling the `Mvcc → Wal` journal-mode downgrade — is the remaining slice and stays parked for a follow-up.
|
|
282
|
+
|
|
283
|
+
- ~~Extend the checkpointer to drain MVCC log records into pager-level updates before folding the WAL into the main file.~~ *Deferred — see status note above.*
|
|
284
|
+
- Crash recovery: on open, replay WAL log records into `MvStore`, then replay pager-level commit frames as today. **(Shipped — 11.9.)**
|
|
285
|
+
- Tests: kill the process mid-MVCC-commit (between log-record append and version-chain push), reopen, verify the committed transaction is visible and the half-written one is not. **(Shipped — 11.9 covers the clean-drop case which exercises the same recovery codepath; a real OS-kill test is parked with the checkpoint-drain follow-up.)**
|
|
276
286
|
|
|
277
287
|
### Phase 10.6 — Garbage collection
|
|
278
288
|
|
|
@@ -294,9 +304,11 @@ Index maintenance under MVCC is hard enough that Turso explicitly punted on it.
|
|
|
294
304
|
|
|
295
305
|
### Phase 10.9 — Docs
|
|
296
306
|
|
|
297
|
-
|
|
298
|
-
|
|
299
|
-
-
|
|
307
|
+
> **Status (roadmap 11.12 — May 2026):** Shipped. The canonical user-facing reference at [`docs/concurrent-writes.md`](concurrent-writes.md) covers the SQL surface, embedding API, SDK error mapping, REPL meta-commands, durability story, and limitations as of Phase 11.11a. This plan-doc is now the historical record. Cross-references in `_index.md`, `supported-sql.md`, `embedding.md`, and `design-decisions.md` point at the canonical doc; a runnable example lives at [`examples/rust/concurrent_writers.rs`](../examples/rust/concurrent_writers.rs).
|
|
308
|
+
|
|
309
|
+
- Promote this plan to `docs/concurrent-writes.md` (the canonical user-facing reference), keeping `concurrent-writes-plan.md` as the historical design document. **(Shipped — 11.12.)**
|
|
310
|
+
- Update [roadmap.md](roadmap.md), [`docs/_index.md`](_index.md), [supported-sql.md](supported-sql.md), [embedding.md](embedding.md), [design-decisions.md](design-decisions.md). **(Shipped — 11.12.)**
|
|
311
|
+
- Add a worked example under `examples/rust/concurrent_writers.rs`. **(Shipped — 11.12.)**
|
|
300
312
|
|
|
301
313
|
---
|
|
302
314
|
|