@graphenedata/cli 0.0.16 → 0.0.18
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +65 -29
- package/dist/cli/{bigQuery-I3F46SC6.js → bigQuery-YIWXZPY6.js} +2 -2
- package/dist/cli/{chunk-QAXEOZ43.js → chunk-SQVXTHE5.js} +2 -2
- package/dist/cli/chunk-SQVXTHE5.js.map +7 -0
- package/dist/cli/{chunk-OVWODUTJ.js → chunk-UTV3ERGI.js} +279 -150
- package/dist/cli/chunk-UTV3ERGI.js.map +7 -0
- package/dist/cli/cli.js +33 -6
- package/dist/cli/{clickhouse-ZN5AN2UL.js → clickhouse-S3BJSKND.js} +3 -2
- package/dist/cli/clickhouse-S3BJSKND.js.map +7 -0
- package/dist/cli/{duckdb-IYBIO5KJ.js → duckdb-V6PJEA7H.js} +2 -2
- package/dist/cli/{serve2-TNN5EROW.js → serve2-CGQSM7TD.js} +7 -6
- package/dist/cli/{serve2-TNN5EROW.js.map → serve2-CGQSM7TD.js.map} +2 -2
- package/dist/cli/{snowflake-MOQB5GA4.js → snowflake-HVSTYBLB.js} +2 -2
- package/dist/index.d.ts +4 -4
- package/dist/lang/index.d.ts +4 -4
- package/dist/skills/graphene/SKILL.md +10 -3
- package/dist/skills/graphene/references/gsql.md +26 -23
- package/dist/skills/graphene/references/model-gsql.md +19 -21
- package/dist/ui/component-utilities/enrich.ts +88 -23
- package/dist/ui/component-utilities/format.ts +36 -21
- package/dist/ui/component-utilities/theme.ts +0 -1
- package/dist/ui/components/AreaChart.svelte +1 -1
- package/dist/ui/components/BarChart.svelte +1 -1
- package/dist/ui/components/LineChart.svelte +1 -1
- package/dist/ui/internal/LocalApp.svelte +29 -27
- package/dist/ui/internal/PageNavGroup.svelte +2 -2
- package/dist/ui/internal/Sidebar.svelte +7 -7
- package/dist/ui/internal/queryEngine.ts +13 -15
- package/dist/ui/internal/runSocket.ts +2 -5
- package/dist/ui/internal/sidebar.svelte.js +11 -1
- package/dist/ui/web.js +4 -2
- package/package.json +5 -1
- package/dist/cli/chunk-OVWODUTJ.js.map +0 -7
- package/dist/cli/chunk-QAXEOZ43.js.map +0 -7
- package/dist/cli/clickhouse-ZN5AN2UL.js.map +0 -7
- /package/dist/cli/{bigQuery-I3F46SC6.js.map → bigQuery-YIWXZPY6.js.map} +0 -0
- /package/dist/cli/{duckdb-IYBIO5KJ.js.map → duckdb-V6PJEA7H.js.map} +0 -0
- /package/dist/cli/{snowflake-MOQB5GA4.js.map → snowflake-HVSTYBLB.js.map} +0 -0
package/README.md
CHANGED
|
@@ -25,23 +25,35 @@
|
|
|
25
25
|
|
|
26
26
|
## Why Graphene?
|
|
27
27
|
|
|
28
|
-
|
|
28
|
+
Graphene is an everything-as-code analytics framework for SQL-based data exploration, visualization, and reporting. It is designed with coding agents in mind as the primary user persona.
|
|
29
29
|
|
|
30
|
-
|
|
31
|
-
- They focus on raising the floor at the expense of lowering the ceiling (limited viz types, simplified querying APIs).
|
|
32
|
-
- They assume the human user has the tribal knowledge and business context necessary for analysis.
|
|
30
|
+
It provides two critical pieces that allow coding agents to do better data work:
|
|
33
31
|
|
|
34
|
-
|
|
32
|
+
1. **A semantic layer**, which yields more accurate queries. GSQL combines the power of SQL with the governance of metrics and modeled joins.
|
|
33
|
+
2. **A dashboard file type**, which yields more consistent and polished visuals compared to raw Python or Javascript.
|
|
35
34
|
|
|
36
|
-
|
|
35
|
+
**Design goals**
|
|
37
36
|
|
|
38
|
-
-
|
|
39
|
-
-
|
|
40
|
-
-
|
|
37
|
+
- Token efficiency. Languages are designed to be brief with minimal boilerplate.
|
|
38
|
+
- Agent ergonomics. Graphene is controlled entirely via CLI. All documentation is inside our agent skill.
|
|
39
|
+
- High ceilings. GSQL follows ANSI and supports over 170 functions; Graphene's visualizations support anything that can be expressed with ECharts.
|
|
40
|
+
|
|
41
|
+
### Versus traditional BI
|
|
42
|
+
|
|
43
|
+
We believe coding agents coupled with an everything-as-code analytics stack beats traditional BI in several ways:
|
|
44
|
+
|
|
45
|
+
- Broad ecosystem of SOTA LLMs, harnesses, skills, and tools
|
|
46
|
+
- Leverage business-wide context from other tools or repos
|
|
47
|
+
- Perform end-to-end tasks across tools, where analytics is just one step
|
|
48
|
+
- More graceful change management and bulk refactors
|
|
49
|
+
- Easily promote/demote logic into or out of the semantic layer
|
|
50
|
+
- Version control and CI. Revert agent mistakes. Run tests on mission-critical dashboards.
|
|
51
|
+
- Tight, complete iteration loops. Agents can validate before running, view dashboards, and iterate locally
|
|
52
|
+
- Leverage continuous agents for self-healing codebases
|
|
41
53
|
|
|
42
54
|
### Open, forever
|
|
43
55
|
|
|
44
|
-
|
|
56
|
+
Graphene is free to use, forever. Your business logic lives in your repo and is never locked into a contract with us.
|
|
45
57
|
|
|
46
58
|
### Rich visualizations
|
|
47
59
|
|
|
@@ -49,16 +61,13 @@ Graphene pages support visualizations, input components for filtering and dynami
|
|
|
49
61
|
|
|
50
62
|
<img alt="Graphene Screenshots" src="./assets/page_examples.png"/>
|
|
51
63
|
|
|
52
|
-
### Powerful
|
|
64
|
+
### Powerful, next-generation semantic layer
|
|
53
65
|
|
|
54
|
-
|
|
66
|
+
Traditional semantic layers give you governance at the expense of capability. They tend to expose niche query APIs that agents aren't familiar with.
|
|
55
67
|
|
|
56
|
-
|
|
57
|
-
|
|
58
|
-
|
|
59
|
-
- Iterate on a dashboard (edit, run, view) without needing to push up to some API or open a SaaS portal
|
|
60
|
-
- Validate SQL and page syntax instantaneously as you type
|
|
61
|
-
- Set up a recurring agent that de-bloats, consolidates your model over time
|
|
68
|
+
GSQL's goal is to bring governance _without_ sacrificing capability. It behaves like regular SQL—with CTEs, subqueries, window functions, set operators, and more—but also adds in the concepts of measures and modeled joins from semantic layers.
|
|
69
|
+
|
|
70
|
+
GSQL is inspired by [Malloy](https://github.com/malloydata/malloy), from the creators of LookML Lloyd Tabb and Michael Toy, but implements it as good old SQL for agent familiarity.
|
|
62
71
|
|
|
63
72
|
## Get started
|
|
64
73
|
|
|
@@ -71,13 +80,10 @@ Once your project is set up, simply start the dev server via `npm exec graphene
|
|
|
71
80
|
|
|
72
81
|
## How it works
|
|
73
82
|
|
|
74
|
-
A Graphene project can either be a standalone repo or a directory within a larger codebase (such as dbt). It is comprised of:
|
|
75
|
-
|
|
76
|
-
- **Semantic models**, via .gsql files. GSQL is both a modeling language and a query language, in the same way that SQL has both DDL and DML.
|
|
77
|
-
- **Pages**, via .md files. Pages are typically used for dashboards, but can also contain notebook-style narratives, documentation, and other visual content.
|
|
78
|
-
|
|
79
83
|
Graphene itself is a CLI which can be installed via npm (or pnpm, yarn, etc.). The CLI can run and compile GSQL queries, render pages in the browser, check syntax, print screenshots, and more.
|
|
80
84
|
|
|
85
|
+
A Graphene project can either be a standalone repo or a directory within a larger codebase (such as dbt). It is comprised of _semantic models_ via .gsql files and _pages_ via .md files.
|
|
86
|
+
|
|
81
87
|
### GSQL and Graphene markdown
|
|
82
88
|
|
|
83
89
|
Semantic models are defined like so:
|
|
@@ -127,12 +133,42 @@ Graphene's entire documentation ships as an agent skill in the Graphene npm pack
|
|
|
127
133
|
|
|
128
134
|
## FAQ
|
|
129
135
|
|
|
130
|
-
<details>
|
|
131
|
-
<
|
|
132
|
-
If
|
|
136
|
+
<details><summary><b>Why coding agents?</b></summary>
|
|
137
|
+
<br/>
|
|
138
|
+
Context, mostly. If your BI stack lives in a folder right next to the rest of your company’s data and code, an agent can make smarter decisions on what it should be analyzing and why it matters.
|
|
139
|
+
<br/><br/>
|
|
140
|
+
The reverse is also true. If you’re working on building out some new feature or a recommendation for a new client, the agent doing that work can ground it’s approach in real data and past analytical insights.
|
|
141
|
+
<br/><br/>
|
|
142
|
+
Lock-in is the other big reason we hear. Folks post-SaaS are wary of having their data and dashboards locked away in some proprietary tool, or forced to use a single LLM provider. With Graphene, you own all the files in your repo. You can use whatever agent or LLM you’d like.
|
|
143
|
+
</details>
|
|
144
|
+
|
|
145
|
+
<details><summary><b>How do you make money?</b></summary>
|
|
146
|
+
<br/>
|
|
147
|
+
We’re building out Graphene Cloud as a turnkey solution to host the dashboards and reports your agent builds. We also host an MCP server and Slack bot that you can use for quick questions. If you'd like to pilot it, contact us <a href="https://graphenedata.com/contact-us">here</a>.
|
|
133
148
|
</details>
|
|
134
149
|
|
|
135
|
-
<details>
|
|
136
|
-
<
|
|
137
|
-
|
|
150
|
+
<details><summary><b>So does everyone have to use git and a coding agent to use Graphene for BI?</b></summary>
|
|
151
|
+
<br/>
|
|
152
|
+
If you just want to use this project and nothing more, yes. Our managed service, Graphene Cloud, offers a Slack agent, MCP server, and browser-based SaaS experience.
|
|
153
|
+
</details>
|
|
154
|
+
|
|
155
|
+
<details><summary><b>Is my data team out of a job?</b></summary>
|
|
156
|
+
<br/>
|
|
157
|
+
No, but we think the nature of the work is going to change. Instead of manually building out reports, data experts are going to be shaping the skills, models, and tools that the rest of their team uses to answer data questions.
|
|
158
|
+
<br/><br/>
|
|
159
|
+
Data teams are going to be focused on guiding agents on how to approach the trickiest and most nebulous data questions at a company. Questions that still require a data expert’s taste to get a good solution.
|
|
160
|
+
</details>
|
|
161
|
+
|
|
162
|
+
<details><summary><b>Can’t I just vibe code dashboards?</b></summary>
|
|
163
|
+
<br/>
|
|
164
|
+
You could! In fact a lot of the folks we’ve talked to have started down this route. The main problem you’ll run into is consistency. The look and feel of your dashboards and reports are all over the place, and in the worst case they end up using different formula to compute the same key metric.
|
|
165
|
+
<br/><br/>
|
|
166
|
+
GSQL codifies metrics into deterministic objects you can directly invoke in queries. Not only does this ensure that every use of "EBITDA" will be the same, the metadata tags we attach can hint our charts into formatting data correctly.
|
|
167
|
+
<br/><br/>
|
|
168
|
+
Graphene raises the floor so that pages you generate with the help of an agent look beautiful by default, so you can move faster with less tokens.
|
|
169
|
+
</details>
|
|
170
|
+
|
|
171
|
+
<details><summary><b>What software license does this use?</b></summary>
|
|
172
|
+
<br/>
|
|
173
|
+
Graphene is licensed under the Elastic License 2.0 which allows you to use it for internal use cases for free, forever. If you would like to build your own commercial application with Graphene, please contact us <a href="https://graphenedata.com/contact-us">here</a>.
|
|
138
174
|
</details>
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
import {
|
|
2
2
|
config
|
|
3
|
-
} from "./chunk-
|
|
3
|
+
} from "./chunk-SQVXTHE5.js";
|
|
4
4
|
|
|
5
5
|
// connections/bigQuery.ts
|
|
6
6
|
import { BigQuery, BigQueryDate, BigQueryTimestamp } from "@google-cloud/bigquery";
|
|
@@ -72,4 +72,4 @@ var BigQueryConnection = class {
|
|
|
72
72
|
export {
|
|
73
73
|
BigQueryConnection
|
|
74
74
|
};
|
|
75
|
-
//# sourceMappingURL=bigQuery-
|
|
75
|
+
//# sourceMappingURL=bigQuery-YIWXZPY6.js.map
|
|
@@ -23,7 +23,7 @@ function normalizeConfig(input, defaultRoot = process.cwd()) {
|
|
|
23
23
|
dialect,
|
|
24
24
|
root: path.resolve(cfg.root || defaultRoot),
|
|
25
25
|
port: cfg.port || Number(process.env.GRAPHENE_PORT) || 4e3,
|
|
26
|
-
ignoredFiles: cfg.ignoredFiles || [
|
|
26
|
+
ignoredFiles: cfg.ignoredFiles || [],
|
|
27
27
|
envFile
|
|
28
28
|
};
|
|
29
29
|
}
|
|
@@ -50,4 +50,4 @@ export {
|
|
|
50
50
|
setGlobalConfig,
|
|
51
51
|
loadConfig
|
|
52
52
|
};
|
|
53
|
-
//# sourceMappingURL=chunk-
|
|
53
|
+
//# sourceMappingURL=chunk-SQVXTHE5.js.map
|
|
@@ -0,0 +1,7 @@
|
|
|
1
|
+
{
|
|
2
|
+
"version": 3,
|
|
3
|
+
"sources": ["../../../lang/config.ts"],
|
|
4
|
+
"sourcesContent": ["import {existsSync} from 'node:fs'\nimport {readFile} from 'node:fs/promises'\nimport path from 'path'\n\nexport interface Config {\n root: string\n dialect: string\n defaultNamespace?: string\n ignoredFiles: string[]\n telemetry?: boolean\n port?: number\n host?: string\n envFile: string[] // array of paths where we can look for the env file\n\n bigquery?: {\n projectId?: string\n keyPath?: string\n }\n\n snowflake?: {\n account: string\n username: string\n privateKeyPath: string\n schema?: string\n database?: string\n }\n\n clickhouse?: {\n url?: string\n username?: string\n database?: string\n requestTimeout?: number\n }\n\n duckdb?: {\n path?: string\n }\n}\n\nexport type ConfigInput = Omit<Config, 'root' | 'dialect' | 'ignoredFiles' | 'envFile'> & {\n root?: string\n dialect?: Config['dialect']\n ignoredFiles?: Config['ignoredFiles']\n envFile?: string | string[]\n namespace?: string\n}\n\nexport let config: Config = {dialect: 'duckdb', root: ''} as Config\n\nexport function setGlobalConfig(cfg: ConfigInput) {\n Object.keys(config).forEach(key => delete config[key])\n Object.assign(config, normalizeConfig(cfg))\n}\n\nexport function normalizeConfig(input: ConfigInput, defaultRoot = process.cwd()): Config {\n let cfg = {...input}\n if (cfg.namespace && !cfg.defaultNamespace) cfg.defaultNamespace = cfg.namespace\n\n let dialect = cfg.dialect || 'duckdb'\n if (cfg.bigquery) dialect = 'bigquery'\n else if (cfg.snowflake) dialect = 'snowflake'\n else if (cfg.clickhouse) dialect = 'clickhouse'\n else if (cfg.duckdb) dialect = 'duckdb'\n let envFile = ['.env']\n if (Array.isArray(cfg.envFile)) envFile = cfg.envFile\n else if (cfg.envFile) envFile = [cfg.envFile]\n\n return {\n ...cfg,\n dialect,\n root: path.resolve(cfg.root || defaultRoot),\n port: cfg.port || Number(process.env.GRAPHENE_PORT) || 4000,\n ignoredFiles: cfg.ignoredFiles || [],\n envFile,\n } as Config\n}\n\n// Read graphene config from the nearest parent package.json.\nexport async function loadConfig(dir: string, envLoader: (envFiles: string[]) => void): Promise<Config> {\n // seek upwards from dir looking for package.json\n let configDir = path.resolve(dir)\n while (!existsSync(path.join(configDir, 'package.json'))) {\n let parent = path.dirname(configDir)\n if (parent == configDir) throw new Error(`No package.json found in ${path.resolve(dir)} or its parents`)\n configDir = parent\n }\n\n let txt = await readFile(path.join(configDir, 'package.json'), 'utf8')\n let graphene = JSON.parse(txt).graphene\n if (!graphene || typeof graphene != 'object' || Array.isArray(graphene)) {\n throw new Error(`No graphene config found in ${path.join(configDir, 'package.json')}`)\n }\n\n // config can provide 1 or more env files that Graphene should load. Default to just `.env`\n let envFiles = Array.isArray(graphene.envFile) ? graphene.envFile : [graphene.envFile || '.env']\n envLoader(envFiles.map(file => path.resolve(configDir, file)))\n\n let cfg = normalizeConfig({...graphene, root: configDir}, configDir)\n return cfg\n}\n"],
|
|
5
|
+
"mappings": ";AAAA,SAAQ,kBAAiB;AACzB,SAAQ,gBAAe;AACvB,OAAO,UAAU;AA6CV,IAAI,SAAiB,EAAC,SAAS,UAAU,MAAM,GAAE;AAEjD,SAAS,gBAAgB,KAAkB;AAChD,SAAO,KAAK,MAAM,EAAE,QAAQ,SAAO,OAAO,OAAO,GAAG,CAAC;AACrD,SAAO,OAAO,QAAQ,gBAAgB,GAAG,CAAC;AAC5C;AAEO,SAAS,gBAAgB,OAAoB,cAAc,QAAQ,IAAI,GAAW;AACvF,MAAI,MAAM,EAAC,GAAG,MAAK;AACnB,MAAI,IAAI,aAAa,CAAC,IAAI,iBAAkB,KAAI,mBAAmB,IAAI;AAEvE,MAAI,UAAU,IAAI,WAAW;AAC7B,MAAI,IAAI,SAAU,WAAU;AAAA,WACnB,IAAI,UAAW,WAAU;AAAA,WACzB,IAAI,WAAY,WAAU;AAAA,WAC1B,IAAI,OAAQ,WAAU;AAC/B,MAAI,UAAU,CAAC,MAAM;AACrB,MAAI,MAAM,QAAQ,IAAI,OAAO,EAAG,WAAU,IAAI;AAAA,WACrC,IAAI,QAAS,WAAU,CAAC,IAAI,OAAO;AAE5C,SAAO;AAAA,IACL,GAAG;AAAA,IACH;AAAA,IACA,MAAM,KAAK,QAAQ,IAAI,QAAQ,WAAW;AAAA,IAC1C,MAAM,IAAI,QAAQ,OAAO,QAAQ,IAAI,aAAa,KAAK;AAAA,IACvD,cAAc,IAAI,gBAAgB,CAAC;AAAA,IACnC;AAAA,EACF;AACF;AAGA,eAAsB,WAAW,KAAa,WAA0D;AAEtG,MAAI,YAAY,KAAK,QAAQ,GAAG;AAChC,SAAO,CAAC,WAAW,KAAK,KAAK,WAAW,cAAc,CAAC,GAAG;AACxD,QAAI,SAAS,KAAK,QAAQ,SAAS;AACnC,QAAI,UAAU,UAAW,OAAM,IAAI,MAAM,4BAA4B,KAAK,QAAQ,GAAG,CAAC,iBAAiB;AACvG,gBAAY;AAAA,EACd;AAEA,MAAI,MAAM,MAAM,SAAS,KAAK,KAAK,WAAW,cAAc,GAAG,MAAM;AACrE,MAAI,WAAW,KAAK,MAAM,GAAG,EAAE;AAC/B,MAAI,CAAC,YAAY,OAAO,YAAY,YAAY,MAAM,QAAQ,QAAQ,GAAG;AACvE,UAAM,IAAI,MAAM,+BAA+B,KAAK,KAAK,WAAW,cAAc,CAAC,EAAE;AAAA,EACvF;AAGA,MAAI,WAAW,MAAM,QAAQ,SAAS,OAAO,IAAI,SAAS,UAAU,CAAC,SAAS,WAAW,MAAM;AAC/F,YAAU,SAAS,IAAI,UAAQ,KAAK,QAAQ,WAAW,IAAI,CAAC,CAAC;AAE7D,MAAI,MAAM,gBAAgB,EAAC,GAAG,UAAU,MAAM,UAAS,GAAG,SAAS;AACnE,SAAO;AACT;",
|
|
6
|
+
"names": []
|
|
7
|
+
}
|