npm - @knockdata/objectexplorer - Versions diffs - 0.5.3 → 0.5.6 - Mend

@knockdata/objectexplorer 0.5.3 → 0.5.6

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (11) hide show

package/README.md CHANGED Viewed

@@ -3,53 +3,13 @@
 **The VSCode for Cloud Storage.** Browse, preview, query and search S3, Google Cloud Storage,
 Azure Blob and local folders in one window — and every byte stays on your machine.
-<img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/screenshot/objectexplorer.png" width="800">
+<img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/docs/public/shot/hero.png" width="800">
-## Install
+📖 **[Documentation](https://objectexplorer.com)** · 🚀 [Try it in a browser](https://objectexplorer.com/app)
-Every link below always points at the newest build. Click the one for your machine.
+## Run it with npx
-| Platform | Download |
-|---|---|
-| macOS, Apple Silicon | [ObjectExplorer-mac-arm64.dmg](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-mac-arm64.dmg) |
-| macOS, Intel | [ObjectExplorer-mac-x64.dmg](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-mac-x64.dmg) |
-| Windows, x64 | [ObjectExplorer-windows-x64.exe](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-windows-x64.exe) |
-| Windows, ARM | [ObjectExplorer-windows-arm64.exe](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-windows-arm64.exe) |
-| Linux, x64 | [ObjectExplorer-linux-x64.AppImage](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-linux-x64.AppImage) |
-| Linux, ARM | [ObjectExplorer-linux-arm64.AppImage](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-linux-arm64.AppImage) |
-Older versions, and the release notes for each one, are on the
-[releases page](https://github.com/knockdata/objectexplorer/releases).
-**macOS** — open the `.dmg` and drag ObjectExplorer to Applications. The app is signed with a
-Developer ID and notarized, so it opens on the first double-click.
-**Windows** — the download is one signed `.exe`. There is no installer and no folder of loose
-`.dll` files: run it where it lands.
-**Linux** — one AppImage:
-```sh
-chmod +x ObjectExplorer-linux-x64.AppImage
-./ObjectExplorer-linux-x64.AppImage
-```
-The window is drawn with the WebKitGTK your distribution ships, and ObjectExplorer opens in your
-default browser on a machine that has none. To get the native window, install it:
-```sh
-sudo apt install libwebkit2gtk-4.1-0        # Debian, Ubuntu
-sudo dnf install webkit2gtk4.1              # Fedora, RHEL
-sudo pacman -S webkit2gtk-4.1               # Arch
-sudo zypper install libwebkit2gtk-4_1-0     # openSUSE
-```
-On an older release without a 4.1 package, the 4.0 one (`libwebkit2gtk-4.0-37`, `webkit2gtk3`)
-works too.
-## Or run it with npx
-No install at all, if you already have Node 20+ installed on your machine:
+No install at all, if you already have Node 20+ on your machine:
 ```sh
 npx @knockdata/objectexplorer
@@ -62,18 +22,21 @@ arguments are optional:
 npx @knockdata/objectexplorer ~/data port=9421
 ```
+If PowerShell refuses to run `npx`, see
+[troubleshooting](https://objectexplorer.com/reference/troubleshooting).
-<details>
-<summary>Windows: "npx.ps1 cannot be loaded because running scripts is disabled on this system"</summary>
+## Or install the app
-- Right click PowerShell and choose **Run as administrator**
-- Run `Get-ExecutionPolicy` — if it says `Restricted`, it needs changing
-- Run `Set-ExecutionPolicy RemoteSigned`
-- Run `Get-ExecutionPolicy` again — it should now say `RemoteSigned`
-`npx` then works in that terminal, and in any new one.
+| Platform | Download |
+|---|---|
+| macOS, Apple Silicon | [ObjectExplorer-mac-arm64.dmg](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-mac-arm64.dmg) |
+| macOS, Intel | [ObjectExplorer-mac-x64.dmg](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-mac-x64.dmg) |
+| Windows, x64 | [ObjectExplorer-windows-x64.msix](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-windows-x64.msix) |
+| Windows, ARM | [ObjectExplorer-windows-arm64.msix](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-windows-arm64.msix) |
+| Linux, x64 | [ObjectExplorer-linux-x64.AppImage](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-linux-x64.AppImage) |
+| Linux, ARM | [ObjectExplorer-linux-arm64.AppImage](https://github.com/knockdata/objectexplorer/releases/latest/download/ObjectExplorer-linux-arm64.AppImage) |
-</details>
+Per-platform notes are in [getting started](https://objectexplorer.com/getting-started).
 ## What it solves
@@ -84,182 +47,53 @@ credentials, and a `Downloads` folder full of data that should never have left t
 ObjectExplorer collapses that loop:
-- **One window for every provider.** S3, GCS, Azure Blob and your local disks in the same tree, with
-  the same keyboard shortcuts.
+- **One window for every provider.** S3, GCS, Azure Blob, MinIO and your local disks in the same
+  tree, with the same keyboard shortcuts.
 - **Preview instead of download.** Formats render in place — including the ones no console will ever
   open, like Parquet, SPSS and SAS.
 - **Search across buckets.** One query over local folders and cloud prefixes at the same time.
 - **Query, chart and model in place.** A table opens as a notebook: SQL over the object, a chart of
   what came back, and a gradient boosting model over the rows — all on your machine.
+- **Delta, Iceberg and Hudi are just tables.** Point DuckDB at the folder and it answers, deletes
+  and schema changes included.
+- **Move things where they belong.** Copy, move, rename and delete across buckets and disks, with
+  one Undo.
 ## Your data never leaves your machine
-This is the part that matters when you work with data you are not allowed to copy.
 ObjectExplorer is an HTTP server bound to `127.0.0.1` plus the OS webview, both inside the same
 executable. Every parser — Parquet, SPSS, SAS, PDF, the office formats, the image decoders — runs
 in a worker on your own machine.
 - Objects are fetched **from your cloud provider to your computer**, and nowhere else. We run no
   backend that sees your data, because there is nothing for it to see.
-- Credentials stay local: `~/.objectexplorer/folders.json`, plus whatever your platform CLI or
-  keychain already holds. Nothing is synced.
+- Credentials stay local, in `~/.objectexplorer` — plus whatever your platform CLI or keychain
+  already holds. Nothing is synced.
 - The only call that is not to your own storage is a version check against the npm registry, so the
   app can tell you an update exists.
-- Nothing is uploaded for "processing", no file names are reported anywhere, and no account is
-  needed to open a file.
-Which also means there is no data-processing agreement to negotiate before anyone can look at a
-bucket.
-## Storage providers
-| | Provider | Connect with |
-|---|---|---|
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/s3.svg" width="18"> | Amazon S3 | drop your `accessKeys.csv`, paste a key ID and secret, or sign in with the AWS CLI |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/gcs.svg" width="18"> | Google Cloud Storage | sign in with your Google account |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/cloud.svg" width="18"> | Azure Blob Storage | a connection string, a SAS URL, or sign in with Microsoft |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/minio.svg" width="18"> | MinIO | your own endpoint, for self-hosted S3-compatible storage |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/folder.svg" width="18"> | Local folders | the native folder picker — any disk, any mounted volume |
-Buckets show up in the tree once you add them, so a thousand-bucket account still opens on the five
-you actually use.
+→ [the whole argument](https://objectexplorer.com/privacy), and
+[where your data lives](https://objectexplorer.com/reference/data-locations)
 ## Features
-### Column summary
-<img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/screenshot/column-summary.png" width="600">
-Open a table and every column comes with its own shape: a histogram for numbers, a box plot for
-distributions, a split bar for categories, a unique count for identifiers, the range underneath. It
-answers "is this the file I want?" without a line of pandas — computed locally, straight from the
-file you are looking at.
-Works on Parquet, CSV, SPSS `.sav` and SAS `.xpt`.
-### Notebook
-Open a table and it opens as a notebook: a column of cells, each one a few lines of code over its
-own output. The first two are already written — a `SELECT *` over the object you clicked, and a
-chart of what that query returned — so the file is queried and plotted before you have typed
-anything.
-```sql
-SELECT * FROM 'gs://sales-eu/orders/2026-08-24.parquet' LIMIT 10000
-```
-The query runs on your machine, against the object where it lives. Nothing is staged into a
-temporary folder first: DuckDB reads the bucket directly, so a `WHERE` over a multi-gigabyte
-Parquet file touches the row groups it needs and no more.
-Cells are piped rather than shared. Each one reads the rows produced by the nearest cell above it
-that produced any, so a query narrows the data and everything under it — the chart, the model, the
-next query — sees what came back. Nothing re-runs on its own: a cell runs from its run button or
-Shift+Enter, so what is on screen is always something you asked for.
-| Cell | What it is |
+| | |
 |---|---|
-| **Table** | SQL, with the rows as a virtualized grid — column summaries and all |
-| **Chart** | a plot of the rows above, as source you can edit |
-| **Model** | gradient boosting over the rows above |
-| **Code** | JavaScript over the same rows, with a pandas-style dataframe already in scope |
-| **Text** | markdown, rendered when you click away |
-A chart cell writes its own first draft. The column statistics say which column is a date, which is
-a category, which is a measure and which is an id that counts up once per row — and the strip under
-the code offers the charts those columns actually support, named in plain words. Click one and its
-source is written into the editor and drawn. After that it is source, and it is yours.
-A folder is a table too: Delta, Iceberg and Hudi tables, Hive-partitioned exports and `YYYY/MM/DD`
-date prefixes are read as one table rather than as a pile of files.
-Notebooks are kept per object. Reopen the file next week — in another window, or after a restart —
-and your cells are still there.
-Queryable: `parquet` `csv` `tsv` `json` `jsonl` `xlsx` `avro`, plus SPSS `.sav` and SAS
-`.sas7bdat` `.xpt`. ORC, Arrow and HDF5 open as grids and charts too; only SQL over them is
-missing, and the cell says so.
-### Train a model on it
-A model cell is gradient boosting — LightGBM, compiled to WebAssembly and running inside the app —
-over the rows the cell above produced.
-Pick the label, the column you want predicted, and the rest comes from the same statistics the grid
-already drew: whether the question is *which one* or *how much*, which columns are worth training
-on, and which are row numbers, ids or coordinates that would teach the model the order the file was
-written in and nothing else.
-The controls hide nothing. Leaves, learning rate and iterations are three sliders, and moving one
-prints the JavaScript underneath it — that printed source is what trains, so a slider and a hand
-edit end in the same place.
-Two plots come out of it. Training draws what the model learned: the features ranked by their share
-of the total gain. Prediction answers the other question — pick a row, and a waterfall walks from
-what the model says on average to what it said about that one row, feature by feature. Those
-contributions are TreeSHAP, exact and additive, so the steps add up to the prediction rather than
-approximating it. Both plots show the same features in the same order, so the pair reads across:
-what a column is worth over the whole file, and what it did to this row.
-It all runs where the data already is. A model over a bucket you are not allowed to copy out of is
-still just a local read.
-### Search
-Search local folders and cloud buckets in the same run: literal, whole word or regex, with include
-and exclude globs, and `.gitignore` honoured when you point it at a repo. Results group by file with
-the matching line in context, and large objects are searched without pulling them down whole.
-### Hex
-Any file, any size, straight to bytes. Offsets, hex pairs and the ASCII column, virtualized so a
-multi-gigabyte object opens instantly instead of after a spinner. Exactly what you need when a
-format is not recognized and the first 64 bytes decide what it is.
-### Sprite sheets
-<img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/screenshot/sprite-sheet.png" width="900">
-Open a TextureAtlas or SpriteSheet XML and ObjectExplorer draws it: the atlas image with every
-sprite's bounding box overlaid and named, aligned to the real pixels however the image is scaled.
-Hover a box to read the frame name — no importing the sheet into an engine to find out which tile is
-`medievalTile_04`.
-### Inside archives, without extracting
-Step into a `.zip`, a `.dmg`, or an office file — `.pptx` and `.xlsx` are zips too — and browse the
-entries as if they were folders. Each entry previews with its own viewer, so a CSV inside a zip
-inside a bucket is still just a table.
-## Formats
-| | Kind | Formats |
-|---|---|---|
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/parquet.svg" width="18"> | Parquet | `parquet` — schema, rows, column summaries |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/table.svg" width="18"> | Data lake | `delta` `iceberg` `hudi`, Hive and date partitions — a folder read as one table |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/table.svg" width="18"> | Tabular | `csv` `json` `jsonl` `yaml` `yml` |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/sas.svg" width="18"> | Statistics | `xpt` (SAS transport), `sav` (SPSS) |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/powerpoint.svg" width="18"> | Presentations | `pptx` `potx` `ppsx` `ppt` `pot` `pps` `key` |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/excel.svg" width="18"> | Spreadsheets | `xlsx` `xltx` |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/word.svg" width="18"> | Documents | `docx` `dotx` `pdf` `evernote` |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/text.svg" width="18"> | Text and code | `md` `markdown` `txt` `html` `xml` `xsl` `js` `py`, syntax highlighted |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/jupyter.svg" width="18"> | Notebooks | `ipynb` — cells with their outputs |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/image.svg" width="18"> | Images | `png` `jpg` `jpeg` `webp` `svg` `ico` — with EXIF, GPS and embedded text |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/music.svg" width="18"> | Audio | `mp3` `wav` `m4a` `aiff` `bwf` `3gpp` — waveform and spectrogram |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/film.svg" width="18"> | Video | played in place, no download first |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/excalidraw.svg" width="18"> | Drawings | `excalidraw` |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/mermaid.svg" width="18"> | Diagrams | `mmd` `mermaid`, rendered |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/archive.svg" width="18"> | Archives | `zip` `dmg` `apkg`, and the office formats, browsed as folders |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/apple.svg" width="18"> | Apple | `plist` `provisionprofile` `.DS_Store` — binary plists decoded |
-| <img src="https://raw.githubusercontent.com/knockdata/objectexplorer/refs/heads/main/assets/format/hex-mode.svg" width="18"> | Everything else | hex, always available |
+| [Connect storage](https://objectexplorer.com/storage/connect) | S3, GCS, Azure Blob, MinIO, local folders — added one root at a time |
+| [Preview anything](https://objectexplorer.com/explore/preview) | parquet, csv, json, SPSS, SAS, pdf, office, images, audio, video, ebooks, sprite sheets, hex |
+| [Column summaries](https://objectexplorer.com/explore/column-summary) | a histogram, a box plot or a split bar under every column header |
+| [Notebook](https://objectexplorer.com/analyze/notebook) | SQL, charts, models and JavaScript over the object you clicked |
+| [Data lake tables](https://objectexplorer.com/analyze/lake) | Delta, Iceberg, Hudi and partitioned exports, read as one table |
+| [Models](https://objectexplorer.com/analyze/model) | LightGBM in WebAssembly, with exact TreeSHAP explanations |
+| [Search](https://objectexplorer.com/explore/search) | local folders and cloud prefixes in the same run |
+| [File management](https://objectexplorer.com/explore/file-management) | copy, move, rename, delete across providers, with a trash and an undo |
+| [Sharing](https://objectexplorer.com/explore/share) | a link to a table, masked or hashed column by column, with an expiry |
+The whole list of formats is on [every format](https://objectexplorer.com/formats/).
 ## Links
-- [objectexplorer.com](https://objectexplorer.com) — screenshots and the full tour
-- [@knockdata/objectexplorer](https://www.npmjs.com/package/@knockdata/objectexplorer) — the npm package behind `npx`
-- [Changelog](https://github.com/knockdata/objectexplorer/blob/main/CHANGELOG.md) — what changed in each version
-- [Releases](https://github.com/knockdata/objectexplorer/releases) — every version, every platform
-Under the hood it is a single native binary: no Electron, no Chromium, just the OS webview (WebKit
-on macOS and Linux, WebView2 on Windows) pointed at the HTTP server running inside the same
-executable.
+- [objectexplorer.com](https://objectexplorer.com) — the documentation
+- [objectexplorer.com](https://objectexplorer.com) — the product page
+- [Changelog](https://github.com/knockdata/objectexplorer/blob/main/CHANGELOG.md)
+- [Releases](https://github.com/knockdata/objectexplorer/releases)

package/app/assets/ShareView.js ADDED Viewed

	@@ -0,0 +1,2 @@
1	+ import{K as e,P as t,X as n,h as r,nt as i,ot as a,s as o}from"./share.js";function s(e){return t(new Date(e*1e3).toISOString())}var c=`import lightgbm as lgb
2	+ booster = lgb.Booster(model_str=open("model.txt").read())`;function l(e){return n(`div`,{class:`share-view`},n(`div`,{class:`share-view-header`},n(`span`,{class:`share-view-title`},`Nothing to show`)),n(`div`,{class:`share-view-failed`},e))}function u(e){let t=e.filter(e=>e.method&&e.method!==`none`);return t.length===0?`every column as it was`:t.map(e=>`${e.name}: ${e.method}`).join(`, `)}function d(t){let r=t.model??{},i=a(r.features??[]);function o(){let e=URL.createObjectURL(new Blob([r.text??``],{type:`text/plain`})),t=document.createElement(`a`);t.href=e,t.download=`model.txt`,t.click(),URL.revokeObjectURL(e)}return n(`div`,{class:`share-view-model`},n(`div`,{class:`share-model`},`${r.objective??`model`}, ${r.trees??0} trees, label ${r.label??`?`}`),n(`div`,{class:`share-view-features`},n(e,{each:i},e=>n(`span`,{class:`share-view-feature`},e))),n(`div`,{class:`share-send`},n(`span`,{class:`btn`,onclick:o},`Download model.txt`)),n(`pre`,{class:`share-view-snippet`},c))}async function f(e){let{reference:t}=e,a=null,c=``;try{a=await o(t)}catch(e){c=String(e.message??e)}if(a===null)return l(c);if(a.expires*1e3<Date.now())return l(`this link expired on `+s(a.expires));{let e=a.columns??[],t=i(()=>a.kind===`table`?`${(a.rows??[]).length} rows — ${u(e)}`:`a trained model, without the rows it was trained on`);return n(`div`,{class:`share-view`},n(`div`,{class:`share-view-header`},n(`span`,{class:`share-view-title`},a.title??`Shared`),n(`span`,{class:`share-hint`},t),n(`span`,{class:`share-hint`},`until ${s(a.expires)}`)),n(`div`,{class:`share-view-body`},a.kind===`model`?d(a):n(r,{payload:a.rows??[],columns:e})))}}export{f as default};