@nothumanwork/wit 0.1.16 → 0.1.18

package/README.md

@@ -64,13 +64,13 @@ cargo install --path .
 
 ```bash
 wit search -p 'ratatui' -l 'Rust'                        # Find repos
-wit tree ratatui/ratatui                                   # See structure
-wit ls -l ratatui/ratatui src                              # Browse with sizes
-wit rg -l 'impl Widget' ratatui/ratatui                    # Find files
-wit cat -n ratatui/ratatui src/lib.rs                      # Read a file
-wit head -n 30 ratatui/ratatui Cargo.toml                  # Preview a file
-wit sed -n '100,150p' ratatui/ratatui src/lib.rs           # Extract range
-wit rg 'TODO' ratatui/ratatui --ignore '.git' --ignore '*.png'  # Exclude paths
+wit tree -r ratatui/ratatui                                   # See structure
+wit ls -l -r ratatui/ratatui src                              # Browse with sizes
+wit rg -l 'impl Widget' -r ratatui/ratatui                    # Find files
+wit cat -n -r ratatui/ratatui src/lib.rs                      # Read a file
+wit head -n 30 -r ratatui/ratatui Cargo.toml                  # Preview a file
+wit sed -n -r ratatui/ratatui '100,150p' src/lib.rs           # Extract range
+wit rg 'TODO' -r ratatui/ratatui --ignore '.git' --ignore '*.png'  # Exclude paths
 ```
 
 ## Global Options
@@ -82,75 +82,76 @@ wit rg 'TODO' ratatui/ratatui --ignore '.git' --ignore '*.png'  # Exclude paths
 Ignore examples:
 
 ```bash
-wit tree ratatui/ratatui --ignore '.github' --ignore 'assets/**'
-wit ls ratatui/ratatui src --ignore 'generated'
-wit rg 'fn main' ratatui/ratatui --ignore '.git' --ignore '*.lock'
-wit cat ratatui/ratatui src/main.rs --ignore 'src/main.rs'   # blocked (explicitly ignored)
+wit tree -r ratatui/ratatui --ignore '.github' --ignore 'assets/**'
+wit ls -r ratatui/ratatui src --ignore 'generated'
+wit rg 'fn main' -r ratatui/ratatui --ignore '.git' --ignore '*.lock'
+wit cat -r ratatui/ratatui src/main.rs --ignore 'src/main.rs'   # blocked (explicitly ignored)
 ```
 
-`search` accepts `--ignore`, but applies it only when `--with-snippets` is enabled.
+`search` ignores `--ignore`, because repository discovery is done through GitHub's repository search API rather than cached file traversal.
 
 ## Commands
 
 ### search (alias: s)
 
-Find GitHub repositories by name and search their code via grep.app.
+Discover repositories using **GitHub’s repository search API** only. Results are ordered by **stars** and the table shows **stars**. Use `-p/--pattern` for a repository-name filter, `-l/--lang` for a GitHub `language:` qualifier, and `-q/--query` to pass raw GitHub repository-search terms and qualifiers through unchanged.
+
+Set **`GITHUB_TOKEN`** for higher GitHub rate limits. GitHub’s `language:` filter must match [GitHub language names](https://github.com/search?q=language%3ARust&type=repositories). `wit search` fetches only enough GitHub pages to satisfy `--limit` (default: `10`, max: `1000`). GitHub may return at most 1000 repositories per query; if GitHub sets `incomplete_results`, a warning is printed.
 
 ```bash
-wit search -p 'ratatui' -l 'Rust'                  # Find Rust repos named 'ratatui'
-wit search -p 'auth' -q 'JWT' -l 'Go' -w           # Find Go auth repos using JWT, show code
-wit search -p 'ratatui' -q 'impl Widget' -w -c      # Matching lines only, no context
+wit search -p 'ratatui' -l 'Rust' --limit 20                 # Rust repos named ratatui (by stars)
+wit search -q 'stars:>1000 topic:tui archived:false'         # Raw GitHub qualifiers
+wit search -p 'auth' -q 'user:ory language:Go pushed:>2025-01-01'
 ```
 
 | Flag | Long | Description |
 |------|------|-------------|
-| `-p` | `--pattern` | Regex pattern to match repository names (required) |
-| `-l` | `--lang` | Filter results by language |
-| `-q` | `--query` | Code pattern to search within repos (default: `.*`) |
-| `-r` | `--regex` | Enable regex search (default: true) |
-| `-w` | `--with-snippets` | Show code snippets with context |
-| `-c` | `--compact` | Show only matching lines (requires `-w`) |
+| `-p` | `--pattern` | Optional repository-name filter (`in:name`) |
+| `-l` | `--lang` | Optional GitHub `language:` qualifier |
+| `-q` | `--query` | Raw GitHub search terms and qualifiers, passed through as-is |
+| `-n` | `--limit` | Maximum repositories to print (default `10`, max `1000`) |
 
 ### cache (alias: c)
 
-Clone a repository into the local cache (or refresh an existing one). Repos are auto-cached on first use by other commands.
+Clone a repository into the local cache (or refresh an existing one). Pass the repository with `-r` / `--repo` (`owner/repo`). Repos are auto-cached on first use by other commands.
 
 ```bash
-wit cache ratatui/ratatui          # Force re-clone of ratatui
+wit cache -r ratatui/ratatui          # Force re-clone of ratatui
 ```
 
 ### tree (alias: t)
 
-Show the file tree of a repository (or subtree). Use `-l` for line counts and token estimates.
+Show the file tree of a repository (or subtree). Pass the repository with `-r` / `--repo` (`owner/repo`). Use `-l` for line counts and token estimates.
 
 ```bash
-wit tree ratatui/ratatui                # Full repo tree
-wit tree ratatui/ratatui src/widgets    # Only the widgets subtree
-wit tree -l ratatui/ratatui src         # With line counts and token estimates
+wit tree -r ratatui/ratatui                # Full repo tree
+wit tree -r ratatui/ratatui src/widgets    # Only the widgets subtree
+wit tree -l -r ratatui/ratatui src         # With line counts and token estimates
 ```
 
 ### ls
 
-List directory contents (non-recursive). Unlike `tree`, shows only immediate children. Use `-l` for file sizes.
+List directory contents (non-recursive). Unlike `tree`, shows only immediate children. Pass the repository with `-r` / `--repo` (`owner/repo`). Use `-l` for file sizes.
 
 ```bash
-wit ls ratatui/ratatui                    # List repo root
-wit ls ratatui/ratatui src/widgets        # List a subdirectory
-wit ls -l ratatui/ratatui src             # With line counts and token estimates
+wit ls -r ratatui/ratatui                    # List repo root
+wit ls -r ratatui/ratatui src/widgets        # List a subdirectory
+wit ls -l -r ratatui/ratatui src             # With line counts and token estimates
 ```
 
 ### cat
 
-Print a file's contents. For large files, prefer `head`/`tail`/`sed` to read specific ranges, or `rg` to search.
+Print a file's contents. Pass the repository with `-r` / `--repo` (`owner/repo`). For large files, prefer `head`/`tail`/`sed` to read specific ranges, or `rg` to search.
 
 ```bash
-wit cat ratatui/ratatui Cargo.toml             # Print file
-wit cat -n ratatui/ratatui src/lib.rs           # With line numbers
-wit cat -b ratatui/ratatui README.md            # Number non-blank lines only
+wit cat -r ratatui/ratatui Cargo.toml             # Print file
+wit cat -n -r ratatui/ratatui src/lib.rs           # With line numbers
+wit cat -b -r ratatui/ratatui README.md            # Number non-blank lines only
 ```
 
 | Flag | Long | Description |
 |------|------|-------------|
+| `-r` | `--repo` | GitHub repository (`owner/repo`) |
 | `-n` | `--number` | Number all output lines |
 | `-b` | `--number-nonblank` | Number non-blank lines only (overrides -n) |
 | `-s` | `--squeeze-blank` | Suppress repeated empty lines |
@@ -160,18 +161,19 @@ wit cat -b ratatui/ratatui README.md            # Number non-blank lines only
 
 ### rg
 
-Search file contents (ripgrep-style). Use `-l` to find files, `-g` to filter by type.
+Search file contents (ripgrep-style). Pass the repository with `-r` / `--repo` (`owner/repo`). Use `-l` to find files, `-g` to filter by type.
 
 ```bash
-wit rg 'impl Widget' ratatui/ratatui              # Find implementations
-wit rg -l 'struct.*Frame' ratatui/ratatui          # List files containing pattern
-wit rg -g '*.rs' -i 'todo' ratatui/ratatui         # Case-insensitive in .rs files
-wit rg -C 3 'fn render' ratatui/ratatui             # 3 lines of context
-wit rg -l --long 'Widget' ratatui/ratatui           # File list with line counts
+wit rg 'impl Widget' -r ratatui/ratatui              # Find implementations
+wit rg -l 'struct.*Frame' -r ratatui/ratatui          # List files containing pattern
+wit rg -g '*.rs' -i 'todo' -r ratatui/ratatui         # Case-insensitive in .rs files
+wit rg -C 3 'fn render' -r ratatui/ratatui             # 3 lines of context
+wit rg -l --long 'Widget' -r ratatui/ratatui           # File list with line counts
 ```
 
 | Flag | Long | Description |
 |------|------|-------------|
+| `-r` | `--repo` | GitHub repository (`owner/repo`) |
 | `-i` | `--ignore-case` | Case insensitive search |
 | `-S` | `--smart-case` | Case-insensitive if pattern is all lowercase |
 | `-w` | `--word-regexp` | Match whole words only |
@@ -187,38 +189,39 @@ wit rg -l --long 'Widget' ratatui/ratatui           # File list with line counts
 
 ### sed
 
-Extract or transform file content using sed scripts (POSIX-style, Rust regex).
+Extract or transform file content using sed scripts (POSIX-style, Rust regex). Pass the repository with `-r` / `--repo` (`owner/repo`).
 
 ```bash
-wit sed -n '320,460p' modal-labs/modal-client modal/image.py    # Print line range
-wit sed -n '/TODO/p' ratatui/ratatui src/lib.rs                 # Lines matching pattern
-wit sed 's/Widget/Component/g' ratatui/ratatui src/lib.rs       # Substitute text
-wit sed -n '/^pub fn/p' ratatui/ratatui src/lib.rs              # Extract function signatures
+wit sed -n -r modal-labs/modal-client '320,460p' modal/image.py    # Print line range
+wit sed -n -r ratatui/ratatui '/TODO/p' src/lib.rs                 # Lines matching pattern
+wit sed -r ratatui/ratatui 's/Widget/Component/g' src/lib.rs       # Substitute text
+wit sed -n -r ratatui/ratatui '/^pub fn/p' src/lib.rs              # Extract function signatures
 ```
 
 **Notes:**
+- Pass the repository with `-r` / `--repo` (`owner/repo`). Positional arguments are the sed script and the file path, or only the path when the script comes from `-e` / `-f`.
 - Regex uses Rust syntax (not POSIX BRE).
 - `sed` operates on a single repo file (no stdin or in-place edits).
 - Supports addresses, substitution, hold space, branching, and most POSIX commands.
 
 ### head
 
-Print the first N lines of a file (default: 10). Use to preview a file before deciding whether to read it fully.
+Print the first N lines of a file (default: 10). Pass the repository with `-r` / `--repo` (`owner/repo`). Use to preview a file before deciding whether to read it fully.
 
 ```bash
-wit head ratatui/ratatui src/lib.rs            # First 10 lines
-wit head -n 50 ratatui/ratatui Cargo.toml      # First 50 lines
-wit head -N ratatui/ratatui README.md           # With line numbers
+wit head -r ratatui/ratatui src/lib.rs            # First 10 lines
+wit head -n 50 -r ratatui/ratatui Cargo.toml      # First 50 lines
+wit head -N -r ratatui/ratatui README.md           # With line numbers
 ```
 
 ### tail
 
-Print the last N lines of a file, or from line N onward. Use `-p` to read from a specific line to end-of-file.
+Print the last N lines of a file, or from line N onward. Pass the repository with `-r` / `--repo` (`owner/repo`). Use `-p` to read from a specific line to end-of-file.
 
 ```bash
-wit tail ratatui/ratatui src/lib.rs              # Last 10 lines
-wit tail -n 20 ratatui/ratatui Cargo.toml        # Last 20 lines
-wit tail -p 100 ratatui/ratatui src/lib.rs       # From line 100 to end
+wit tail -r ratatui/ratatui src/lib.rs              # Last 10 lines
+wit tail -n 20 -r ratatui/ratatui Cargo.toml        # Last 20 lines
+wit tail -p 100 -r ratatui/ratatui src/lib.rs       # From line 100 to end
 ```
 
 ## Packaging & Release
@@ -226,32 +229,31 @@ wit tail -p 100 ratatui/ratatui src/lib.rs       # From line 100 to end
 - Every push to `main` triggers `.github/workflows/auto-tag.yml`, which increments the patch version in `Cargo.toml`, creates a new `vX.Y.Z` tag, and pushes it.
 - Push a semver tag (for example `v0.2.0`) to trigger `.github/workflows/release.yml`.
 - `.github/workflows/release.yml` can also be triggered manually with `workflow_dispatch` (select a `vX.Y.Z` tag ref).
-- The workflow builds and uploads `wit-<platform>-<arch>` archives plus `wit-checksums.txt` to the GitHub release.
-- `.github/workflows/publish-npm.yml` publishes `@nothumanwork/wit` from the GitHub release assets and can be re-run manually for an existing release tag without rebuilding Rust binaries.
+- `.github/workflows/release.yml` validates the tag ref, builds Linux/macOS/Windows artifacts on GitHub-hosted runners, uploads `wit-<platform>-<arch>` archives plus `wit-checksums.txt`, and then invokes `.github/workflows/publish-npm.yml`.
+- `.github/workflows/publish-npm.yml` publishes `@nothumanwork/wit` from the attached GitHub release assets and can be re-run manually for an existing release tag without rebuilding Rust binaries.
 - `install.sh` downloads the matching archive and verifies it against the checksum manifest when available.
 
 ## Architecture
 
 ```
-src/
-├── cli.rs          # CLI entry point and display logic
-├── lib.rs          # Library exports
-├── sed.rs          # POSIX-style sed engine
-├── gitops/
-│   ├── mod.rs
-│   └── ops.rs      # Bare-repo caching, file access, tree, ls, head/tail, ripgrep
-└── grep/
-    ├── mod.rs
-    ├── client.rs   # grep.app API client
-    └── types.rs    # Response types and data structures
+crates/wit/src/
+├── cli.rs           # CLI entry point
+├── lib.rs           # Library exports (gitops, sed, search, search_run)
+├── search.rs        # GitHub repository search, query assembly, limit-aware pagination
+├── search_run.rs    # `wit search`: GitHub-only orchestration
+├── sed.rs
+└── gitops/          # Bare-repo cache, tree, ls, cat, rg, head, tail
+
+crates/wits/         # grep.app client + `wits` binary; shared result printing
 ```
 
 ## Dependencies
 
 - `clap` - CLI argument parsing
 - `gix` (gitoxide) - Bare clone + tree traversal + blob reading
-- `reqwest` - HTTP client for grep.app
-- `scraper` - HTML parsing for code snippets
+- `octocrab` - GitHub REST API (`wit search`)
+- `reqwest` - HTTP client (grep.app in `wits`; other HTTP in wit)
+- `scraper` - HTML parsing for grep.app snippets (`wits`)
 - `grep-regex` / `grep-searcher` / `grep-matcher` - Ripgrep-style search on blobs
 - `ptree` - Tree display
 - `colored` - Terminal output formatting

package/dists/wit-checksums.txt

@@ -1,6 +1,6 @@
-537832c6ed342cefdaae053365d0f2da0f0e5709c66a50b4cd0cf2aca8ca7cff  wit-linux-aarch64.tar.gz
-3e426c8e5925f3614f17f609d019801c7cde6d7d4a27a3458da6879ac29013a1  wit-linux-x86_64.tar.gz
-19c0e55a68fabce3ade9d018037df5a2678c92374f5bf6c012f9fdc13f19ff49  wit-macos-aarch64.tar.gz
-6df40e9e9e128db4d47a272a5cdbfd315e7b6479f0f84483a7fe00eb0d5374c5  wit-macos-x86_64.tar.gz
-cfe949d7f002547665c713f6d530b8915369651f7c2d7fe43114fd612494b8af  wit-windows-aarch64.zip
-b9ceeec230d78e0448720781c3c19446a974f3803045d96d41617abab5b77915  wit-windows-x86_64.zip
+3a399a6e11d3d98a4cf643f95784a3dc4bc0550620a6783aad59fc420d8f3670  wit-linux-aarch64.tar.gz
+a4941c90b17523605d75f1e5985146542e58602fd3bb73c76b1a03f109f42f40  wit-linux-x86_64.tar.gz
+c8709c7af64d91397d495e59e5f74034cb2896e0ec20ab07f211b4ef1286f87e  wit-macos-aarch64.tar.gz
+e618b007eea0a21c3a6566cbf09f4aeb8cedae3d4804a10ac13f5c26ee397ed6  wit-macos-x86_64.tar.gz
+99acd626091d1f15bf318ac0b5e423f9162415ebe2b96ee8ce13ed98ddc17987  wit-windows-aarch64.zip
+87515be2a1da63b8d1e68467f43ae53f8c960cc726653e4cf0fc409fbc21e096  wit-windows-x86_64.zip

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@nothumanwork/wit",
-  "version": "0.1.16",
+  "version": "0.1.18",
   "description": "GitHub exploration CLI for AI agents",
   "license": "UNLICENSED",
   "repository": {