readystack-robots-txt-ai-crawler-audit 0.1.8__tar.gz

readystack_robots_txt_ai_crawler_audit-0.1.8/LICENSE.txt

@@ -0,0 +1,2 @@
+Copyright. Free features may be used without a licence key.
+Paid features require a valid licence key.

readystack_robots_txt_ai_crawler_audit-0.1.8/PKG-INFO

@@ -0,0 +1,84 @@
+Metadata-Version: 2.4
+Name: readystack-robots-txt-ai-crawler-audit
+Version: 0.1.8
+Summary: Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing. (bundled Node.js runtime)
+Author-email: ReadyStack <support@getreadystack.com>
+License: Proprietary - see LICENSE.txt
+Project-URL: Homepage, https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi
+Project-URL: Documentation, https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi
+Project-URL: Support, https://getreadystack.com/support
+Keywords: robots.txt,AI crawler,GPTBot,Google-Extended,SEO
+Classifier: Programming Language :: Python :: 3
+Classifier: Environment :: Console
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Operating System :: OS Independent
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: nodejs-wheel-binaries>=20
+Dynamic: license-file
+
+# AI Crawler Rules - robots.txt Audit for AI Search
+
+> Runs the same checker as the npm package `@readystack/robots-txt-ai-crawler-audit` on a Node.js runtime that pip installs for you (`nodejs-wheel-binaries`) - no system Node.js needed. Your files are checked locally.
+
+![robots.txt AI Crawler Audit - GPTBot, ClaudeBot, Google-Extended — finds the line](https://getreadystack.com/img/promo/robots-txt-ai-crawler-audit_demo.gif)
+
+Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing.
+
+## Install
+
+```
+robots-txt-ai-crawler-audit file
+```
+
+Node 18+. The same 19 rules as the VS Code extension, from a terminal or CI.
+
+## Free
+
+- Check the open robots.txt against every rule - full results, nothing withheld; Check only the lines you highlight; See every rule and what each AI token controls; Reopen the last report
+- `--rules` lists every rule
+
+## With a licence ($29 once)
+
+- Scan every robots.txt in the workspace; Export the report as CSV, JSON or HTML; CI output that fails the build on errors; Add your own agency policy tokens; Re-check automatically on every save
+
+```
+@readystack/robots-txt-ai-crawler-audit --dir ./templates --report html --out report.html
+```
+
+A freelance technical SEO consultant bills roughly $100-150 an hour, and an AI-crawler robots.txt review is a one-to-two hour job.
+
+## Use from an AI agent (MCP)
+
+Claude Code · Cursor · Windsurf · any MCP client - add to your MCP config:
+
+```json
+{ "mcpServers": { "robots-txt-ai-crawler-audit": { "command": "npx", "args": ["-y", "@readystack/robots-txt-ai-crawler-audit", "--mcp"] } } }
+```
+
+Tools: `check_text` and `check_file` (free) · `check_dir` (licence). The agent gets every finding with the line number.
+
+## Use in CI
+
+```yaml
+- name: AI Crawler Rules - robots.txt Audit for AI Search
+  run: npx -y @readystack/robots-txt-ai-crawler-audit --dir . --ci
+```
+
+(container: `docker run --rm -v "$PWD:/work" getreadystack/robots-txt-ai-crawler-audit --dir /work --ci`)
+
+The folder sweep, reports and CI mode need one licence — one payment, no subscription. Set `READYSTACK_LICENSE=<key>` or run `--license <key>` once.
+
+[Get a licence](https://getreadystack.com/api/buy/cl/polar_cl_I8R8AzowzmASHy45ujvewcvtcl4wBBfC2Fe7r3fZwpr)
+
+
+<!-- ai crawler rules for robots txt -->
+
+
+## Install (PyPI)
+
+```
+pip install readystack-robots-txt-ai-crawler-audit
+robots-txt-ai-crawler-audit --help
+```

readystack_robots_txt_ai_crawler_audit-0.1.8/README.md

@@ -0,0 +1,64 @@
+# AI Crawler Rules - robots.txt Audit for AI Search
+
+> Runs the same checker as the npm package `@readystack/robots-txt-ai-crawler-audit` on a Node.js runtime that pip installs for you (`nodejs-wheel-binaries`) - no system Node.js needed. Your files are checked locally.
+
+![robots.txt AI Crawler Audit - GPTBot, ClaudeBot, Google-Extended — finds the line](https://getreadystack.com/img/promo/robots-txt-ai-crawler-audit_demo.gif)
+
+Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing.
+
+## Install
+
+```
+robots-txt-ai-crawler-audit file
+```
+
+Node 18+. The same 19 rules as the VS Code extension, from a terminal or CI.
+
+## Free
+
+- Check the open robots.txt against every rule - full results, nothing withheld; Check only the lines you highlight; See every rule and what each AI token controls; Reopen the last report
+- `--rules` lists every rule
+
+## With a licence ($29 once)
+
+- Scan every robots.txt in the workspace; Export the report as CSV, JSON or HTML; CI output that fails the build on errors; Add your own agency policy tokens; Re-check automatically on every save
+
+```
+@readystack/robots-txt-ai-crawler-audit --dir ./templates --report html --out report.html
+```
+
+A freelance technical SEO consultant bills roughly $100-150 an hour, and an AI-crawler robots.txt review is a one-to-two hour job.
+
+## Use from an AI agent (MCP)
+
+Claude Code · Cursor · Windsurf · any MCP client - add to your MCP config:
+
+```json
+{ "mcpServers": { "robots-txt-ai-crawler-audit": { "command": "npx", "args": ["-y", "@readystack/robots-txt-ai-crawler-audit", "--mcp"] } } }
+```
+
+Tools: `check_text` and `check_file` (free) · `check_dir` (licence). The agent gets every finding with the line number.
+
+## Use in CI
+
+```yaml
+- name: AI Crawler Rules - robots.txt Audit for AI Search
+  run: npx -y @readystack/robots-txt-ai-crawler-audit --dir . --ci
+```
+
+(container: `docker run --rm -v "$PWD:/work" getreadystack/robots-txt-ai-crawler-audit --dir /work --ci`)
+
+The folder sweep, reports and CI mode need one licence — one payment, no subscription. Set `READYSTACK_LICENSE=<key>` or run `--license <key>` once.
+
+[Get a licence](https://getreadystack.com/api/buy/cl/polar_cl_I8R8AzowzmASHy45ujvewcvtcl4wBBfC2Fe7r3fZwpr)
+
+
+<!-- ai crawler rules for robots txt -->
+
+
+## Install (PyPI)
+
+```
+pip install readystack-robots-txt-ai-crawler-audit
+robots-txt-ai-crawler-audit --help
+```

readystack_robots_txt_ai_crawler_audit-0.1.8/pyproject.toml

@@ -0,0 +1,29 @@
+[build-system]
+requires = ["setuptools>=68"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "readystack-robots-txt-ai-crawler-audit"
+version = "0.1.8"
+description = "Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing. (bundled Node.js runtime)"
+readme = "README.md"
+requires-python = ">=3.9"
+dependencies = ["nodejs-wheel-binaries>=20"]
+license = {text = "Proprietary - see LICENSE.txt"}
+keywords = ["robots.txt", "AI crawler", "GPTBot", "Google-Extended", "SEO"]
+authors = [{name = "ReadyStack", email = "support@getreadystack.com"}]
+classifiers = ["Programming Language :: Python :: 3", "Environment :: Console", "Topic :: Software Development :: Quality Assurance", "Operating System :: OS Independent"]
+
+[project.urls]
+Homepage = "https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi"
+Documentation = "https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi"
+Support = "https://getreadystack.com/support"
+
+[project.scripts]
+"robots-txt-ai-crawler-audit" = "readystack_robots_txt_ai_crawler_audit.__main__:main"
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[tool.setuptools.package-data]
+"readystack_robots_txt_ai_crawler_audit" = ["js/*"]

readystack_robots_txt_ai_crawler_audit-0.1.8/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/__init__.py

@@ -0,0 +1 @@
+__version__ = '0.1.8'

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/__main__.py

@@ -0,0 +1,12 @@
+import os, sys
+
+
+def main():
+    # Runs the same checker as the npm package on the Node.js runtime installed with this package (nodejs-wheel-binaries).
+    from nodejs_wheel import node
+    here = os.path.dirname(os.path.abspath(__file__))
+    return node([os.path.join(here, "js", "cli.js")] + sys.argv[1:])
+
+
+if __name__ == "__main__":
+    sys.exit(main())

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/js/cli.js

@@ -0,0 +1,164 @@
+#!/usr/bin/env node
+// cli.js — the same rules as the VS Code extension, run from a terminal or a container. Generated by adapters.py.
+'use strict';
+const fs = require('fs'), path = require('path');
+const RULES = require('./rules.json');
+const S = require('./strings.json');
+const lic = require('./license.js');
+function scan(text) {
+  const lines = String(text).split(/\r?\n/); const hits = [];
+  for (let i = 0; i < lines.length; i++) {
+    for (const r of RULES) {
+      let re; try { re = new RegExp(r.pattern, r.flags || ''); } catch (e) { continue; }
+      if (re.test(lines[i])) hits.push({ line: i + 1, msg: r.message, fix: r.fix || null, sev: r.sev || 'warn' });
+    }
+  }
+  return hits;
+}
+function isText(p) { try { const b = fs.readFileSync(p); if (b.length > 2 * 1024 * 1024) return false; const s = b.subarray(0, 4096); for (const x of s) if (x === 0) return false; return true; } catch (e) { return false; } }
+function walk(dir, exts, out) {
+  let ents = []; try { ents = fs.readdirSync(dir, { withFileTypes: true }); } catch (e) { return out; }
+  for (const e of ents) {
+    if (['node_modules', '.git', '.hg', '.svn', '.venv', 'venv', '.tox', '.cache', '.next', '.nuxt', '.terraform', '__pycache__'].includes(e.name)) continue;   // s158 — .github · .gitlab-ci.yml · .env · .well-known 은 본다 (옛 줄은 점으로 시작하는 것을 전부 건너뛰어 워크플로 검사기가 .github/workflows 를 못 봤다)
+    const p = path.join(dir, e.name);
+    if (e.isDirectory()) walk(p, exts, out);
+    else if ((!exts.length || exts.includes(path.extname(e.name).toLowerCase())) && isText(p)) out.push(p);
+  }
+  return out;
+}
+function esc(s) { return String(s).replace(/&/g, '&amp;').replace(/</g, '&lt;').replace(/>/g, '&gt;'); }
+function csvq(s) { return '"' + String(s == null ? '' : s).replace(/"/g, '""') + '"'; }
+function render(rows, fmt) {
+  if (fmt === 'json') return JSON.stringify({ tool: S.name, rules: RULES.length, files: rows }, null, 1);
+  if (fmt === 'csv') { const o = ['file,line,severity,message,fix']; for (const r of rows) for (const h of r.hits) o.push([csvq(r.file), h.line, h.sev, csvq(h.msg), csvq(h.fix)].join(',')); return o.join('\n') + '\n'; }
+  if (fmt === 'html') {
+    const n = rows.reduce((a, r) => a + r.hits.length, 0);
+    let o = '<!doctype html><meta charset="utf-8"><title>' + esc(S.name) + ' report</title><style>body{font:14px system-ui;margin:24px}table{border-collapse:collapse}td,th{border:1px solid #ddd;padding:4px 8px;font-size:13px}code{font-family:ui-monospace,monospace}</style>';
+    o += '<h1>' + esc(S.name) + '</h1><p>' + rows.length + ' files · ' + n + ' findings · ' + RULES.length + ' rules</p><table><tr><th>file</th><th>line</th><th>sev</th><th>message</th><th>fix</th></tr>';
+    for (const r of rows) for (const h of r.hits) o += '<tr><td><code>' + esc(r.file) + '</code></td><td>' + h.line + '</td><td>' + esc(h.sev) + '</td><td>' + esc(h.msg) + '</td><td>' + esc(h.fix || '') + '</td></tr>';
+    return o + '</table>';
+  }
+  let o = ''; for (const r of rows) { o += r.file + '\n'; for (const h of r.hits) o += '  ' + String(h.line).padStart(5) + '  ' + h.sev.padEnd(5) + ' ' + h.msg + (h.fix ? '\n         -> ' + h.fix : '') + '\n'; if (!r.hits.length) o += '  (no findings)\n'; }
+  return o;
+}
+function trialState() {
+  // s158 — ⚑7일 무료 없음: 새 체험은 ⛔열지 않는다 · 이미 시작된 체험(trial.json)만 끝까지 지킨다 (읽기 전용)
+  if (process.env.READYSTACK_NO_TRIAL) return { active: false };
+  try {
+    const p = path.join(path.dirname(lic.storePath()), S.bin + '.trial.json');
+    const t = JSON.parse(fs.readFileSync(p, 'utf8'));
+    return { active: !!(t && t.until) && new Date(t.until + 'T23:59:59Z').getTime() > Date.now(), until: t && t.until };
+  } catch (e) { return { active: false }; }
+}
+// ★s158 2026-09-23 — the free run SPEAKS about the rest of the folder (vsix: auto.js · crx: welcome tab).
+//   The answer for the named files is complete and free; the next step is shown with the user's OWN numbers:
+//   "this folder has N more matching files - M issues in K of them" + the one command that sweeps them.
+//   Never blocks, never starts a trial (s158: no free trial - the free answer on the named files is the "try it"), human seat only, 400 files / 1.5 s cap.
+function folderHint(done) {
+  if (!process.stderr.isTTY || process.env.CI || process.env.READYSTACK_NO_HINT || !done.length) return;
+  const base = path.dirname(path.resolve(done[0]));
+  const seen = new Set(done.map((f) => path.resolve(f)));
+  const all = walk(base, S.exts || [], []).filter((f) => !seen.has(path.resolve(f)));
+  if (!all.length) return;
+  const t0 = Date.now(); let issues = 0, hitFiles = 0, scanned = 0;
+  for (const f of all.slice(0, 400)) { if (Date.now() - t0 > 1500) break; let t = ''; try { t = fs.readFileSync(f, 'utf8'); } catch (e) { continue; } scanned++; const h = scan(t, f); if (h.length) { issues += h.length; hitFiles++; } }
+  const rel = path.relative(process.cwd(), base) || '.';
+  const tail = trialState().active ? 'free during your trial' : '$' + S.price + ' once';
+  const more = all.length + ' more matching file' + (all.length > 1 ? 's' : '');
+  const found = issues ? ' - ' + (scanned < all.length ? 'at least ' : '') + issues + ' issue' + (issues > 1 ? 's' : '') + ' in ' + hitFiles + ' of them' : ' - no issues found in them';
+  process.stderr.write('\n' + (rel === '.' ? 'This folder' : rel) + ' has ' + more + found + '.\n' + (issues ? 'Sweep them all: ' + S.bin + ' --dir ' + (/\s/.test(rel) ? JSON.stringify(rel) : rel) + '   (' + tail + ')\n' : ''));
+}
+let _usePinged = false;
+function pingUse() {
+  try {
+    if (_usePinged) return; _usePinged = true;
+    if (process.env.DO_NOT_TRACK === '1' || process.env.READYSTACK_NO_TELEMETRY || process.env.CI) return;
+    if (!(process.stdout.isTTY || process.stdin.isTTY)) return;   // human seat only (s152)
+    const https = require('https');
+    const body = JSON.stringify({ t: 'use', slug: S.bin, src: 'cli', why: 'free' });
+    const req = https.request({ hostname: 'getreadystack.com', path: '/api/ev', method: 'POST', timeout: 3000,
+      headers: { 'content-type': 'application/json', 'content-length': Buffer.byteLength(body), 'user-agent': 'readystack-cli/' + S.bin } }, function (res) { res.resume(); });
+    req.on('timeout', function () { req.destroy(); }); req.on('error', function () {});
+    req.write(body); req.end();
+  } catch (e) {}
+}
+function mcpServe() {
+  process.env.READYSTACK_MCP = '1';   // s152 - 에이전트(Claude Code·Cursor)가 부른 세션은 사람 자리다 · 키 판 핑 src=mcp
+  // s144 — MCP server over stdio (newline-delimited JSON-RPC · no dependencies). Free: check_text · check_file. Licence (s158: no free trial): check_dir.
+  const rl = require('readline').createInterface({ input: process.stdin });
+  const send = (o) => process.stdout.write(JSON.stringify(o) + '\n');
+  const tools = [
+    { name: 'check_text', description: S.name + ' - run all ' + RULES.length + ' checks on a text (free)', inputSchema: { type: 'object', properties: { text: { type: 'string', description: 'file contents' }, path: { type: 'string', description: 'optional file name for context' } }, required: ['text'] } },
+    { name: 'check_file', description: S.name + ' - run all checks on one file by path (free)', inputSchema: { type: 'object', properties: { path: { type: 'string' } }, required: ['path'] } },
+    { name: 'check_dir', description: S.name + ' - sweep a folder and return every finding (licence; $' + S.price + ' once)', inputSchema: { type: 'object', properties: { dir: { type: 'string' }, ext: { type: 'string', description: 'optional extension filter, e.g. .html' } }, required: ['dir'] } }
+  ];
+  const result = (id, rows) => send({ jsonrpc: '2.0', id, result: { content: [{ type: 'text', text: render(rows, 'text') }], structuredContent: { tool: S.name, rules: RULES.length, files: rows } } });
+  const fail = (id, text) => send({ jsonrpc: '2.0', id, result: { content: [{ type: 'text', text }], isError: true } });
+  rl.on('line', async (line) => {
+    let m; try { m = JSON.parse(line); } catch (e) { return; }
+    const id = m.id, method = m.method;
+    if (method === 'initialize') return send({ jsonrpc: '2.0', id, result: { protocolVersion: '2025-06-18', capabilities: { tools: {} }, serverInfo: { name: '@readystack/' + S.bin, version: '1.0.0' } } });
+    if (method === 'notifications/initialized' || method === 'ping') { if (id !== undefined) send({ jsonrpc: '2.0', id, result: {} }); return; }
+    if (method === 'tools/list') return send({ jsonrpc: '2.0', id, result: { tools } });
+    if (method === 'tools/call') {
+      const name = (m.params || {}).name, args = (m.params || {}).arguments || {};
+      try {
+        if (name === 'check_text') return result(id, [{ file: args.path || '(text)', hits: scan(String(args.text || ''), args.path || '') }]);
+        if (name === 'check_file') return result(id, [{ file: args.path, hits: scan(fs.readFileSync(args.path, 'utf8'), args.path) }]);
+        if (name === 'check_dir') {
+          const r = await lic.ensure();
+          if (!r.ok && !trialState().active) return fail(id, S.need_key + ' Get a licence ($' + S.price + ', once): ' + lic.BUY_URL);
+          const files = walk(args.dir, args.ext ? [args.ext] : (S.exts || []), []);
+          return result(id, files.map((f) => { let t = ''; try { t = fs.readFileSync(f, 'utf8'); } catch (e) { return { file: f, hits: [], error: String(e.message) }; } return { file: f, hits: scan(t, f) }; }));
+        }
+        return send({ jsonrpc: '2.0', id, error: { code: -32601, message: 'unknown tool ' + name } });
+      } catch (e) { return fail(id, String(e && e.message || e)); }
+    }
+    if (id !== undefined) send({ jsonrpc: '2.0', id, error: { code: -32601, message: 'method not found: ' + method } });
+  });
+}
+function help() {
+  return [S.name + ' - ' + S.subtitle, '', 'Usage: ' + S.bin + ' <file> [more files]           check the files you name (free, every rule)',
+    '       ' + S.bin + ' --dir <folder> [--ext .html]  scan a whole folder            (licence)',
+    '       ' + S.bin + ' ... --report csv|json|html [--out file]   export a report   (licence)',
+    '       ' + S.bin + ' ... --ci                      exit 1 when an error-level finding exists (licence)',
+    '       ' + S.bin + ' --license <key>               store your licence key (or set READYSTACK_LICENSE)',
+    '       ' + S.bin + ' --rules                       list the ' + RULES.length + ' rules',
+    '       ' + S.bin + ' --mcp                         run as an MCP server (stdio) for Claude Code / Cursor / Windsurf - free checks, folder sweep needs a licence', '',
+    'Free: ' + S.free, 'Licence ($' + S.price + ', once): ' + S.paid, 'Get a licence: ' + lic.BUY_URL, ''].join('\n');
+}
+(async function main() {
+  try { const _feed = await lic.pullFeed(); if (_feed && Array.isArray(_feed.rules)) { for (const r of _feed.rules) RULES.push(r); } } catch (e) {}   // ★s134 구독 피드 병합 (키 있는 손님만)
+  const a = process.argv.slice(2);
+  const get = (k) => { const i = a.indexOf(k); return i >= 0 ? a[i + 1] : null; };
+  if (a.includes('--mcp')) { mcpServe(); return; }
+  if (!a.length || a.includes('--help') || a.includes('-h')) { process.stdout.write(help()); return; }
+  if (a.includes('--rules')) { process.stdout.write(RULES.map((r, i) => String(i + 1).padStart(3) + '  [' + (r.sev || 'warn') + '] ' + r.message).join('\n') + '\n'); return; }
+  if (a.includes('--license')) { const r = await lic.ensure(get('--license')); process.stdout.write(r.ok ? 'Licence stored: ' + lic.storePath() + '\n' : 'Licence not accepted (' + r.why + '). Get one: ' + lic.BUY_URL + '\n'); process.exit(r.ok ? 0 : 2); }
+  const dir = get('--dir'), fmt = get('--report'), out = get('--out'), ci = a.includes('--ci');
+  const exts = a.includes('--ext') ? [get('--ext')] : (S.exts || []);
+  const paid = !!(dir || fmt || ci);
+  if (paid) {
+    const r = await lic.ensure();
+    if (!r.ok) {
+      const t = trialState();   // s158 — ⚑7일 무료 없음 · 이미 시작된 체험만 지킨다
+      if (t.active) process.stderr.write('Trial: the full run is free until ' + t.until + ' — after that $' + S.price + ' once. Get a licence: ' + lic.BUY_URL + '\n');
+      else {
+        // s158 — the key is asked WITH the customer's own count (endowment · open loop): how many issues this folder holds.
+        let own = '';
+        if (dir) { try { const all = walk(dir, exts, []); let n = 0, k = 0, sc = 0; const t0 = Date.now();
+          for (const f of all.slice(0, 2000)) { if (Date.now() - t0 > 4000) break; let tx = ''; try { tx = fs.readFileSync(f, 'utf8'); } catch (e) { continue; } sc++; const h = scan(tx, f); if (h.length) { n += h.length; k++; } }
+          if (n) own = dir + ': ' + (sc < all.length ? 'at least ' : '') + n + ' issue' + (n > 1 ? 's' : '') + ' in ' + k + ' of ' + all.length + ' files.\n'; } catch (e) {} }
+        process.stderr.write(own + S.need_key + '\n  set READYSTACK_LICENSE=<key>  or  ' + S.bin + ' --license <key>\n  Get a licence ($' + S.price + ' once): ' + lic.BUY_URL + '\n'); process.exit(2);
+      }
+    }
+  }
+  const files = dir ? walk(dir, exts, []) : a.filter((x, i) => !x.startsWith('--') && !['--dir', '--report', '--out', '--ext', '--license'].includes(a[i - 1]));
+  if (!files.length) { process.stderr.write('No files. ' + S.bin + ' --help\n'); process.exit(2); }
+  const rows = files.map((f) => { let t = ''; try { t = fs.readFileSync(f, 'utf8'); } catch (e) { return { file: f, hits: [], error: String(e.message) }; } return { file: f, hits: scan(t) }; });
+  const text = render(rows, fmt || 'text');
+  if (out) fs.writeFileSync(out, text); else process.stdout.write(text.endsWith('\n') ? text : text + '\n');
+  if (!paid) { try { folderHint(files); } catch (e) {} pingUse(); }   // s158 — a free run ends with the user's own folder count + one anonymous 'used' count (human seat only)
+  const errors = rows.reduce((n, r) => n + r.hits.filter((h) => h.sev === 'error').length, 0);
+  if (ci && errors) process.exit(1);
+})().catch((e) => { process.stderr.write(String(e && e.stack || e) + '\n'); process.exit(3); });

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/js/license.js

@@ -0,0 +1,103 @@
+// license.js — Polar licence check for the CLI / container. Generated by adapters.py; do not edit by hand.
+'use strict';
+const https = require('https'), fs = require('fs'), path = require('path'), os = require('os');
+const ORG_ID = 'a5cdf664-d8e7-4f87-8895-056717aaba17';
+const BENEFIT_ID = '6ddfd3d5-8a8c-4426-8dce-b18957fd3a44';   // s142 — this product's Polar benefit (s140 law: ask with benefit_id, or one key opens every product)
+const BUY_URL = 'https://getreadystack.com/api/buy/cl/polar_cl_I8R8AzowzmASHy45ujvewcvtcl4wBBfC2Fe7r3fZwpr';
+const SLUG = 'robots-txt-ai-crawler-audit';
+const GRACE_MS = 30 * 24 * 3600 * 1000;   // after a successful check, 30 days work offline
+const RECHECK_MS = 7 * 24 * 3600 * 1000;  // re-ask Polar every 7 days (refunds / cancellations)
+function storePath() { return path.join(process.env.READYSTACK_HOME || path.join(os.homedir(), '.config', 'readystack'), SLUG + '.json'); }
+function load() { try { return JSON.parse(fs.readFileSync(storePath(), 'utf8')); } catch (e) { return {}; } }
+function save(o) { try { fs.mkdirSync(path.dirname(storePath()), { recursive: true }); fs.writeFileSync(storePath(), JSON.stringify(o)); } catch (e) { /* read-only home: still works for this run */ } }
+const ALL_BENEFIT_ID = '22692551-5203-4467-b1a3-e33cdba6589d';   // s149 2026-09-17 — 팀 키(전 린터 한 키 · Polar benefit) · 상품 benefit 다음에 한 번 더 묻는다
+// s170 2026-09-29 — ask OUR worker first (/api/lic): keys bought on Whop open here (a price-tier key binds to the first tool it opens · the team key opens every tool). Then the old Polar check.
+function validate(key) {
+  return validateHub(key).then(function (h) {
+    if (h.ok) return h;
+    return validate1(key, BENEFIT_ID).then(function (r) { return (r.ok || r.offline || !/^[0-9a-f-]{36}$/.test(ALL_BENEFIT_ID)) ? r : validate1(key, ALL_BENEFIT_ID); })
+      .then(function (r) { return r.ok ? r : { ok: false, offline: !!(h.offline || r.offline) }; });
+  });
+}
+function validateHub(key) {
+  return new Promise(function (resolve) {
+    const req = https.request({ hostname: 'getreadystack.com', path: '/api/lic?key=' + encodeURIComponent(key) + '&slug=' + encodeURIComponent(SLUG),
+      method: 'GET', timeout: 8000, headers: { 'accept': 'application/json', 'user-agent': 'readystack-cli/' + SLUG } }, function (res) {
+      let buf = ''; res.on('data', function (d) { buf += d; });
+      res.on('end', function () {
+        if (res.statusCode !== 200) return resolve({ ok: false, offline: res.statusCode >= 500 });
+        try { const j = JSON.parse(buf); resolve({ ok: !!(j && j.ok), offline: false }); } catch (e) { resolve({ ok: false, offline: false }); }
+      });
+    });
+    req.on('timeout', function () { req.destroy(); resolve({ ok: false, offline: true }); });
+    req.on('error', function () { resolve({ ok: false, offline: true }); });
+    req.end();
+  });
+}
+function validate1(key, ben) {
+  return new Promise(function (resolve) {
+    if (!ORG_ID) return resolve({ ok: false, offline: false });
+    const body = JSON.stringify(/^[0-9a-f-]{36}$/.test(ben) ? { key: key, organization_id: ORG_ID, benefit_id: ben } : { key: key, organization_id: ORG_ID });
+    const req = https.request({ hostname: 'api.polar.sh', path: '/v1/customer-portal/license-keys/validate', method: 'POST', timeout: 8000,
+      headers: { 'content-type': 'application/json', 'polar-version': '2026-04', 'content-length': Buffer.byteLength(body) } }, function (res) {
+      let buf = ''; res.on('data', function (d) { buf += d; });
+      res.on('end', function () {
+        if (res.statusCode !== 200) return resolve({ ok: false, offline: false });
+        try { const j = JSON.parse(buf); resolve({ ok: j && (j.status === 'granted' || j.valid === true || !!j.id), offline: false }); }
+        catch (e) { resolve({ ok: false, offline: false }); }
+      });
+    });
+    req.on('timeout', function () { req.destroy(); resolve({ ok: false, offline: true }); });
+    req.on('error', function () { resolve({ ok: false, offline: true }); });
+    req.write(body); req.end();
+  });
+}
+// ★s151 2026-09-19 — 키 판(키가 없거나 거절된 순간)을 익명으로 센다 (슬러그·출처·이유만) · DO_NOT_TRACK=1 · READYSTACK_NO_TELEMETRY 면 안 보낸다 · 실패는 조용히 · 프로세스당 한 번.
+let _pinged = false;
+function pingPaywall(why) {
+  try {
+    if (_pinged) return; _pinged = true;
+    if (process.env.DO_NOT_TRACK === '1' || process.env.READYSTACK_NO_TELEMETRY || process.env.CI) return;   // s151: CI(깃허브 액션 등)와 우리 빌드는 손님이 아니다
+    if (!(process.stdout.isTTY || process.stdin.isTTY || process.env.READYSTACK_MCP === '1')) return;   // s152: 사람 자리(터미널·MCP 세션)에서만 센다 - 발행 1분 뒤 남의 실행기(JP · 우리 3대는 US)가 돌린 no_key 13건은 손님이 아니다
+    const body = JSON.stringify({ t: 'paywall', slug: SLUG, src: process.env.READYSTACK_MCP === '1' ? 'mcp' : 'cli', why: why || 'no_key' });
+    const req = https.request({ hostname: 'getreadystack.com', path: '/api/ev', method: 'POST', timeout: 3000,
+      headers: { 'content-type': 'application/json', 'content-length': Buffer.byteLength(body), 'user-agent': 'readystack-cli/' + SLUG } }, function (res) { res.resume(); });
+    req.on('timeout', function () { req.destroy(); }); req.on('error', function () {});
+    req.write(body); req.end();
+  } catch (e) { /* 세는 것이 실패해도 상품은 돈다 */ }
+}
+async function ensure(explicitKey) {
+  const st = load();
+  const key = explicitKey || process.env.READYSTACK_LICENSE || st.key;
+  if (!key) { pingPaywall('no_key'); return { ok: false, why: 'no_key' }; }   // s151
+  const age = Date.now() - (st.okAt || 0);
+  if (!explicitKey && st.key === key && age < RECHECK_MS) return { ok: true, cached: true };
+  const r = await validate(String(key).trim());
+  if (r.ok) { save({ key: String(key).trim(), okAt: Date.now() }); return { ok: true }; }
+  if (r.offline && st.key === key && age < GRACE_MS) return { ok: true, offline: true };
+  if (!r.offline) pingPaywall('invalid');   // s151
+  return { ok: false, why: r.offline ? 'offline' : 'invalid' };
+}
+// ★s134 — 구독 규칙 피드(층3 "바뀌면 업데이트"): 키 있는 손님만 · 7일마다 · 오프라인은 캐시. 워커 GET /api/rules/<slug>?key=
+const FEED_URL = 'https://getreadystack.com/api/rules/';
+function pullFeed() {
+  const st = load(); const key = process.env.READYSTACK_LICENSE || st.key; const cached = st.feed || null;
+  if (!key) return Promise.resolve(cached);
+  if (cached && (Date.now() - (st.feedAt || 0)) < RECHECK_MS) return Promise.resolve(cached);
+  return new Promise(function (resolve) {
+    let req;
+    try {
+      req = https.get(FEED_URL + encodeURIComponent(SLUG) + '?key=' + encodeURIComponent(key), { timeout: 8000, headers: { 'user-agent': 'readystack-cli' } }, function (res) {
+        let buf = ''; res.on('data', function (d) { buf += d; });
+        res.on('end', function () {
+          if (res.statusCode !== 200) return resolve(cached);
+          try { const j = JSON.parse(buf); if (!j || !Array.isArray(j.rules)) return resolve(cached); save(Object.assign(load(), { feed: j, feedAt: Date.now() })); resolve(j); }
+          catch (e) { resolve(cached); }
+        });
+      });
+    } catch (e) { return resolve(cached); }
+    req.on('timeout', function () { req.destroy(); resolve(cached); });
+    req.on('error', function () { resolve(cached); });
+  });
+}
+module.exports = { ensure, BUY_URL, storePath, pullFeed };

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/js/package.json

@@ -0,0 +1,38 @@
+{
+  "name": "@readystack/robots-txt-ai-crawler-audit",
+  "version": "0.1.8",
+  "description": "Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing.",
+  "license": "SEE LICENSE IN LICENSE.txt",
+  "publishConfig": {
+    "access": "public"
+  },
+  "keywords": [
+    "robots.txt",
+    "AI crawler",
+    "GPTBot",
+    "Google-Extended",
+    "SEO"
+  ],
+  "homepage": "https://getreadystack.com",
+  "funding": "https://getreadystack.com/api/buy/cl/polar_cl_I8R8AzowzmASHy45ujvewcvtcl4wBBfC2Fe7r3fZwpr",
+  "bin": {
+    "robots-txt-ai-crawler-audit": "cli.js"
+  },
+  "engines": {
+    "node": ">=18"
+  },
+  "mcpName": "io.github.jmshinhwa/robots-txt-ai-crawler-audit",
+  "repository": {
+    "type": "git",
+    "url": "https://github.com/jmshinhwa/readystack-themes.git",
+    "directory": "robots-txt-ai-crawler-audit"
+  },
+  "files": [
+    "cli.js",
+    "license.js",
+    "rules.json",
+    "strings.json",
+    "README.md",
+    "LICENSE.txt"
+  ]
+}

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/js/rules.json

@@ -0,0 +1,119 @@
+[
+ {
+  "pattern": "^\\s*User-agent:\\s*(Claude-Web|anthropic-ai)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "error",
+  "message": "Retired token. Claude-Web and anthropic-ai were replaced by ClaudeBot in 2024, so this group controls no current Claude traffic. Use ClaudeBot (training), Claude-SearchBot (citation in Claude) or Claude-User (user-triggered fetch).",
+  "fix": "User-agent: ClaudeBot"
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(GPT-Bot|Claude-Bot|Perplexity-Bot|Amazon-Bot|Google-Bot|Bing-Bot|Apple-Bot|Byte-Spider)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "error",
+  "message": "No crawler answers to this name - the real token has no hyphen (GPTBot, ClaudeBot, PerplexityBot, Amazonbot, Googlebot, Bingbot, Applebot, Bytespider). robots.txt ignores unknown tokens silently, so this group is dead weight.",
+  "fix": "User-agent: GPTBot"
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(ChatGPT-Bot|ChatGPTBot|ChatGPT|OpenAI-Bot|OpenAI-Crawler|OpenAI|Bard|Google-Bard|Gemini|Gemini-Bot|Meta-AI|LLaMA|Copilot-Bot|AI-Bot|AIBot|GPT-4|GPT4)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "error",
+  "message": "Not a real crawler token. Assistants emit these names confidently, but nothing answers to them, so this group blocks nothing at all. The documented tokens are GPTBot, OAI-SearchBot, ChatGPT-User, OAI-AdsBot, ClaudeBot, Claude-SearchBot, Claude-User, Google-Extended and PerplexityBot.",
+  "fix": "User-agent: GPTBot"
+ },
+ {
+  "pattern": "^\\s*Noindex\\s*:",
+  "flags": "i",
+  "sev": "error",
+  "message": "Google stopped honouring noindex in robots.txt on 1 September 2019. This line does nothing. Use a meta robots noindex tag on the page, or an X-Robots-Tag HTTP header.",
+  "fix": "# move to: <meta name=\"robots\" content=\"noindex\">"
+ },
+ {
+  "pattern": "^\\s*Disallow:\\s*\\*\\s*(#.*)?$",
+  "sev": "error",
+  "message": "Disallow: * is not a valid path value. To block a whole group write Disallow: / - as written this is widely parsed as an empty path, which allows the entire site rather than blocking it.",
+  "fix": "Disallow: /"
+ },
+ {
+  "pattern": "^\\s*Sitemap:\\s*(?!https?://)\\S",
+  "flags": "i",
+  "sev": "error",
+  "message": "Sitemap must be an absolute URL including scheme and host. A relative path is ignored, so your sitemap is not being announced here.",
+  "fix": "Sitemap: https://example.com/sitemap.xml"
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(Google-Extended)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Google-Extended is a control token, not a crawler - it only opts content out of Gemini model training and grounding. Google documents that it does NOT affect inclusion in Google Search and is not a ranking signal, and AI Overviews are served from Googlebot. Blocking this to escape AI Overviews does not work."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(Applebot-Extended)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Applebot-Extended is a control token, not a crawler - it only opts content out of Apple model training. Apple Search and Siri still use Applebot, so this line does not change your visibility there. You will never see it as a request in server logs."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(OAI-SearchBot|Claude-SearchBot|PerplexityBot|Amzn-SearchBot)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "warn",
+  "message": "This is a search and citation crawler, not a training crawler. If this group disallows, you remove yourself from the answers ChatGPT, Claude, Perplexity or Amazon show - while your content can still be trained on through GPTBot or ClaudeBot. Training and citation are separate controls."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(Googlebot)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Googlebot is the search crawler and it is also what feeds AI Overviews. Disallowing this group removes you from Google Search itself. There is currently no supported way to stay in Search but out of AI Overviews."
+ },
+ {
+  "pattern": "^\\s*Crawl-delay\\s*:",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Googlebot ignores Crawl-delay completely. Bing and several AI crawlers do honour it. To slow Google down, use the crawl rate setting in Search Console instead of this line."
+ },
+ {
+  "pattern": "^\\s*Host\\s*:",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Host: is not part of the robots.txt standard and is ignored by Google and Bing. Set your canonical host with redirects and rel=canonical instead."
+ },
+ {
+  "pattern": "^\\s*Disallow:\\s*/\\*\\s*(#.*)?$",
+  "sev": "warn",
+  "message": "Disallow: /* matches every path, exactly like Disallow: /. If you meant to block a pattern, put the literal part first, for example Disallow: /draft*."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(Perplexity-User)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "warn",
+  "message": "Perplexity-User is a user-triggered fetcher and Perplexity documents that it generally does not follow robots.txt. Treat this group as advisory: if you must stop it, block at the edge or by IP rather than relying on this line."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(GPTBot|ClaudeBot|CCBot|Bytespider|Amazonbot|Meta-ExternalAgent|meta-externalagent)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "info",
+  "message": "Training crawler. Disallowing it keeps your pages out of model training data and does NOT affect whether you are cited in AI search, which runs on OAI-SearchBot, Claude-SearchBot and PerplexityBot. Blocking GPTBot alone does not remove you from ChatGPT."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(ChatGPT-User|Claude-User|Amzn-User|Meta-ExternalFetcher)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "info",
+  "message": "User-triggered fetcher: it loads the page only when a person asks the assistant to open your link. Disallowing it means a reader who deliberately pastes your URL gets an empty answer, while training access is unaffected."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*(OAI-AdsBot)\\s*(#.*)?$",
+  "flags": "i",
+  "sev": "info",
+  "message": "OAI-AdsBot only validates the safety of pages submitted as ads in ChatGPT, and OpenAI documents that it is not used for model training. Blocking it can stop your own ads from being verified."
+ },
+ {
+  "pattern": "^\\s*User-agent:\\s*\\*\\s*(#.*)?$",
+  "sev": "info",
+  "message": "The wildcard group does not cover AI crawlers the way most people assume: a named group replaces it entirely, it is not merged. If GPTBot has its own group, GPTBot ignores every rule written here. Name each AI token you actually care about."
+ },
+ {
+  "pattern": "llms\\.txt",
+  "flags": "i",
+  "sev": "info",
+  "message": "llms.txt is a proposed convention, not an honoured standard - no major AI crawler currently reads it. Keep real access rules in robots.txt and treat llms.txt as documentation only."
+ }
+]

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit/js/strings.json

@@ -0,0 +1,10 @@
+{
+ "name": "AI Crawler Rules - robots.txt Audit for AI Search",
+ "subtitle": "Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing.",
+ "bin": "robots-txt-ai-crawler-audit",
+ "price": 29,
+ "free": "Check the open robots.txt against every rule - full results, nothing withheld; Check only the lines you highlight; See every rule and what each AI token controls; Reopen the last report",
+ "paid": "Scan every robots.txt in the workspace; Export the report as CSV, JSON or HTML; CI output that fails the build on errors; Add your own agency policy tokens; Re-check automatically on every save",
+ "need_key": "This option needs a licence (AI Crawler Rules - robots.txt Audit for AI Search).",
+ "exts": []
+}

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/PKG-INFO

@@ -0,0 +1,84 @@
+Metadata-Version: 2.4
+Name: readystack-robots-txt-ai-crawler-audit
+Version: 0.1.8
+Summary: Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing. (bundled Node.js runtime)
+Author-email: ReadyStack <support@getreadystack.com>
+License: Proprietary - see LICENSE.txt
+Project-URL: Homepage, https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi
+Project-URL: Documentation, https://getreadystack.com/tools/robots-txt-ai-crawler-audit?ref=pypi
+Project-URL: Support, https://getreadystack.com/support
+Keywords: robots.txt,AI crawler,GPTBot,Google-Extended,SEO
+Classifier: Programming Language :: Python :: 3
+Classifier: Environment :: Console
+Classifier: Topic :: Software Development :: Quality Assurance
+Classifier: Operating System :: OS Independent
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: nodejs-wheel-binaries>=20
+Dynamic: license-file
+
+# AI Crawler Rules - robots.txt Audit for AI Search
+
+> Runs the same checker as the npm package `@readystack/robots-txt-ai-crawler-audit` on a Node.js runtime that pip installs for you (`nodejs-wheel-binaries`) - no system Node.js needed. Your files are checked locally.
+
+![robots.txt AI Crawler Audit - GPTBot, ClaudeBot, Google-Extended — finds the line](https://getreadystack.com/img/promo/robots-txt-ai-crawler-audit_demo.gif)
+
+Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing.
+
+## Install
+
+```
+robots-txt-ai-crawler-audit file
+```
+
+Node 18+. The same 19 rules as the VS Code extension, from a terminal or CI.
+
+## Free
+
+- Check the open robots.txt against every rule - full results, nothing withheld; Check only the lines you highlight; See every rule and what each AI token controls; Reopen the last report
+- `--rules` lists every rule
+
+## With a licence ($29 once)
+
+- Scan every robots.txt in the workspace; Export the report as CSV, JSON or HTML; CI output that fails the build on errors; Add your own agency policy tokens; Re-check automatically on every save
+
+```
+@readystack/robots-txt-ai-crawler-audit --dir ./templates --report html --out report.html
+```
+
+A freelance technical SEO consultant bills roughly $100-150 an hour, and an AI-crawler robots.txt review is a one-to-two hour job.
+
+## Use from an AI agent (MCP)
+
+Claude Code · Cursor · Windsurf · any MCP client - add to your MCP config:
+
+```json
+{ "mcpServers": { "robots-txt-ai-crawler-audit": { "command": "npx", "args": ["-y", "@readystack/robots-txt-ai-crawler-audit", "--mcp"] } } }
+```
+
+Tools: `check_text` and `check_file` (free) · `check_dir` (licence). The agent gets every finding with the line number.
+
+## Use in CI
+
+```yaml
+- name: AI Crawler Rules - robots.txt Audit for AI Search
+  run: npx -y @readystack/robots-txt-ai-crawler-audit --dir . --ci
+```
+
+(container: `docker run --rm -v "$PWD:/work" getreadystack/robots-txt-ai-crawler-audit --dir /work --ci`)
+
+The folder sweep, reports and CI mode need one licence — one payment, no subscription. Set `READYSTACK_LICENSE=<key>` or run `--license <key>` once.
+
+[Get a licence](https://getreadystack.com/api/buy/cl/polar_cl_I8R8AzowzmASHy45ujvewcvtcl4wBBfC2Fe7r3fZwpr)
+
+
+<!-- ai crawler rules for robots txt -->
+
+
+## Install (PyPI)
+
+```
+pip install readystack-robots-txt-ai-crawler-audit
+robots-txt-ai-crawler-audit --help
+```

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/SOURCES.txt

@@ -0,0 +1,16 @@
+LICENSE.txt
+README.md
+pyproject.toml
+src/readystack_robots_txt_ai_crawler_audit/__init__.py
+src/readystack_robots_txt_ai_crawler_audit/__main__.py
+src/readystack_robots_txt_ai_crawler_audit.egg-info/PKG-INFO
+src/readystack_robots_txt_ai_crawler_audit.egg-info/SOURCES.txt
+src/readystack_robots_txt_ai_crawler_audit.egg-info/dependency_links.txt
+src/readystack_robots_txt_ai_crawler_audit.egg-info/entry_points.txt
+src/readystack_robots_txt_ai_crawler_audit.egg-info/requires.txt
+src/readystack_robots_txt_ai_crawler_audit.egg-info/top_level.txt
+src/readystack_robots_txt_ai_crawler_audit/js/cli.js
+src/readystack_robots_txt_ai_crawler_audit/js/license.js
+src/readystack_robots_txt_ai_crawler_audit/js/package.json
+src/readystack_robots_txt_ai_crawler_audit/js/rules.json
+src/readystack_robots_txt_ai_crawler_audit/js/strings.json

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+robots-txt-ai-crawler-audit = readystack_robots_txt_ai_crawler_audit.__main__:main

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/requires.txt

@@ -0,0 +1 @@
+nodejs-wheel-binaries>=20

readystack_robots_txt_ai_crawler_audit-0.1.8/src/readystack_robots_txt_ai_crawler_audit.egg-info/top_level.txt

@@ -0,0 +1 @@
+readystack_robots_txt_ai_crawler_audit