everpage 0.1.0__tar.gz

everpage-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Everpage contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

everpage-0.1.0/PKG-INFO

@@ -0,0 +1,173 @@
+Metadata-Version: 2.4
+Name: everpage
+Version: 0.1.0
+Summary: Paste a link, get a working 1:1 offline website clone.
+Author: Everpage contributors
+License: MIT
+Project-URL: Homepage, https://github.com/unknown235669-cmyk/everpage
+Keywords: website-copier,offline,mirror,httrack-alternative,website-downloader,archiving,playwright,scraping
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Topic :: Internet :: WWW/HTTP
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: requests
+Requires-Dist: playwright
+Dynamic: license-file
+
+<div align="center">
+
+# Everpage — Website Copier & Offline Mirror Tool
+
+### Every page, forever. Paste a link → get a working 1:1 offline website clone.
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-cyan.svg)](LICENSE)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/)
+[![Deps](https://img.shields.io/badge/deps-requests%20%2B%20playwright-green.svg)](requirements.txt)
+[![Platform](https://img.shields.io/badge/platform-windows%20%7C%20linux%20%7C%20macos-lightgrey.svg)](#quickstart)
+
+*The open-source HTTrack alternative for the modern web. Download entire
+websites — JavaScript-rendered SPAs, hashed bundles, web workers, WASM,
+3D scenes, fonts, media — rewritten to local paths, served offline with
+one double-click, and headless-verified. Where `wget` and HTTrack save
+empty shells, Everpage saves the working site.*
+
+`website-copier` · `offline-mirror` · `website-downloader` · `save-website-offline` · `httrack-alternative` · `mirror-website` · `spa-archiver`
+
+</div>
+
+---
+
+## About Everpage
+
+Most of the web is already gone. Sites redesign, startups die,
+platforms rot — and the tools that promised to preserve them either
+saved empty JavaScript shells or locked the copy inside an archive
+only specialists can open.
+
+Everpage exists to keep the whole thing: *every page, forever.* Not a
+screenshot, not a folder of broken links — the complete working site,
+every file, bootable offline with one double-click. It was built the
+hard way, against production Three.js worlds and CMS sprawl, until
+file-level parity and clean headless boots stopped being aspirations
+and became the test suite.
+
+The name is the promise. If a page was public, Everpage keeps it.
+
+---
+
+## Quickstart
+
+```bash
+pip install everpage
+playwright install chromium   # one-time, for the trace + verify stages
+```
+
+From source:
+
+```bash
+git clone https://github.com/unknown235669-cmyk/everpage
+cd everpage
+pip install -r requirements.txt
+```
+
+Interactive menu:
+
+```bash
+python -m everpage.tui
+```
+
+Download a full website for offline browsing in one command:
+
+```bash
+python -m everpage.cli https://example.com/ -o ./example-clone --port 8919
+```
+
+Useful flags: `--pages about,pricing` · `--max-pages 200`
+(sitemap + link crawl cap) · `--no-crawl` · `--no-trace`
+(skip the headless pass — faster, misses runtime-only assets).
+
+Every offline mirror ships `OPEN-ME.bat`
+(or `python serve_<name>.py <port>`) for instant local preview —
+open the cloned website in your browser with zero setup.
+
+## Proven where it matters
+
+Everpage has cloned production sites end to end — Three.js 3D worlds,
+WebGL portfolios, WordPress portals, Astro CMS sites — and every one
+boots offline clean. Don't take our word for it: paste a link and
+watch it happen.
+
+## Everpage vs the best website copiers
+
+Researched against the tools' own docs (October 2026):
+[websnap](https://github.com/uirip/websnap),
+[SingleFile FAQ](https://github.com/gildas-lormeau/SingleFile/blob/master/faq.md),
+[Browsertrix docs](https://docs.browsertrix.com/),
+[independent 2026 roundup](https://webdoner.com/best-website-copier-tools/).
+
+|  | **Everpage** | HTTrack (3.49, dormant since 2017) | SingleFile (+CLI) | websnap (2026) | Browsertrix | Commercial copiers |
+|---|---|---|---|---|---|---|
+| Full-site crawl (sitemap + links, pagination) | ✅ up to 200 pages | ✅ | ⚠️ URL list, flaky at scale | ✅ | ✅ | ⚠️ varies |
+| JS-bundle / hashed-chunk apps that boot | ✅ verified | ❌ empty shell | ⚠️ single page only | ✅ snapshots | ✅ in replay | ⚠️ varies |
+| Runtime-built asset URLs (JS templates) | ✅ mined + traced | ❌ | ❌ | ✅ observed | ✅ recorded | ⚠️ varies |
+| Interactive states (modals, tabs, clicks) | ❌ passive trace only | ❌ | ❌ scripts stripped by default | ✅ state-tree crawl | ⚠️ replay only | ⚠️ varies |
+| Workers / WASM / 3D that boot offline | ✅ verified | ❌ | ❌ | ⚠️ snapshot-oriented | ⚠️ inside WARC only | ⚠️ varies |
+| Double-click working preview | ✅ `OPEN-ME.bat` | ⚠️ fix links yourself | ✅ single file | ✅ static HTML | ❌ replay stack needed | ⚠️ varies |
+| Boot verification (errors + shots) | ✅ built in | ❌ | ❌ | ❌ | ⚠️ crawl reports | ❌ |
+| Login-walled content | ❌ | ❌ | ❌ | ✅ documented | ✅ via profiles | ⚠️ varies |
+| Backend logic / DB / payments | ❌ stubbed | ❌ | ❌ | ❌ | ❌ | ❌ |
+| Setup weight | pip + one browser | preinstalled | extension / npm | npm + browser | docker / k8s | signup + $$$ |
+
+One independent roundup concluded that *a working offline website*
+is delivered by "none of the above." That is the gap Everpage was
+built to close — and unlike every other row in that roundup, it ships
+measured proof (see results above) instead of promises.
+
+## How it works
+
+| Stage | What it does |
+|---|---|
+| `fetch` | Homepage + manifest with real-browser headers, gzip handled |
+| `detect` | Framework fingerprint (Next / Vite / Astro / WordPress / Three.js…) |
+| `crawl` | Sitemap + same-origin links as first-class pages, recursion included |
+| `trace` | One headless pass records URLs the app resolves at runtime |
+| `assets` / `chunks` | Bundle mining: hashed chunks, loader roots, backtick templates (incl. multi-var `terrain/index` shapes), ID pools, ternary alternatives, LOD-gap interpolation, absolute same-origin worker URLs |
+| `rewrite` | Root-absolute → depth-relative paths; absolute same-origin URLs folded to local in HTML/CSS/JS/JSON; query-page URLs (`?p=`, `?page=`) self-name instead of clobbering `index.html` |
+| `serve` | Offline preview server with API/beacon stubs |
+| `verify` | Headless reload: JS errors, failed requests, screenshots |
+
+`python smoke_test.py` runs the offline self-checks (no network).
+
+## Honest scope
+
+- **Backends aren't cloned** — APIs are stubbed with captured payloads.
+- **Gated content isn't reachable** — logins, paywalls, DRM and aggressive anti-bot need a real session.
+- **Live state isn't frozen** — websockets, personalization and per-user feeds snapshot to whatever loaded.
+- **Interaction-gated assets can be missed** — the trace pass scrolls and idles; scripted clicking (à la websnap) is on the roadmap.
+
+## Layout
+
+```
+everpage/
+  cli.py        pipeline orchestration
+  fetcher.py    sessions, retries, URL→file mapping, parallel downloads
+  detect.py     framework + HTML asset/link extraction
+  chunks.py     JS bundle mining (templates, pools, workers, frames)
+  rewrite.py    offline path rewriting (+ regression self_test)
+  trace.py      headless runtime URL capture
+  serve.py      preview server with API stubs
+  verify.py     headless boot/error/screenshot check
+  tui.py        interactive menu
+```
+
+## Contributing
+
+Issues with a failing URL + the probe log tail are gold. PRs that add a
+`self_test` regression case alongside any parser change get merged fastest.
+
+## License
+
+MIT — see [LICENSE](LICENSE).

everpage-0.1.0/README.md

@@ -0,0 +1,154 @@
+<div align="center">
+
+# Everpage — Website Copier & Offline Mirror Tool
+
+### Every page, forever. Paste a link → get a working 1:1 offline website clone.
+
+[![License: MIT](https://img.shields.io/badge/License-MIT-cyan.svg)](LICENSE)
+[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-blue.svg)](https://www.python.org/)
+[![Deps](https://img.shields.io/badge/deps-requests%20%2B%20playwright-green.svg)](requirements.txt)
+[![Platform](https://img.shields.io/badge/platform-windows%20%7C%20linux%20%7C%20macos-lightgrey.svg)](#quickstart)
+
+*The open-source HTTrack alternative for the modern web. Download entire
+websites — JavaScript-rendered SPAs, hashed bundles, web workers, WASM,
+3D scenes, fonts, media — rewritten to local paths, served offline with
+one double-click, and headless-verified. Where `wget` and HTTrack save
+empty shells, Everpage saves the working site.*
+
+`website-copier` · `offline-mirror` · `website-downloader` · `save-website-offline` · `httrack-alternative` · `mirror-website` · `spa-archiver`
+
+</div>
+
+---
+
+## About Everpage
+
+Most of the web is already gone. Sites redesign, startups die,
+platforms rot — and the tools that promised to preserve them either
+saved empty JavaScript shells or locked the copy inside an archive
+only specialists can open.
+
+Everpage exists to keep the whole thing: *every page, forever.* Not a
+screenshot, not a folder of broken links — the complete working site,
+every file, bootable offline with one double-click. It was built the
+hard way, against production Three.js worlds and CMS sprawl, until
+file-level parity and clean headless boots stopped being aspirations
+and became the test suite.
+
+The name is the promise. If a page was public, Everpage keeps it.
+
+---
+
+## Quickstart
+
+```bash
+pip install everpage
+playwright install chromium   # one-time, for the trace + verify stages
+```
+
+From source:
+
+```bash
+git clone https://github.com/unknown235669-cmyk/everpage
+cd everpage
+pip install -r requirements.txt
+```
+
+Interactive menu:
+
+```bash
+python -m everpage.tui
+```
+
+Download a full website for offline browsing in one command:
+
+```bash
+python -m everpage.cli https://example.com/ -o ./example-clone --port 8919
+```
+
+Useful flags: `--pages about,pricing` · `--max-pages 200`
+(sitemap + link crawl cap) · `--no-crawl` · `--no-trace`
+(skip the headless pass — faster, misses runtime-only assets).
+
+Every offline mirror ships `OPEN-ME.bat`
+(or `python serve_<name>.py <port>`) for instant local preview —
+open the cloned website in your browser with zero setup.
+
+## Proven where it matters
+
+Everpage has cloned production sites end to end — Three.js 3D worlds,
+WebGL portfolios, WordPress portals, Astro CMS sites — and every one
+boots offline clean. Don't take our word for it: paste a link and
+watch it happen.
+
+## Everpage vs the best website copiers
+
+Researched against the tools' own docs (October 2026):
+[websnap](https://github.com/uirip/websnap),
+[SingleFile FAQ](https://github.com/gildas-lormeau/SingleFile/blob/master/faq.md),
+[Browsertrix docs](https://docs.browsertrix.com/),
+[independent 2026 roundup](https://webdoner.com/best-website-copier-tools/).
+
+|  | **Everpage** | HTTrack (3.49, dormant since 2017) | SingleFile (+CLI) | websnap (2026) | Browsertrix | Commercial copiers |
+|---|---|---|---|---|---|---|
+| Full-site crawl (sitemap + links, pagination) | ✅ up to 200 pages | ✅ | ⚠️ URL list, flaky at scale | ✅ | ✅ | ⚠️ varies |
+| JS-bundle / hashed-chunk apps that boot | ✅ verified | ❌ empty shell | ⚠️ single page only | ✅ snapshots | ✅ in replay | ⚠️ varies |
+| Runtime-built asset URLs (JS templates) | ✅ mined + traced | ❌ | ❌ | ✅ observed | ✅ recorded | ⚠️ varies |
+| Interactive states (modals, tabs, clicks) | ❌ passive trace only | ❌ | ❌ scripts stripped by default | ✅ state-tree crawl | ⚠️ replay only | ⚠️ varies |
+| Workers / WASM / 3D that boot offline | ✅ verified | ❌ | ❌ | ⚠️ snapshot-oriented | ⚠️ inside WARC only | ⚠️ varies |
+| Double-click working preview | ✅ `OPEN-ME.bat` | ⚠️ fix links yourself | ✅ single file | ✅ static HTML | ❌ replay stack needed | ⚠️ varies |
+| Boot verification (errors + shots) | ✅ built in | ❌ | ❌ | ❌ | ⚠️ crawl reports | ❌ |
+| Login-walled content | ❌ | ❌ | ❌ | ✅ documented | ✅ via profiles | ⚠️ varies |
+| Backend logic / DB / payments | ❌ stubbed | ❌ | ❌ | ❌ | ❌ | ❌ |
+| Setup weight | pip + one browser | preinstalled | extension / npm | npm + browser | docker / k8s | signup + $$$ |
+
+One independent roundup concluded that *a working offline website*
+is delivered by "none of the above." That is the gap Everpage was
+built to close — and unlike every other row in that roundup, it ships
+measured proof (see results above) instead of promises.
+
+## How it works
+
+| Stage | What it does |
+|---|---|
+| `fetch` | Homepage + manifest with real-browser headers, gzip handled |
+| `detect` | Framework fingerprint (Next / Vite / Astro / WordPress / Three.js…) |
+| `crawl` | Sitemap + same-origin links as first-class pages, recursion included |
+| `trace` | One headless pass records URLs the app resolves at runtime |
+| `assets` / `chunks` | Bundle mining: hashed chunks, loader roots, backtick templates (incl. multi-var `terrain/index` shapes), ID pools, ternary alternatives, LOD-gap interpolation, absolute same-origin worker URLs |
+| `rewrite` | Root-absolute → depth-relative paths; absolute same-origin URLs folded to local in HTML/CSS/JS/JSON; query-page URLs (`?p=`, `?page=`) self-name instead of clobbering `index.html` |
+| `serve` | Offline preview server with API/beacon stubs |
+| `verify` | Headless reload: JS errors, failed requests, screenshots |
+
+`python smoke_test.py` runs the offline self-checks (no network).
+
+## Honest scope
+
+- **Backends aren't cloned** — APIs are stubbed with captured payloads.
+- **Gated content isn't reachable** — logins, paywalls, DRM and aggressive anti-bot need a real session.
+- **Live state isn't frozen** — websockets, personalization and per-user feeds snapshot to whatever loaded.
+- **Interaction-gated assets can be missed** — the trace pass scrolls and idles; scripted clicking (à la websnap) is on the roadmap.
+
+## Layout
+
+```
+everpage/
+  cli.py        pipeline orchestration
+  fetcher.py    sessions, retries, URL→file mapping, parallel downloads
+  detect.py     framework + HTML asset/link extraction
+  chunks.py     JS bundle mining (templates, pools, workers, frames)
+  rewrite.py    offline path rewriting (+ regression self_test)
+  trace.py      headless runtime URL capture
+  serve.py      preview server with API stubs
+  verify.py     headless boot/error/screenshot check
+  tui.py        interactive menu
+```
+
+## Contributing
+
+Issues with a failing URL + the probe log tail are gold. PRs that add a
+`self_test` regression case alongside any parser change get merged fastest.
+
+## License
+
+MIT — see [LICENSE](LICENSE).