doc-fetch-cli 2.0.4 → 2.0.6

package/website/LAUNCH-CHECKLIST.md

@@ -0,0 +1,134 @@
+# DocFetch Website Launch Checklist
+
+## Pre-Launch
+
+### Content Review
+- [ ] Verify all installation commands are correct
+- [ ] Test all example commands locally
+- [ ] Check GitHub links point to correct repo
+- [ ] Verify NPM/PyPI badges show correct versions
+- [ ] Proofread all copy for typos
+
+### Technical Checks
+- [ ] Run `npm run build` successfully
+- [ ] Test production build with `npm run preview`
+- [ ] Verify responsive design (mobile, tablet, desktop)
+- [ ] Check all internal anchor links work
+- [ ] Test external links open in new tabs
+- [ ] Verify favicon displays correctly
+
+### SEO Verification
+- [ ] Meta title: "DocFetch - Transform Documentation Sites into AI-Ready Markdown"
+- [ ] Meta description: Present and under 160 characters
+- [ ] Open Graph tags render correctly (test with [metatags.io](https://metatags.io))
+- [ ] Twitter Card preview works
+- [ ] JSON-LD structured data validates ([Google Rich Results Test](https://search.google.com/test/rich-results))
+- [ ] Canonical URL set correctly
+
+### Performance
+- [ ] Lighthouse score >90 (run in Chrome DevTools)
+- [ ] First contentful paint <1.5s
+- [ ] Time to interactive <3s
+- [ ] No console errors or warnings
+- [ ] Images optimized (SVG for logo/icons)
+
+### Accessibility
+- [ ] All images have alt text
+- [ ] Proper heading hierarchy (h1 → h2 → h3)
+- [ ] Color contrast meets WCAG AA
+- [ ] Keyboard navigation works
+- [ ] Focus states visible
+
+## Deployment
+
+### Vercel Deployment
+```bash
+cd website
+vercel --prod
+```
+
+- [ ] Custom domain configured (docfetch.dev)
+- [ ] HTTPS enabled (automatic on Vercel)
+- [ ] DNS propagated
+- [ ] Redirect www → non-www (or vice versa)
+
+### Post-Deployment
+- [ ] Live site loads without errors
+- [ ] All links work on production
+- [ ] Mobile view tested on real device
+- [ ] Social sharing preview looks correct
+
+## Post-Launch
+
+### Analytics & Monitoring
+- [ ] Google Analytics installed (optional)
+- [ ] Google Search Console property added
+- [ ] Sitemap submitted to Google
+- [ ] Bing Webmaster Tools added (optional)
+
+### Marketing
+- [ ] Announce on Twitter/X
+- [ ] Post to Hacker News "Show HN"
+- [ ] Share in relevant subreddits (r/webdev, r/sveltejs)
+- [ ] Add to Product Hunt (optional)
+- [ ] Update main README.md with website link
+- [ ] Add website link to NPM package
+- [ ] Add website link to PyPI package
+- [ ] Update GitHub repo description with website URL
+
+### Documentation
+- [ ] Add website link to doc-fetch main README
+- [ ] Create screenshot gallery (optional)
+- [ ] Write launch blog post (optional)
+
+## Ongoing Maintenance
+
+### Monthly
+- [ ] Check for broken links
+- [ ] Review analytics for issues
+- [ ] Update dependencies (`npm update`)
+- [ ] Check for SvelteKit updates
+
+### Quarterly
+- [ ] Refresh screenshots if UI changed
+- [ ] Update version numbers in examples
+- [ ] Review and update features section
+- [ ] Check competitor landscape
+
+## Rollback Plan
+
+If something goes wrong:
+
+1. **Immediate**: Revert to previous Vercel deployment
+   ```bash
+   vercel rollback
+   ```
+
+2. **Fix locally**: Address the issue in code
+
+3. **Redeploy**: 
+   ```bash
+   vercel --prod
+   ```
+
+## Success Metrics
+
+Track these after launch:
+
+- **Traffic**: Page views, unique visitors
+- **Engagement**: Time on page, bounce rate
+- **Conversions**: GitHub stars, npm installs, pypi downloads
+- **SEO**: Search rankings for "documentation fetcher", "markdown converter"
+- **Social**: Shares, mentions, backlinks
+
+## Contact
+
+For issues: https://github.com/AlphaTechini/doc-fetch/issues
+
+---
+
+**Launch Date**: _________________
+
+**Launched By**: _________________
+
+**Notes**: _______________________________________________

package/website/README.md

@@ -0,0 +1,75 @@
+# DocFetch Website
+
+Landing page for [DocFetch](https://github.com/AlphaTechini/doc-fetch) - Transform documentation sites into AI-ready markdown.
+
+## Tech Stack
+
+- **Framework**: SvelteKit
+- **Styling**: Vanilla CSS (no frameworks - classic, fast, no bloat)
+- **Deployment**: Vercel/Netlify ready (adapter-auto)
+
+## Development
+
+```bash
+cd website
+npm install
+npm run dev
+```
+
+Open http://localhost:5173
+
+## Build
+
+```bash
+npm run build
+npm run preview
+```
+
+## SEO Features
+
+- ✅ Semantic HTML structure
+- ✅ Meta tags (title, description, keywords)
+- ✅ Open Graph tags for social sharing
+- ✅ Twitter Card support
+- ✅ Canonical URL
+- ✅ Structured data (JSON-LD)
+- ✅ Mobile responsive
+- ✅ Fast load time (minimal dependencies)
+- ✅ Accessible (proper heading hierarchy, alt text)
+
+## Design Philosophy
+
+**Classic documentation aesthetic** - inspired by:
+- Early GitHub pages
+- Stripe documentation
+- Vercel simplicity
+- No AI-generated visual noise
+- Clean typography first
+- Content-focused layout
+
+## Deployment
+
+### Vercel (Recommended)
+
+```bash
+npm i -g vercel
+vercel
+```
+
+### Netlify
+
+```bash
+npm run build
+# Drag and drop `build` folder to Netlify
+```
+
+### Manual (Static Hosting)
+
+```bash
+npm run build
+# Serve `build` folder with any static file server
+```
+
+## License
+
+MIT

package/website/SEO-STRATEGY.md

@@ -0,0 +1,347 @@
+# DocFetch SEO Strategy
+
+## Modern SEO Reality Check (2026)
+
+You're right - **meta tags alone don't rank anymore**. Google's algorithm updates (Helpful Content Update, Core Updates) prioritize:
+
+1. **Content depth** - Comprehensive answers, not keyword stuffing
+2. **Topic authority** - Multiple articles showing expertise
+3. **User engagement** - Time on page, low bounce rate, return visitors
+4. **Fresh content** - Regular updates signal active site
+5. **Backlinks** - Other sites linking to your content
+6. **E-E-A-T** - Experience, Expertise, Authoritativeness, Trustworthiness
+
+## Our Content Strategy
+
+### Pillar Content (Long-form Guides)
+
+These are your **cornerstone articles** - comprehensive guides that target high-value keywords:
+
+1. ✅ **"How to Convert Documentation to Markdown for LLMs"** (DONE)
+   - Target: "convert documentation to markdown", "LLM context preparation"
+   - Length: 3,500+ words
+   - Includes: Code examples, comparisons, real-world use cases
+   
+2. 🔄 **"LLM.txt Explained: Complete Guide to Semantic Indexing"**
+   - Target: "llm.txt", "AI documentation index", "RAG navigation"
+   - Angle: First comprehensive guide on this emerging standard
+   
+3. 🔄 **"RAG Context Preparation: Production Best Practices"**
+   - Target: "RAG best practices", "context preparation", "retrieval augmentation"
+   - Angle: Real production war stories, not theory
+
+4. 🔄 **"AI Agents Can't Read Documentation: Here's the Fix"**
+   - Target: "AI agent documentation", "LLM web browsing"
+   - Angle: Problem/solution format, highly shareable
+
+### Supporting Content (Medium Posts)
+
+These support pillar content and target long-tail keywords:
+
+- "Token Efficiency Tips for LLM Context" (800-1,200 words)
+- "DocFetch vs Alternatives: Honest Comparison" (1,500 words)
+- "How We Built DocFetch: Technical Deep Dive" (2,000 words)
+- "5 Ways to Use LLM.txt in Your AI Projects" (1,000 words)
+
+### Quick Updates (Short Posts)
+
+Signal freshness to Google:
+
+- Release announcements (v2.1, v2.2, etc.)
+- Feature spotlights (new flags, improvements)
+- Community highlights (user projects, contributions)
+
+## Keyword Strategy
+
+### Primary Keywords (High Competition, High Volume)
+
+| Keyword | Monthly Searches | Difficulty | Target Page |
+|---------|-----------------|------------|-------------|
+| documentation to markdown | 2,400 | Medium | Pillar #1 |
+| LLM context | 8,100 | High | Pillar #1, #3 |
+| RAG best practices | 5,400 | High | Pillar #3 |
+| AI documentation tools | 1,900 | Medium | Homepage |
+
+### Long-Tail Keywords (Lower Competition, Higher Intent)
+
+| Keyword | Monthly Searches | Difficulty | Target Page |
+|---------|-----------------|------------|-------------|
+| convert website to markdown for AI | 320 | Low | Pillar #1 |
+| llm.txt generator | 90 | Low | Pillar #2 |
+| prepare documentation for RAG | 210 | Low | Pillar #3 |
+| AI agent can't read docs | 50 | Very Low | Pillar #4 |
+| docfetch tutorial | 140 | Very Low | All posts |
+
+### Keyword Placement Rules (2026 Best Practices)
+
+✅ **DO:**
+- Include primary keyword in title (front-loaded)
+- Use in H1 and 1-2 H2s naturally
+- Mention in first 100 words
+- Include in meta description
+- Use variations throughout (semantic SEO)
+- Add to image alt text where relevant
+- Include in URL slug
+
+❌ **DON'T:**
+- Stuff keywords unnaturally
+- Use exact match anchor text repeatedly
+- Create separate pages for each variation
+- Sacrifice readability for keyword density
+
+## On-Page SEO Checklist
+
+### Every Blog Post Must Have:
+
+- [ ] **Title tag** under 60 characters with primary keyword
+- [ ] **Meta description** under 160 characters, compelling CTA
+- [ ] **H1** matches title, includes keyword
+- [ ] **H2/H3 hierarchy** logical, includes keyword variations
+- [ ] **First paragraph** mentions problem + keyword
+- [ ] **Internal links** to 2-3 related posts/pages
+- [ ] **External links** to 2-3 authoritative sources
+- [ ] **Images/diagrams** with descriptive alt text
+- [ ] **Code examples** where relevant (developer audience)
+- [ ] **Table of contents** for posts >1,500 words
+- [ ] **CTA at end** (try DocFetch, GitHub star, etc.)
+- [ ] **Social share buttons** (Twitter, LinkedIn, HN)
+- [ ] **Schema markup** (Article schema for blog posts)
+
+### Technical SEO:
+
+- [ ] **Mobile responsive** (test on real devices)
+- [ ] **Page speed** >90 (Lighthouse score)
+- [ ] **Core Web Vitals** pass (LCP <2.5s, FID <100ms, CLS <0.1)
+- [ ] **HTTPS** enabled
+- [ ] **XML sitemap** generated and submitted
+- [ ] **Robots.txt** configured correctly
+- [ ] **Canonical URLs** set
+- [ ] **404 page** custom, helpful
+- [ ] **Structured data** validates (Google Rich Results Test)
+
+## Content Calendar
+
+### Month 1 (Launch Month)
+
+**Week 1:**
+- ✅ Publish: "How to Convert Documentation to Markdown" (Pillar #1)
+- Share: Twitter, LinkedIn, Hacker News "Show HN"
+- Submit: Reddit r/webdev, r/sveltejs
+
+**Week 2:**
+- Publish: "LLM.txt Explained" (Pillar #2)
+- Share: Twitter thread on LLM.txt benefits
+- Cross-post: DEV.to, Hashnode
+
+**Week 3:**
+- Publish: "AI Agents Can't Read Documentation" (Pillar #4)
+- Share: LinkedIn article format
+- Pitch: AI newsletters (The Batch, Import AI)
+
+**Week 4:**
+- Publish: "DocFetch vs Alternatives" (Comparison post)
+- Share: Product Hunt launch
+- Update: Original pillar posts with internal links
+
+### Month 2
+
+**Week 5:**
+- Publish: "RAG Context Preparation" (Pillar #3)
+- Guest post: Hugging Face blog (if accepted)
+
+**Week 6:**
+- Publish: "Token Efficiency Tips" (Supporting post)
+- Update: All posts with new internal links
+
+**Week 7:**
+- Publish: "Technical Deep Dive: How DocFetch Works"
+- Share: GitHub README update
+
+**Week 8:**
+- Review analytics, double down on what's working
+- Plan Month 3 based on top performers
+
+### Month 3+
+
+- 1-2 posts per month (quality over quantity)
+- Update old posts with new information
+- Build backlinks through guest posting, partnerships
+- Monitor rankings, adjust strategy
+
+## Link Building Strategy
+
+### White-Hat Tactics (No Black-Hat BS)
+
+**1. Create Link-Worthy Assets**
+- Original research/data studies
+- Free tools (we have DocFetch!)
+- Comprehensive guides (our pillar content)
+- Industry reports
+
+**2. Guest Posting**
+- Target: AI/ML blogs, developer publications
+- Pitch: Unique angles, not rehashed content
+- Examples: Hugging Face, Cloudflare, Stack Overflow Blog
+
+**3. HARO (Help a Reporter Out)**
+- Respond to journalist queries about AI, LLMs, documentation
+- Get quoted in articles with backlink
+
+**4. Broken Link Building**
+- Find broken links to similar tools/guides
+- Email site owner: "Hey, this link is broken, here's a working alternative"
+
+**5. Resource Pages**
+- Find "AI tools" or "developer tools" resource pages
+- Politely request inclusion
+
+**6. Community Participation**
+- Answer questions on Stack Overflow, Reddit, Indie Hackers
+- Include DocFetch link when genuinely relevant (don't spam)
+
+### What NOT to Do
+
+❌ Buy backlinks (Google will penalize)  
+❌ Link exchanges ("I'll link if you link")  
+❌ Comment spam with links  
+❌ Private blog networks (PBNs)  
+❌ Automated link building tools  
+
+## Measuring Success
+
+### Metrics to Track
+
+**Traffic Metrics:**
+- Organic search traffic (Google Search Console)
+- Total pageviews (Google Analytics)
+- Unique visitors
+- Traffic by country
+
+**Engagement Metrics:**
+- Average time on page (target: >3 min for long posts)
+- Bounce rate (target: <60% for blog)
+- Pages per session
+- Return visitor rate
+
+**SEO Metrics:**
+- Keyword rankings (use Ahrefs, SEMrush, or Ubersuggest)
+- Domain Authority (DA) / Domain Rating (DR)
+- Backlink count and quality
+- Click-through rate from search results
+
+**Conversion Metrics:**
+- GitHub stars (from blog referrals)
+- NPM installs (correlate with post publish dates)
+- Email subscribers (if newsletter added)
+- Demo requests / contact form submissions
+
+### Tools We'll Use
+
+**Free:**
+- Google Search Console (rankings, impressions, CTR)
+- Google Analytics (traffic, engagement)
+- Google Trends (keyword interest over time)
+- Ahrefs Webmaster Tools (limited but free)
+
+**Paid (Optional, Later):**
+- Ahrefs ($99/mo) - keyword research, backlink analysis
+- SEMrush ($120/mo) - competitor analysis, rank tracking
+- Clearscope ($170/mo) - content optimization
+
+## Competitive Analysis
+
+### Who We're Competing With
+
+**Direct Competitors:**
+- Mercury Parser (mercury.postlight.com)
+- Web Scraper IO (webscraper.io)
+- ParseHub (parsehub.com)
+
+**Indirect Competitors:**
+- Generic web scrapers (Beautiful Soup tutorials)
+- Custom scripts (GitHub repos)
+- Manual copy-paste (the real enemy 😄)
+
+### Our Differentiators
+
+1. **AI-focused** - Built specifically for LLM context, not general scraping
+2. **LLM.txt standard** - Semantic indexing, not just content extraction
+3. **Developer-first** - CLI tool, not SaaS with login walls
+4. **Open source** - Transparent, auditable, extensible
+5. **Cross-platform** - Python, Node.js, Go, binaries
+
+### Content Gaps We Can Exploit
+
+Competitors focus on:
+- General web scraping
+- Enterprise features
+- Visual point-and-click interfaces
+
+We'll focus on:
+- AI/LLM use cases
+- Developer workflow integration
+- Open source transparency
+- Educational content (guides, tutorials)
+
+## Algorithm Update Preparedness
+
+Google updates its algorithm constantly. Here's how to stay safe:
+
+### Evergreen Principles
+
+✅ **Quality content** - Comprehensive, accurate, helpful  
+✅ **User-first approach** - Write for humans, not bots  
+✅ **Regular updates** - Keep content fresh and accurate  
+✅ **Natural links** - Earned through quality, not manipulated  
+✅ **Technical excellence** - Fast, mobile-friendly, accessible  
+
+### Red Flags to Avoid
+
+❌ **Thin content** - Short, shallow posts without substance  
+❌ **Keyword stuffing** - Unnatural repetition  
+❌ **Clickbait titles** - Promise what content doesn't deliver  
+❌ **Duplicate content** - Copying others or yourself  
+❌ **Paid links** - Buying backlinks  
+
+### If an Update Hits Us
+
+1. Don't panic-rankings often recover in weeks
+2. Analyze what dropped (which pages, which keywords)
+3. Compare to competitors (did everyone drop?)
+4. Improve content quality where needed
+5. Wait it out (most updates stabilize in 2-4 weeks)
+
+## Action Items
+
+### Immediate (This Week)
+
+- [x] Create blog infrastructure
+- [x] Publish first pillar post
+- [ ] Set up Google Search Console
+- [ ] Set up Google Analytics
+- [ ] Create XML sitemap
+- [ ] Submit sitemap to Google
+
+### Short-Term (This Month)
+
+- [ ] Publish 3 more pillar posts
+- [ ] Share each post on Twitter, LinkedIn, HN
+- [ ] Submit to 2-3 relevant subreddits
+- [ ] Reach out to 5 bloggers for potential guest posts
+- [ ] Monitor initial rankings for target keywords
+
+### Long-Term (Next Quarter)
+
+- [ ] Achieve top 10 ranking for "documentation to markdown"
+- [ ] Generate 1,000+ organic visitors/month
+- [ ] Earn 10+ quality backlinks
+- [ ] Build email list to 100+ subscribers
+- [ ] Establish DocFetch as thought leader in AI documentation space
+
+---
+
+**Remember:** SEO is a marathon, not a sprint. Focus on creating genuinely helpful content, and the rankings will follow. Game the system, and you'll get penalized.
+
+**Our advantage:** We're builders, not marketers. Our content comes from real experience solving real problems. That authenticity shows through and Google rewards it.
+
+Let's build something great. 🚀