@wentorai/research-plugins 1.0.0 → 1.2.0

package/skills/literature/search/open-library-api/SKILL.md

@@ -0,0 +1,196 @@
+---
+name: open-library-api
+description: "Search and access book metadata via the Open Library API"
+metadata:
+  openclaw:
+    emoji: "📕"
+    category: "literature"
+    subcategory: "search"
+    keywords: ["Open Library", "book search", "ISBN lookup", "Internet Archive", "book metadata", "digital library"]
+    source: "https://openlibrary.org/"
+---
+
+# Open Library API
+
+## Overview
+
+Open Library (by the Internet Archive) catalogs every book ever published — 40M+ editions, 20M+ unique works. The API provides book search, ISBN/OCLC lookup, cover images, and reading access for 2M+ borrowable ebooks. Particularly useful for monograph discovery, edition tracking, and bibliographic verification. Free, no authentication required.
+
+## API Endpoints
+
+### Search Books
+
+```bash
+# Full-text search
+curl "https://openlibrary.org/search.json?q=machine+learning&limit=20"
+
+# Search by title
+curl "https://openlibrary.org/search.json?title=deep+learning&limit=10"
+
+# Search by author
+curl "https://openlibrary.org/search.json?author=goodfellow&title=deep+learning"
+
+# Filter by subject
+curl "https://openlibrary.org/search.json?q=statistics&subject=data+analysis"
+
+# Filter by publication year
+curl "https://openlibrary.org/search.json?q=artificial+intelligence&first_publish_year=2020"
+
+# Sort by edition count
+curl "https://openlibrary.org/search.json?q=calculus&sort=editions"
+```
+
+### Book Details
+
+```bash
+# Get work (canonical book entity)
+curl "https://openlibrary.org/works/OL45804W.json"
+
+# Get edition
+curl "https://openlibrary.org/books/OL7353617M.json"
+
+# Get by ISBN
+curl "https://openlibrary.org/isbn/9780262035613.json"
+
+# Bibliographic data via Books API
+curl "https://openlibrary.org/api/books?bibkeys=ISBN:9780262035613&format=json&jscmd=data"
+```
+
+### Cover Images
+
+```bash
+# By ISBN (S/M/L sizes)
+https://covers.openlibrary.org/b/isbn/9780262035613-M.jpg
+
+# By OLID
+https://covers.openlibrary.org/b/olid/OL7353617M-L.jpg
+```
+
+### Author Data
+
+```bash
+# Get author
+curl "https://openlibrary.org/authors/OL34184A.json"
+
+# Search authors
+curl "https://openlibrary.org/search/authors.json?q=hinton"
+
+# Author's works
+curl "https://openlibrary.org/authors/OL34184A/works.json?limit=20"
+```
+
+### Search Parameters
+
+| Parameter | Description | Example |
+|-----------|-------------|---------|
+| `q` | General search | `q=neural+networks` |
+| `title` | Title search | `title=deep+learning` |
+| `author` | Author search | `author=bengio` |
+| `subject` | Subject filter | `subject=computer+science` |
+| `isbn` | ISBN lookup | `isbn=9780262035613` |
+| `first_publish_year` | Publication year | `first_publish_year=2020` |
+| `limit` | Results (max 100) | `limit=50` |
+| `offset` | Pagination | `offset=50` |
+| `sort` | Sort order | `new`, `editions`, `old` |
+| `fields` | Return fields | `key,title,author_name` |
+
+## Response Structure (Search)
+
+```json
+{
+  "numFound": 1250,
+  "docs": [
+    {
+      "key": "/works/OL45804W",
+      "title": "Deep Learning",
+      "author_name": ["Ian Goodfellow", "Yoshua Bengio", "Aaron Courville"],
+      "first_publish_year": 2016,
+      "isbn": ["9780262035613"],
+      "publisher": ["MIT Press"],
+      "subject": ["Machine learning", "Neural networks"],
+      "edition_count": 8,
+      "cover_i": 8739161,
+      "ebook_access": "borrowable"
+    }
+  ]
+}
+```
+
+## Python Usage
+
+```python
+import requests
+
+BASE_URL = "https://openlibrary.org"
+
+
+def search_books(query: str, limit: int = 20,
+                 subject: str = None) -> list:
+    """Search Open Library for books."""
+    params = {"q": query, "limit": limit}
+    if subject:
+        params["subject"] = subject
+
+    resp = requests.get(f"{BASE_URL}/search.json", params=params)
+    resp.raise_for_status()
+    data = resp.json()
+
+    results = []
+    for doc in data.get("docs", []):
+        results.append({
+            "key": doc.get("key"),
+            "title": doc.get("title"),
+            "authors": doc.get("author_name", []),
+            "year": doc.get("first_publish_year"),
+            "publisher": doc.get("publisher", [None])[0],
+            "isbn": doc.get("isbn", [None])[0],
+            "editions": doc.get("edition_count", 0),
+            "subjects": doc.get("subject", [])[:5],
+            "ebook": doc.get("ebook_access"),
+        })
+    return results
+
+
+def get_by_isbn(isbn: str) -> dict:
+    """Look up a book by ISBN."""
+    resp = requests.get(
+        f"{BASE_URL}/api/books",
+        params={
+            "bibkeys": f"ISBN:{isbn}",
+            "format": "json",
+            "jscmd": "data",
+        },
+    )
+    resp.raise_for_status()
+    data = resp.json()
+    return data.get(f"ISBN:{isbn}", {})
+
+
+def get_author_works(author_key: str, limit: int = 20) -> list:
+    """Get works by an author."""
+    resp = requests.get(
+        f"{BASE_URL}/authors/{author_key}/works.json",
+        params={"limit": limit},
+    )
+    resp.raise_for_status()
+    return resp.json().get("entries", [])
+
+
+# Example: search CS textbooks
+books = search_books("algorithms data structures",
+                     subject="computer science")
+for b in books[:5]:
+    print(f"[{b['year']}] {b['title']} — {', '.join(b['authors'][:2])}")
+    print(f"  Publisher: {b['publisher']} | Editions: {b['editions']}")
+
+# Example: ISBN lookup
+info = get_by_isbn("9780262035613")
+print(f"Title: {info.get('title')}")
+print(f"URL: {info.get('url')}")
+```
+
+## References
+
+- [Open Library](https://openlibrary.org/)
+- [Open Library API](https://openlibrary.org/developers/api)
+- [Open Library Data Dumps](https://openlibrary.org/developers/dumps)

package/skills/literature/search/open-semantic-search-guide/SKILL.md

@@ -0,0 +1,190 @@
+---
+name: open-semantic-search-guide
+description: "Self-hosted semantic search and text mining platform"
+metadata:
+  openclaw:
+    emoji: "🔎"
+    category: "literature"
+    subcategory: "search"
+    keywords: ["semantic search", "text mining", "self-hosted", "Solr", "NLP", "entity extraction"]
+    source: "https://github.com/opensemanticsearch/open-semantic-search"
+---
+
+# Open Semantic Search Guide
+
+## Overview
+
+Open Semantic Search is a self-hosted search and text mining platform that combines full-text search (Apache Solr) with semantic analysis — entity extraction, named entity recognition, text classification, and knowledge graph building. Process and search across documents (PDF, DOCX, emails) with faceted navigation and visual analytics. Ideal for researchers needing private, on-premise document search over large paper collections.
+
+## Installation
+
+```bash
+# Docker deployment (recommended)
+git clone https://github.com/opensemanticsearch/open-semantic-search.git
+cd open-semantic-search
+docker-compose up -d
+
+# Access web UI at http://localhost:8080
+# Admin panel at http://localhost:8080/admin
+```
+
+## Architecture
+
+```
+Documents (PDF, DOCX, HTML, email)
+         ↓
+   Connector/Crawler (file system, web, IMAP)
+         ↓
+   ETL Pipeline
+   ├── Text extraction (Apache Tika)
+   ├── OCR (Tesseract, for scanned docs)
+   ├── NER (spaCy, Stanford NER)
+   ├── Entity linking (knowledge base)
+   └── Classification (custom models)
+         ↓
+   Apache Solr (full-text index + facets)
+         ↓
+   Web UI (search, browse, visualize)
+```
+
+## Indexing Documents
+
+```bash
+# Index a directory of papers
+curl -X POST "http://localhost:8080/api/index" \
+  -H "Content-Type: application/json" \
+  -d '{"path": "/data/papers/", "recursive": true}'
+
+# Index single file
+curl -X POST "http://localhost:8080/api/index" \
+  -H "Content-Type: application/json" \
+  -d '{"path": "/data/papers/attention.pdf"}'
+
+# Schedule recurring index
+# Add to crontab or use built-in scheduler
+```
+
+## Search Features
+
+```markdown
+### Full-Text Search
+- Boolean queries: "attention mechanism" AND transformer
+- Phrase search: "self-attention"
+- Wildcard: transform*
+- Proximity: "attention transformer"~5 (within 5 words)
+- Field-specific: title:"attention" author:"Vaswani"
+
+### Faceted Navigation
+- Filter by: author, date, organization, topic, language
+- Nested facets for hierarchical browsing
+- Date range slider
+- Entity type filters (person, organization, location)
+
+### Semantic Features
+- Named entity highlighting in results
+- Related entity suggestions
+- Concept co-occurrence visualization
+- Auto-generated tag clouds
+```
+
+## Python Client
+
+```python
+import requests
+
+SEARCH_URL = "http://localhost:8080/api/search"
+
+def search_papers(query, filters=None, max_results=20):
+    """Search indexed documents."""
+    params = {
+        "q": query,
+        "rows": max_results,
+        "fl": "title,author,content_type,date,score",
+        "hl": "true",        # Highlight matches
+        "hl.fl": "content",  # Highlight in content field
+        "facet": "true",
+        "facet.field": ["author", "organization", "topic"],
+    }
+    if filters:
+        params["fq"] = filters
+
+    resp = requests.get(SEARCH_URL, params=params)
+    data = resp.json()
+
+    results = data["response"]["docs"]
+    facets = data.get("facet_counts", {}).get("facet_fields", {})
+
+    return results, facets
+
+# Search
+results, facets = search_papers(
+    "attention mechanism transformer",
+    filters='date:[2023-01-01T00:00:00Z TO *]',
+)
+
+for doc in results:
+    print(f"[{doc.get('date', 'N/A')}] {doc.get('title', 'Untitled')}")
+    print(f"  Score: {doc['score']:.2f}")
+```
+
+## Entity Extraction Configuration
+
+```json
+{
+  "ner": {
+    "engines": ["spacy", "stanford"],
+    "models": {
+      "spacy": "en_core_web_lg",
+      "stanford": "english.all.3class.caseless"
+    },
+    "entity_types": [
+      "PERSON", "ORG", "GPE", "DATE",
+      "WORK_OF_ART", "EVENT"
+    ],
+    "custom_entities": {
+      "METHODOLOGY": ["transformer", "CNN", "RNN", "GAN"],
+      "DATASET": ["ImageNet", "CIFAR", "MNIST", "COCO"]
+    }
+  },
+  "classification": {
+    "enabled": true,
+    "model": "custom_topic_classifier",
+    "categories": ["NLP", "CV", "RL", "Theory"]
+  }
+}
+```
+
+## Knowledge Graph
+
+```python
+# Query the auto-built knowledge graph
+def get_entity_network(entity, depth=2):
+    """Get co-occurring entities for a given entity."""
+    resp = requests.get(
+        f"{SEARCH_URL}/graph",
+        params={"entity": entity, "depth": depth},
+    )
+    graph = resp.json()
+
+    for node in graph["nodes"]:
+        print(f"Entity: {node['label']} ({node['type']})")
+    for edge in graph["edges"]:
+        print(f"  {edge['source']} ↔ {edge['target']} "
+              f"(co-occur: {edge['weight']})")
+
+get_entity_network("Transformer")
+```
+
+## Use Cases
+
+1. **Paper search**: Full-text search over local paper collections
+2. **Literature mining**: Extract entities and relationships from papers
+3. **Institutional repository**: Campus-wide document search
+4. **Due diligence**: Search across legal/business document archives
+5. **Investigative research**: Cross-reference entities across documents
+
+## References
+
+- [Open Semantic Search GitHub](https://github.com/opensemanticsearch/open-semantic-search)
+- [Apache Solr](https://solr.apache.org/)
+- [Apache Tika](https://tika.apache.org/)

package/skills/literature/search/openaire-api/SKILL.md

@@ -0,0 +1,141 @@
+---
+name: openaire-api
+description: "Search EU-funded research outputs via the OpenAIRE Graph API"
+metadata:
+  openclaw:
+    emoji: "🇪🇺"
+    category: "literature"
+    subcategory: "search"
+    keywords: ["openaire", "european research", "open science", "EU funding", "research outputs", "open access"]
+    source: "https://develop.openaire.eu/"
+---
+
+# OpenAIRE Graph API
+
+## Overview
+
+OpenAIRE is the European Open Science infrastructure providing programmatic access to millions of research outputs — publications, datasets, software, and other research products — linked to EU-funded projects, organizations, and researchers. The Graph API is free, requires no authentication, and returns JSON or XML. Uniquely valuable for discovering EU/Horizon-funded research and tracing connections between research outputs, projects, and institutions.
+
+## API Endpoints
+
+### Base URL
+
+```
+https://api.openaire.eu
+```
+
+### Search Publications
+
+```bash
+# Search by keywords
+curl "https://api.openaire.eu/search/publications?keywords=climate+change+adaptation&format=json&size=10"
+
+# Filter by open access
+curl "https://api.openaire.eu/search/publications?keywords=machine+learning&openaccessonly=true&format=json"
+
+# Filter by date
+curl "https://api.openaire.eu/search/publications?keywords=CRISPR&fromDateAccepted=2023-01-01&toDateAccepted=2026-12-31&format=json"
+
+# Filter by EU project
+curl "https://api.openaire.eu/search/publications?projectID=corda__h2020::123456&format=json"
+
+# Search by DOI
+curl "https://api.openaire.eu/search/publications?doi=10.1038/s41586-023-05881-4&format=json"
+```
+
+### Search Datasets
+
+```bash
+# Find research datasets
+curl "https://api.openaire.eu/search/datasets?keywords=genomics+sequencing&format=json&size=20"
+
+# Open access datasets only
+curl "https://api.openaire.eu/search/datasets?keywords=ocean+temperature&openaccessonly=true&format=json"
+```
+
+### Search Projects
+
+```bash
+# Search EU-funded projects
+curl "https://api.openaire.eu/search/projects?keywords=artificial+intelligence&funder=EC&format=json"
+
+# Horizon 2020 projects
+curl "https://api.openaire.eu/search/projects?keywords=renewable+energy&fundingStream=H2020&format=json"
+
+# Horizon Europe projects
+curl "https://api.openaire.eu/search/projects?keywords=quantum+computing&fundingStream=HE&format=json"
+```
+
+### Query Parameters
+
+| Parameter | Description | Example |
+|-----------|-------------|---------|
+| `keywords` | Free-text search | `keywords=deep+learning` |
+| `doi` | Search by DOI | `doi=10.1234/example` |
+| `openaccessonly` | Open access filter | `openaccessonly=true` |
+| `fromDateAccepted` | Start date | `fromDateAccepted=2023-01-01` |
+| `toDateAccepted` | End date | `toDateAccepted=2026-12-31` |
+| `funder` | Funding agency | `funder=EC` (European Commission) |
+| `fundingStream` | Funding program | `fundingStream=H2020` |
+| `format` | Response format | `format=json` or `format=xml` |
+| `size` | Results per page | `size=50` (max 100) |
+| `page` | Page number | `page=2` |
+| `sortBy` | Sort order | `sortBy=resultdateofacceptance,descending` |
+
+## Python Usage
+
+```python
+import requests
+
+BASE_URL = "https://api.openaire.eu"
+
+def search_publications(keywords: str, open_access: bool = False,
+                         from_date: str = None, size: int = 20) -> list:
+    """Search OpenAIRE publications."""
+    params = {
+        "keywords": keywords,
+        "format": "json",
+        "size": size
+    }
+    if open_access:
+        params["openaccessonly"] = "true"
+    if from_date:
+        params["fromDateAccepted"] = from_date
+
+    resp = requests.get(f"{BASE_URL}/search/publications", params=params)
+    resp.raise_for_status()
+    data = resp.json()
+
+    results = []
+    for item in data.get("response", {}).get("results", {}).get("result", []):
+        metadata = item.get("metadata", {}).get("oaf:entity", {}).get("oaf:result", {})
+        title = metadata.get("title", {})
+        if isinstance(title, dict):
+            title = title.get("$", "")
+        results.append({
+            "title": title,
+            "doi": metadata.get("pid", [{}])[0].get("$", "") if metadata.get("pid") else None,
+            "date": metadata.get("dateofacceptance", {}).get("$", ""),
+            "description": metadata.get("description", {}).get("$", "")[:300] if metadata.get("description") else None
+        })
+    return results
+
+# Example: find recent open access papers on climate
+pubs = search_publications("climate resilience urban", open_access=True, from_date="2024-01-01")
+for p in pubs:
+    print(f"[{p['date']}] {p['title']}")
+```
+
+## Unique Capabilities
+
+- **Project-output linking**: Trace which publications came from which EU grant
+- **Cross-entity relationships**: Publications ↔ Datasets ↔ Software ↔ Projects ↔ Organizations
+- **Deduplication**: OpenAIRE deduplicates records from multiple sources (Crossref, PubMed, arXiv, institutional repos)
+- **Open access monitoring**: Track OA compliance for funded research
+- **175M+ research products** from 120,000+ data sources
+
+## References
+
+- [OpenAIRE API Documentation](https://develop.openaire.eu/)
+- [OpenAIRE Graph](https://graph.openaire.eu/)
+- [OpenAIRE EXPLORE Portal](https://explore.openaire.eu/)

package/skills/literature/search/paper-search-mcp-guide/SKILL.md

@@ -0,0 +1,107 @@
+---
+name: paper-search-mcp-guide
+description: "MCP server for searching papers across arXiv, PubMed, bioRxiv"
+metadata:
+  openclaw:
+    emoji: "🔍"
+    category: "literature"
+    subcategory: "search"
+    keywords: ["paper search", "MCP", "arXiv", "PubMed", "bioRxiv", "multi-database"]
+    source: "https://github.com/openags/paper-search-mcp"
+---
+
+# Paper Search MCP Guide
+
+## Overview
+
+Paper Search MCP is an MCP server that provides unified paper search across multiple academic databases — arXiv, PubMed, bioRxiv, and medRxiv. AI agents can search, download, and analyze papers through a single MCP interface. Handles API authentication, rate limiting, and result normalization across different database formats.
+
+## MCP Configuration
+
+```json
+{
+  "mcpServers": {
+    "paper-search": {
+      "command": "npx",
+      "args": ["@openags/paper-search-mcp"],
+      "env": {}
+    }
+  }
+}
+```
+
+## Available Tools
+
+```markdown
+### search_papers
+Search across all databases or specific ones.
+- query: Search terms
+- source: "arxiv" | "pubmed" | "biorxiv" | "all"
+- max_results: Number of results (default 10)
+- date_from: Start date filter
+- date_to: End date filter
+
+### get_paper
+Get full details for a specific paper.
+- id: arXiv ID, PMID, or DOI
+
+### download_pdf
+Download paper PDF.
+- id: Paper identifier
+- output_dir: Save location
+
+### get_references
+Get references cited by a paper.
+- id: Paper identifier
+
+### get_citations
+Get papers that cite this paper.
+- id: Paper identifier
+```
+
+## Usage in Agent Chat
+
+```markdown
+### Example Interactions
+
+"Search for recent papers on protein folding"
+→ Searches arXiv + PubMed + bioRxiv, returns unified results
+
+"Download the PDF for arxiv:2401.12345"
+→ Fetches and saves PDF locally
+
+"What papers cite the AlphaFold2 paper?"
+→ Looks up forward citations via Semantic Scholar
+
+"Find PubMed papers on CRISPR therapy from 2024"
+→ PubMed-specific search with date filter
+```
+
+## Normalized Result Format
+
+```json
+{
+  "title": "Paper Title",
+  "authors": ["Author A", "Author B"],
+  "abstract": "Abstract text...",
+  "source": "arxiv",
+  "id": "2401.12345",
+  "doi": "10.48550/arXiv.2401.12345",
+  "url": "https://arxiv.org/abs/2401.12345",
+  "published": "2024-01-15",
+  "categories": ["cs.AI", "cs.CL"]
+}
+```
+
+## Use Cases
+
+1. **Literature search**: Multi-database paper discovery
+2. **Agent research**: Automated paper retrieval for AI agents
+3. **PDF collection**: Bulk paper downloading
+4. **Citation analysis**: Forward and backward citation chains
+5. **Cross-database**: Unified search across arXiv + PubMed + bioRxiv
+
+## References
+
+- [paper-search-mcp GitHub](https://github.com/openags/paper-search-mcp)
+- [MCP Specification](https://modelcontextprotocol.io/)