firecrawl-mcp 3.23.8 → 3.24.0

package/README.md

@@ -291,6 +291,7 @@ Use this guide to select the right tool for your task:
 - **If you need to discover URLs on a site:** use **map**
 - **If you want to search the web for info:** use **search**
 - **If you have a programming question** (a library, an API contract, an error message, a known bug): use **developer search**
+- **If you need scientific papers** (biomedical, life-science, clinical, or arXiv literature): use **research tools** — they search paper abstracts and full text. `search` with `categories: ["research"]` is a different thing: a website filter over ordinary web results.
 - **If you need complex research across multiple unknown sources:** use **agent**
 - **If you want to analyze a whole site or section:** use **crawl** (with limits!)
 - **If you need interactive browser automation** (click, type, navigate): use **interact** with a URL for a fresh page, or **scrape** + **interact** when you already scraped the page or need tighter scrape control
@@ -465,7 +466,7 @@ Search the web and optionally extract content from search results.
 {
   "name": "firecrawl_search",
   "arguments": {
-    "query": "latest AI research papers 2023",
+    "query": "remote work stipend policies at tech companies",
     "highlights": true,
     "limit": 5,
     "lang": "en",
@@ -481,13 +482,15 @@ Search the web and optionally extract content from search results.
 
 Set `highlights` to `true` to request query-relevant highlights or `false` to keep the original search snippets. Omit it to use the API's default behavior.
 
+For scientific papers, see [Research Tools](#12-research-tools-firecrawl_research_): they search paper abstracts and full text, while `categories: ["research"]` here filters ordinary web results to research-affiliated websites.
+
 **Returns:**
 
 - Array of search results (with optional scraped content), plus an `id` field. Pass that `id` to `firecrawl_search_feedback` after you've used the results to refund 1 credit (search costs 2) and improve search quality.
 
 **Prompt Example:**
 
-> "Find the latest research papers on AI published in 2023."
+> "Compare remote work stipend policies across tech companies."
 
 ### 3b. Search Feedback Tool (`firecrawl_search_feedback`)
 
@@ -829,16 +832,20 @@ Stop an interact session for a scraped page when you are done interacting.
 
 Search and inspect papers and GitHub repositories through the research MCP tools.
 
+**Covers:** paper abstracts and full text across biomedical, life-science, and clinical literature (PubMed, bioRxiv, medRxiv) alongside arXiv and other scientific sources.
+
 **Available research tools:**
 
-- `firecrawl_research_search_papers`: search research papers.
-- `firecrawl_research_inspect_paper`: inspect one paper.
-- `firecrawl_research_related_papers`: find related papers.
-- `firecrawl_research_read_paper`: read paper content.
-- `firecrawl_research_search_github`: search GitHub repositories.
+- `firecrawl_research_search_papers`: search paper metadata and abstracts with a natural-language query, with optional author, category, and date filters.
+- `firecrawl_research_inspect_paper`: retrieve canonical metadata for one paper ID (arXiv, PMC, PMID, or DOI).
+- `firecrawl_research_related_papers`: expand from one or more anchor papers through the citation graph.
+- `firecrawl_research_read_paper`: read full-text passages from a specific paper.
+- `firecrawl_research_search_github`: search indexed public GitHub issue, pull-request, and README content.
 
 **Best for:** Literature review, paper lookup, and repository discovery workflows where the agent needs a focused research surface instead of general web scraping.
 
+`firecrawl_search` with `categories: ["research"]` is a different surface: it filters ordinary web results to research-affiliated websites and returns page snippets, not paper records. Use these tools when the question is about the literature itself, and pass several distinct framings of the same question — they surface different papers than a single query does.
+
 ### 13. Monitor Tools (`firecrawl_monitor_*`)
 
 Create and manage recurring page monitors. Monitors run scheduled scrapes or crawls, diff each result against the last retained snapshot, and can notify by webhook or email.

package/dist/index.js

@@ -18,8 +18,10 @@ var MAX_PASSAGE_CHARS = 1200;
 function fmtDeveloper(results) {
   if (!results || results.length === 0) return "(no results)";
   return results.map((r) => {
-    const kind = r.type ? ` (${r.type})` : "";
-    const lines = [`## [${r.id ?? "?"}]${kind} ${r.title ?? "(untitled)"}`];
+    const id = r.id ?? "?";
+    const kind = r.id?.split(":", 1)[0];
+    const kindLabel = kind ? ` (${kind})` : "";
+    const lines = [`## [${id}]${kindLabel} ${r.title ?? "(untitled)"}`];
     if (r.url) lines.push(r.url);
     const body = (r.passages ?? []).map((p) => p.text ?? "").join("\n---\n").trim();
     lines.push(body ? body.slice(0, MAX_PASSAGE_CHARS) : "(no content)");
@@ -586,7 +588,7 @@ function fmtGithub(results) {
   if (!results || results.length === 0) return "(no results)";
   return results.map((r) => {
     const lines = [];
-    if (r.resultType === "repo_readme") {
+    if (r.number == null && r.pageType == null) {
       lines.push(`[${r.repo ?? "?"}] README`);
     } else {
       const ref = r.number != null ? `#${r.number}` : "";
@@ -618,7 +620,9 @@ function registerResearchTools(server2, getClient2) {
       // Query-only; no writes to external sources or the research index.
     },
     description: `
-For topics represented in the indexed corpus, search paper metadata and abstracts with a natural-language query. Optional author, category, and date filters constrain results.
+Search paper metadata and abstracts with a natural-language query across the indexed corpus, which spans biomedical, life-science, and clinical literature (PubMed, bioRxiv, medRxiv) alongside arXiv and other scientific sources. Optional author, category, and date filters constrain results.
+
+Several distinct framings of the same question surface different papers than a single query does.
 
 Returns ranked papers with canonical IDs, titles, authors, and abstracts.
 `,
@@ -689,7 +693,7 @@ Retrieve canonical metadata for one paper ID, such as an arXiv, PMC, PMID, or DO
   server2.addTool({
     name: "firecrawl_research_related_papers",
     annotations: {
-      title: "Find related arXiv papers",
+      title: "Find related papers via citation graph",
       readOnlyHint: true,
       // Finds related papers via citation graph expansion; returns candidates only.
       openWorldHint: true,
@@ -1280,7 +1284,7 @@ var searchToolBaseFields = {
   excludeDomains: z4.array(searchDomainSchema).optional(),
   sources: z4.array(z4.object({ type: z4.enum(["web", "images", "news"]) })).optional(),
   categories: z4.array(z4.enum(["github", "research", "pdf", "developer"])).optional().describe(
-    "Limit results to specific source types. `github` searches GitHub repositories, code, issues, and docs; `research` searches academic and research sources; `pdf` searches PDF results; `developer` searches an index built for coding agents over GitHub issues, merged pull requests, repository READMEs, and curated documentation sites. `developer` adds a `data.developer` group of `{ url, title, description }` results, where `description` holds the matched passage; the other categories filter `data.web`."
+    "Limit results to specific source types. `github` searches GitHub repositories, code, issues, and docs; `research` restricts ordinary web results to research-affiliated websites and returns page snippets, which is separate from the `firecrawl_research_*` tools that search paper abstracts and full text across biomedical (PubMed, bioRxiv, medRxiv) and arXiv literature; `pdf` searches PDF results; `developer` searches an index built for coding agents over GitHub issues, merged pull requests, repository READMEs, and curated documentation sites. `developer` adds a `data.developer` group of `{ url, title, description }` results, where `description` holds the matched passage; the other categories filter `data.web`."
   ),
   enterprise: z4.array(z4.enum(["default", "anon", "zdr"])).optional()
 };
@@ -1319,9 +1323,9 @@ var ConsoleLogger = class {
 var openAiAppsChallengeToken = normalizeHeader(
   process.env.OPENAI_APPS_CHALLENGE_TOKEN
 );
-var FULL_PROFILE_INSTRUCTIONS = `Firecrawl provides web search, page retrieval, site URL discovery, multi-page collection, structured page data, monitoring, and asynchronous research. Match the requested operation to the tool boundary: firecrawl_scrape retrieves one supplied page and can return JSON matching a supplied schema, firecrawl_map enumerates URLs under a site without retrieving their content, and firecrawl_agent starts multi-source research whose result is read with firecrawl_agent_status. Provide only the required inputs and account for stated network or external side effects.`;
-var KEYLESS_PROFILE_INSTRUCTIONS = `Without authentication, this endpoint exposes Search, Scrape, and Parse with usage limits. An OAuth connection or Authorization bearer API key exposes account tools; unavailable tools return connection guidance. Firecrawl provides web search, page retrieval, site URL discovery, multi-page collection, structured page data, monitoring, and asynchronous research. Match the requested operation to the tool boundary: firecrawl_scrape retrieves one supplied page and can return JSON matching a supplied schema, firecrawl_map enumerates URLs under a site without retrieving their content, and firecrawl_agent starts multi-source research whose result is read with firecrawl_agent_status. Provide only the required inputs.`;
-var SEARCH_PROFILE_INSTRUCTIONS = `Firecrawl provides web, developer, and research search. Use firecrawl_search to find relevant results across the web and specialized indexes. For a programming question, use firecrawl_search with categories: ["developer"] to search indexed GitHub issues, merged pull requests, READMEs, and documentation. Use the firecrawl_research_* tools to search academic and research literature, expand from anchor papers via the citation graph, read full-text passages from a specific paper, and search public code repositories. All tools are read-only and return ranked results.`;
+var FULL_PROFILE_INSTRUCTIONS = `Firecrawl provides web search, page retrieval, site URL discovery, multi-page collection, structured page data, monitoring, and asynchronous research. Match the requested operation to the tool boundary: firecrawl_scrape retrieves one supplied page and can return JSON matching a supplied schema, firecrawl_map enumerates URLs under a site without retrieving their content, and firecrawl_agent starts multi-source research whose result is read with firecrawl_agent_status. For biomedical, life-science, clinical, or arXiv literature, the firecrawl_research_* tools search a paper index of abstracts and full text; firecrawl_search with categories: ["research"] is a website filter over ordinary web results and reaches different sources. Provide only the required inputs and account for stated network or external side effects.`;
+var KEYLESS_PROFILE_INSTRUCTIONS = `Without authentication, this endpoint exposes Search, Scrape, and Parse with usage limits. An OAuth connection or Authorization bearer API key exposes account tools; unavailable tools return connection guidance. Firecrawl provides web search, page retrieval, site URL discovery, multi-page collection, structured page data, monitoring, and asynchronous research. Match the requested operation to the tool boundary: firecrawl_scrape retrieves one supplied page and can return JSON matching a supplied schema, firecrawl_map enumerates URLs under a site without retrieving their content, and firecrawl_agent starts multi-source research whose result is read with firecrawl_agent_status. For biomedical, life-science, clinical, or arXiv literature, firecrawl_search with categories: ["research"] filters ordinary web results to research-affiliated websites; the firecrawl_research_* tools search a separate paper index of abstracts and full text and become available once an OAuth connection or Authorization bearer API key is present. Provide only the required inputs.`;
+var SEARCH_PROFILE_INSTRUCTIONS = `Firecrawl provides web, developer, and research search. Use firecrawl_search to find relevant results across the web and specialized indexes. For a programming question, use firecrawl_search with categories: ["developer"] to search indexed GitHub issues, merged pull requests, READMEs, and documentation. For a biomedical, life-science, clinical, or arXiv literature question, the firecrawl_research_* tools search the paper index, while categories: ["research"] on firecrawl_search filters ordinary web results to research-affiliated websites. Use the firecrawl_research_* tools to search academic and research literature, expand from anchor papers via the citation graph, read full-text passages from a specific paper, and search public code repositories. All tools are read-only and return ranked results.`;
 var SEARCH_PROFILE_TOOLS = /* @__PURE__ */ new Set([
   "firecrawl_search",
   "firecrawl_research_search_papers",
@@ -2216,6 +2220,8 @@ Search web, news, or image sources and return ranked results. Operators include
 
 For a programming question, add \`categories: ["developer"]\`. It searches an index of GitHub issues, merged pull requests, repository READMEs, and curated documentation sites, and returns the hits in \`data.developer\` beside the web results.
 
+\`categories: ["research"]\` restricts these web results to research-affiliated websites and returns page snippets. The \`firecrawl_research_*\` tools are a separate surface that searches paper abstracts and full text across biomedical (PubMed, bioRxiv, medRxiv) and arXiv literature.
+
 \`scrapeOptions\` can attach extracted page content; pages fetched this way use a fixed reuse window and ignore \`maxAge\`, so use \`firecrawl_scrape\` when a live fetch is required. Returns source-type result groups and usage metadata. Authenticated responses can include an \`id\` for optional search feedback.
 `,
   parameters: z4.object({

package/package.json

@@ -1,7 +1,7 @@
 {
   "name": "firecrawl-mcp",
-  "version": "3.23.8",
-  "description": "MCP server for Firecrawl — search, scrape, and interact with the web. Supports both cloud and self-hosted instances. Features include web search, scraping, page interaction, batch processing, and LLM-powered content analysis.",
+  "version": "3.24.0",
+  "description": "MCP server for Firecrawl — search, scrape, and interact with the web, and search scientific papers. Supports both cloud and self-hosted instances. Features include web search, scraping, page interaction, batch processing, LLM-powered content analysis, and research paper search over biomedical and arXiv literature (PubMed, bioRxiv, medRxiv, arXiv) with citation-graph expansion and full-text reading.",
   "type": "module",
   "mcpName": "io.github.firecrawl/firecrawl-mcp-server",
   "bin": {
@@ -28,7 +28,13 @@
     "firecrawl",
     "web-search",
     "web-data",
-    "web-interaction"
+    "web-interaction",
+    "research",
+    "paper-search",
+    "literature-search",
+    "biomedical",
+    "pubmed",
+    "arxiv"
   ],
   "repository": {
     "type": "git",