scientify 1.3.0 → 1.4.0

package/skills/research-survey/SKILL.md

@@ -0,0 +1,140 @@
+---
+name: research-survey
+description: "Deep analysis of downloaded papers: read .tex sources, extract core methods/formulas, map formulas to reference code, write structured notes. Requires papers already downloaded via /literature-survey."
+metadata:
+  {
+    "openclaw":
+      {
+        "emoji": "📖",
+      },
+  }
+---
+
+# Research Survey (Deep Analysis)
+
+**Don't ask permission. Just do it.**
+
+**Workspace:** See `../_shared/workspace-spec.md`. Set `$W` to the active project directory.
+
+## Prerequisites
+
+Read and verify these files exist before starting:
+
+| File | Source |
+|------|--------|
+| `$W/papers/_meta/*.json` | /literature-survey |
+| `$W/papers/_downloads/` or `$W/papers/{direction}/` | /literature-survey |
+| `$W/repos/` (optional) | git clone in /literature-survey or manually |
+
+**If any prerequisite is missing, STOP and report:** "需要先运行 /literature-survey 完成论文下载"
+
+## Output
+
+| File | Content |
+|------|---------|
+| `$W/notes/paper_{arxiv_id}.md` | Per-paper structured notes |
+| `$W/survey_res.md` | Synthesis report |
+
+---
+
+## Workflow
+
+### Step 1: 收集论文列表
+
+```bash
+ls $W/papers/_meta/
+```
+
+读取所有 `.json` 元数据，构建论文列表。按 score 降序排列。
+
+### Step 2: 逐篇深度分析
+
+**对每篇论文**（优先高分论文）：
+
+#### 2.1 读 .tex 源码
+
+找到论文的 .tex 文件（在 `_downloads/{arxiv_id}/` 或 `{direction}/{arxiv_id}/` 下），重点读取：
+- **Method / Approach** section
+- **Model Architecture** section
+- 数学公式定义
+
+如果没有 .tex（只有 PDF），基于 abstract 分析。
+
+#### 2.2 提取核心内容
+
+从 .tex 中提取：
+- **核心方法**：1-2 段描述
+- **数学公式**：至少 1 个关键公式（保留 LaTeX 格式）
+- **创新点**：与同领域其他方法的区别
+
+#### 2.3 映射到代码（如果 repos/ 存在）
+
+如果 `$W/repos/` 中有相关仓库：
+- 找到公式对应的代码实现
+- 记录文件路径和行号
+
+#### 2.4 写入笔记
+
+写入 `$W/notes/paper_{arxiv_id}.md`：
+
+```markdown
+# {Paper Title}
+
+- **arXiv:** {arxiv_id}
+- **核心方法:** {1-2 sentences}
+
+## 数学公式
+
+$$
+{key formula in LaTeX}
+$$
+
+含义：{解释}
+
+## 代码映射
+
+文件：`repos/{repo}/path/to/file.py:L42-L60`
+```python
+# relevant code excerpt (< 20 lines)
+```
+
+## 与本研究的关系
+
+{如何应用到当前研究}
+```
+
+### Step 3: 综合报告
+
+读取所有 `notes/paper_*.md`，写入 `$W/survey_res.md`：
+
+```markdown
+# Survey Synthesis
+
+## 论文总览
+- 分析论文数: {N}
+- 涉及方向: {list}
+
+## 核心方法对比
+
+| 论文 | 方法 | 核心公式 | 复杂度 | 优势 |
+|------|------|----------|--------|------|
+| ... | ... | ... | ... | ... |
+
+## 技术路线建议
+
+基于以上分析，推荐的技术路线是：
+{建议}
+
+## 关键公式汇总
+
+{列出所有提取的核心公式}
+```
+
+---
+
+## Rules
+
+1. 每篇论文必须读 .tex 原文（如有），不能只读 abstract
+2. 每篇笔记必须包含至少 1 个数学公式
+3. 如果有 repos/，必须尝试找到公式到代码的映射
+4. survey_res.md 必须包含方法对比表

package/skills/write-review-paper/SKILL.md

@@ -12,6 +12,8 @@ metadata:
 
 # Literature Review Writing
 
+**Don't ask permission. Just do it.**
+
 Guide for writing a structured literature review or survey paper from papers you've already collected. This skill helps with reading strategy, note organization, and academic writing.
 
 **Workspace:** See `../_shared/workspace-spec.md` for directory structure. Outputs go to `$WORKSPACE/review/`.

package/dist/src/tools/arxiv-tool.d.ts.map

@@ -1 +0,0 @@
-{"version":3,"file":"arxiv-tool.d.ts","sourceRoot":"","sources":["../../../src/tools/arxiv-tool.ts"],"names":[],"mappings":"AAUA,eAAO,MAAM,eAAe;;;;;;;EA+B1B,CAAC;AA2LH,wBAAgB,eAAe;;;;;;;;;;;;2BAOE,MAAM,WAAW,OAAO;;;;EA6ExD"}

package/dist/src/tools/arxiv-tool.js

@@ -1,258 +0,0 @@
-import { Type } from "@sinclair/typebox";
-import * as fs from "node:fs";
-import * as path from "node:path";
-import * as os from "node:os";
-import * as tar from "tar";
-const ARXIV_API_URL = "https://export.arxiv.org/api/query";
-const DEFAULT_MAX_RESULTS = 10;
-const MAX_RESULTS_LIMIT = 50;
-export const ArxivToolSchema = Type.Object({
-    query: Type.String({ description: "Search query for arXiv papers (e.g. 'graph neural network')." }),
-    max_results: Type.Optional(Type.Number({
-        description: "Maximum number of results to return (1-50). Default: 10.",
-        minimum: 1,
-        maximum: MAX_RESULTS_LIMIT,
-    })),
-    sort_by: Type.Optional(Type.String({
-        description: 'Sort order: "relevance" (default), "lastUpdatedDate", or "submittedDate".',
-    })),
-    date_from: Type.Optional(Type.String({
-        description: "Filter papers submitted after this date (YYYY-MM-DD).",
-    })),
-    download: Type.Optional(Type.Boolean({
-        description: "If true, download .tex source for each paper to output_dir. Default: false.",
-    })),
-    output_dir: Type.Optional(Type.String({
-        description: "Directory to download .tex source files into. Default: workspace/papers/",
-    })),
-});
-const SORT_MAP = {
-    relevance: "relevance",
-    lastupdateddate: "lastUpdatedDate",
-    submitteddate: "submittedDate",
-};
-function readStringParam(params, key, opts) {
-    const value = params[key];
-    if (value === undefined || value === null) {
-        if (opts?.required) {
-            throw new Error(`Missing required parameter: ${key}`);
-        }
-        return undefined;
-    }
-    return String(value);
-}
-function readNumberParam(params, key, opts) {
-    const value = params[key];
-    if (value === undefined || value === null)
-        return undefined;
-    const num = Number(value);
-    if (isNaN(num))
-        return undefined;
-    return opts?.integer ? Math.floor(num) : num;
-}
-/**
- * Download and extract .tex source from arXiv
- */
-async function downloadTexSource(arxivId, outputDir) {
-    const paperDir = path.join(outputDir, arxivId);
-    await fs.promises.mkdir(paperDir, { recursive: true });
-    const srcUrl = `https://arxiv.org/src/${arxivId}`;
-    const tarPath = path.join(paperDir, "source.tar.gz");
-    try {
-        // Try to download .tex source
-        const response = await fetch(srcUrl);
-        if (!response.ok) {
-            // Fallback to PDF
-            return await downloadPdfFallback(arxivId, outputDir);
-        }
-        const buffer = Buffer.from(await response.arrayBuffer());
-        await fs.promises.writeFile(tarPath, buffer);
-        // Check if it's actually a tar.gz or just a single file
-        const isTarGz = buffer[0] === 0x1f && buffer[1] === 0x8b;
-        if (isTarGz) {
-            // Extract tar.gz
-            await tar.x({ file: tarPath, cwd: paperDir });
-            await fs.promises.unlink(tarPath); // Remove tar.gz after extraction
-            // Find all .tex files
-            const files = await findTexFiles(paperDir);
-            if (files.length === 0) {
-                return await downloadPdfFallback(arxivId, outputDir);
-            }
-            return { success: true, format: "tex", files };
-        }
-        else {
-            // Single file (probably .tex directly)
-            const texPath = path.join(paperDir, "main.tex");
-            await fs.promises.rename(tarPath, texPath);
-            return { success: true, format: "tex", files: ["main.tex"] };
-        }
-    }
-    catch (error) {
-        // Fallback to PDF on any error
-        return await downloadPdfFallback(arxivId, outputDir);
-    }
-}
-async function downloadPdfFallback(arxivId, outputDir) {
-    try {
-        const pdfUrl = `https://arxiv.org/pdf/${arxivId}.pdf`;
-        const response = await fetch(pdfUrl);
-        if (!response.ok) {
-            return { success: false, format: "pdf", files: [], error: `PDF download failed: ${response.status}` };
-        }
-        const pdfPath = path.join(outputDir, `${arxivId}.pdf`);
-        const buffer = Buffer.from(await response.arrayBuffer());
-        await fs.promises.writeFile(pdfPath, buffer);
-        return { success: true, format: "pdf", files: [`${arxivId}.pdf`] };
-    }
-    catch (error) {
-        return { success: false, format: "pdf", files: [], error: String(error) };
-    }
-}
-async function findTexFiles(dir) {
-    const files = [];
-    const entries = await fs.promises.readdir(dir, { withFileTypes: true });
-    for (const entry of entries) {
-        const fullPath = path.join(dir, entry.name);
-        if (entry.isDirectory()) {
-            const subFiles = await findTexFiles(fullPath);
-            files.push(...subFiles.map((f) => path.join(entry.name, f)));
-        }
-        else if (entry.name.endsWith(".tex")) {
-            files.push(entry.name);
-        }
-    }
-    return files;
-}
-function buildSearchUrl(query, maxResults, sortBy, dateFrom) {
-    let searchQuery = query;
-    if (dateFrom) {
-        // ArXiv date filter format: submittedDate:[YYYYMMDD0000+TO+*]
-        const dateFormatted = dateFrom.replace(/-/g, "");
-        searchQuery = `${query} AND submittedDate:[${dateFormatted}0000 TO 99991231]`;
-    }
-    const params = new URLSearchParams({
-        search_query: searchQuery,
-        start: "0",
-        max_results: String(maxResults),
-        sortBy,
-        sortOrder: "descending",
-    });
-    return `${ARXIV_API_URL}?${params.toString()}`;
-}
-function parseAtomXml(xml) {
-    const papers = [];
-    const entryRegex = /<entry>([\s\S]*?)<\/entry>/g;
-    let match;
-    while ((match = entryRegex.exec(xml)) !== null) {
-        const entry = match[1];
-        const getTag = (tag) => {
-            const m = entry.match(new RegExp(`<${tag}[^>]*>([\\s\\S]*?)<\\/${tag}>`));
-            return m ? m[1].trim() : "";
-        };
-        const title = getTag("title").replace(/\s+/g, " ");
-        const abstract = getTag("summary").replace(/\s+/g, " ");
-        const published = getTag("published");
-        const updated = getTag("updated");
-        // Extract arXiv ID from <id> tag
-        const idUrl = getTag("id");
-        const arxivId = idUrl.replace("http://arxiv.org/abs/", "").replace(/v\d+$/, "");
-        // Extract authors
-        const authors = [];
-        const authorRegex = /<author>\s*<name>([^<]+)<\/name>/g;
-        let authorMatch;
-        while ((authorMatch = authorRegex.exec(entry)) !== null) {
-            authors.push(authorMatch[1].trim());
-        }
-        // Extract PDF link
-        const pdfMatch = entry.match(/<link[^>]+title="pdf"[^>]+href="([^"]+)"/);
-        const pdfUrl = pdfMatch ? pdfMatch[1] : `https://arxiv.org/pdf/${arxivId}`;
-        // Extract categories
-        const categories = [];
-        const catRegex = /<category[^>]+term="([^"]+)"/g;
-        let catMatch;
-        while ((catMatch = catRegex.exec(entry)) !== null) {
-            categories.push(catMatch[1]);
-        }
-        if (title && arxivId) {
-            papers.push({ title, authors, abstract, arxivId, pdfUrl, published, updated, categories });
-        }
-    }
-    return papers;
-}
-export function createArxivTool() {
-    return {
-        label: "ArXiv",
-        name: "arxiv",
-        description: "Search arXiv.org for academic papers by keyword. Returns titles, authors, abstracts, and IDs. Optionally downloads .tex source files.",
-        parameters: ArxivToolSchema,
-        execute: async (_toolCallId, rawArgs) => {
-            const params = rawArgs;
-            const query = readStringParam(params, "query", { required: true });
-            const maxResults = Math.min(readNumberParam(params, "max_results", { integer: true }) ?? DEFAULT_MAX_RESULTS, MAX_RESULTS_LIMIT);
-            const rawSort = readStringParam(params, "sort_by") ?? "relevance";
-            const sortBy = SORT_MAP[rawSort.toLowerCase()] ?? "relevance";
-            const dateFrom = readStringParam(params, "date_from");
-            const download = params.download === true || params.download === "true";
-            const outputDir = readStringParam(params, "output_dir") ??
-                path.join(os.homedir(), ".openclaw", "workspace", "papers");
-            const url = buildSearchUrl(query, maxResults, sortBy, dateFrom);
-            let response;
-            try {
-                response = await fetch(url);
-            }
-            catch (error) {
-                return {
-                    type: "tool_result",
-                    content: JSON.stringify({
-                        error: "network_error",
-                        message: `Failed to reach arXiv API: ${error instanceof Error ? error.message : String(error)}`,
-                    }),
-                };
-            }
-            if (!response.ok) {
-                return {
-                    type: "tool_result",
-                    content: JSON.stringify({
-                        error: "api_error",
-                        message: `arXiv API returned ${response.status}: ${response.statusText}`,
-                    }),
-                };
-            }
-            const xml = await response.text();
-            const papers = parseAtomXml(xml);
-            // If download requested, download .tex source for each paper
-            let downloads;
-            if (download && papers.length > 0) {
-                await fs.promises.mkdir(outputDir, { recursive: true });
-                downloads = [];
-                for (const paper of papers) {
-                    const result = await downloadTexSource(paper.arxivId, outputDir);
-                    downloads.push({
-                        arxiv_id: paper.arxivId,
-                        format: result.format,
-                        files: result.files,
-                        error: result.error,
-                    });
-                }
-            }
-            return {
-                type: "tool_result",
-                content: JSON.stringify({
-                    query,
-                    total: papers.length,
-                    papers: papers.map((p) => ({
-                        title: p.title,
-                        authors: p.authors,
-                        abstract: p.abstract,
-                        arxiv_id: p.arxivId,
-                        pdf_url: p.pdfUrl,
-                        published: p.published,
-                        categories: p.categories,
-                    })),
-                    ...(downloads && { downloads, output_dir: outputDir }),
-                }),
-            };
-        },
-    };
-}
-//# sourceMappingURL=arxiv-tool.js.map

package/dist/src/tools/arxiv-tool.js.map

@@ -1 +0,0 @@
-{"version":3,"file":"arxiv-tool.js","sourceRoot":"","sources":["../../../src/tools/arxiv-tool.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,IAAI,EAAE,MAAM,mBAAmB,CAAC;AACzC,OAAO,KAAK,EAAE,MAAM,SAAS,CAAC;AAC9B,OAAO,KAAK,IAAI,MAAM,WAAW,CAAC;AAClC,OAAO,KAAK,EAAE,MAAM,SAAS,CAAC;AAC9B,OAAO,KAAK,GAAG,MAAM,KAAK,CAAC;AAE3B,MAAM,aAAa,GAAG,oCAAoC,CAAC;AAC3D,MAAM,mBAAmB,GAAG,EAAE,CAAC;AAC/B,MAAM,iBAAiB,GAAG,EAAE,CAAC;AAE7B,MAAM,CAAC,MAAM,eAAe,GAAG,IAAI,CAAC,MAAM,CAAC;IACzC,KAAK,EAAE,IAAI,CAAC,MAAM,CAAC,EAAE,WAAW,EAAE,8DAA8D,EAAE,CAAC;IACnG,WAAW,EAAE,IAAI,CAAC,QAAQ,CACxB,IAAI,CAAC,MAAM,CAAC;QACV,WAAW,EAAE,0DAA0D;QACvE,OAAO,EAAE,CAAC;QACV,OAAO,EAAE,iBAAiB;KAC3B,CAAC,CACH;IACD,OAAO,EAAE,IAAI,CAAC,QAAQ,CACpB,IAAI,CAAC,MAAM,CAAC;QACV,WAAW,EACT,2EAA2E;KAC9E,CAAC,CACH;IACD,SAAS,EAAE,IAAI,CAAC,QAAQ,CACtB,IAAI,CAAC,MAAM,CAAC;QACV,WAAW,EAAE,uDAAuD;KACrE,CAAC,CACH;IACD,QAAQ,EAAE,IAAI,CAAC,QAAQ,CACrB,IAAI,CAAC,OAAO,CAAC;QACX,WAAW,EACT,6EAA6E;KAChF,CAAC,CACH;IACD,UAAU,EAAE,IAAI,CAAC,QAAQ,CACvB,IAAI,CAAC,MAAM,CAAC;QACV,WAAW,EAAE,0EAA0E;KACxF,CAAC,CACH;CACF,CAAC,CAAC;AAaH,MAAM,QAAQ,GAA2B;IACvC,SAAS,EAAE,WAAW;IACtB,eAAe,EAAE,iBAAiB;IAClC,aAAa,EAAE,eAAe;CAC/B,CAAC;AAEF,SAAS,eAAe,CAAC,MAA+B,EAAE,GAAW,EAAE,IAA6B;IAClG,MAAM,KAAK,GAAG,MAAM,CAAC,GAAG,CAAC,CAAC;IAC1B,IAAI,KAAK,KAAK,SAAS,IAAI,KAAK,KAAK,IAAI,EAAE,CAAC;QAC1C,IAAI,IAAI,EAAE,QAAQ,EAAE,CAAC;YACnB,MAAM,IAAI,KAAK,CAAC,+BAA+B,GAAG,EAAE,CAAC,CAAC;QACxD,CAAC;QACD,OAAO,SAAS,CAAC;IACnB,CAAC;IACD,OAAO,MAAM,CAAC,KAAK,CAAC,CAAC;AACvB,CAAC;AAED,SAAS,eAAe,CAAC,MAA+B,EAAE,GAAW,EAAE,IAA4B;IACjG,MAAM,KAAK,GAAG,MAAM,CAAC,GAAG,CAAC,CAAC;IAC1B,IAAI,KAAK,KAAK,SAAS,IAAI,KAAK,KAAK,IAAI;QAAE,OAAO,SAAS,CAAC;IAC5D,MAAM,GAAG,GAAG,MAAM,CAAC,KAAK,CAAC,CAAC;IAC1B,IAAI,KAAK,CAAC,GAAG,CAAC;QAAE,OAAO,SAAS,CAAC;IACjC,OAAO,IAAI,EAAE,OAAO,CAAC,CAAC,CAAC,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC;AAC/C,CAAC;AAED;;GAEG;AACH,KAAK,UAAU,iBAAiB,CAC9B,OAAe,EACf,SAAiB;IAEjB,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,CAAC,SAAS,EAAE,OAAO,CAAC,CAAC;IAC/C,MAAM,EAAE,CAAC,QAAQ,CAAC,KAAK,CAAC,QAAQ,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;IAEvD,MAAM,MAAM,GAAG,yBAAyB,OAAO,EAAE,CAAC;IAClD,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,CAAC,QAAQ,EAAE,eAAe,CAAC,CAAC;IAErD,IAAI,CAAC;QACH,8BAA8B;QAC9B,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,MAAM,CAAC,CAAC;QACrC,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;YACjB,kBAAkB;YAClB,OAAO,MAAM,mBAAmB,CAAC,OAAO,EAAE,SAAS,CAAC,CAAC;QACvD,CAAC;QAED,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,MAAM,QAAQ,CAAC,WAAW,EAAE,CAAC,CAAC;QACzD,MAAM,EAAE,CAAC,QAAQ,CAAC,SAAS,CAAC,OAAO,EAAE,MAAM,CAAC,CAAC;QAE7C,wDAAwD;QACxD,MAAM,OAAO,GAAG,MAAM,CAAC,CAAC,CAAC,KAAK,IAAI,IAAI,MAAM,CAAC,CAAC,CAAC,KAAK,IAAI,CAAC;QAEzD,IAAI,OAAO,EAAE,CAAC;YACZ,iBAAiB;YACjB,MAAM,GAAG,CAAC,CAAC,CAAC,EAAE,IAAI,EAAE,OAAO,EAAE,GAAG,EAAE,QAAQ,EAAE,CAAC,CAAC;YAC9C,MAAM,EAAE,CAAC,QAAQ,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC,iCAAiC;YAEpE,sBAAsB;YACtB,MAAM,KAAK,GAAG,MAAM,YAAY,CAAC,QAAQ,CAAC,CAAC;YAC3C,IAAI,KAAK,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;gBACvB,OAAO,MAAM,mBAAmB,CAAC,OAAO,EAAE,SAAS,CAAC,CAAC;YACvD,CAAC;YACD,OAAO,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,KAAK,EAAE,CAAC;QACjD,CAAC;aAAM,CAAC;YACN,uCAAuC;YACvC,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAC;YAChD,MAAM,EAAE,CAAC,QAAQ,CAAC,MAAM,CAAC,OAAO,EAAE,OAAO,CAAC,CAAC;YAC3C,OAAO,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,KAAK,EAAE,CAAC,UAAU,CAAC,EAAE,CAAC;QAC/D,CAAC;IACH,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,+BAA+B;QAC/B,OAAO,MAAM,mBAAmB,CAAC,OAAO,EAAE,SAAS,CAAC,CAAC;IACvD,CAAC;AACH,CAAC;AAED,KAAK,UAAU,mBAAmB,CAChC,OAAe,EACf,SAAiB;IAEjB,IAAI,CAAC;QACH,MAAM,MAAM,GAAG,yBAAyB,OAAO,MAAM,CAAC;QACtD,MAAM,QAAQ,GAAG,MAAM,KAAK,CAAC,MAAM,CAAC,CAAC;QACrC,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;YACjB,OAAO,EAAE,OAAO,EAAE,KAAK,EAAE,MAAM,EAAE,KAAK,EAAE,KAAK,EAAE,EAAE,EAAE,KAAK,EAAE,wBAAwB,QAAQ,CAAC,MAAM,EAAE,EAAE,CAAC;QACxG,CAAC;QACD,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,CAAC,SAAS,EAAE,GAAG,OAAO,MAAM,CAAC,CAAC;QACvD,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,MAAM,QAAQ,CAAC,WAAW,EAAE,CAAC,CAAC;QACzD,MAAM,EAAE,CAAC,QAAQ,CAAC,SAAS,CAAC,OAAO,EAAE,MAAM,CAAC,CAAC;QAC7C,OAAO,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,KAAK,EAAE,CAAC,GAAG,OAAO,MAAM,CAAC,EAAE,CAAC;IACrE,CAAC;IAAC,OAAO,KAAK,EAAE,CAAC;QACf,OAAO,EAAE,OAAO,EAAE,KAAK,EAAE,MAAM,EAAE,KAAK,EAAE,KAAK,EAAE,EAAE,EAAE,KAAK,EAAE,MAAM,CAAC,KAAK,CAAC,EAAE,CAAC;IAC5E,CAAC;AACH,CAAC;AAED,KAAK,UAAU,YAAY,CAAC,GAAW;IACrC,MAAM,KAAK,GAAa,EAAE,CAAC;IAC3B,MAAM,OAAO,GAAG,MAAM,EAAE,CAAC,QAAQ,CAAC,OAAO,CAAC,GAAG,EAAE,EAAE,aAAa,EAAE,IAAI,EAAE,CAAC,CAAC;IACxE,KAAK,MAAM,KAAK,IAAI,OAAO,EAAE,CAAC;QAC5B,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,CAAC,GAAG,EAAE,KAAK,CAAC,IAAI,CAAC,CAAC;QAC5C,IAAI,KAAK,CAAC,WAAW,EAAE,EAAE,CAAC;YACxB,MAAM,QAAQ,GAAG,MAAM,YAAY,CAAC,QAAQ,CAAC,CAAC;YAC9C,KAAK,CAAC,IAAI,CAAC,GAAG,QAAQ,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,IAAI,CAAC,IAAI,CAAC,KAAK,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC,CAAC,CAAC;QAC/D,CAAC;aAAM,IAAI,KAAK,CAAC,IAAI,CAAC,QAAQ,CAAC,MAAM,CAAC,EAAE,CAAC;YACvC,KAAK,CAAC,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;QACzB,CAAC;IACH,CAAC;IACD,OAAO,KAAK,CAAC;AACf,CAAC;AAED,SAAS,cAAc,CAAC,KAAa,EAAE,UAAkB,EAAE,MAAc,EAAE,QAAiB;IAC1F,IAAI,WAAW,GAAG,KAAK,CAAC;IACxB,IAAI,QAAQ,EAAE,CAAC;QACb,8DAA8D;QAC9D,MAAM,aAAa,GAAG,QAAQ,CAAC,OAAO,CAAC,IAAI,EAAE,EAAE,CAAC,CAAC;QACjD,WAAW,GAAG,GAAG,KAAK,uBAAuB,aAAa,mBAAmB,CAAC;IAChF,CAAC;IACD,MAAM,MAAM,GAAG,IAAI,eAAe,CAAC;QACjC,YAAY,EAAE,WAAW;QACzB,KAAK,EAAE,GAAG;QACV,WAAW,EAAE,MAAM,CAAC,UAAU,CAAC;QAC/B,MAAM;QACN,SAAS,EAAE,YAAY;KACxB,CAAC,CAAC;IACH,OAAO,GAAG,aAAa,IAAI,MAAM,CAAC,QAAQ,EAAE,EAAE,CAAC;AACjD,CAAC;AAED,SAAS,YAAY,CAAC,GAAW;IAC/B,MAAM,MAAM,GAAiB,EAAE,CAAC;IAChC,MAAM,UAAU,GAAG,6BAA6B,CAAC;IACjD,IAAI,KAA6B,CAAC;IAElC,OAAO,CAAC,KAAK,GAAG,UAAU,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC,KAAK,IAAI,EAAE,CAAC;QAC/C,MAAM,KAAK,GAAG,KAAK,CAAC,CAAC,CAAC,CAAC;QACvB,MAAM,MAAM,GAAG,CAAC,GAAW,EAAE,EAAE;YAC7B,MAAM,CAAC,GAAG,KAAK,CAAC,KAAK,CAAC,IAAI,MAAM,CAAC,IAAI,GAAG,yBAAyB,GAAG,GAAG,CAAC,CAAC,CAAC;YAC1E,OAAO,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;QAC9B,CAAC,CAAC;QAEF,MAAM,KAAK,GAAG,MAAM,CAAC,OAAO,CAAC,CAAC,OAAO,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;QACnD,MAAM,QAAQ,GAAG,MAAM,CAAC,SAAS,CAAC,CAAC,OAAO,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;QACxD,MAAM,SAAS,GAAG,MAAM,CAAC,WAAW,CAAC,CAAC;QACtC,MAAM,OAAO,GAAG,MAAM,CAAC,SAAS,CAAC,CAAC;QAElC,iCAAiC;QACjC,MAAM,KAAK,GAAG,MAAM,CAAC,IAAI,CAAC,CAAC;QAC3B,MAAM,OAAO,GAAG,KAAK,CAAC,OAAO,CAAC,uBAAuB,EAAE,EAAE,CAAC,CAAC,OAAO,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC;QAEhF,kBAAkB;QAClB,MAAM,OAAO,GAAa,EAAE,CAAC;QAC7B,MAAM,WAAW,GAAG,mCAAmC,CAAC;QACxD,IAAI,WAAmC,CAAC;QACxC,OAAO,CAAC,WAAW,GAAG,WAAW,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,KAAK,IAAI,EAAE,CAAC;YACxD,OAAO,CAAC,IAAI,CAAC,WAAW,CAAC,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,CAAC;QACtC,CAAC;QAED,mBAAmB;QACnB,MAAM,QAAQ,GAAG,KAAK,CAAC,KAAK,CAAC,0CAA0C,CAAC,CAAC;QACzE,MAAM,MAAM,GAAG,QAAQ,CAAC,CAAC,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,yBAAyB,OAAO,EAAE,CAAC;QAE3E,qBAAqB;QACrB,MAAM,UAAU,GAAa,EAAE,CAAC;QAChC,MAAM,QAAQ,GAAG,+BAA+B,CAAC;QACjD,IAAI,QAAgC,CAAC;QACrC,OAAO,CAAC,QAAQ,GAAG,QAAQ,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,KAAK,IAAI,EAAE,CAAC;YAClD,UAAU,CAAC,IAAI,CAAC,QAAQ,CAAC,CAAC,CAAC,CAAC,CAAC;QAC/B,CAAC;QAED,IAAI,KAAK,IAAI,OAAO,EAAE,CAAC;YACrB,MAAM,CAAC,IAAI,CAAC,EAAE,KAAK,EAAE,OAAO,EAAE,QAAQ,EAAE,OAAO,EAAE,MAAM,EAAE,SAAS,EAAE,OAAO,EAAE,UAAU,EAAE,CAAC,CAAC;QAC7F,CAAC;IACH,CAAC;IACD,OAAO,MAAM,CAAC;AAChB,CAAC;AAED,MAAM,UAAU,eAAe;IAC7B,OAAO;QACL,KAAK,EAAE,OAAO;QACd,IAAI,EAAE,OAAO;QACb,WAAW,EACT,uIAAuI;QACzI,UAAU,EAAE,eAAe;QAC3B,OAAO,EAAE,KAAK,EAAE,WAAmB,EAAE,OAAgB,EAAE,EAAE;YACvD,MAAM,MAAM,GAAG,OAAkC,CAAC;YAClD,MAAM,KAAK,GAAG,eAAe,CAAC,MAAM,EAAE,OAAO,EAAE,EAAE,QAAQ,EAAE,IAAI,EAAE,CAAE,CAAC;YACpE,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,CACzB,eAAe,CAAC,MAAM,EAAE,aAAa,EAAE,EAAE,OAAO,EAAE,IAAI,EAAE,CAAC,IAAI,mBAAmB,EAChF,iBAAiB,CAClB,CAAC;YACF,MAAM,OAAO,GAAG,eAAe,CAAC,MAAM,EAAE,SAAS,CAAC,IAAI,WAAW,CAAC;YAClE,MAAM,MAAM,GAAG,QAAQ,CAAC,OAAO,CAAC,WAAW,EAAE,CAAC,IAAI,WAAW,CAAC;YAC9D,MAAM,QAAQ,GAAG,eAAe,CAAC,MAAM,EAAE,WAAW,CAAC,CAAC;YACtD,MAAM,QAAQ,GAAG,MAAM,CAAC,QAAQ,KAAK,IAAI,IAAI,MAAM,CAAC,QAAQ,KAAK,MAAM,CAAC;YACxE,MAAM,SAAS,GAAG,eAAe,CAAC,MAAM,EAAE,YAAY,CAAC;gBACrD,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC,OAAO,EAAE,EAAE,WAAW,EAAE,WAAW,EAAE,QAAQ,CAAC,CAAC;YAE9D,MAAM,GAAG,GAAG,cAAc,CAAC,KAAK,EAAE,UAAU,EAAE,MAAM,EAAE,QAAQ,CAAC,CAAC;YAEhE,IAAI,QAAkB,CAAC;YACvB,IAAI,CAAC;gBACH,QAAQ,GAAG,MAAM,KAAK,CAAC,GAAG,CAAC,CAAC;YAC9B,CAAC;YAAC,OAAO,KAAK,EAAE,CAAC;gBACf,OAAO;oBACL,IAAI,EAAE,aAAsB;oBAC5B,OAAO,EAAE,IAAI,CAAC,SAAS,CAAC;wBACtB,KAAK,EAAE,eAAe;wBACtB,OAAO,EAAE,8BAA8B,KAAK,YAAY,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,EAAE;qBAChG,CAAC;iBACH,CAAC;YACJ,CAAC;YAED,IAAI,CAAC,QAAQ,CAAC,EAAE,EAAE,CAAC;gBACjB,OAAO;oBACL,IAAI,EAAE,aAAsB;oBAC5B,OAAO,EAAE,IAAI,CAAC,SAAS,CAAC;wBACtB,KAAK,EAAE,WAAW;wBAClB,OAAO,EAAE,sBAAsB,QAAQ,CAAC,MAAM,KAAK,QAAQ,CAAC,UAAU,EAAE;qBACzE,CAAC;iBACH,CAAC;YACJ,CAAC;YAED,MAAM,GAAG,GAAG,MAAM,QAAQ,CAAC,IAAI,EAAE,CAAC;YAClC,MAAM,MAAM,GAAG,YAAY,CAAC,GAAG,CAAC,CAAC;YAEjC,6DAA6D;YAC7D,IAAI,SAAmG,CAAC;YACxG,IAAI,QAAQ,IAAI,MAAM,CAAC,MAAM,GAAG,CAAC,EAAE,CAAC;gBAClC,MAAM,EAAE,CAAC,QAAQ,CAAC,KAAK,CAAC,SAAS,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;gBACxD,SAAS,GAAG,EAAE,CAAC;gBACf,KAAK,MAAM,KAAK,IAAI,MAAM,EAAE,CAAC;oBAC3B,MAAM,MAAM,GAAG,MAAM,iBAAiB,CAAC,KAAK,CAAC,OAAO,EAAE,SAAS,CAAC,CAAC;oBACjE,SAAS,CAAC,IAAI,CAAC;wBACb,QAAQ,EAAE,KAAK,CAAC,OAAO;wBACvB,MAAM,EAAE,MAAM,CAAC,MAAM;wBACrB,KAAK,EAAE,MAAM,CAAC,KAAK;wBACnB,KAAK,EAAE,MAAM,CAAC,KAAK;qBACpB,CAAC,CAAC;gBACL,CAAC;YACH,CAAC;YAED,OAAO;gBACL,IAAI,EAAE,aAAsB;gBAC5B,OAAO,EAAE,IAAI,CAAC,SAAS,CAAC;oBACtB,KAAK;oBACL,KAAK,EAAE,MAAM,CAAC,MAAM;oBACpB,MAAM,EAAE,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;wBACzB,KAAK,EAAE,CAAC,CAAC,KAAK;wBACd,OAAO,EAAE,CAAC,CAAC,OAAO;wBAClB,QAAQ,EAAE,CAAC,CAAC,QAAQ;wBACpB,QAAQ,EAAE,CAAC,CAAC,OAAO;wBACnB,OAAO,EAAE,CAAC,CAAC,MAAM;wBACjB,SAAS,EAAE,CAAC,CAAC,SAAS;wBACtB,UAAU,EAAE,CAAC,CAAC,UAAU;qBACzB,CAAC,CAAC;oBACH,GAAG,CAAC,SAAS,IAAI,EAAE,SAAS,EAAE,UAAU,EAAE,SAAS,EAAE,CAAC;iBACvD,CAAC;aACH,CAAC;QACJ,CAAC;KACF,CAAC;AACJ,CAAC"}

package/skills/research-pipeline/references/prompts/implement.md

@@ -1,135 +0,0 @@
-# Implementation Guide
-
-You are implementing an ML research project based on the plan in `workspace/plan_res.md`. The goal is a self-contained, runnable codebase in `workspace/project/`.
-
-## Core Principles
-
-### 1. Self-Contained Project
-
-ALL code must reside within `workspace/project/`. No direct imports from `workspace/repos/`. Reference code should be studied, understood, and rewritten to fit the project's architecture.
-
-When adapting reference code:
-
-- Understand the core logic and algorithm, not just copy the syntax.
-- Rewrite to fit consistent naming conventions and coding style.
-- Document the origin: add a comment like `# Adapted from repos/xyz/model/attention.py`.
-- Include all necessary utility functions — do not rely on external helpers.
-
-### 2. Follow the Plan Exactly
-
-Implement every component listed in `workspace/plan_res.md`:
-
-- Every atomic definition from the Model Plan becomes a class or module.
-- The dataset pipeline matches the Dataset Plan.
-- The loss function matches the Training Plan formula.
-- The evaluation matches the Testing Plan metrics.
-
-Do not skip components. Do not substitute simpler alternatives. If a component seems wrong, flag it rather than silently changing it.
-
-### 3. Real Data, Not Toy Data
-
-Use the actual datasets specified in the plan. If the dataset requires downloading, write the download logic. Never substitute with random data or tiny synthetic datasets for the implementation (the quick validation uses real data with 2 epochs, not fake data).
-
-## Project Structure
-
-```
-workspace/project/
-  model/
-    __init__.py
-    [component files matching Model Plan]
-  data/
-    __init__.py
-    dataset.py       # Dataset class
-    loader.py         # DataLoader configuration
-    preprocess.py     # Preprocessing logic
-  training/
-    __init__.py
-    trainer.py        # Training loop
-    loss.py           # Loss functions
-  testing/
-    __init__.py
-    evaluator.py      # Evaluation logic
-    metrics.py        # Metric implementations
-  utils/
-    __init__.py
-    [shared utilities]
-  run.py              # Main entry point
-  requirements.txt    # All dependencies with versions
-  README.md           # Brief description of the project
-```
-
-## Implementation Sequence
-
-Follow this order to catch issues early:
-
-1. **requirements.txt**: List all dependencies. Pin major versions.
-2. **Data pipeline**: Implement dataset loading first. Verify with a small print test.
-3. **Model architecture**: Implement each component. Verify shapes with dummy input.
-4. **Loss function**: Implement and verify with dummy predictions.
-5. **Training loop**: Wire everything together. Include logging.
-6. **Evaluation**: Implement metrics and test evaluation pipeline.
-7. **run.py**: Main entry point with argument parsing.
-
-After each step, run a quick sanity check before moving on.
-
-## Quick Validation Run
-
-The first run uses 2 epochs only:
-
-```bash
-cd workspace/project
-pip install -r requirements.txt
-python run.py --epochs 2
-```
-
-Expected outcomes:
-- No import errors or missing dependencies.
-- Loss decreases (even slightly) over 2 epochs.
-- No NaN or Inf in loss or gradients.
-- Evaluation metrics produce reasonable (not necessarily good) numbers.
-- Memory usage stays within limits.
-
-If the run fails, debug and fix before reporting. Common issues:
-- Shape mismatches: print tensor shapes at each step.
-- OOM: reduce batch size or model size for validation.
-- Data loading errors: verify file paths and formats.
-
-## Debugging Tips
-
-- Add `print(f"tensor.shape = {tensor.shape}")` at critical points during initial debugging.
-- Use `torch.autograd.set_detect_anomaly(True)` to catch gradient issues.
-- If training is unstable, check learning rate and gradient norms.
-- Remove debugging prints before the final version.
-
-## Implementation Report
-
-After the quick validation succeeds, write `workspace/ml_res.md`:
-
-```markdown
-# Implementation Report
-
-## Components Implemented
-- [List each module with brief description]
-
-## Quick Validation Results
-- Epochs: 2
-- Final training loss: [value]
-- Validation metrics: [values]
-- Runtime: [time]
-- GPU memory: [peak usage]
-
-## Deviations from Plan
-- [Any changes made and why]
-
-## Known Issues
-- [Any issues encountered]
-```
-
-## Rules
-
-1. Never import from `workspace/repos/` — adapt and rewrite instead.
-2. Never use toy/synthetic data — use real datasets from the plan.
-3. Never skip plan components — implement everything or flag the issue.
-4. Always validate with 2 epochs before declaring success.
-5. Always write `requirements.txt` with pinned versions.
-6. If you cannot resolve an issue after 3 attempts, document the problem and ask the user.