clearai-dsh 0.1.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (154) hide show
  1. package/CHANGELOG.md +26 -0
  2. package/LICENSE +201 -0
  3. package/README.md +138 -0
  4. package/README.zh-CN.md +138 -0
  5. package/bin/clearai.mjs +224 -0
  6. package/brand/README.md +41 -0
  7. package/brand/logo-512-dark.png +0 -0
  8. package/brand/logo-512.png +0 -0
  9. package/brand/logo-lockup-dark.png +0 -0
  10. package/brand/logo-lockup.png +0 -0
  11. package/brand/logo-lockup.svg +12 -0
  12. package/brand/logo-wordmark.svg +6 -0
  13. package/brand/logo.svg +19 -0
  14. package/cordis.patch.yml +39 -0
  15. package/lib/client.js +3071 -0
  16. package/lib/fold.js +1576 -0
  17. package/lib/host.js +605 -0
  18. package/package.json +65 -0
  19. package/presets/clearai/agent.cordis.yml +226 -0
  20. package/presets/clearai/plugins/brain.js +547 -0
  21. package/presets/clearai/plugins/clearai-kernel.js +5485 -0
  22. package/presets/clearai/plugins/ontology.js +306 -0
  23. package/presets/clearai/plugins/prompts.js +312 -0
  24. package/presets/clearai/preset.yml +5 -0
  25. package/presets/clearai/skills/clearai-loop/SKILL.md +89 -0
  26. package/presets/clearai/template/knowledge/README.md +25 -0
  27. package/presets/clearai/template/memory/README.md +34 -0
  28. package/presets/clearai/template/project.md +49 -0
  29. package/presets/clearai/template/skills/README.md +37 -0
  30. package/presets/clearai/template/skills/chart-diagram-qa/SKILL.md +43 -0
  31. package/presets/clearai/template/skills/citation-management/SKILL.md +73 -0
  32. package/presets/clearai/template/skills/citation-management/references/bibtex_formatting.md +908 -0
  33. package/presets/clearai/template/skills/citation-management/references/citation_validation.md +794 -0
  34. package/presets/clearai/template/skills/citation-management/references/google_scholar_search.md +725 -0
  35. package/presets/clearai/template/skills/citation-management/references/metadata_extraction.md +870 -0
  36. package/presets/clearai/template/skills/citation-management/references/pubmed_search.md +839 -0
  37. package/presets/clearai/template/skills/citation-management/scripts/doi_to_bibtex.py +204 -0
  38. package/presets/clearai/template/skills/citation-management/scripts/extract_metadata.py +569 -0
  39. package/presets/clearai/template/skills/citation-management/scripts/format_bibtex.py +349 -0
  40. package/presets/clearai/template/skills/citation-management/scripts/generate_schematic.py +139 -0
  41. package/presets/clearai/template/skills/citation-management/scripts/generate_schematic_ai.py +817 -0
  42. package/presets/clearai/template/skills/citation-management/scripts/search_google_scholar.py +282 -0
  43. package/presets/clearai/template/skills/citation-management/scripts/search_pubmed.py +398 -0
  44. package/presets/clearai/template/skills/citation-management/scripts/validate_citations.py +497 -0
  45. package/presets/clearai/template/skills/data-analysis/SKILL.md +92 -0
  46. package/presets/clearai/template/skills/data-analysis/checklists/readiness_check.md +23 -0
  47. package/presets/clearai/template/skills/data-analysis/templates/analysis_report.md.tpl +63 -0
  48. package/presets/clearai/template/skills/data-analysis/templates/cleaning_rules_draft.yaml.tpl +32 -0
  49. package/presets/clearai/template/skills/data-analysis/templates/data_dictionary.md.tpl +12 -0
  50. package/presets/clearai/template/skills/data-analysis/templates/domain_knowledge_template.md.tpl +316 -0
  51. package/presets/clearai/template/skills/data-analysis/templates/feature_candidates.json.tpl +20 -0
  52. package/presets/clearai/template/skills/data-analysis/templates/quality_scorecard.md.tpl +30 -0
  53. package/presets/clearai/template/skills/data-analysis/workflows/01-data-profiling.md +42 -0
  54. package/presets/clearai/template/skills/data-analysis/workflows/02-quality-audit.md +36 -0
  55. package/presets/clearai/template/skills/data-analysis/workflows/03-physical-correlation.md +25 -0
  56. package/presets/clearai/template/skills/data-analysis/workflows/04-unstructured-mining.md +26 -0
  57. package/presets/clearai/template/skills/data-qa-analysis/SKILL.md +102 -0
  58. package/presets/clearai/template/skills/data-qa-analysis/checklists/readiness_check.md +62 -0
  59. package/presets/clearai/template/skills/data-qa-analysis/templates/best_in_class_report.md.tpl +56 -0
  60. package/presets/clearai/template/skills/data-qa-analysis/templates/cleaning_rules_draft.yaml.tpl +56 -0
  61. package/presets/clearai/template/skills/data-qa-analysis/templates/data_dictionary.md.tpl +13 -0
  62. package/presets/clearai/template/skills/data-qa-analysis/templates/data_source_inventory_and_lineage.md.tpl +146 -0
  63. package/presets/clearai/template/skills/data-qa-analysis/templates/data_status_report.md.tpl +60 -0
  64. package/presets/clearai/template/skills/data-qa-analysis/templates/steady_state_rules.yaml.tpl +41 -0
  65. package/presets/clearai/template/skills/data-qa-analysis/templates/subsystem_registry.md.tpl +101 -0
  66. package/presets/clearai/template/skills/data-qa-analysis/templates/unified_execution_plan.md.tpl +100 -0
  67. package/presets/clearai/template/skills/data-qa-analysis/workflows/01-data-source-inventory-and-lineage.md +194 -0
  68. package/presets/clearai/template/skills/data-qa-analysis/workflows/02-data-alignment-and-tag-semantics.md +122 -0
  69. package/presets/clearai/template/skills/data-qa-analysis/workflows/03-steady-state-identification.md +126 -0
  70. package/presets/clearai/template/skills/data-qa-analysis/workflows/04-consumption-analysis.md +152 -0
  71. package/presets/clearai/template/skills/data-qa-analysis/workflows/05-best-in-class-and-optimization-space.md +78 -0
  72. package/presets/clearai/template/skills/domain-presearch/SKILL.md +131 -0
  73. package/presets/clearai/template/skills/domain-presearch/checklists/domain_checklist.md +24 -0
  74. package/presets/clearai/template/skills/domain-presearch/references/figure_code.md +78 -0
  75. package/presets/clearai/template/skills/domain-presearch/references/strategic_frameworks.md +38 -0
  76. package/presets/clearai/template/skills/exploration-loop/SKILL.md +81 -0
  77. package/presets/clearai/template/skills/exploratory-data-analysis/SKILL.md +77 -0
  78. package/presets/clearai/template/skills/exploratory-data-analysis/references/bioinformatics_genomics_formats.md +664 -0
  79. package/presets/clearai/template/skills/exploratory-data-analysis/references/chemistry_molecular_formats.md +664 -0
  80. package/presets/clearai/template/skills/exploratory-data-analysis/references/general_scientific_formats.md +518 -0
  81. package/presets/clearai/template/skills/exploratory-data-analysis/references/microscopy_imaging_formats.md +620 -0
  82. package/presets/clearai/template/skills/exploratory-data-analysis/references/proteomics_metabolomics_formats.md +517 -0
  83. package/presets/clearai/template/skills/exploratory-data-analysis/references/spectroscopy_analytical_formats.md +633 -0
  84. package/presets/clearai/template/skills/exploratory-data-analysis/scripts/eda_analyzer.py +547 -0
  85. package/presets/clearai/template/skills/hypothesis-generation/SKILL.md +73 -0
  86. package/presets/clearai/template/skills/hypothesis-generation/references/experimental_design_patterns.md +329 -0
  87. package/presets/clearai/template/skills/hypothesis-generation/references/hypothesis_quality_criteria.md +198 -0
  88. package/presets/clearai/template/skills/hypothesis-generation/references/literature_search_strategies.md +622 -0
  89. package/presets/clearai/template/skills/hypothesis-generation/scripts/generate_schematic.py +139 -0
  90. package/presets/clearai/template/skills/hypothesis-generation/scripts/generate_schematic_ai.py +817 -0
  91. package/presets/clearai/template/skills/literature-review/SKILL.md +72 -0
  92. package/presets/clearai/template/skills/literature-review/references/citation_styles.md +166 -0
  93. package/presets/clearai/template/skills/literature-review/references/database_strategies.md +455 -0
  94. package/presets/clearai/template/skills/literature-review/scripts/generate_pdf.py +176 -0
  95. package/presets/clearai/template/skills/literature-review/scripts/generate_schematic.py +139 -0
  96. package/presets/clearai/template/skills/literature-review/scripts/generate_schematic_ai.py +817 -0
  97. package/presets/clearai/template/skills/literature-review/scripts/search_databases.py +303 -0
  98. package/presets/clearai/template/skills/literature-review/scripts/verify_citations.py +221 -0
  99. package/presets/clearai/template/skills/paper-lookup/SKILL.md +59 -0
  100. package/presets/clearai/template/skills/paper-lookup/references/arxiv.md +161 -0
  101. package/presets/clearai/template/skills/paper-lookup/references/biorxiv.md +118 -0
  102. package/presets/clearai/template/skills/paper-lookup/references/core.md +150 -0
  103. package/presets/clearai/template/skills/paper-lookup/references/crossref.md +181 -0
  104. package/presets/clearai/template/skills/paper-lookup/references/medrxiv.md +104 -0
  105. package/presets/clearai/template/skills/paper-lookup/references/openalex.md +174 -0
  106. package/presets/clearai/template/skills/paper-lookup/references/pmc.md +152 -0
  107. package/presets/clearai/template/skills/paper-lookup/references/pubmed.md +124 -0
  108. package/presets/clearai/template/skills/paper-lookup/references/semantic-scholar.md +203 -0
  109. package/presets/clearai/template/skills/paper-lookup/references/unpaywall.md +127 -0
  110. package/presets/clearai/template/skills/process-presearch/SKILL.md +196 -0
  111. package/presets/clearai/template/skills/process-presearch/checklists/process_checklist.md +18 -0
  112. package/presets/clearai/template/skills/process-presearch/references/figure_code.md +107 -0
  113. package/presets/clearai/template/skills/process-presearch/references/source_attribution_example.md +22 -0
  114. package/presets/clearai/template/skills/process-understanding-extraction/SKILL.md +69 -0
  115. package/presets/clearai/template/skills/process-understanding-extraction/checklists/readiness_check.md +34 -0
  116. package/presets/clearai/template/skills/process-understanding-extraction/templates/docx_raw_dump_extractor.py.tpl +132 -0
  117. package/presets/clearai/template/skills/process-understanding-extraction/templates/entity_map_unit_topology.json.tpl +86 -0
  118. package/presets/clearai/template/skills/process-understanding-extraction/templates/process_brief.md.tpl +89 -0
  119. package/presets/clearai/template/skills/process-understanding-extraction/templates/process_brief_builder_from_raw_dump.py.tpl +203 -0
  120. package/presets/clearai/template/skills/process-understanding-extraction/templates/process_flow_mermaid.md.tpl +41 -0
  121. package/presets/clearai/template/skills/process-understanding-extraction/templates/unified_execution_plan.md.tpl +53 -0
  122. package/presets/clearai/template/skills/process-understanding-extraction/workflows/01-process-doc-discovery.md +173 -0
  123. package/presets/clearai/template/skills/process-understanding-extraction/workflows/02-process-understanding-and-diagramming.md +106 -0
  124. package/presets/clearai/template/skills/scientific-brainstorming/SKILL.md +64 -0
  125. package/presets/clearai/template/skills/scientific-brainstorming/references/brainstorming_methods.md +326 -0
  126. package/presets/clearai/template/skills/scientific-critical-thinking/SKILL.md +72 -0
  127. package/presets/clearai/template/skills/scientific-critical-thinking/references/common_biases.md +364 -0
  128. package/presets/clearai/template/skills/scientific-critical-thinking/references/evidence_hierarchy.md +485 -0
  129. package/presets/clearai/template/skills/scientific-critical-thinking/references/experimental_design.md +496 -0
  130. package/presets/clearai/template/skills/scientific-critical-thinking/references/logical_fallacies.md +478 -0
  131. package/presets/clearai/template/skills/scientific-critical-thinking/references/scientific_method.md +169 -0
  132. package/presets/clearai/template/skills/scientific-critical-thinking/references/statistical_pitfalls.md +506 -0
  133. package/presets/clearai/template/skills/skill-creator/SKILL.md +109 -0
  134. package/presets/clearai/template/skills/skill-creator/references/authoring-guide.md +89 -0
  135. package/presets/clearai/template/skills/statistical-analysis/SKILL.md +79 -0
  136. package/presets/clearai/template/skills/statistical-analysis/references/assumptions_and_diagnostics.md +369 -0
  137. package/presets/clearai/template/skills/statistical-analysis/references/bayesian_statistics.md +653 -0
  138. package/presets/clearai/template/skills/statistical-analysis/references/effect_sizes_and_power.md +578 -0
  139. package/presets/clearai/template/skills/statistical-analysis/references/reporting_standards.md +469 -0
  140. package/presets/clearai/template/skills/statistical-analysis/references/test_selection_guide.md +129 -0
  141. package/presets/clearai/template/skills/statistical-analysis/scripts/assumption_checks.py +538 -0
  142. package/presets/clearai/template/skills/web-artifact/SKILL.md +165 -0
  143. package/presets/clearai/template/skills/web-artifact/assets/renderer/renderer.css +229 -0
  144. package/presets/clearai/template/skills/web-artifact/assets/renderer/renderer.js +373 -0
  145. package/presets/clearai/template/skills/web-artifact/assets/vendor/elkjs/LICENSE +263 -0
  146. package/presets/clearai/template/skills/web-artifact/assets/vendor/elkjs/UPSTREAM.md +26 -0
  147. package/presets/clearai/template/skills/web-artifact/assets/vendor/elkjs/elk.bundled.js +6605 -0
  148. package/presets/clearai/template/skills/web-artifact/references/when-drawing-a-topology.md +150 -0
  149. package/presets/clearai/template/skills/web-artifact/references/when-the-page-must-work-offline.md +62 -0
  150. package/presets/clearai/template/skills/web-artifact/scripts/check_artifact.py +167 -0
  151. package/presets/clearai/template/skills/web-artifact/scripts/render_topology.js +272 -0
  152. package/presets/clearai/template/skills/what-if-oracle/LICENSE.txt +5 -0
  153. package/presets/clearai/template/skills/what-if-oracle/SKILL.md +72 -0
  154. package/presets/clearai/template/skills/what-if-oracle/references/scenario-templates.md +154 -0
@@ -0,0 +1,72 @@
1
+ ---
2
+ name: literature-review
3
+ description: |
4
+ 【文献综述·系统检索】按 PRISMA 思路做多库检索、主题综合与引用核验。适用:研究主题的系统性文献梳理、技术路线证据链。不适用:售前企业快研(用 domain-presearch);单篇 DOI 查找(用 paper-lookup)。
5
+ license: MIT license
6
+ metadata:
7
+ version: 1.0-clearai
8
+ skill-author: K-Dense Inc. (adapted for ClearAI)
9
+ tier: system
10
+ origin: template
11
+ created_at: '2026-06-12T02:47:05.409207+00:00'
12
+ ---
13
+
14
+ # 文献综述 Skill(ClearAI 版)
15
+
16
+ ## 使用边界
17
+
18
+ - **适用**:需系统性梳理某技术/工艺/行业的学术与工程文献;撰写 `products/reports/literature_review.md`。
19
+ - **不适用**:快速企业预研 → `domain-presearch`;仅查几篇论文 → `paper-lookup`。
20
+
21
+ ## ClearAI 工具与路径映射
22
+
23
+ - 广度检索 → `web_search`(领域/学术关键词,标注 sources)
24
+ - 关键来源核验 → `web_fetch`(只打开关键原始落地页、摘要页或公开附件,不浏览全部结果)
25
+ - 学术 API 检索 → `bash` + `paper-lookup` 参考(`references/`)
26
+ - 综述正文 → `write` 到 `products/reports/literature_review.md`
27
+ - 检索日志 → `lab/knowledge/lit_search_log.md`
28
+ - 引用库 → `lab/knowledge/references.bib`(配合 `citation-management`)
29
+ - PRISMA 图 → mermaid → `lab/diagrams/`
30
+ - 经验回写 → `clear/memory/literature_review_lessons.md`
31
+
32
+ ## 来源优先级(对齐 domain-presearch)
33
+
34
+ P0 标准/手册 > P1 学术论文 > P2 专利 > P3 企业公开 > P4 行业报告 > P5 推断
35
+
36
+ ## 工作流
37
+
38
+ ### Phase 1:规划
39
+
40
+ - 明确研究问题(PICO 变体:Process / Intervention / Comparison / Outcome)
41
+ - 确定综述类型:叙述性 / 系统性 / 范围综述
42
+ - 时间、地域、文献类型边界
43
+
44
+ ### Phase 2:检索
45
+
46
+ - `web_search` 多组并行关键词(中英文)
47
+ - 对纳入结论承重的候选,用 `web_fetch` 核验题名、作者、摘要、出处与公开附件语境
48
+ - 深度学术需求:`read` `paper-lookup/SKILL.md` 并按 `references/` 调用 API(`bash` curl)
49
+
50
+ 检索策略见 `references/search_strategies.md`(若已复制)。
51
+
52
+ ### Phase 3:筛选与综合
53
+
54
+ - 纳入/排除标准;记录于 `lab/knowledge/lit_search_log.md`
55
+ - 主题归类:方法、效果、局限、应用案例
56
+
57
+ ### Phase 4:引用核验
58
+
59
+ 加载 `citation-management`:DOI 校验、BibTeX 去重
60
+
61
+ ### Phase 5:撰写与自检
62
+
63
+ - 输出 `products/reports/literature_review.md`
64
+ - 文末可点击来源列表 `[N]`
65
+ - 可选 PRISMA 流程 mermaid
66
+
67
+ ## 交付清单
68
+
69
+ - [ ] 研究问题与检索式已记录
70
+ - [ ] 纳入文献表(标题、年份、来源、相关性)
71
+ - [ ] 综合结论与证据空白
72
+ - [ ] 引用与 `references.bib` 一致
@@ -0,0 +1,166 @@
1
+ # Citation Styles Reference
2
+
3
+ This document provides detailed guidelines for formatting citations in various academic styles commonly used in literature reviews.
4
+
5
+ ## APA Style (7th Edition)
6
+
7
+ ### Journal Articles
8
+
9
+ **Format**: Author, A. A., Author, B. B., & Author, C. C. (Year). Title of article. *Title of Periodical*, *volume*(issue), page range. https://doi.org/xx.xxx/yyyy
10
+
11
+ **Example**: Smith, J. D., Johnson, M. L., & Williams, K. R. (2023). Machine learning approaches in drug discovery. *Nature Reviews Drug Discovery*, *22*(4), 301-318. https://doi.org/10.1038/nrd.2023.001
12
+
13
+ ### Books
14
+
15
+ **Format**: Author, A. A. (Year). *Title of work: Capital letter also for subtitle*. Publisher Name. https://doi.org/xxxx
16
+
17
+ **Example**: Kumar, V., Abbas, A. K., & Aster, J. C. (2021). *Robbins and Cotran pathologic basis of disease* (10th ed.). Elsevier.
18
+
19
+ ### Book Chapters
20
+
21
+ **Format**: Author, A. A., & Author, B. B. (Year). Title of chapter. In E. E. Editor & F. F. Editor (Eds.), *Title of book* (pp. xx-xx). Publisher.
22
+
23
+ **Example**: Brown, P. O., & Botstein, D. (2020). Exploring the new world of the genome with DNA microarrays. In M. B. Eisen & P. O. Brown (Eds.), *DNA microarrays: A molecular cloning manual* (pp. 1-45). Cold Spring Harbor Laboratory Press.
24
+
25
+ ### Preprints
26
+
27
+ **Format**: Author, A. A., & Author, B. B. (Year). Title of preprint. *Repository Name*. https://doi.org/xxxx
28
+
29
+ **Example**: Zhang, Y., Chen, L., & Wang, H. (2024). Novel therapeutic targets in Alzheimer's disease. *bioRxiv*. https://doi.org/10.1101/2024.01.001
30
+
31
+ ### Conference Papers
32
+
33
+ **Format**: Author, A. A. (Year, Month day-day). Title of paper. In E. E. Editor (Ed.), *Title of conference proceedings* (pp. xx-xx). Publisher. https://doi.org/xxxx
34
+
35
+ ---
36
+
37
+ ## Nature Style
38
+
39
+ ### Journal Articles
40
+
41
+ **Format**: Author, A. A., Author, B. B. & Author, C. C. Title of article. *J. Name* **volume**, page range (year).
42
+
43
+ **Example**: Smith, J. D., Johnson, M. L. & Williams, K. R. Machine learning approaches in drug discovery. *Nat. Rev. Drug Discov.* **22**, 301-318 (2023).
44
+
45
+ ### Books
46
+
47
+ **Format**: Author, A. A. & Author, B. B. *Book Title* (Publisher, Year).
48
+
49
+ **Example**: Kumar, V., Abbas, A. K. & Aster, J. C. *Robbins and Cotran Pathologic Basis of Disease* 10th edn (Elsevier, 2021).
50
+
51
+ ### Multiple Authors
52
+
53
+ - 1-2 authors: List all
54
+ - 3+ authors: List first author followed by "et al."
55
+
56
+ **Example**: Zhang, Y. et al. Novel therapeutic targets in Alzheimer's disease. *bioRxiv* https://doi.org/10.1101/2024.01.001 (2024).
57
+
58
+ ---
59
+
60
+ ## Chicago Style (Author-Date)
61
+
62
+ ### Journal Articles
63
+
64
+ **Format**: Author, First Name Middle Initial. Year. "Article Title." *Journal Title* volume, no. issue (Month): page range. https://doi.org/xxxx.
65
+
66
+ **Example**: Smith, John D., Mary L. Johnson, and Karen R. Williams. 2023. "Machine Learning Approaches in Drug Discovery." *Nature Reviews Drug Discovery* 22, no. 4 (April): 301-318. https://doi.org/10.1038/nrd.2023.001.
67
+
68
+ ### Books
69
+
70
+ **Format**: Author, First Name Middle Initial. Year. *Book Title: Subtitle*. Edition. Place: Publisher.
71
+
72
+ **Example**: Kumar, Vinay, Abul K. Abbas, and Jon C. Aster. 2021. *Robbins and Cotran Pathologic Basis of Disease*. 10th ed. Philadelphia: Elsevier.
73
+
74
+ ---
75
+
76
+ ## Vancouver Style (Numbered)
77
+
78
+ ### Journal Articles
79
+
80
+ **Format**: Author AA, Author BB, Author CC. Title of article. Abbreviated Journal Name. Year;volume(issue):page range.
81
+
82
+ **Example**: Smith JD, Johnson ML, Williams KR. Machine learning approaches in drug discovery. Nat Rev Drug Discov. 2023;22(4):301-18.
83
+
84
+ ### Books
85
+
86
+ **Format**: Author AA, Author BB. Title of book. Edition. Place: Publisher; Year.
87
+
88
+ **Example**: Kumar V, Abbas AK, Aster JC. Robbins and Cotran pathologic basis of disease. 10th ed. Philadelphia: Elsevier; 2021.
89
+
90
+ ### Citation in Text
91
+
92
+ Use superscript numbers in order of appearance: "Recent studies^1,2^ have shown..."
93
+
94
+ ---
95
+
96
+ ## IEEE Style
97
+
98
+ ### Journal Articles
99
+
100
+ **Format**: [#] A. A. Author, B. B. Author, and C. C. Author, "Title of article," *Abbreviated Journal Name*, vol. x, no. x, pp. xxx-xxx, Month Year.
101
+
102
+ **Example**: [1] J. D. Smith, M. L. Johnson, and K. R. Williams, "Machine learning approaches in drug discovery," *Nat. Rev. Drug Discov.*, vol. 22, no. 4, pp. 301-318, Apr. 2023.
103
+
104
+ ### Books
105
+
106
+ **Format**: [#] A. A. Author, *Title of Book*, xth ed. City, State: Publisher, Year.
107
+
108
+ **Example**: [2] V. Kumar, A. K. Abbas, and J. C. Aster, *Robbins and Cotran Pathologic Basis of Disease*, 10th ed. Philadelphia, PA: Elsevier, 2021.
109
+
110
+ ---
111
+
112
+ ## Common Abbreviations for Journal Names
113
+
114
+ - Nature: Nat.
115
+ - Science: Science
116
+ - Cell: Cell
117
+ - Nature Reviews Drug Discovery: Nat. Rev. Drug Discov.
118
+ - Journal of the American Chemical Society: J. Am. Chem. Soc.
119
+ - Proceedings of the National Academy of Sciences: Proc. Natl. Acad. Sci. U.S.A.
120
+ - PLOS ONE: PLoS ONE
121
+ - Bioinformatics: Bioinformatics
122
+ - Nucleic Acids Research: Nucleic Acids Res.
123
+
124
+ ---
125
+
126
+ ## DOI Best Practices
127
+
128
+ 1. **Always verify DOIs**: Use the verify_citations.py script to check all DOIs
129
+ 2. **Format as URLs**: https://doi.org/10.xxxx/yyyy (preferred over doi:10.xxxx/yyyy)
130
+ 3. **No period after DOI**: DOI should be the last element without trailing punctuation
131
+ 4. **Resolve redirects**: Check that DOIs resolve to the correct article
132
+
133
+ ---
134
+
135
+ ## In-Text Citation Guidelines
136
+
137
+ ### APA Style
138
+ - (Smith et al., 2023)
139
+ - Smith et al. (2023) demonstrated...
140
+ - Multiple citations: (Brown, 2022; Smith et al., 2023; Zhang, 2024)
141
+
142
+ ### Nature Style
143
+ - Superscript numbers: Recent studies^1,2^ have shown...
144
+ - Or: Recent studies (refs 1,2) have shown...
145
+
146
+ ### Chicago Style
147
+ - (Smith, Johnson, and Williams 2023)
148
+ - Smith, Johnson, and Williams (2023) found...
149
+
150
+ ---
151
+
152
+ ## Reference List Organization
153
+
154
+ ### By Citation Style
155
+ - **APA, Chicago**: Alphabetical by first author's last name
156
+ - **Nature, Vancouver, IEEE**: Numerical order of first appearance in text
157
+
158
+ ### Hanging Indents
159
+ Most styles use hanging indents where the first line is flush left and subsequent lines are indented.
160
+
161
+ ### Consistency
162
+ Maintain consistent formatting throughout:
163
+ - Capitalization (title case vs. sentence case)
164
+ - Journal name abbreviations
165
+ - DOI presentation
166
+ - Author name format
@@ -0,0 +1,455 @@
1
+ # Literature Database Search Strategies
2
+
3
+ This document provides comprehensive guidance for searching multiple literature databases systematically and effectively.
4
+
5
+ ## Available Databases and Skills
6
+
7
+ ### Biomedical & Life Sciences
8
+
9
+ #### PubMed / PubMed Central
10
+ - **Access**: Use `gget` skill or WebFetch tool
11
+ - **Coverage**: 35M+ citations in biomedical literature
12
+ - **Best for**: Clinical studies, biomedical research, genetics, molecular biology
13
+ - **Search tips**: Use MeSH terms, Boolean operators (AND, OR, NOT), field tags [Title], [Author]
14
+ - **Example**: `"CRISPR"[Title] AND "gene editing"[Title/Abstract] AND 2020:2024[Publication Date]`
15
+
16
+ #### bioRxiv / medRxiv
17
+ - **Access**: Use `gget` skill or direct API
18
+ - **Coverage**: Preprints in biology and medicine
19
+ - **Best for**: Latest unpublished research, cutting-edge findings
20
+ - **Note**: Not peer-reviewed; verify findings with caution
21
+ - **Search tips**: Search by category (bioinformatics, genomics, etc.)
22
+
23
+ ### General Scientific Literature
24
+
25
+ #### arXiv
26
+ - **Access**: Direct API access
27
+ - **Coverage**: Preprints in physics, mathematics, computer science, quantitative biology
28
+ - **Best for**: Computational methods, bioinformatics algorithms, theoretical work
29
+ - **Categories**: q-bio (Quantitative Biology), cs.LG (Machine Learning), stat.ML (Statistics)
30
+ - **Search format**: `cat:q-bio.QM AND title:"single cell"`
31
+
32
+ #### Semantic Scholar
33
+ - **Access**: Direct API (requires API key)
34
+ - **Coverage**: 200M+ papers across all fields
35
+ - **Best for**: Cross-disciplinary searches, citation graphs, paper recommendations
36
+ - **Features**: Influential citations, paper summaries, related papers
37
+ - **Rate limits**: 100 requests/5 minutes with API key
38
+
39
+ #### Google Scholar
40
+ - **Access**: Web scraping (use cautiously) or manual search
41
+ - **Coverage**: Comprehensive across all fields
42
+ - **Best for**: Finding highly cited papers, conference proceedings, theses
43
+ - **Limitations**: No official API, rate limiting
44
+ - **Export**: Use "Cite" feature for formatted citations
45
+
46
+ ### Specialized Databases
47
+
48
+ #### ChEMBL / PubChem
49
+ - **Access**: Use `gget` skill or `bioservices` skill
50
+ - **Coverage**: Chemical compounds, bioactivity data, drug molecules
51
+ - **Best for**: Drug discovery, chemical biology, medicinal chemistry
52
+ - **ChEMBL**: 2M+ compounds, bioactivity data
53
+ - **PubChem**: 110M+ compounds, assay data
54
+
55
+ #### UniProt
56
+ - **Access**: Use `gget` skill or `bioservices` skill
57
+ - **Coverage**: Protein sequence and functional information
58
+ - **Best for**: Protein research, sequence analysis, functional annotations
59
+ - **Search by**: Protein name, gene name, organism, function
60
+
61
+ #### KEGG (Kyoto Encyclopedia of Genes and Genomes)
62
+ - **Access**: Use `bioservices` skill
63
+ - **Coverage**: Pathways, diseases, drugs, genes
64
+ - **Best for**: Pathway analysis, systems biology, metabolic research
65
+
66
+ #### COSMIC (Catalogue of Somatic Mutations in Cancer)
67
+ - **Access**: Use `gget` skill or direct download
68
+ - **Coverage**: Cancer genomics, somatic mutations
69
+ - **Best for**: Cancer research, mutation analysis
70
+
71
+ #### AlphaFold Database
72
+ - **Access**: Use `gget` skill with `alphafold` command
73
+ - **Coverage**: 200M+ protein structure predictions
74
+ - **Best for**: Structural biology, protein modeling
75
+
76
+ #### PDB (Protein Data Bank)
77
+ - **Access**: Use `gget` or direct API
78
+ - **Coverage**: Experimental 3D structures of proteins, nucleic acids
79
+ - **Best for**: Structural biology, drug design, molecular modeling
80
+
81
+ ### Citation & Reference Management
82
+
83
+ #### OpenAlex
84
+ - **Access**: Direct API (free, no key required)
85
+ - **Coverage**: 250M+ works, comprehensive metadata
86
+ - **Best for**: Citation analysis, author disambiguation, institutional research
87
+ - **Features**: Open access, excellent for bibliometrics
88
+
89
+ #### Dimensions
90
+ - **Access**: Free tier available
91
+ - **Coverage**: Publications, grants, patents, clinical trials
92
+ - **Best for**: Research impact, funding analysis, translational research
93
+
94
+ ---
95
+
96
+ ## Search Strategy Framework
97
+
98
+ ### 1. Define Research Question (PICO Framework)
99
+
100
+ For clinical/biomedical reviews:
101
+ - **P**opulation: Who is the study about?
102
+ - **I**ntervention: What is being tested?
103
+ - **C**omparison: What is it compared to?
104
+ - **O**utcome: What are the results?
105
+
106
+ **Example**: "What is the efficacy of CRISPR-Cas9 gene therapy (I) for treating sickle cell disease (P) compared to standard care (C) in improving patient outcomes (O)?"
107
+
108
+ ### 2. Develop Search Terms
109
+
110
+ #### Primary Concepts
111
+ Identify 2-4 main concepts from your research question.
112
+
113
+ **Example**:
114
+ - Concept 1: CRISPR, Cas9, gene editing
115
+ - Concept 2: sickle cell disease, SCD, hemoglobin disorders
116
+ - Concept 3: gene therapy, therapeutic editing
117
+
118
+ #### Synonyms & Related Terms
119
+ List alternative terms, abbreviations, and related concepts.
120
+
121
+ **Tool**: Use MeSH (Medical Subject Headings) browser for standardized terms
122
+
123
+ #### Boolean Operators
124
+ - **AND**: Narrows search (must include both terms)
125
+ - **OR**: Broadens search (includes either term)
126
+ - **NOT**: Excludes terms
127
+
128
+ **Example**: `(CRISPR OR Cas9 OR "gene editing") AND ("sickle cell" OR SCD) AND therapy`
129
+
130
+ #### Wildcards & Truncation
131
+ - `*` or `%`: Matches any characters
132
+ - `?`: Matches single character
133
+
134
+ **Example**: `genom*` matches genomic, genomics, genome
135
+
136
+ ### 3. Set Inclusion/Exclusion Criteria
137
+
138
+ #### Inclusion Criteria
139
+ - **Date range**: e.g., 2015-2024 (last 10 years)
140
+ - **Language**: English (or specify multilingual)
141
+ - **Publication type**: Peer-reviewed articles, reviews, preprints
142
+ - **Study design**: RCTs, cohort studies, meta-analyses
143
+ - **Population**: Human, animal models, in vitro
144
+
145
+ #### Exclusion Criteria
146
+ - Case reports (n<5)
147
+ - Conference abstracts without full text
148
+ - Non-original research (editorials, commentaries)
149
+ - Duplicate publications
150
+ - Retracted articles
151
+
152
+ ### 4. Database Selection Strategy
153
+
154
+ #### Multi-Database Approach
155
+ Search at least 3 complementary databases:
156
+
157
+ 1. **Primary database**: PubMed (biomedical) or arXiv (computational)
158
+ 2. **Preprint server**: bioRxiv/medRxiv or arXiv
159
+ 3. **Comprehensive database**: Semantic Scholar or Google Scholar
160
+ 4. **Specialized database**: ChEMBL, UniProt, or field-specific
161
+
162
+ #### Database-Specific Syntax
163
+
164
+ | Database | Field Tags | Example |
165
+ |----------|-----------|---------|
166
+ | PubMed | [Title], [Author], [MeSH] | "CRISPR"[Title] AND 2020:2024[DP] |
167
+ | arXiv | ti:, au:, cat: | ti:"machine learning" AND cat:q-bio.QM |
168
+ | Semantic Scholar | title:, author:, year: | title:"deep learning" year:2020-2024 |
169
+
170
+ ---
171
+
172
+ ## Search Execution Workflow
173
+
174
+ ### Phase 1: Pilot Search
175
+ 1. Run initial search with broad terms
176
+ 2. Review first 50 results for relevance
177
+ 3. Note common keywords and MeSH terms
178
+ 4. Refine search strategy
179
+
180
+ ### Phase 2: Comprehensive Search
181
+ 1. Execute refined searches across all selected databases
182
+ 2. Export results in standard format (RIS, BibTeX, JSON)
183
+ 3. Document search strings and date for each database
184
+ 4. Record number of results per database
185
+
186
+ ### Phase 3: Deduplication
187
+ 1. Import all results into a single file
188
+ 2. Use `search_databases.py --deduplicate` to remove duplicates
189
+ 3. Identify duplicates by DOI (primary) or title (fallback)
190
+ 4. Keep the version with most complete metadata
191
+
192
+ ### Phase 4: Screening
193
+ 1. **Title screening**: Review titles, exclude obviously irrelevant
194
+ 2. **Abstract screening**: Read abstracts, apply inclusion/exclusion criteria
195
+ 3. **Full-text screening**: Obtain and review full texts
196
+ 4. Document reasons for exclusion at each stage
197
+
198
+ ### Phase 5: Quality Assessment
199
+ 1. Assess study quality using appropriate tools:
200
+ - **RCTs**: Cochrane Risk of Bias tool
201
+ - **Observational**: Newcastle-Ottawa Scale
202
+ - **Systematic reviews**: AMSTAR 2
203
+ 2. Grade quality of evidence (high, moderate, low, very low)
204
+ 3. Consider excluding very low-quality studies
205
+
206
+ ---
207
+
208
+ ## Search Documentation Template
209
+
210
+ ### Required Documentation
211
+ All searches must be documented for reproducibility:
212
+
213
+ ```markdown
214
+ ## Search Strategy
215
+
216
+ ### Database: PubMed
217
+ - **Date searched**: 2024-10-25
218
+ - **Date range**: 2015-01-01 to 2024-10-25
219
+ - **Search string**:
220
+ ```
221
+ ("CRISPR"[Title] OR "Cas9"[Title] OR "gene editing"[Title/Abstract])
222
+ AND ("sickle cell disease"[MeSH] OR "SCD"[Title/Abstract])
223
+ AND ("gene therapy"[MeSH] OR "therapeutic editing"[Title/Abstract])
224
+ AND 2015:2024[Publication Date]
225
+ AND English[Language]
226
+ ```
227
+ - **Results**: 247 articles
228
+ - **After deduplication**: 189 articles
229
+
230
+ ### Database: bioRxiv
231
+ - **Date searched**: 2024-10-25
232
+ - **Date range**: 2015-01-01 to 2024-10-25
233
+ - **Search string**: "CRISPR" AND "sickle cell" (in title/abstract)
234
+ - **Results**: 34 preprints
235
+ - **After deduplication**: 28 preprints
236
+
237
+ ### Total Unique Articles
238
+ - **Combined results**: 217 unique articles
239
+ - **After title screening**: 156 articles
240
+ - **After abstract screening**: 89 articles
241
+ - **After full-text screening**: 52 articles included in review
242
+ ```
243
+
244
+ ---
245
+
246
+ ## Advanced Search Techniques
247
+
248
+ ### Prioritizing High-Impact Papers (CRITICAL)
249
+
250
+ **Always prioritize papers based on citation count, venue quality, and author reputation.** Quality matters more than quantity.
251
+
252
+ #### Citation Metrics in Database Searches
253
+
254
+ Use citation counts to identify influential work:
255
+
256
+ | Paper Age | Citations | Classification |
257
+ |-----------|-----------|----------------|
258
+ | 0-3 years | 20+ | Noteworthy |
259
+ | 0-3 years | 100+ | Highly Influential |
260
+ | 3-7 years | 100+ | Significant |
261
+ | 3-7 years | 500+ | Landmark |
262
+ | 7+ years | 500+ | Seminal |
263
+ | 7+ years | 1000+ | Foundational |
264
+
265
+ **Database-Specific Citation Features:**
266
+ - **Google Scholar:** Sort by citation count, use "Cited by" feature
267
+ - **Semantic Scholar:** "Highly Influential Citations" metric, citation velocity
268
+ - **OpenAlex:** Citation counts, citation context analysis
269
+ - **PubMed:** Use "Cited by" in PMC, check citation counts via Google Scholar
270
+
271
+ #### Filtering by Journal Quality
272
+
273
+ Prioritize papers from higher-tier venues:
274
+
275
+ **Tier 1 (Always Prefer):**
276
+ - Nature, Science, Cell, NEJM, Lancet, JAMA, PNAS
277
+ - Nature Medicine, Nature Biotechnology, Nature Methods
278
+ - Search tip: `source:Nature` or `journal:Nature` in Google Scholar
279
+
280
+ **Tier 2 (High Priority):**
281
+ - High-impact specialized journals (Impact Factor >10)
282
+ - Top conferences: NeurIPS, ICML, ICLR, CVPR, ACL
283
+
284
+ **Tier 3 (Include When Relevant):**
285
+ - Respected field-specific journals (IF 5-10)
286
+
287
+ **PubMed Journal Filtering:**
288
+ ```
289
+ "Nature"[Journal] OR "Science"[Journal] OR "Cell"[Journal]
290
+ ```
291
+
292
+ **Google Scholar Journal Filtering:**
293
+ ```
294
+ source:Nature source:Science source:Cell
295
+ ```
296
+
297
+ #### Leveraging "Cited by" Features
298
+
299
+ **Finding Influential Work:**
300
+ 1. Start with a known key paper
301
+ 2. Click "Cited by" to find papers that cite it
302
+ 3. Sort citing papers by their citation count
303
+ 4. Highly-cited citing papers indicate important follow-up work
304
+
305
+ **Identifying Seminal Papers:**
306
+ 1. Search your topic broadly
307
+ 2. Note which papers appear repeatedly in reference lists
308
+ 3. Papers cited by many of your results are likely seminal
309
+ 4. Check citation counts to confirm influence
310
+
311
+ **Semantic Scholar Features:**
312
+ - "Highly Influential Citations" shows citations that significantly built on the paper
313
+ - "Citation Velocity" shows recent citation growth
314
+ - Paper recommendations based on citation networks
315
+
316
+ ### Citation Chaining
317
+
318
+ #### Forward Citation Search
319
+ Find papers that cite a key paper:
320
+ - Use Google Scholar "Cited by" feature
321
+ - Use OpenAlex or Semantic Scholar APIs
322
+ - Identifies newer research building on seminal work
323
+ - **Tip:** Sort by citation count to find the most influential follow-up work
324
+
325
+ #### Backward Citation Search
326
+ Review references in key papers:
327
+ - Extract references from included papers
328
+ - Search for highly cited references (500+ citations for older papers)
329
+ - Identifies foundational research
330
+ - **Tip:** Focus on references that appear in multiple papers' bibliographies
331
+
332
+ ### Snowball Sampling
333
+ 1. Start with 3-5 highly relevant papers **from Tier-1 venues**
334
+ 2. Extract all their references
335
+ 3. Check which references are cited by multiple papers
336
+ 4. Review those high-overlap references - these are likely seminal
337
+ 5. Repeat for newly identified key papers
338
+ 6. **Prioritize papers with high citation counts** at each step
339
+
340
+ ### Author Search
341
+ Follow prolific and reputable authors in the field:
342
+ - Search by author name across databases
343
+ - Check author profiles (ORCID, Google Scholar) for h-index and publication venues
344
+ - Review recent publications and preprints
345
+ - **Prefer authors with multiple Tier-1 publications** and high h-index (>40)
346
+ - Look for senior authors who are recognized field leaders
347
+
348
+ ### Related Article Features
349
+ Many databases suggest related articles:
350
+ - PubMed "Similar articles"
351
+ - Semantic Scholar "Recommended papers"
352
+ - Use to discover papers missed by keyword search
353
+ - **Filter recommendations by citation count and venue quality**
354
+
355
+ ---
356
+
357
+ ## Quality Control Checklist
358
+
359
+ ### Before Searching
360
+ - [ ] Research question clearly defined
361
+ - [ ] PICO criteria established (if applicable)
362
+ - [ ] Search terms and synonyms listed
363
+ - [ ] Inclusion/exclusion criteria documented
364
+ - [ ] Target databases selected (minimum 3)
365
+ - [ ] Date range determined
366
+
367
+ ### During Searching
368
+ - [ ] Search string tested and refined
369
+ - [ ] Results exported with complete metadata
370
+ - [ ] Search parameters documented
371
+ - [ ] Number of results recorded per database
372
+ - [ ] Search date recorded
373
+
374
+ ### After Searching
375
+ - [ ] Duplicates removed
376
+ - [ ] Screening protocol followed
377
+ - [ ] Reasons for exclusion documented
378
+ - [ ] Quality assessment completed
379
+ - [ ] All citations verified with verify_citations.py
380
+ - [ ] Search methodology documented in review
381
+
382
+ ---
383
+
384
+ ## Common Pitfalls to Avoid
385
+
386
+ 1. **Too narrow search**: Missing relevant papers
387
+ - Solution: Include synonyms, related terms, broader concepts
388
+
389
+ 2. **Too broad search**: Thousands of irrelevant results
390
+ - Solution: Add specific concepts with AND, use field tags
391
+
392
+ 3. **Single database**: Incomplete coverage
393
+ - Solution: Search minimum 3 complementary databases
394
+
395
+ 4. **Ignoring preprints**: Missing latest findings
396
+ - Solution: Include bioRxiv, medRxiv, or arXiv
397
+
398
+ 5. **No documentation**: Irreproducible search
399
+ - Solution: Document every search string, date, and result count
400
+
401
+ 6. **Manual deduplication**: Time-consuming and error-prone
402
+ - Solution: Use search_databases.py script
403
+
404
+ 7. **Unverified citations**: Broken DOIs, incorrect metadata
405
+ - Solution: Run verify_citations.py on final reference list
406
+
407
+ 8. **Publication bias**: Only including published positive results
408
+ - Solution: Search trial registries, contact authors for unpublished data
409
+
410
+ ---
411
+
412
+ ## Example Multi-Database Search Workflow
413
+
414
+ ```python
415
+ # Example workflow using available skills
416
+
417
+ # 1. Search PubMed via gget
418
+ search_term = "CRISPR AND sickle cell disease"
419
+ # Use gget search pubmed search_term
420
+
421
+ # 2. Search bioRxiv
422
+ # Use gget search biorxiv search_term
423
+
424
+ # 3. Search arXiv for computational papers
425
+ # Search arXiv with: cat:q-bio AND "CRISPR" AND "sickle cell"
426
+
427
+ # 4. Search Semantic Scholar via API
428
+ # Use semantic scholar API with search query
429
+
430
+ # 5. Aggregate and deduplicate results
431
+ # python search_databases.py combined_results.json --deduplicate --format markdown --output review_papers.md
432
+
433
+ # 6. Verify all citations
434
+ # python verify_citations.py review_papers.md
435
+
436
+ # 7. Generate final PDF
437
+ # python generate_pdf.py review_papers.md --citation-style nature
438
+ ```
439
+
440
+ ---
441
+
442
+ ## Resources
443
+
444
+ ### MeSH Browser
445
+ https://meshb.nlm.nih.gov/search
446
+
447
+ ### Boolean Search Tutorial
448
+ https://www.ncbi.nlm.nih.gov/books/NBK3827/
449
+
450
+ ### Citation Style Guides
451
+ See references/citation_styles.md in this skill
452
+
453
+ ### PRISMA Guidelines
454
+ Preferred Reporting Items for Systematic Reviews and Meta-Analyses:
455
+ http://www.prisma-statement.org/