debase 0.1.1__tar.gz → 0.1.3__tar.gz

debase-0.1.3/.gitignore

@@ -0,0 +1,177 @@
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+share/python-wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+cover/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+.python-version
+
+# pipenv
+Pipfile.lock
+
+# poetry
+poetry.lock
+
+# pdm
+.pdm.toml
+
+# PEP 582
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+.venv
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# Pyre type checker
+.pyre/
+
+# pytype static type analyzer
+.pytype/
+
+# Cython debug symbols
+cython_debug/
+
+# PyCharm
+.idea/
+
+# VS Code
+.vscode/
+
+# macOS
+.DS_Store
+.AppleDouble
+.LSOverride
+
+# Windows
+Thumbs.db
+Thumbs.db:encryptable
+ehthumbs.db
+ehthumbs_vista.db
+*.stackdump
+[Dd]esktop.ini
+$RECYCLE.BIN/
+*.cab
+*.msi
+*.msix
+*.msm
+*.msp
+*.lnk
+
+# Linux
+*~
+
+# Temporary files
+*.tmp
+*.temp
+*.log
+.temp_*/
+.cache/
+
+# DEBase specific
+enzyme_pipeline*.log
+temp_merged_input.csv
+*.egg-info/
+
+# Project data and examples
+data/
+examples/
+!examples/test.csv  # Keep test.csv as example output
+
+# Cache files
+*.pkl
+*_cache.pkl
+
+# Large database files
+*.db
+
+# PDFs and Excel files
+*.pdf
+*.xlsx
+
+# Backup files
+*_backup.py
+lineage_format_backup.py
+
+# Temporary directories
+.temp_*
+enzyme_analysis_*

debase-0.1.3/CONTRIBUTING.md

@@ -0,0 +1,61 @@
+# Contributing to DEBase
+
+Thank you for your interest in contributing to DEBase!
+
+## Development Setup
+
+1. Clone the repository:
+```bash
+git clone https://github.com/yourusername/debase.git
+cd debase
+```
+
+2. Create a virtual environment:
+```bash
+python -m venv venv
+source venv/bin/activate  # On Windows: venv\Scripts\activate
+```
+
+3. Install in development mode:
+```bash
+pip install -e ".[dev]"
+```
+
+## Running Tests
+
+```bash
+pytest tests/
+```
+
+## Code Style
+
+We use Black for code formatting:
+```bash
+black src/ tests/
+```
+
+And isort for import sorting:
+```bash
+isort src/ tests/
+```
+
+## Project Structure
+
+```
+debase/
+├── src/debase/           # Main package source code
+├── tests/               # Test suite
+├── docs/               # Documentation
+├── examples/           # Example outputs and usage
+├── data/              # Research data (PDFs)
+└── scripts/           # Utility scripts
+```
+
+## Submitting Changes
+
+1. Fork the repository
+2. Create a feature branch
+3. Make your changes
+4. Add tests if applicable
+5. Run the test suite
+6. Submit a pull request

{debase-0.1.1/src/debase.egg-info → debase-0.1.3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: debase
-Version: 0.1.1
+Version: 0.1.3
 Summary: Enzyme lineage analysis and sequence extraction package
 Home-page: https://github.com/YuemingLong/DEBase
 Author: DEBase Team
@@ -64,13 +64,6 @@ Enzyme lineage analysis and sequence extraction package with advanced parallel p
 ```bash
 pip install debase
 ```
-
-For full functionality with chemical SMILES support:
-
-```bash
-pip install debase[rdkit]
-```
-
 ## Requirements
 
 - Python 3.8 or higher
@@ -139,13 +132,6 @@ debase --manuscript paper.pdf --si si.pdf --use-optimized-reaction --reaction-ba
 debase --manuscript paper.pdf --si si.pdf  # Default method
 ```
 
-## Performance Comparison
-
-| Method | Total Time | API Calls | Accuracy | Best For |
-|--------|------------|-----------|----------|----------|
-| Sequential | ~45 min | 44 calls | Highest | Small datasets |
-| **Parallel Individual** | **~12 min** | **44 calls** | **High** | **Recommended** |
-| Batch Processing | ~8 min | ~8 calls | Good | Speed-critical |
 
 ## Advanced Usage
 
@@ -169,31 +155,6 @@ python -m debase.substrate_scope_extractor_parallel \
   --manuscript paper.pdf --si si.pdf --lineage-csv lineage.csv \
   --max-workers 5 --output substrate_scope.csv
 ```
-
-## Python API
-
-```python
-from debase.wrapper import run_pipeline
-
-# Run full pipeline with parallel processing
-run_pipeline(
-    manuscript_path="paper.pdf",
-    si_path="si.pdf", 
-    output="output.csv",
-    use_parallel_individual=True,
-    max_workers=5
-)
-
-# For individual steps
-from debase.reaction_info_extractor_parallel import extract_reaction_info_parallel
-from debase.enzyme_lineage_extractor import setup_gemini_api
-
-model = setup_gemini_api()
-reaction_data = extract_reaction_info_parallel(
-    model, manuscript_path, si_path, enzyme_csv_path, max_workers=5
-)
-```
-
 ## Pipeline Architecture
 
 The DEBase pipeline consists of 5 main steps:
@@ -222,9 +183,6 @@ The DEBase pipeline consists of 5 main steps:
 - **External database integration:** Automatic sequence fetching from PDB and UniProt
 - **AI-powered matching:** Uses Gemini to intelligently match database entries to enzyme variants
 - **Smart filtering:** Automatically excludes non-enzyme entries (buffers, controls, etc.)
-- **Progress tracking:** Real-time status updates
-- **Flexible output:** CSV format with comprehensive chemical and performance data
-- **Caching:** PDF encoding cache for improved performance
 - **Vision capabilities:** Extracts data from both text and images in PDFs
 
 ## Complete Command Reference
@@ -234,7 +192,6 @@ The DEBase pipeline consists of 5 main steps:
 --manuscript PATH           # Required: Path to manuscript PDF
 --si PATH                  # Optional: Path to supplementary information PDF
 --output PATH              # Output file path (default: manuscript_name_debase.csv)
---queries N                # Number of consensus queries (default: 2)
 ```
 
 ### Performance Options
@@ -279,21 +236,5 @@ The DEBase pipeline consists of 5 main steps:
 3. **Use batch processing** only when speed is critical and some accuracy loss is acceptable
 4. **Skip validation** (`--skip-validation`) for faster processing in production
 5. **Keep intermediates** (`--keep-intermediates`) for debugging and incremental runs
-6. **Check external databases** - Many sequences can be automatically fetched from PDB/UniProt
-7. **Verify enzyme entries** - The system automatically filters out buffers and controls
-
-## Troubleshooting
-
-### No sequences found
-- The extractor will automatically search PDB and UniProt databases
-- Check the logs for which database IDs were found and attempted
-- Sequences with PDB structures will be fetched with high confidence
-
-### Incorrect enzyme extraction
-- Non-enzyme entries (buffers, controls, media) are automatically filtered
-- Check the log for entries marked as "Filtering out non-enzyme entry"
+6. 
 
-### PDB matching issues
-- The system uses AI to match PDB IDs to specific enzyme variants
-- Increased context extraction ensures better matching accuracy
-- Check logs for "Gemini PDB matching" entries to see the matching process

{debase-0.1.1 → debase-0.1.3}/README.md

@@ -7,13 +7,6 @@ Enzyme lineage analysis and sequence extraction package with advanced parallel p
 ```bash
 pip install debase
 ```
-
-For full functionality with chemical SMILES support:
-
-```bash
-pip install debase[rdkit]
-```
-
 ## Requirements
 
 - Python 3.8 or higher
@@ -82,13 +75,6 @@ debase --manuscript paper.pdf --si si.pdf --use-optimized-reaction --reaction-ba
 debase --manuscript paper.pdf --si si.pdf  # Default method
 ```
 
-## Performance Comparison
-
-| Method | Total Time | API Calls | Accuracy | Best For |
-|--------|------------|-----------|----------|----------|
-| Sequential | ~45 min | 44 calls | Highest | Small datasets |
-| **Parallel Individual** | **~12 min** | **44 calls** | **High** | **Recommended** |
-| Batch Processing | ~8 min | ~8 calls | Good | Speed-critical |
 
 ## Advanced Usage
 
@@ -112,31 +98,6 @@ python -m debase.substrate_scope_extractor_parallel \
   --manuscript paper.pdf --si si.pdf --lineage-csv lineage.csv \
   --max-workers 5 --output substrate_scope.csv
 ```
-
-## Python API
-
-```python
-from debase.wrapper import run_pipeline
-
-# Run full pipeline with parallel processing
-run_pipeline(
-    manuscript_path="paper.pdf",
-    si_path="si.pdf", 
-    output="output.csv",
-    use_parallel_individual=True,
-    max_workers=5
-)
-
-# For individual steps
-from debase.reaction_info_extractor_parallel import extract_reaction_info_parallel
-from debase.enzyme_lineage_extractor import setup_gemini_api
-
-model = setup_gemini_api()
-reaction_data = extract_reaction_info_parallel(
-    model, manuscript_path, si_path, enzyme_csv_path, max_workers=5
-)
-```
-
 ## Pipeline Architecture
 
 The DEBase pipeline consists of 5 main steps:
@@ -165,9 +126,6 @@ The DEBase pipeline consists of 5 main steps:
 - **External database integration:** Automatic sequence fetching from PDB and UniProt
 - **AI-powered matching:** Uses Gemini to intelligently match database entries to enzyme variants
 - **Smart filtering:** Automatically excludes non-enzyme entries (buffers, controls, etc.)
-- **Progress tracking:** Real-time status updates
-- **Flexible output:** CSV format with comprehensive chemical and performance data
-- **Caching:** PDF encoding cache for improved performance
 - **Vision capabilities:** Extracts data from both text and images in PDFs
 
 ## Complete Command Reference
@@ -177,7 +135,6 @@ The DEBase pipeline consists of 5 main steps:
 --manuscript PATH           # Required: Path to manuscript PDF
 --si PATH                  # Optional: Path to supplementary information PDF
 --output PATH              # Output file path (default: manuscript_name_debase.csv)
---queries N                # Number of consensus queries (default: 2)
 ```
 
 ### Performance Options
@@ -222,21 +179,5 @@ The DEBase pipeline consists of 5 main steps:
 3. **Use batch processing** only when speed is critical and some accuracy loss is acceptable
 4. **Skip validation** (`--skip-validation`) for faster processing in production
 5. **Keep intermediates** (`--keep-intermediates`) for debugging and incremental runs
-6. **Check external databases** - Many sequences can be automatically fetched from PDB/UniProt
-7. **Verify enzyme entries** - The system automatically filters out buffers and controls
-
-## Troubleshooting
-
-### No sequences found
-- The extractor will automatically search PDB and UniProt databases
-- Check the logs for which database IDs were found and attempted
-- Sequences with PDB structures will be fetched with high confidence
-
-### Incorrect enzyme extraction
-- Non-enzyme entries (buffers, controls, media) are automatically filtered
-- Check the log for entries marked as "Filtering out non-enzyme entry"
+6. 
 
-### PDB matching issues
-- The system uses AI to match PDB IDs to specific enzyme variants
-- Increased context extraction ensures better matching accuracy
-- Check logs for "Gemini PDB matching" entries to see the matching process

debase-0.1.3/docs/README.md

@@ -0,0 +1,19 @@
+# DEBase Documentation
+
+This directory contains comprehensive documentation for the DEBase enzyme analysis pipeline.
+
+## Directory Structure
+
+- `api/` - API documentation and reference
+- `examples/` - Usage examples and tutorials  
+- `tutorials/` - Step-by-step guides
+
+## Quick Start
+
+See the main [README.md](../README.md) for installation and basic usage.
+
+## Contents
+
+1. [Installation Guide](tutorials/installation.md)
+2. [API Reference](api/README.md)
+3. [Usage Examples](examples/README.md)

debase-0.1.3/docs/examples/README.md

@@ -0,0 +1,24 @@
+# DEBase Examples
+
+This directory contains example outputs and usage demonstrations for the DEBase pipeline.
+
+## Example Outputs
+
+The `../../examples/` directory contains sample results from successful pipeline runs:
+
+- `trpb_complete_pipeline.csv` - Complete TrpB enzyme dataset with sequences, mutations, and reactions
+- `carbene_complete_pipeline.csv` - Carbene transfer enzyme data with SMILES and conditions  
+- `REFINED_ENZYME_SEQUENCES.csv` - Refined sequence extraction results
+
+## Data Format
+
+Each CSV contains:
+- Full-length protein sequences (200-400+ amino acids)
+- Complete mutation lineage tracking
+- Chemical reaction SMILES strings
+- Experimental conditions and metadata
+- Performance metrics (yield, TTN, enantioselectivity)
+
+## Usage
+
+These files demonstrate the expected output format and can be used as reference for pipeline validation.

debase-0.1.3/environment.yml

@@ -0,0 +1,21 @@
+name: debase
+channels:
+  - conda-forge
+  - defaults
+dependencies:
+  - python=3.9
+  - pandas>=1.0.0
+  - numpy>=1.19.0
+  - matplotlib>=3.3.0
+  - seaborn>=0.11.0
+  - jupyter>=1.0.0
+  - jupyterlab>=3.0.0
+  - openpyxl>=3.0.0
+  - biopython>=1.78
+  - requests>=2.25.0
+  - tqdm>=4.60.0
+  - rdkit>=2020.03.1
+  - pip
+  - pip:
+    - PyMuPDF>=1.18.0
+    - google-generativeai>=0.3.0

debase-0.1.3/src/debase/PIPELINE_FLOW.md

@@ -0,0 +1,100 @@
+# DEBase Pipeline Flow
+
+## Overview
+The DEBase pipeline extracts enzyme engineering data from chemistry papers through a series of modular steps.
+
+## Pipeline Architecture
+
+```
+┌─────────────────────┐     ┌─────────────────────┐
+│   Manuscript PDF    │     │       SI PDF        │
+└──────────┬──────────┘     └──────────┬──────────┘
+           │                           │
+           └───────────┬───────────────┘
+                       │
+                       ▼
+         ┌─────────────────────────────┐
+         │ 1. enzyme_lineage_extractor │
+         │   - Extract enzyme variants │
+         │   - Parse mutations         │
+         │   - Get basic metadata      │
+         └─────────────┬───────────────┘
+                       │
+                       ▼
+         ┌─────────────────────────────┐
+         │    2. cleanup_sequence      │
+         │   - Validate sequences      │
+         │   - Fix formatting issues   │
+         │   - Generate full sequences │
+         └─────────────┬───────────────┘
+                       │
+           ┌───────────┴───────────────┐
+           │                           │
+           ▼                           ▼
+┌─────────────────────────┐ ┌─────────────────────────┐
+│ 3a. reaction_info       │ │ 3b. substrate_scope     │
+│     _extractor          │ │     _extractor          │
+│ - Performance metrics   │ │ - Substrate variations  │
+│ - Model reaction        │ │ - Additional variants   │
+│ - Conditions            │ │ - Scope data            │
+└───────────┬─────────────┘ └───────────┬─────────────┘
+            │                           │
+            └───────────┬───────────────┘
+                        │
+                        ▼
+          ┌─────────────────────────────┐
+          │    4. lineage_format_o3     │
+          │   - Merge all data          │
+          │   - Fill missing sequences  │
+          │   - Format final output     │
+          └─────────────┬───────────────┘
+                        │
+                        ▼
+                ┌─────────────┐
+                │ Final CSV   │
+                └─────────────┘
+```
+
+## Module Details
+
+### 1. enzyme_lineage_extractor.py
+- **Input**: Manuscript PDF, SI PDF
+- **Output**: CSV with enzyme variants and mutations
+- **Function**: Extracts enzyme identifiers, mutation lists, and basic metadata
+
+### 2. cleanup_sequence.py  
+- **Input**: Enzyme lineage CSV
+- **Output**: CSV with validated sequences
+- **Function**: Validates protein sequences, generates full sequences from mutations
+
+### 3a. reaction_info_extractor.py
+- **Input**: PDFs + cleaned enzyme CSV
+- **Output**: CSV with reaction performance data
+- **Function**: Extracts yield, TTN, selectivity, reaction conditions
+
+### 3b. substrate_scope_extractor.py
+- **Input**: PDFs + cleaned enzyme CSV  
+- **Output**: CSV with substrate scope entries
+- **Function**: Extracts substrate variations tested with different enzymes
+
+### 4. lineage_format_o3.py
+- **Input**: Reaction CSV + Substrate scope CSV
+- **Output**: Final formatted CSV
+- **Function**: Merges data, fills missing sequences, applies consistent formatting
+
+## Key Features
+
+1. **Modular Design**: Each step can be run independently
+2. **Parallel Extraction**: Steps 3a and 3b run independently 
+3. **Error Recovery**: Pipeline can resume from any step
+4. **Clean Interfaces**: Each module has well-defined inputs/outputs
+
+## Usage
+
+```bash
+# Full pipeline
+python -m debase.wrapper_clean manuscript.pdf --si si.pdf --output results.csv
+
+# With intermediate files kept for debugging  
+python -m debase.wrapper_clean manuscript.pdf --si si.pdf --keep-intermediates
+```

{debase-0.1.1 → debase-0.1.3}/src/debase/_version.py

@@ -1,3 +1,3 @@
 """Version information."""
 
-__version__ = "0.1.1"
+__version__ = "0.1.3"

{debase-0.1.1 → debase-0.1.3}/src/debase/enzyme_lineage_extractor.py

@@ -1297,6 +1297,8 @@ _SEQUENCE_SCHEMA_HINT = """
 _SEQ_LOC_PROMPT = """
 Find where FULL-LENGTH protein or DNA sequences are located in this document.
 
+PRIORITY: Protein/amino acid sequences are preferred over DNA sequences.
+
 Look for table of contents entries or section listings that mention sequences.
 Return a JSON array where each element has:
 - "section": the section heading or description
@@ -1305,6 +1307,7 @@ Return a JSON array where each element has:
 Focus on:
 - Table of contents or entries about "Sequence Information" or "Nucleotide and amino acid sequences"
 - Return the EXACT notation as shown.
+- Prioritize sections that mention "protein" or "amino acid" sequences
 
 Return [] if no sequence sections are found.
 Absolutely don't include nucleotides or primer sequences, it is better to return nothing then incomplete sequence, use your best judgement.
@@ -1465,10 +1468,16 @@ def validate_sequence_locations(text: str, locations: list, model, *, pdf_paths:
 # --- 7.3  Main extraction prompt ---------------------------------------------
 _SEQ_EXTRACTION_PROMPT = """
 Extract EVERY distinct enzyme-variant sequence you can find in the text.
+
+IMPORTANT: Prioritize amino acid (protein) sequences over DNA sequences:
+- If an amino acid sequence exists for a variant, extract ONLY the aa_seq (set dna_seq to null)
+- Only extract dna_seq if NO amino acid sequence is available for that variant
+- This reduces redundancy since protein sequences are usually more relevant
+
 For each variant return:
   * variant_id  - the label used in the paper (e.g. "R4-10")
   * aa_seq      - amino-acid sequence (uppercase), or null
-  * dna_seq     - DNA sequence (A/C/G/T), or null
+  * dna_seq     - DNA sequence (A/C/G/T), or null (ONLY if no aa_seq exists)
 
 Respond ONLY with **minified JSON** that matches the schema below.
 NO markdown, no code fences, no commentary.

{debase-0.1.1 → debase-0.1.3}/src/debase/reaction_info_extractor.py

@@ -685,7 +685,7 @@ Ignore locations that contain data for other campaigns.
             'confidence': 95
         }
     
-    def find_lineage_model_reaction(self, location: str, group_context: str) -> Dict[str, Any]:
+    def find_lineage_model_reaction(self, location: str, group_context: str, model_reaction_locations: Optional[Dict[str, Any]] = None) -> Dict[str, Any]:
         """Find the model reaction for a specific lineage group."""
         # Gather relevant text near this location
         page_text = self._page_with_reference(location) or ""
@@ -693,6 +693,7 @@ Ignore locations that contain data for other campaigns.
         # Also check manuscript introduction for model reaction info
         intro_text = "\n\n".join(self.ms_pages[:3]) if self.ms_pages else ""
         
+        # Build the prompt with location and context
         prompt = PROMPT_FIND_LINEAGE_MODEL_REACTION.format(
             location=location,
             group_context=group_context
@@ -700,6 +701,22 @@ Ignore locations that contain data for other campaigns.
         prompt += f"\n\nText near {location}:\n{page_text[:3000]}"
         prompt += f"\n\nManuscript introduction:\n{intro_text[:3000]}"
         
+        # If we have model reaction locations, include text from those locations too
+        if model_reaction_locations:
+            # Add text from model reaction location
+            if model_reaction_locations.get("model_reaction_location", {}).get("location"):
+                model_loc = model_reaction_locations["model_reaction_location"]["location"]
+                model_text = self._get_text_around_location(model_loc)
+                if model_text:
+                    prompt += f"\n\nText from {model_loc} (potential model reaction location):\n{model_text[:3000]}"
+            
+            # Add text from conditions location (often contains reaction details)
+            if model_reaction_locations.get("conditions_location", {}).get("location"):
+                cond_loc = model_reaction_locations["conditions_location"]["location"]
+                cond_text = self._get_text_around_location(cond_loc)
+                if cond_text:
+                    prompt += f"\n\nText from {cond_loc} (reaction conditions):\n{cond_text[:3000]}"
+        
         try:
             data = generate_json_with_retry(
                 self.model,
@@ -1038,7 +1055,20 @@ Different campaigns may use different model reactions.
         """Extract text around a given location identifier."""
         location_lower = location.lower()
         
-        # Search in all pages
+        # Handle compound locations like "Figure 2 caption and Section I"
+        # Extract the first figure/table/scheme reference
+        figure_match = re.search(r"(figure|scheme|table)\s*\d+", location_lower)
+        if figure_match:
+            primary_location = figure_match.group(0)
+            # Try to find this primary location first
+            for page_text in self.all_pages:
+                if primary_location in page_text.lower():
+                    idx = page_text.lower().index(primary_location)
+                    start = max(0, idx - 500)
+                    end = min(len(page_text), idx + 3000)
+                    return page_text[start:end]
+        
+        # Search in all pages for exact match
         for page_text in self.all_pages:
             if location_lower in page_text.lower():
                 # Find the location and extract context around it
@@ -1790,8 +1820,16 @@ TEXT FROM MANUSCRIPT:
             if location.get('caption'):
                 location_context += f"\nCaption: {location['caption']}"
             
-            # Try to find model reaction for this specific lineage
-            location_model_reaction = self.find_lineage_model_reaction(location['location'], location_context)
+            # First find model reaction locations for this campaign/enzyme group
+            location_enzymes = df_location['enzyme'].unique().tolist()
+            model_reaction_locations = self.find_model_reaction_locations(location_enzymes)
+            
+            # Try to find model reaction for this specific lineage, passing the locations
+            location_model_reaction = self.find_lineage_model_reaction(
+                location['location'], 
+                location_context,
+                model_reaction_locations
+            )
             
             # Get full model reaction info with IUPAC names
             if location_model_reaction.get('substrate_ids') or location_model_reaction.get('product_ids'):
@@ -1799,7 +1837,6 @@ TEXT FROM MANUSCRIPT:
             else:
                 # Fall back to general model reaction extraction
                 # Pass the enzyme variants from this location
-                location_enzymes = df_location['enzyme'].unique().tolist()
                 model_info = self.gather_model_reaction_info(location_enzymes)
             
             # Add model reaction info to all enzymes from this location
@@ -1891,7 +1928,16 @@ TEXT FROM MANUSCRIPT:
             if group.get('caption'):
                 location_context += f"\nCaption: {group['caption']}"
             
-            location_model_reaction = self.find_lineage_model_reaction(group_location, location_context)
+            # First find model reaction locations for this enzyme group
+            location_enzymes = df_location['enzyme'].unique().tolist() if 'enzyme' in df_location.columns else all_enzyme_ids
+            model_reaction_locations = self.find_model_reaction_locations(location_enzymes)
+            
+            # Try to find model reaction for this specific lineage, passing the locations
+            location_model_reaction = self.find_lineage_model_reaction(
+                group_location, 
+                location_context,
+                model_reaction_locations
+            )
             
             # Get full model reaction info with IUPAC names
             if location_model_reaction.get('substrate_ids') or location_model_reaction.get('product_ids'):
@@ -1899,7 +1945,6 @@ TEXT FROM MANUSCRIPT:
             else:
                 # Try to extract model reaction from this specific location
                 # Pass the enzyme variants that have data in this location
-                location_enzymes = df_location['enzyme'].unique().tolist() if 'enzyme' in df_location.columns else all_enzyme_ids
                 model_info = self.gather_model_reaction_info(location_enzymes)
             
             # Add model reaction info to all enzymes from this location

{debase-0.1.1 → debase-0.1.3/src/debase.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: debase
-Version: 0.1.1
+Version: 0.1.3
 Summary: Enzyme lineage analysis and sequence extraction package
 Home-page: https://github.com/YuemingLong/DEBase
 Author: DEBase Team
@@ -64,13 +64,6 @@ Enzyme lineage analysis and sequence extraction package with advanced parallel p
 ```bash
 pip install debase
 ```
-
-For full functionality with chemical SMILES support:
-
-```bash
-pip install debase[rdkit]
-```
-
 ## Requirements
 
 - Python 3.8 or higher
@@ -139,13 +132,6 @@ debase --manuscript paper.pdf --si si.pdf --use-optimized-reaction --reaction-ba
 debase --manuscript paper.pdf --si si.pdf  # Default method
 ```
 
-## Performance Comparison
-
-| Method | Total Time | API Calls | Accuracy | Best For |
-|--------|------------|-----------|----------|----------|
-| Sequential | ~45 min | 44 calls | Highest | Small datasets |
-| **Parallel Individual** | **~12 min** | **44 calls** | **High** | **Recommended** |
-| Batch Processing | ~8 min | ~8 calls | Good | Speed-critical |
 
 ## Advanced Usage
 
@@ -169,31 +155,6 @@ python -m debase.substrate_scope_extractor_parallel \
   --manuscript paper.pdf --si si.pdf --lineage-csv lineage.csv \
   --max-workers 5 --output substrate_scope.csv
 ```
-
-## Python API
-
-```python
-from debase.wrapper import run_pipeline
-
-# Run full pipeline with parallel processing
-run_pipeline(
-    manuscript_path="paper.pdf",
-    si_path="si.pdf", 
-    output="output.csv",
-    use_parallel_individual=True,
-    max_workers=5
-)
-
-# For individual steps
-from debase.reaction_info_extractor_parallel import extract_reaction_info_parallel
-from debase.enzyme_lineage_extractor import setup_gemini_api
-
-model = setup_gemini_api()
-reaction_data = extract_reaction_info_parallel(
-    model, manuscript_path, si_path, enzyme_csv_path, max_workers=5
-)
-```
-
 ## Pipeline Architecture
 
 The DEBase pipeline consists of 5 main steps:
@@ -222,9 +183,6 @@ The DEBase pipeline consists of 5 main steps:
 - **External database integration:** Automatic sequence fetching from PDB and UniProt
 - **AI-powered matching:** Uses Gemini to intelligently match database entries to enzyme variants
 - **Smart filtering:** Automatically excludes non-enzyme entries (buffers, controls, etc.)
-- **Progress tracking:** Real-time status updates
-- **Flexible output:** CSV format with comprehensive chemical and performance data
-- **Caching:** PDF encoding cache for improved performance
 - **Vision capabilities:** Extracts data from both text and images in PDFs
 
 ## Complete Command Reference
@@ -234,7 +192,6 @@ The DEBase pipeline consists of 5 main steps:
 --manuscript PATH           # Required: Path to manuscript PDF
 --si PATH                  # Optional: Path to supplementary information PDF
 --output PATH              # Output file path (default: manuscript_name_debase.csv)
---queries N                # Number of consensus queries (default: 2)
 ```
 
 ### Performance Options
@@ -279,21 +236,5 @@ The DEBase pipeline consists of 5 main steps:
 3. **Use batch processing** only when speed is critical and some accuracy loss is acceptable
 4. **Skip validation** (`--skip-validation`) for faster processing in production
 5. **Keep intermediates** (`--keep-intermediates`) for debugging and incremental runs
-6. **Check external databases** - Many sequences can be automatically fetched from PDB/UniProt
-7. **Verify enzyme entries** - The system automatically filters out buffers and controls
-
-## Troubleshooting
-
-### No sequences found
-- The extractor will automatically search PDB and UniProt databases
-- Check the logs for which database IDs were found and attempted
-- Sequences with PDB structures will be fetched with high confidence
-
-### Incorrect enzyme extraction
-- Non-enzyme entries (buffers, controls, media) are automatically filtered
-- Check the log for entries marked as "Filtering out non-enzyme entry"
+6. 
 
-### PDB matching issues
-- The system uses AI to match PDB IDs to specific enzyme variants
-- Increased context extraction ensures better matching accuracy
-- Check logs for "Gemini PDB matching" entries to see the matching process

{debase-0.1.1 → debase-0.1.3}/src/debase.egg-info/SOURCES.txt

@@ -1,8 +1,15 @@
+.gitignore
+CONTRIBUTING.md
 LICENSE
 MANIFEST.in
 README.md
+environment.yml
 pyproject.toml
 setup.py
+docs/README.md
+docs/examples/README.md
+src/__init__.py
+src/debase/PIPELINE_FLOW.md
 src/debase/__init__.py
 src/debase/__main__.py
 src/debase/_version.py

debase-0.1.3/src/debase.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+