pembot 0.0.4__tar.gz → 0.0.6__tar.gz

{pembot-0.0.4 → pembot-0.0.6}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: pembot
-Version: 0.0.4
+Version: 0.0.6
 Summary: A Python Package to convert PEM blog content to usseful information by leveraging LLMs
 Author-email: cyto <aryan_sidhwani@protonmail.com>
 License-Expression: MIT

pembot-0.0.6/pembot/.git/COMMIT_EDITMSG

@@ -0,0 +1 @@
+handled config loading errors gracefully; added gemini support, as an option; added huggingface nanonets transformers support (as an option); redesigned the extract markdown for captioning and image ocr (block image and full-page image);

{pembot-0.0.4 → pembot-0.0.6}/pembot/.git/logs/HEAD

@@ -4,3 +4,5 @@ ac9c9018c62fa30dc142665c1b5a375f4e056880 72f047cda92abcd1ddc857f6461de605f866833
 72f047cda92abcd1ddc857f6461de605f8668331 e91172752e9a421ae463112d2b0506b37498c98d cyto <silverstone965@gmail.com> 1748881846 +0530	commit: added gemini to the embedders and llms ladders; redeclared the required fields;
 e91172752e9a421ae463112d2b0506b37498c98d 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 cyto <silverstone965@gmail.com> 1749716350 +0530	commit: added a pem blog chunking module for updating from local, and, an embedding loop to embed all the blogs, with document id as the filter in the search, and the first line title as the filter in updation
 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 eb75e1c49f1e5b79dca17ccdbec8067756523238 cyto <silverstone965@gmail.com> 1750856653 +0530	commit: made arrangements for the cases when custom file bytes are to be processed to text output; handled a ollama running / crashing error
+eb75e1c49f1e5b79dca17ccdbec8067756523238 0bdb4169fc0f312b8698f1df17a258fff163aeaa cyto <silverstone965@gmail.com> 1750937276 +0530	commit: fixed the output_dir bug; fixed the excel to json function; ran some tests on convertor; incremented the version on the package; removed dependency on schema / structure, and shifted required fields to a pickle file path in the cli args;
+0bdb4169fc0f312b8698f1df17a258fff163aeaa 9528bbccd167e3f4ad583a1ae9fac98a52620e27 cyto <silverstone965@gmail.com> 1750947488 +0530	commit: handled local llm nonexistent error properly for choice of just passing None as llm_client;

{pembot-0.0.4 → pembot-0.0.6}/pembot/.git/logs/refs/heads/main

@@ -4,3 +4,5 @@ ac9c9018c62fa30dc142665c1b5a375f4e056880 72f047cda92abcd1ddc857f6461de605f866833
 72f047cda92abcd1ddc857f6461de605f8668331 e91172752e9a421ae463112d2b0506b37498c98d cyto <silverstone965@gmail.com> 1748881846 +0530	commit: added gemini to the embedders and llms ladders; redeclared the required fields;
 e91172752e9a421ae463112d2b0506b37498c98d 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 cyto <silverstone965@gmail.com> 1749716350 +0530	commit: added a pem blog chunking module for updating from local, and, an embedding loop to embed all the blogs, with document id as the filter in the search, and the first line title as the filter in updation
 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 eb75e1c49f1e5b79dca17ccdbec8067756523238 cyto <silverstone965@gmail.com> 1750856653 +0530	commit: made arrangements for the cases when custom file bytes are to be processed to text output; handled a ollama running / crashing error
+eb75e1c49f1e5b79dca17ccdbec8067756523238 0bdb4169fc0f312b8698f1df17a258fff163aeaa cyto <silverstone965@gmail.com> 1750937276 +0530	commit: fixed the output_dir bug; fixed the excel to json function; ran some tests on convertor; incremented the version on the package; removed dependency on schema / structure, and shifted required fields to a pickle file path in the cli args;
+0bdb4169fc0f312b8698f1df17a258fff163aeaa 9528bbccd167e3f4ad583a1ae9fac98a52620e27 cyto <silverstone965@gmail.com> 1750947488 +0530	commit: handled local llm nonexistent error properly for choice of just passing None as llm_client;

{pembot-0.0.4 → pembot-0.0.6}/pembot/.git/logs/refs/remotes/origin/main

@@ -3,3 +3,5 @@ ac9c9018c62fa30dc142665c1b5a375f4e056880 72f047cda92abcd1ddc857f6461de605f866833
 72f047cda92abcd1ddc857f6461de605f8668331 e91172752e9a421ae463112d2b0506b37498c98d cyto <silverstone965@gmail.com> 1748881859 +0530	update by push
 e91172752e9a421ae463112d2b0506b37498c98d 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 cyto <silverstone965@gmail.com> 1749716371 +0530	update by push
 0c8d9b2690545bf1906b05cd9f18b783b3eb74f1 eb75e1c49f1e5b79dca17ccdbec8067756523238 cyto <silverstone965@gmail.com> 1750856672 +0530	update by push
+eb75e1c49f1e5b79dca17ccdbec8067756523238 0bdb4169fc0f312b8698f1df17a258fff163aeaa cyto <silverstone965@gmail.com> 1750937389 +0530	update by push
+0bdb4169fc0f312b8698f1df17a258fff163aeaa 9528bbccd167e3f4ad583a1ae9fac98a52620e27 cyto <silverstone965@gmail.com> 1750947502 +0530	update by push

pembot-0.0.6/pembot/.git/refs/heads/main

@@ -0,0 +1 @@
+9528bbccd167e3f4ad583a1ae9fac98a52620e27

pembot-0.0.6/pembot/.git/refs/remotes/origin/main

@@ -0,0 +1 @@
+9528bbccd167e3f4ad583a1ae9fac98a52620e27

{pembot-0.0.4 → pembot-0.0.6}/pembot/AnyToText/convertor.py

@@ -35,6 +35,8 @@ class Convertor():
 
         self.output= ""
 
+        # model_name=  "gemini-2.5-flash"
+        model_name= None
         # file_type can be pdf, excel, etc.
         if output_dir is None and myfile is None and file_bytes is not None and suffix is not None:
             with tempfile.TemporaryDirectory() as dp:
@@ -43,7 +45,7 @@ class Convertor():
                     myfile= Path(fp.name)
                     output_dir= Path(dp)
                     if file_type == 'pdf':
-                        extractor= MarkdownPDFExtractor(str(myfile), output_path= str(output_dir), page_delimiter= "-- NEXT PAGE --")
+                        extractor= MarkdownPDFExtractor(str(myfile), output_path= str(output_dir), page_delimiter= "-- NEXT PAGE --", model_name= model_name)
                         extractor.extract()
                         with open(output_dir / (myfile.stem + '.md')) as output_file:
                             self.output= output_file.read()
@@ -67,7 +69,7 @@ class Convertor():
                 print("the file was json")
             elif mt == 'application/pdf':
                 print("the file was pdf, outputting in: ", output_dir)
-                extractor= MarkdownPDFExtractor(str(myfile), output_path= str(self.output_dir), page_delimiter= "-- NEXT PAGE --")
+                extractor= MarkdownPDFExtractor(str(myfile), output_path= str(self.output_dir), page_delimiter= "-- NEXT PAGE --", model_name= model_name)
                 extractor.extract()
 
             elif mt in EXCEL_FILE_TYPES:
@@ -333,10 +335,10 @@ def chunk_text(text, chunk_size=500, overlap_size=50):
 if __name__ == '__main__':
     print("Test Run Start:")
     try:
-        # print("Test 1: scaned pdf page, bytes")
-        # with open("/home/cyto/Documents/scanned.pdf", "rb") as imgpdf:
-        #     conv= Convertor(file_bytes= imgpdf.read(), suffix= ".pdf", file_type= "pdf")
-        #     print(conv.output)
+        print("Test 1: scaned pdf page, bytes")
+        with open("/home/cyto/Documents/scanned.pdf", "rb") as imgpdf:
+            conv= Convertor(file_bytes= imgpdf.read(), suffix= ".pdf", file_type= "pdf")
+            print(conv.output)
 
         # print("Test 2: JD pdf, bytes")
         # with open("/home/cyto/dev/pembotdir/jds/PM Trainee.pdf", "rb") as imgpdf:

{pembot-0.0.4 → pembot-0.0.6}/pembot/__init__.py

@@ -1,6 +1,6 @@
 """
 A Python Package to convert PEM blog content to usseful information by leveraging LLMs
 """
-__version__ = '0.0.4'
+__version__ = '0.0.6'
 from .main import save_to_json_file, make_query
 __all__ = ["save_to_json_file", "make_query"]

{pembot-0.0.4 → pembot-0.0.6}/pembot/config/config.yaml

@@ -2,4 +2,4 @@ OUTPUT_DIR: /home/cyto/dev/pembotdir
 PAGE_DELIMITER: ___________________________ NEXT PAGE ___________________________
 app:
   name: pembot
-  version: 0.0.4
+  version: 0.0.6

pembot-0.0.6/pembot/pdf2markdown/.git/COMMIT_EDITMSG

@@ -0,0 +1 @@
+cyto/argument-list-bug-fix;authentication-used-in-gradio-client

{pembot-0.0.4 → pembot-0.0.6}/pembot/pdf2markdown/.git/config

@@ -9,3 +9,6 @@
 [branch "main"]
 	remote = origin
 	merge = refs/heads/main
+[remote "myorigin"]
+	url = https://github.com/silverstone-git/pdf-to-markdown.git
+	fetch = +refs/heads/*:refs/remotes/myorigin/*

pembot-0.0.6/pembot/pdf2markdown/.git/logs/HEAD

@@ -0,0 +1,4 @@
+0000000000000000000000000000000000000000 ffb759ee4605b232366a9ee58134532913c3f9e0 cyto <cyto@callisto.localdomain> 1747745478 +0530	clone: from https://github.com/iamarunbrahma/pdf-to-markdown
+ffb759ee4605b232366a9ee58134532913c3f9e0 b8702320e56074e9680181d8b7897d6a0a552e2d cyto <silverstone965@gmail.com> 1750947962 +0530	commit: handled config loading errors gracefully; added gemini support, as an option; added huggingface nanonets transformers support (as an option); redesigned the extract markdown for captioning and image ocr (block image and full-page image);
+b8702320e56074e9680181d8b7897d6a0a552e2d 14251b198e0bac39a3dc3b42f9e57b20c01465fb cyto <silverstone965@gmail.com> 1751604763 +0530	commit: removed deps on torch and transformers; used gradio client for ocr through public spaces;
+14251b198e0bac39a3dc3b42f9e57b20c01465fb b48d697aa9fd97151eb2a84a1af5d408b7630232 cyto <silverstone965@gmail.com> 1751871887 +0530	commit: cyto/argument-list-bug-fix;authentication-used-in-gradio-client

pembot-0.0.6/pembot/pdf2markdown/.git/logs/refs/heads/main

@@ -0,0 +1,4 @@
+0000000000000000000000000000000000000000 ffb759ee4605b232366a9ee58134532913c3f9e0 cyto <cyto@callisto.localdomain> 1747745478 +0530	clone: from https://github.com/iamarunbrahma/pdf-to-markdown
+ffb759ee4605b232366a9ee58134532913c3f9e0 b8702320e56074e9680181d8b7897d6a0a552e2d cyto <silverstone965@gmail.com> 1750947962 +0530	commit: handled config loading errors gracefully; added gemini support, as an option; added huggingface nanonets transformers support (as an option); redesigned the extract markdown for captioning and image ocr (block image and full-page image);
+b8702320e56074e9680181d8b7897d6a0a552e2d 14251b198e0bac39a3dc3b42f9e57b20c01465fb cyto <silverstone965@gmail.com> 1751604763 +0530	commit: removed deps on torch and transformers; used gradio client for ocr through public spaces;
+14251b198e0bac39a3dc3b42f9e57b20c01465fb b48d697aa9fd97151eb2a84a1af5d408b7630232 cyto <silverstone965@gmail.com> 1751871887 +0530	commit: cyto/argument-list-bug-fix;authentication-used-in-gradio-client

pembot-0.0.6/pembot/pdf2markdown/.git/logs/refs/remotes/myorigin/main

@@ -0,0 +1,3 @@
+0000000000000000000000000000000000000000 b8702320e56074e9680181d8b7897d6a0a552e2d cyto <silverstone965@gmail.com> 1750948073 +0530	update by push
+b8702320e56074e9680181d8b7897d6a0a552e2d 14251b198e0bac39a3dc3b42f9e57b20c01465fb cyto <silverstone965@gmail.com> 1751604904 +0530	update by push
+14251b198e0bac39a3dc3b42f9e57b20c01465fb b48d697aa9fd97151eb2a84a1af5d408b7630232 cyto <silverstone965@gmail.com> 1751872077 +0530	update by push

pembot-0.0.6/pembot/pdf2markdown/.git/refs/heads/main

@@ -0,0 +1 @@
+b48d697aa9fd97151eb2a84a1af5d408b7630232

pembot-0.0.6/pembot/pdf2markdown/.git/refs/remotes/myorigin/main

@@ -0,0 +1 @@
+b48d697aa9fd97151eb2a84a1af5d408b7630232

{pembot-0.0.4 → pembot-0.0.6}/pembot/pdf2markdown/extract.py

@@ -2,11 +2,9 @@ import fitz
 import pdfplumber
 import re
 import yaml
-# import pytesseract
+import pytesseract
 import numpy as np
-from transformers import AutoTokenizer, AutoProcessor, AutoModelForImageTextToText, VisionEncoderDecoderModel, ViTImageProcessor
 from typing import Literal, final
-import torch
 from PIL import Image
 import os
 import logging
@@ -19,13 +17,25 @@ import io
 from google import genai
 from google.genai import types
 import mimetypes
+from gradio_client import Client, handle_file
+import gradio as gr
+import tempfile
 
 
 
 warnings.filterwarnings("ignore")
 
-with open(Path("config/config.yaml").resolve(), "r", encoding="utf-8") as f:
-    config = yaml.safe_load(f)
+config= {}
+try:
+    with open(Path("config/config.yaml").resolve(), "r", encoding="utf-8") as f:
+        config = yaml.safe_load(f)
+except FileNotFoundError:
+    config= {
+        'OUTPUT_DIR': '.',
+        'PAGE_DELIMITER': '____NEXT PAGE____'
+    }
+except Exception as e:
+    print("unhandled while opening default config in pdf2markdown: ", e)
 
 
 class PDFExtractor(ABC):
@@ -62,29 +72,22 @@ class MarkdownPDFExtractor(PDFExtractor):
 
     BULLET_POINTS = "•◦▪▫●○"
 
-    def __init__(self, pdf_path, output_path= config["OUTPUT_DIR"], page_delimiter= config["PAGE_DELIMITER"], model_name: str | None= None):
+    def __init__(self, pdf_path, output_path= config.get("OUTPUT_DIR", '.'), page_delimiter= config.get("PAGE_DELIMITER", ''), model_name: str | None= None):
         super().__init__(pdf_path)
 
         if model_name is None:
-            self.MODEL_NAME= "gemini-2.5-flash"
+            # self.MODEL_NAME= "gemini-2.5-flash"
+            self.MODEL_NAME= "Nanonets-OCR-s"
         else:
             self.MODEL_NAME= model_name
 
         if  "gemini" in self.MODEL_NAME:
             self.gclient = genai.Client(api_key= os.getenv("GEMINI_API_KEY", ''))
-        else:
-            model_path = "nanonets/Nanonets-OCR-s"
-            self.model = AutoModelForImageTextToText.from_pretrained(
-                model_path,
-                torch_dtype="auto",
-                device_map="auto",
-                attn_implementation="flash_attention_2"
-            )
-            self.model.eval()
-            self.tokenizer = AutoTokenizer.from_pretrained(model_path)
-            self.processor = AutoProcessor.from_pretrained(model_path)
-            self.setup_image_captioning()
+        elif "anonet" in self.MODEL_NAME:
+            # self.nclient= Client("prithivMLmods/Multimodal-OCR2")
 
+            # zerogpu public
+            self.nclient= Client("deepak-mehta/ocr-simplify", hf_token= os.getenv('HF_TOKEN', ''))
 
 
         self.markdown_content= ""
@@ -99,25 +102,6 @@ class MarkdownPDFExtractor(PDFExtractor):
 
 
 
-    def setup_image_captioning(self):
-        """Set up the image captioning model."""
-        try:
-            self.model = VisionEncoderDecoderModel.from_pretrained(
-                "nlpconnect/vit-gpt2-image-captioning"
-            )
-            self.feature_extractor = ViTImageProcessor.from_pretrained(
-                "nlpconnect/vit-gpt2-image-captioning"
-            )
-            self.tokenizer = AutoTokenizer.from_pretrained(
-                "nlpconnect/vit-gpt2-image-captioning"
-            )
-            self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
-            self.model.to(self.device)
-            self.logger.info("Image captioning model set up successfully.")
-        except Exception as e:
-            self.logger.error(f"Error setting up image captioning model: {e}")
-            self.logger.exception(traceback.format_exc())
-
     def extract(self):
         try:
             markdown_content, markdown_pages = self.extract_markdown()
@@ -134,12 +118,18 @@ class MarkdownPDFExtractor(PDFExtractor):
             return "", []
 
 
-    def ocr_page_with_nanonets_s(self, pil_image, img_bytes, max_new_tokens: int | None = None):
-        prompt = """Extract the text from the above document as if you were reading it naturally. Return the tables in html format. Return the equations in LaTeX representation. If there is an image in the document and image caption is not present, add a small description of the image inside the <img></img> tag; otherwise, add the image caption inside <img></img>. Watermarks should be wrapped in brackets. Ex: <watermark>OFFICIAL COPY</watermark>. Page numbers should be wrapped in brackets. Ex: <page_number>14</page_number> or <page_number>9/22</page_number>. Prefer using ☐ and ☑ for check boxes."""
+    def image_ocr(self, pil_image, img_bytes, max_new_tokens: int | None = None, prompt: str | None= None):
+        if prompt is None:
+            prompt = """Extract the text from the above document as if you were reading it naturally. Return the tables in html format. Return the equations in LaTeX representation. If there is an image in the document and image caption is not present, add a small description of the image inside the <img></img> tag; otherwise, add the image caption inside <img></img>. Watermarks should be wrapped in brackets. Ex: <watermark>OFFICIAL COPY</watermark>. Page numbers should be wrapped in brackets. Ex: <page_number>14</page_number> or <page_number>9/22</page_number>. Prefer using ☐ and ☑ for check boxes."""
         if max_new_tokens is None:
             max_new_tokens= 4096
 
-        if 'gemini' in self.MODEL_NAME:
+        w, h= pil_image.size
+        if w < 200 or h < 50:
+            return "<img> A small image </img>"
+
+        model_name= self.MODEL_NAME.lower()
+        if 'gemini' in model_name:
 
             image_format = pil_image.format
             dummy_filename = f"dummy.{image_format.lower()}"
@@ -156,24 +146,40 @@ class MarkdownPDFExtractor(PDFExtractor):
             )
             # print("response :", response)
             return response.text
-        else:
-            image = pil_image
-            messages = [
-                {"role": "system", "content": "You are a helpful assistant."},
-                {"role": "user", "content": [
-                    {"type": "image", "image": image},
-                    {"type": "text", "text": prompt},
-                ]},
-            ]
-            text = self.processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
-            inputs = self.processor(text=[text], images=[image], padding=True, return_tensors="pt")
-            inputs = inputs.to(self.model.device)
+        elif 'nanonet' in model_name:
 
-            output_ids = self.model.generate(**inputs, max_new_tokens=max_new_tokens, do_sample=False)
-            generated_ids = [output_ids[len(input_ids):] for input_ids, output_ids in zip(inputs.input_ids, output_ids)]
-
-            output_text = self.processor.batch_decode(generated_ids, skip_special_tokens=True, clean_up_tokenization_spaces=True)
-            return output_text[0]
+            result= ""
+            try:
+                with tempfile.NamedTemporaryFile(suffix=f'.{pil_image.format.lower()}', mode= 'w') as temp_file:
+                    pil_image.save(temp_file.name)
+                    print("file name: ", temp_file.name)
+                    gr_image= handle_file(temp_file.name)
+                    print("gr image : ", gr_image)
+                    result = self.nclient.predict(
+                        # model_name="Nanonets-OCR-s",
+                        # text= prompt,
+                        gr_image,
+                        # max_new_tokens=max_new_tokens,
+                        # temperature=0.6,
+                        # top_p=0.9,
+                        # top_k=50,
+                        # repetition_penalty=1.2,
+
+                        # prithiv model
+                        # api_name="/generate_image"
+
+                        max_new_tokens,
+
+                        # spaces zerogpu
+                        api_name="/predict"
+                    )
+                    print("ocr'd: ", result[:100] + "...")
+            except Exception as e:
+                print("Error during nanonet inference", e)
+            
+            return result
+        else:
+            return pytesseract.image_to_string(pil_image)
 
 
 
@@ -210,7 +216,7 @@ class MarkdownPDFExtractor(PDFExtractor):
                 for page_num, page in enumerate(doc):
                     current_page_markdown_blocks = [] # Collect markdown blocks for the current page
                     page_has_searchable_text = False
-                    page_has_embedded_images = False
+                    # page_has_embedded_images = False
 
                     self.logger.info(f"\nProcessing page {page_num + 1}...")
 
@@ -243,7 +249,7 @@ class MarkdownPDFExtractor(PDFExtractor):
                             try:
                                 image_bytes= io.BytesIO(img_data)
                                 pil_image = Image.open(image_bytes)
-                                ocr_text_from_block_image = self.ocr_page_with_nanonets_s(
+                                ocr_text_from_block_image = self.image_ocr(
                                     pil_image, image_bytes, max_new_tokens=15000
                                 )
 
@@ -283,7 +289,7 @@ class MarkdownPDFExtractor(PDFExtractor):
                             image_bytestream= io.BytesIO(img_bytes)
                             pil_image = Image.open(image_bytestream)
 
-                            ocr_text_from_page = self.ocr_page_with_nanonets_s(
+                            ocr_text_from_page = self.image_ocr(
                                 pil_image, image_bytestream, max_new_tokens=15000
                             )
 
@@ -380,7 +386,7 @@ class MarkdownPDFExtractor(PDFExtractor):
             # ocr_result = pytesseract.image_to_string(
             #     image
             # )
-            ocr_result= self.ocr_page_with_nanonets_s(image, image_bytes, max_new_tokens=15000)
+            ocr_result= self.image_ocr(image, image_bytes, max_new_tokens=15000)
 
 
             return ocr_result.strip()
@@ -400,38 +406,9 @@ class MarkdownPDFExtractor(PDFExtractor):
             if image.mode != "RGB":
                 image = image.convert("RGB")
 
-            image_format = image.format
-            dummy_filename = f"dummy.{image_format.lower()}"
-            mime_type, _ = mimetypes.guess_type(dummy_filename)
-
-            if "gemini" in self.MODEL_NAME:
-                response=  self.gclient.models.generate_content(
-                    model= self.MODEL_NAME,
-                    contents=[
-                        types.Part.from_bytes(
-                            data=image_bytes.getvalue(),
-                            mime_type= mime_type
-                        ),
-                        "Write a caption for this image"
-                    ]
-                )
-                return response.text
-            else:
-                # Ensure the image is in the correct shape
-                image = np.array(image).transpose(2, 0, 1)  # Convert to (C, H, W) format
-
-                inputs = self.feature_extractor(images=image, return_tensors="pt").to(
-                    self.device
-                )
-                pixel_values = inputs.pixel_values
-
-                generated_ids = self.model.generate(pixel_values, max_length=30)
+            caption= self.image_ocr(image, image_bytes, max_new_tokens=15000, prompt= "Write a caption for this image")
+            return caption
 
-                generated_ids = self.model.generate(pixel_values, max_length=30)
-                generated_caption = self.tokenizer.batch_decode(
-                    generated_ids, skip_special_tokens=True
-                )[0]
-                return generated_caption.strip()
         except Exception as e:
             self.logger.error(f"Error captioning image: {e}")
             self.logger.exception(traceback.format_exc())

pembot-0.0.6/pembot/pdf2markdown/pyrightconfig.json

@@ -0,0 +1,4 @@
+{
+  "venvPath": "../..",
+  "venv": "venvpem"
+}

{pembot-0.0.4 → pembot-0.0.6}/pembot/query.py

@@ -97,16 +97,22 @@ def rag_query_llm(db_client, llm_client, inference_client, user_query: str, docu
         str: The generated response from the Ollama model.
     """
 
-    models = llm_client.list()
-    found= False
     embed_locally= False
-
-    for model in models.models:
-        # print(model.model)
-        if model.model == model_name:
-            found= True
-        if model.model == embedding_model:
-            embed_locally= True
+    found= False
+    try:
+        models = llm_client.list()
+        for model in models.models:
+            # print(model.model)
+            if model.model == model_name:
+                found= True
+            if model.model == embedding_model:
+                embed_locally= True
+    except AttributeError as ae:
+        print("cant find ollama", ae)
+        print("continuing with other models")
+    except Exception as e:
+        print("unhandled error: ", e)
+        raise e
 
 
 

pembot-0.0.6/pembot/requirements.txt

@@ -0,0 +1,80 @@
+aiofiles==24.1.0
+annotated-types==0.7.0
+anyio==4.9.0
+audioop-lts==0.2.1
+cachetools==5.5.2
+certifi==2025.6.15
+cffi==1.17.1
+charset-normalizer==3.4.2
+click==8.2.1
+cryptography==45.0.5
+dnspython==2.7.0
+et_xmlfile==2.0.0
+fastapi==0.115.14
+ffmpy==0.6.0
+filelock==3.18.0
+fsspec==2025.5.1
+google-auth==2.40.3
+google-genai==1.24.0
+gradio==5.35.0
+gradio_client==1.10.4
+greenlet==3.2.3
+groovy==0.1.2
+h11==0.16.0
+hf-xet==1.1.5
+httpcore==1.0.9
+httpx==0.28.1
+huggingface-hub==0.33.2
+idna==3.10
+Jinja2==3.1.6
+markdown-it-py==3.0.0
+MarkupSafe==3.0.2
+mdurl==0.1.2
+msgpack==1.1.1
+numpy==2.3.1
+ollama==0.5.1
+openpyxl==3.1.5
+orjson==3.10.18
+packaging==25.0
+pandas==2.3.0
+pathlib==1.0.1
+pdfminer.six==20250506
+pdfplumber==0.11.7
+pembot==0.0.6
+pillow==11.3.0
+pyasn1==0.6.1
+pyasn1_modules==0.4.2
+pycparser==2.22
+pydantic==2.11.7
+pydantic_core==2.33.2
+pydub==0.25.1
+Pygments==2.19.2
+pymongo==4.13.2
+PyMuPDF==1.26.3
+pynvim==0.5.2
+pypdfium2==4.30.1
+pytesseract==0.3.13
+python-dateutil==2.9.0.post0
+python-multipart==0.0.20
+pytz==2025.2
+PyYAML==6.0.2
+requests==2.32.4
+rich==14.0.0
+rsa==4.9.1
+ruff==0.12.1
+safehttpx==0.1.6
+semantic-version==2.10.0
+shellingham==1.5.4
+six==1.17.0
+sniffio==1.3.1
+starlette==0.46.2
+tenacity==8.5.0
+tomlkit==0.13.3
+tqdm==4.67.1
+typer==0.16.0
+typing-inspection==0.4.1
+typing_extensions==4.14.0
+tzdata==2025.2
+urllib3==2.5.0
+uvicorn==0.35.0
+websockets==15.0.1

pembot-0.0.4/pembot/.git/COMMIT_EDITMSG

@@ -1 +0,0 @@
-made arrangements for the cases when custom file bytes are to be processed to text output; handled a ollama running / crashing error

pembot-0.0.4/pembot/.git/refs/heads/main

@@ -1 +0,0 @@
-eb75e1c49f1e5b79dca17ccdbec8067756523238

pembot-0.0.4/pembot/.git/refs/remotes/origin/main

@@ -1 +0,0 @@
-eb75e1c49f1e5b79dca17ccdbec8067756523238

pembot-0.0.4/pembot/pdf2markdown/.git/logs/refs/heads/main

@@ -1 +0,0 @@
-0000000000000000000000000000000000000000 ffb759ee4605b232366a9ee58134532913c3f9e0 cyto <cyto@callisto.localdomain> 1747745478 +0530	clone: from https://github.com/iamarunbrahma/pdf-to-markdown

pembot-0.0.4/pembot/pdf2markdown/.git/logs/refs/remotes/origin/HEAD

@@ -1 +0,0 @@
-0000000000000000000000000000000000000000 ffb759ee4605b232366a9ee58134532913c3f9e0 cyto <cyto@callisto.localdomain> 1747745478 +0530	clone: from https://github.com/iamarunbrahma/pdf-to-markdown

pembot-0.0.4/pembot/pdf2markdown/.git/refs/heads/main

@@ -1 +0,0 @@
-ffb759ee4605b232366a9ee58134532913c3f9e0